Using smart speakers to contactlessly monitor heart rhythms

Abstract

Heart rhythm assessment is indispensable in diagnosis and management of many cardiac conditions and to study heart rate variability in healthy individuals. We present a proof-of-concept system for acquiring individual heart beats using smart speakers in a fully contact-free manner. Our algorithms transform the smart speaker into a short-range active sonar system and measure heart rate and inter-beat intervals (R-R intervals) for both regular and irregular rhythms. The smart speaker emits inaudible 18–22\u2009kHz sound and receives echoes reflected from the human body that encode sub-mm displacements due to heart beats. We conducted a clinical study with both healthy participants and hospitalized cardiac patients with diverse structural and arrhythmic cardiac abnormalities including atrial fibrillation, flutter and congestive heart failure. Compared to electrocardiogram (ECG) data, our system computed R-R intervals for healthy participants with a median error of 28\u2009ms over 12,280 heart beats and a correlation coefficient of 0.929. For hospitalized cardiac patients, the median error was 30\u2009ms over 5639 heart beats with a correlation coefficient of 0.901. The increasing adoption of smart speakers in hospitals and homes may provide a means to realize the potential of our non-contact cardiac rhythm monitoring system for monitoring of contagious or quarantined patients, skin sensitive patients and in telemedicine settings. Anran Wang et al. present a contact-free method of monitoring individual heart beats by converting smart-speakers into active sonar systems. Their approach is capable of measuring heart rhythms with high accuracy in both healthy participants and hospitalized patients, and may be a useful healthcare tool for remote diagnosis or patient monitoring.