Matías Zañartu

Mobile Voice Health Monitoring Using a Wearable Accelerometer Sensor and a Smartphone Platform

Many common voice disorders are chronic or recurring conditions that are likely to result from faulty and/or abusive patterns of vocal behavior, referred to generically as vocal hyperfunction. An ongoing goal in clinical voice assessment is the development and use of noninvasively derived measures to quantify and track the daily status of vocal hyperfunction so that the diagnosis and treatment of such behaviorally based voice disorders can be improved. This paper reports on the development of a new, versatile, and cost-effective clinical tool for mobile voice monitoring that acquires the high-bandwidth signal from an accelerometer sensor placed on the neck skin above the collarbone. Using a smartphone as the data acquisition platform, the prototype device provides a user-friendly interface for voice use monitoring, daily sensor calibration, and periodic alert capabilities. Pilot data are reported from three vocally normal speakers and three subjects with voice disorders to demonstrate the potential of the device to yield standard measures of fundamental frequency and sound pressure level and model-based glottal airflow properties. The smartphone-based platform enables future clinical studies for the identification of the best set of measures for differentiating between normal and hyperfunctional patterns of voice use.

Influence of acoustic loading on an effective single mass model of the vocal folds

Three-way interactions between sound waves in the subglottal and supraglottal tracts, the vibrations of the vocal folds, and laryngeal flow were investigated. Sound wave propagation was modeled using a wave reflection analog method. An effective single-degree-of-freedom model was designed to model vocal-fold vibrations. The effects of orifice geometry changes on the flow were considered by enforcing a time-varying discharge coefficient within a Bernoulli flow model. The resulting single-degree-of-freedom model allowed for energy transfer from flow to structural vibrations, an essential feature usually incorporated through the use of higher order models. The relative importance of acoustic loading and the time-varying flow resistance for fluid-structure energy transfer was established for various configurations. The results showed that acoustic loading contributed more significantly to the net energy transfer than the time-varying flow resistance, especially for less inertive supraglottal loads. The contribution of supraglottal loading was found to be more significant than that of subglottal loading. Subglottal loading was found to reduce the net energy transfer to the vocal-fold oscillation during phonation, balancing the effects of the supraglottal load.

Observation and analysis of in vivo vocal fold tissue instabilities produced by nonlinear source-filter coupling: a case study.

Different source-related factors can lead to vocal fold instabilities and bifurcations referred to as voice breaks. Nonlinear coupling in phonation suggests that changes in acoustic loading can also be responsible for this unstable behavior. However, no in vivo visualization of tissue motion during these acoustically induced instabilities has been reported. Simultaneous recordings of laryngeal high-speed videoendoscopy, acoustics, aerodynamics, electroglottography, and neck skin acceleration are obtained from a participant consistently exhibiting voice breaks during pitch glide maneuvers. Results suggest that acoustically induced and source-induced instabilities can be distinguished at the tissue level. Differences in vibratory patterns are described through kymography and phonovibrography; measures of glottal area, open/speed quotient, and amplitude/phase asymmetry; and empirical orthogonal function decomposition. Acoustically induced tissue instabilities appear abruptly and exhibit irregular vocal fold motion after the bifurcation point, whereas source-induced ones show a smoother transition. These observations are also reflected in the acoustic and acceleration signals. Added aperiodicity is observed after the acoustically induced break, and harmonic changes appear prior to the bifurcation for the source-induced break. Both types of breaks appear to be subcritical bifurcations due to the presence of hysteresis and amplitude changes after the frequency jumps. These results are consistent with previous studies and the nonlinear source-filter coupling theory.

Learning to Detect Vocal Hyperfunction From Ambulatory Neck-Surface Acceleration Features: Initial Results for Vocal Fold Nodules

Voice disorders are medical conditions that often result from vocal abuse/misuse which is referred to generically as vocal hyperfunction. Standard voice assessment approaches cannot accurately determine the actual nature, prevalence, and pathological impact of hyperfunctional vocal behaviors because such behaviors can vary greatly across the course of an individuals typical day and may not be clearly demonstrated during a brief clinical encounter. Thus, it would be clinically valuable to develop noninvasive ambulatory measures that can reliably differentiate vocal hyperfunction from normal patterns of vocal behavior. As an initial step toward this goal we used an accelerometer taped to the neck surface to provide a continuous, noninvasive acceleration signal designed to capture some aspects of vocal behavior related to vocal cord nodules, a common manifestation of vocal hyperfunction. We gathered data from 12 female adult patients diagnosed with vocal fold nodules and 12 control speakers matched for age and occupation. We derived features from weeklong neck-surface acceleration recordings by using distributions of sound pressure level and fundamental frequency over 5-min windows of the acceleration signal and normalized these features so that intersubject comparisons were meaningful. We then used supervised machine learning to show that the two groups exhibit distinct vocal behaviors that can be detected using the acceleration signal. We were able to correctly classify 22 of the 24 subjects, suggesting that in the future measures of the acceleration signal could be used to detect patients with the types of aberrant vocal behaviors that are associated with hyperfunctional voice disorders.

Air-Borne and Tissue-Borne Sensitivities of Bioacoustic Sensors Used on the Skin Surface

Measurements of body sounds on the skin surface have been widely used in the medical field and continue to be a topic of current research, ranging from the diagnosis of respiratory and cardiovascular diseases to the monitoring of voice dosimetry. These measurements are typically made using light-weight accelerometers and/or air-coupled microphones attached to the skin. Although normally neglected, air-borne sounds generated by the subject or other sources of background noise can easily corrupt such recordings, which is particularly critical in the recording of voiced sounds on the skin surface. In this study, the sensitivity of commonly used bioacoustic sensors to air-borne sounds was evaluated and compared with their sensitivity to tissue-borne body sounds. To delineate the sensitivity to each pathway, the sensors were first tested in vitro and then on human subjects. The results indicated that, in general, the air-borne sensitivity is sufficiently high to significantly corrupt body sound signals. In addition, the air-borne and tissue-borne sensitivities can be used to discriminate between these components. Although the study is focused on the evaluation of voiced sounds on the skin surface, an extension of the proposed methods to other bioacoustic applications is discussed.

Robust fundamental frequency estimation in sustained vowels: Detailed algorithmic comparisons and information fusion with adaptive Kalman filtering

There has been consistent interest among speech signal processing researchers in the accurate estimation of the fundamental frequency (F(0)) of speech signals. This study examines ten F(0) estimation algorithms (some well-established and some proposed more recently) to determine which of these algorithms is, on average, better able to estimate F(0) in the sustained vowel /a/. Moreover, a robust method for adaptively weighting the estimates of individual F(0) estimation algorithms based on quality and performance measures is proposed, using an adaptive Kalman filter (KF) framework. The accuracy of the algorithms is validated using (a) a database of 117 synthetic realistic phonations obtained using a sophisticated physiological model of speech production and (b) a database of 65 recordings of human phonations where the glottal cycles are calculated from electroglottograph signals. On average, the sawtooth waveform inspired pitch estimator and the nearly defect-free algorithms provided the best individual F(0) estimates, and the proposed KF approach resulted in a ∼16% improvement in accuracy over the best single F(0) estimation algorithm. These findings may be useful in speech signal processing applications where sustained vowels are used to assess vocal quality, when very accurate F(0) estimation is required.

A review of lumped-element models of voiced speech

Voiced speech is a highly complex process involving coupled interactions between the vocal fold structure, aerodynamics, and acoustic field. Reduced-order lumped-element models of the vocal fold structure, coupled with various aerodynamic and acoustic models, have proven useful in a wide array of speech investigations. These simplified models of speech, in which the vocal folds are approximated as arrays of lumped masses connected to one another via springs and dampers to simulate the viscoelastic tissue properties, have been used to study phenomena ranging from sustained vowels and pitch glides to polyps and vocal fold paralysis. Over the past several decades a variety of structural, aerodynamic, and acoustic models have been developed and deployed into the lumped-element modeling framework. This paper aims to provide an overview of advances in lumped-element models and their constituents, with particular emphasis on their physical foundations and limitations. Examples of the application of lumped-element models to speech studies will also be addressed, as well as an outlook on the direction and future of these models.

A theoretical model of the pressure field arising from asymmetric intraglottal flows applied to a two-mass model of the vocal folds.

A theoretical flow solution is presented for predicting the pressure distribution along the vocal fold walls arising from asymmetric flow that forms during the closing phases of speech. The resultant wall jet was analyzed using boundary layer methods in a non-inertial reference frame attached to the moving wall. A solution for the near-wall velocity profiles on the flow wall was developed based on a Falkner-Skan similarity solution and it was demonstrated that the pressure distribution along the flow wall is imposed by the velocity in the inviscid core of the wall jet. The method was validated with experimental velocity data from 7.5 times life-size vocal fold models, acquired for varying flow rates and glottal divergence angles. The solution for the asymmetric pressures was incorporated into a widely used two-mass model of vocal fold oscillation with a coupled acoustical model of sound propagation. Asymmetric pressure loading was found to facilitate glottal closure, which yielded only slightly higher values of maximum flow declination rate and radiated sound, and a small decrease in the slope of the spectral tilt. While the impact on symmetrically tensioned vocal folds was small, results indicate the effect becomes more significant for asymmetrically tensioned vocal folds.

Modeling the effects of a posterior glottal opening on vocal fold dynamics with implications for vocal hyperfunction.

Despite the frequent observation of a persistent opening in the posterior cartilaginous glottis in normal and pathological phonation, its influence on the self-sustained oscillations of the vocal folds is not well understood. The effects of a posterior gap on the vocal fold tissue dynamics and resulting acoustics were numerically investigated using a specially designed flow solver and a reduced-order model of human phonation. The inclusion of posterior gap areas of 0.03-0.1 cm(2) reduced the energy transfer from the fluid to the vocal folds by more than 42%-80% and the radiated sound pressure level by 6-14 dB, respectively. The model was used to simulate vocal hyperfucntion, i.e., patterns of vocal misuse/abuse associated with many of the most common voice disorders. In this first approximation, vocal hyperfunction was modeled by introducing a compensatory increase in lung air pressure to regain the vocal loudness level that was produced prior to introducing a large glottal gap. This resulted in a significant increase in maximum flow declination rate and amplitude of unsteady flow, thereby mimicking clinical studies. The amplitude of unsteady flow was found to be linearly correlated with collision forces, thus being an indicative measure of vocal hyperfunction.

Subglottal Impedance-Based Inverse Filtering of Voiced Sounds Using Neck Surface Acceleration

A model-based inverse filtering scheme is proposed for an accurate, non-invasive estimation of the aerodynamic source of voiced sounds at the glottis. The approach, referred to as subglottal impedance-based inverse filtering (IBIF), takes as input the signal from a lightweight accelerometer placed on the skin over the extrathoracic trachea and yields estimates of glottal airflow and its time derivative, offering important advantages over traditional methods that deal with the supraglottal vocal tract. The proposed scheme is based on mechano-acoustic impedance representations from a physiologically-based transmission line model and a lumped skin surface representation. A subject-specific calibration protocol is used to account for individual adjustments of subglottal impedance parameters and mechanical properties of the skin. Preliminary results for sustained vowels with various voice qualities show that the subglottal IBIF scheme yields comparable estimates with respect to current aerodynamics-based methods of clinical vocal assessment. A mean absolute error of less than 10% was observed for two glottal airflow measures-maximum flow declination rate and amplitude of the modulation component-that have been associated with the pathophysiology of some common voice disorders caused by faulty and/or abusive patterns of vocal behavior (i.e., vocal hyper-function). The proposed method further advances the ambulatory assessment of vocal function based on the neck acceleration signal, that previously have been limited to the estimation of phonation duration, loudness, and pitch. Subglottal IBIF is also suitable for other ambulatory applications in speech communication, in which further evaluation is underway.