Riccardo Barbieri

Revealing Real-Time Emotional Responses: a Personalized Assessment based on Heartbeat Dynamics

Emotion recognition through computational modeling and analysis of physiological signals has been widely investigated in the last decade. Most of the proposed emotion recognition systems require relatively long-time series of multivariate records and do not provide accurate real-time characterizations using short-time series. To overcome these limitations, we propose a novel personalized probabilistic framework able to characterize the emotional state of a subject through the analysis of heartbeat dynamics exclusively. The study includes thirty subjects presented with a set of standardized images gathered from the international affective picture system, alternating levels of arousal and valence. Due to the intrinsic nonlinearity and nonstationarity of the RR interval series, a specific point-process model was devised for instantaneous identification considering autoregressive nonlinearities up to the third-order according to the Wiener-Volterra representation, thus tracking very fast stimulus-response changes. Features from the instantaneous spectrum and bispectrum, as well as the dominant Lyapunov exponent, were extracted and considered as input features to a support vector machine for classification. Results, estimating emotions each 10 seconds, achieve an overall accuracy in recognizing four emotional states based on the circumplex model of affect of 79.29%, with 79.15% on the valence axis, and 83.55% on the arousal axis.

Characterization of Depressive States in Bipolar Patients Using Wearable Textile Technology and Instantaneous Heart Rate Variability Assessment

The analysis of cognitive and autonomic responses to emotionally relevant stimuli could provide a viable solution for the automatic recognition of different mood states, both in normal and pathological conditions. In this study, we present a methodological application describing a novel system based on wearable textile technology and instantaneous nonlinear heart rate variability assessment, able to characterize the autonomic status of bipolar patients by considering only electrocardiogram recordings. As a proof of this concept, our study presents results obtained from eight bipolar patients during their normal daily activities and being elicited according to a specific emotional protocol through the presentation of emotionally relevant pictures. Linear and nonlinear features were computed using a novel point-process-based nonlinear autoregressive integrative model and compared with traditional algorithmic methods. The estimated indices were used as the input of a multilayer perceptron to discriminate the depressive from the euthymic status. Results show that our system achieves much higher accuracy than the traditional techniques. Moreover, the inclusion of instantaneous higher order spectra features significantly improves the accuracy in successfully recognizing depression from euthymia.

Estimation of instantaneous complex dynamics through Lyapunov exponents: a study on heartbeat dynamics.

Measures of nonlinearity and complexity, and in particular the study of Lyapunov exponents, have been increasingly used to characterize dynamical properties of a wide range of biological nonlinear systems, including cardiovascular control. In this work, we present a novel methodology able to effectively estimate the Lyapunov spectrum of a series of stochastic events in an instantaneous fashion. The paradigm relies on a novel point-process high-order nonlinear model of the event series dynamics. The long-term information is taken into account by expanding the linear, quadratic, and cubic Wiener-Volterra kernels with the orthonormal Laguerre basis functions. Applications to synthetic data such as the Hénon map and Rössler attractor, as well as two experimental heartbeat interval datasets (i.e., healthy subjects undergoing postural changes and patients with severe cardiac heart failure), focus on estimation and tracking of the Instantaneous Dominant Lyapunov Exponent (IDLE). The novel cardiovascular assessment demonstrates that our method is able to effectively and instantaneously track the nonlinear autonomic control dynamics, allowing for complexity variability estimations.

The Somatosensory Link in Fibromyalgia: Functional Connectivity of the Primary Somatosensory Cortex Is Altered by Sustained Pain and Is Associated With Clinical/Autonomic Dysfunction

Fibromyalgia (FM) is a chronic functional pain syndrome characterized by widespread pain, significant pain catastrophizing, sympathovagal dysfunction, and amplified temporal summation for evoked pain. While several studies have demonstrated altered resting brain connectivity in FM, studies have not specifically probed the somatosensory system and its role in both somatic and nonsomatic FM symptoms. Our objective was to evaluate resting primary somatosensory cortex (S1) connectivity and to explore how sustained, evoked deep tissue pain modulates this connectivity.

Point-process Nonlinear Autonomic Assessment of Depressive States in Bipolar Patients

INTRODUCTIONnThis article is part of the Focus Theme of Methods of Information in Medicine on Biosignal Interpretation: Advanced Methods for Studying Cardiovascular and Respiratory Systems.nnnOBJECTIVESnThe goal of this work is to apply a computational methodology able to characterize mood states in bipolar patients through instantaneous analysis of heartbeat dynamics.nnnMETHODSnA Point-Process-based Nonlinear Autoregressive Integrative (NARI) model is applied to analyze data collected from five bipolar patients (two males and three females, age 42.4 ± 10.5 range 32u2009-56) undergoing a dedicated affective elicitation protocol using images from the International Affective Picture System (IAPS) and Thematic Apperception Test (TAT). The study was designed within the European project PSYCHE (Personalised monitoring SYstems for Care in mental HEalth).nnnRESULTSnRESULTS demonstrate that the inclusion of instantaneous higher order spectral (HOS) features estimated from the NARI nonlinear assessment significantly improves the accuracy in successfully recognizing specific mood states such as euthymia and depression with respect to results using only linear indices. In particular, a specificity of 74.44% using the instantaneous linear features set, and 99.56% using also the nonlinear feature set were achieved. Moreover, IAPS emotional elicitation resulted in a more discriminant procedure with respect to the TAT elicitation protocol.nnnCONCLUSIONSnA significant pattern of instantaneous heartbeat features was found in depressive and euthymic states despite the inter-subject variability. The presented point-process Heart Rate Variability (HRV) nonlinear methodology provides a promising application in the field of mood assessment in bipolar patients.

Brain Circuitry Supporting Multi-Organ Autonomic Outflow in Response to Nausea

While autonomic outflow is an important co-factor of nausea physiology, central control of this outflow is poorly understood. We evaluated sympathetic (skin conductance level) and cardiovagal (high-frequency heart rate variability) modulation, collected synchronously with functional MRI (fMRI) data during nauseogenic visual stimulation aimed to induce vection in susceptible individuals. Autonomic data guided analysis of neuroimaging data, using a stimulus-based (analysis windows set by visual stimulation protocol) and percept-based (windows set by subjects ratings) approach. Increased sympathetic and decreased parasympathetic modulation was associated with robust and anti-correlated brain activity in response to nausea. Specifically, greater autonomic response was associated with reduced fMRI signal in brain regions such as the insula, suggesting an inhibitory relationship with premotor brainstem nuclei. Interestingly, some sympathetic/parasympathetic specificity was noted. Activity in default mode network and visual motion areas was anti-correlated with parasympathetic outflow at peak nausea. In contrast, lateral prefrontal cortical activity was anti-correlated with sympathetic outflow during recovery, soon after cessation of nauseogenic stimulation. These results suggest divergent central autonomic control for sympathetic and parasympathetic response to nausea. Autonomic outflow and the central autonomic network underlying ANS response to nausea may be an important determinant of overall nausea intensity and, ultimately, a potential therapeutic target.

Likelihood methods for point processes with refractoriness

Likelihood-based encoding models founded on point processes have received significant attention in the literature because of their ability to reveal the information encoded by spiking neural populations. We propose an approximation to the likelihood of a point-process model of neurons that holds under assumptions about the continuous time process that are physiologically reasonable for neural spike trains: the presence of a refractory period, the predictability of the conditional intensity function, and its integrability. These are properties that apply to a large class of point processes arising in applications other than neuroscience. The proposed approach has several advantages over conventional ones. In particular, one can use standard fitting procedures for generalized linear models based on iteratively reweighted least squares while improving the accuracy of the approximation to the likelihood and reducing bias in the estimation of the parameters of the underlying continuous-time model. As a result, the proposed approach can use a larger bin size to achieve the same accuracy as conventional approaches would with a smaller bin size. This is particularly important when analyzing neural data with high mean and instantaneous firing rates. We demonstrate these claims on simulated and real neural spiking activity. By allowing a substantive increase in the required bin size, our algorithm has the potential to lower the barrier to the use of point-process methods in an increasing number of applications.

Complexity Variability Assessment of Nonlinear Time-Varying Cardiovascular Control

The application of complex systems theory to physiology and medicine has provided meaningful information about the nonlinear aspects underlying the dynamics of a wide range of biological processes and their disease-related aberrations. However, no studies have investigated whether meaningful information can be extracted by quantifying second-order moments of time-varying cardiovascular complexity. To this extent, we introduce a novel mathematical framework termed complexity variability, in which the variance of instantaneous Lyapunov spectra estimated over time serves as a reference quantifier. We apply the proposed methodology to four exemplary studies involving disorders which stem from cardiology, neurology and psychiatry: Congestive Heart Failure (CHF), Major Depression Disorder (MDD), Parkinson’s Disease (PD), and Post-Traumatic Stress Disorder (PTSD) patients with insomnia under a yoga training regime. We show that complexity assessments derived from simple time-averaging are not able to discern pathology-related changes in autonomic control, and we demonstrate that between-group differences in measures of complexity variability are consistent across pathologies. Pathological states such as CHF, MDD, and PD are associated with an increased complexity variability when compared to healthy controls, whereas wellbeing derived from yoga in PTSD is associated with lower time-variance of complexity.

Uncovering brain–heart information through advanced signal and image processing

Through their dynamical interplay, the brain and the heart ensure fundamental homeostasis and mediate a number of physiological functions as well as their disease-related aberrations. Although a vast number of ad hoc analytical and computational tools have been recently applied to the non-invasive characterization of brain and heart dynamic functioning, little attention has been devoted to combining information to unveil the interactions between these two physiological systems. This theme issue collects contributions from leading experts dealing with the development of advanced analytical and computational tools in the field of biomedical signal and image processing. It includes perspectives on recent advances in 7u2009T magnetic resonance imaging as well as electroencephalogram, electrocardiogram and cerebrovascular flow processing, with the specific aim of elucidating methods to uncover novel biological and physiological correlates of brain–heart physiology and physiopathology.

Neuroimaging brainstem circuitry supporting cardiovagal response to pain: A combined heart rate variability/ultrahigh-field (7 T) functional magnetic resonance imaging study

Central autonomic control nuclei in the brainstem have been difficult to evaluate non-invasively in humans. We applied ultrahigh-field (7u2009T) functional magnetic resonance imaging (fMRI), and the improved spatial resolution it affords (1.2u2009mm isotropic), to evaluate putative brainstem nuclei that control and/or sense pain-evoked cardiovagal modulation (high-frequency heart rate variability (HF-HRV) instantaneously estimated through a point-process approach). The time-variant HF-HRV signal was used to guide the general linear model analysis of neuroimaging data. Sustained (6u2009min) pain stimulation reduced cardiovagal modulation, with the most prominent reduction evident in the first 2u2009min. Brainstem nuclei associated with pain-evoked HF-HRV reduction were previously implicated in both autonomic regulation and pain processing. Specifically, clusters consistent with the rostral ventromedial medulla, ventral nucleus reticularis (Rt)/nucleus ambiguus (NAmb) and pontine nuclei (Pn) were found when contrasting sustained pain versus rest. Analysis of the initial 2-min period identified Rt/NAmb and Pn, in addition to clusters consistent with the dorsal motor nucleus of the vagus/nucleus of the solitary tract and locus coeruleus. Combining high spatial resolution fMRI and high temporal resolution HF-HRV allowed for a non-invasive characterization of brainstem nuclei, suggesting that nociceptive afference induces pain-processing brainstem nuclei to function in concert with known premotor autonomic nuclei in order to affect the cardiovagal response to pain.