Heike Jacob

Non-verbal emotion communication training induces specific changes in brain function and structure

The perception of emotional cues from voice and face is essential for social interaction. However, this process is altered in various psychiatric conditions along with impaired social functioning. Emotion communication trainings have been demonstrated to improve social interaction in healthy individuals and to reduce emotional communication deficits in psychiatric patients. Here, we investigated the impact of a non-verbal emotion communication training (NECT) on cerebral activation and brain structure in a controlled and combined functional magnetic resonance imaging (fMRI) and voxel-based morphometry study. NECT-specific reductions in brain activity occurred in a distributed set of brain regions including face and voice processing regions as well as emotion processing- and motor-related regions presumably reflecting training-induced familiarization with the evaluation of face/voice stimuli. Training-induced changes in non-verbal emotion sensitivity at the behavioral level and the respective cerebral activation patterns were correlated in the face-selective cortical areas in the posterior superior temporal sulcus and fusiform gyrus for valence ratings and in the temporal pole, lateral prefrontal cortex and midbrain/thalamus for the response times. A NECT-induced increase in gray matter (GM) volume was observed in the fusiform face area. Thus, NECT induces both functional and structural plasticity in the face processing system as well as functional plasticity in the emotion perception and evaluation system. We propose that functional alterations are presumably related to changes in sensory tuning in the decoding of emotional expressions. Taken together, these findings highlight that the present experimental design may serve as a valuable tool to investigate the altered behavioral and neuronal processing of emotional cues in psychiatric disorders as well as the impact of therapeutic interventions on brain function and structure.

Nonverbal signals speak up: Association between perceptual nonverbal dominance and emotional intelligence

Emotional communication uses verbal and nonverbal means. In case of conflicting signals, nonverbal information is assumed to have a stronger impact. It is unclear, however, whether perceptual nonverbal dominance varies between individuals and whether it is linked to emotional intelligence. Using audiovisual stimulus material comprising verbal and nonverbal emotional cues that were varied independently, perceptual nonverbal dominance profiles and their relations to emotional intelligence were examined. Nonverbal dominance was found in every participant, ranging from 55 to 100%. Moreover, emotional intelligence, particularly the ability to understand emotions, correlated positively with nonverbal dominance. Furthermore, higher overall emotional intelligence as well as a higher ability to understand emotions were linked to smaller reaction time differences between emotionally incongruent and congruent stimuli. The association between perceptual nonverbal dominance and emotional intelligence, and more specifically the ability to understand emotions, might reflect an adaptive process driven by the experience of higher authenticity in nonverbal cues.

They Are Laughing at Me: Cerebral Mediation of Cognitive Biases in Social Anxiety

The fear of embarrassment and humiliation is the central element of social anxiety. This frequent condition is associated with cognitive biases indicating increased sensitivity to signals of social threat, which are assumed to play a causal role in the maintenance of social anxiety. Here, we employed laughter, a potent medium for the expression of acceptance and rejection, as an experimental stimulus in participants selected for varying degrees of social anxiety to identify cerebral mediators of cognitive biases in social anxiety using functional magnetic resonance imaging in combination with mediation analysis. We directly demonstrated that cerebral activation patterns within the dorsal attention network including the left dorsolateral and dorsomedial prefrontal cortex mediate the influence of social anxiety on laughter perception. This mediation proved to be specific for social anxiety after correction for measures of general state and trait anxiety and occurred most prominently under bimodal audiovisual laughter presentation when compared with monomodal auditory or visual laughter cues. Considering the possibility to modulate cognitive biases and cerebral activity by neuropsychological trainings, non-invasive electrophysiological stimulation and psychotherapy, this study represents a starting point for a whole line of translational research projects and identifies promising targets for electrophysiological interventions aiming to alleviate cognitive biases and symptom severity in social anxiety.

Laughter perception in social anxiety

BACKGROUND Laughter is a powerful signal of social acceptance or rejection while the fear of being embarrassed and humiliated is central in social anxiety (SA). This type of anxiety is associated with cognitive biases indicating increased sensitivity to social threat as well as with deficits in emotion regulation. Both are thought to be implicated in the maintenance of social anxiety. METHOD Using laughter as a novel stimulus, we investigated cognitive biases and their modulation through emotion regulation and cue ambiguity in individuals with varying degrees of SA (N = 60). RESULTS A combination of a negative laughter interpretation bias and an attention bias away from joyful/social inclusive laughter in SA was observed. Both biases were not attributable to effects of general anxiety and were closely correlated with the concept of gelotophobia, the fear of being laughed at. DISCUSSION Thus, our study demonstrates altered laughter perception in SA. Furthermore, it highlights the usefulness of laughter as a highly prevalent social signal for future research on the interrelations of interpretation and attention biases in SA and their modulation through emotion regulation.

Effects of Emotional Intelligence on the Impression of Irony Created by the Mismatch between Verbal and Nonverbal Cues

Emotional information is conveyed through verbal and nonverbal signals, with nonverbal cues often being considered the decisive factor in the judgment of others’ emotional states. The aim of the present study was to examine how verbal and nonverbal cues are integrated by perceivers. More specifically, we tested whether the mismatch between verbal and nonverbal information was perceived as an expression of irony. Moreover, we investigated the effects of emotional intelligence on the impression of irony. The findings revealed that the mismatch between verbal and nonverbal information created the impression of irony. Furthermore, participants higher in emotional intelligence were faster at rating such stimuli as ironic expressions.

Integration of verbal and nonverbal emotional signals in patients with schizophrenia: Decreased nonverbal dominance

In day-to-day social interaction, emotions are usually expressed by verbal (e.g. spoken words) and nonverbal signals (e.g. facial expressions, prosody). In case of conflicting signals nonverbal signals are perceived as being the more reliable source of information. Deficits in interpreting nonverbal signals - as described for patients with schizophrenic disorders - might interfere with the ability to integrate verbal and nonverbal social cues into a meaningful whole. The aim of this study was to examine how schizophrenic disorders influence the integration of verbal and nonverbal signals. For this purpose short video sequences were presented to 21 patients with schizophrenia and 21 healthy controls. Each sequence showed an actor speaking a short sentence with independently varying emotional connotations at the verbal and the nonverbal level. The participants rated the valence of the speakers emotional state on a four-point scale (from very negative to very positive). The relative impact of nonverbal cues as compared to verbal cues on these ratings was evaluated. Both groups base their decisions primarily on nonverbal information. However, this effect is significantly less prominent in the patient group. Patients tend to base their decisions less on nonverbal signals and more on verbal information than healthy controls.

Cerebral Processing of Prosodic Emotional Signals: Evaluation of a Network Model Using rTMS

A great number of functional imaging studies contributed to developing a cerebral network model illustrating the processing of prosody in the brain. According to this model, the processing of prosodic emotional signals is divided into three main steps, each related to different brain areas. The present study sought to evaluate parts of the aforementioned model by using low-frequency repetitive transcranial magnetic stimulation (rTMS) over two important brain regions identified by the model: the superior temporal cortex (Experiment 1) and the inferior frontal cortex (Experiment 2). The aim of both experiments was to reduce cortical activity in the respective brain areas and evaluate whether these reductions lead to measurable behavioral effects during prosody processing. However, results obtained in this study revealed no rTMS effects on the acquired behavioral data. Possible explanations for these findings are discussed in the paper.

Neurobiological correlates of emotional intelligence in voice and face perception networks

Abstract Facial expressions and voice modulations are among the most important communicational signals to convey emotional information. The ability to correctly interpret this information is highly relevant for successful social interaction and represents an integral component of emotional competencies that have been conceptualized under the term emotional intelligence. Here, we investigated the relationship of emotional intelligence as measured with the Salovey-Caruso-Emotional-Intelligence-Test (MSCEIT) with cerebral voice and face processing using functional and structural magnetic resonance imaging. MSCEIT scores were positively correlated with increased voice-sensitivity and gray matter volume of the insula accompanied by voice-sensitivity enhanced connectivity between the insula and the temporal voice area, indicating generally increased salience of voices. Conversely, in the face processing system, higher MSCEIT scores were associated with decreased face-sensitivity and gray matter volume of the fusiform face area. Taken together, these findings point to an alteration in the balance of cerebral voice and face processing systems in the form of an attenuated face-vs-voice bias as one potential factor underpinning emotional intelligence.

Attenuated impression of irony created by the mismatch of verbal and nonverbal cues in patients with autism spectrum disorder

Perception of irony has been observed to be impaired in adults with autism spectrum disorder. In typically developed adults, the mismatch of verbal and nonverbal emotional cues can be perceived as an expression of irony even in the absence of any further contextual information. In this study, we evaluate to what extent high functioning autists perceive this incongruence as expressing irony. Our results show that incongruent verbal and nonverbal signals create an impression of irony significantly less often in participants with high-functioning autism than in typically developed control subjects. The extent of overall autistic symptomatology as measured with the autism-spectrum questionnaire (AQ), however, does not correlate with the reduced tendency to attribute incongruent stimuli as expressing irony. Therefore, the attenuation in irony attribution might rather be related to specific subdomains of autistic traits, such as a reduced tendency to interpret communicative signals in terms of complex intentional mental states. The observed differences in irony attribution support the assumption that a less pronounced tendency to engage in higher order mentalization processes might underlie the impairment of pragmatic language understanding in high functioning autism.

Effects of cue modality and emotional category on recognition of nonverbal emotional signals in schizophrenia.

BackgroundImpaired interpretation of nonverbal emotional cues in patients with schizophrenia has been reported in several studies and a clinical relevance of these deficits for social functioning has been assumed. However, it is unclear to what extent the impairments depend on specific emotions or specific channels of nonverbal communication.MethodsHere, the effect of cue modality and emotional categories on accuracy of emotion recognition was evaluated in 21 patients with schizophrenia and compared to a healthy control group (n = 21). To this end, dynamic stimuli comprising speakers of both genders in three different sensory modalities (auditory, visual and audiovisual) and five emotional categories (happy, alluring, neutral, angry and disgusted) were used.ResultsPatients with schizophrenia were found to be impaired in emotion recognition in comparison to the control group across all stimuli. Considering specific emotions more severe deficits were revealed in the recognition of alluring stimuli and less severe deficits in the recognition of disgusted stimuli as compared to all other emotions.Regarding cue modality the extent of the impairment in emotional recognition did not significantly differ between auditory and visual cues across all emotional categories. However, patients with schizophrenia showed significantly more severe disturbances for vocal as compared to facial cues when sexual interest is expressed (alluring stimuli), whereas more severe disturbances for facial as compared to vocal cues were observed when happiness or anger is expressed.ConclusionOur results confirmed that perceptual impairments can be observed for vocal as well as facial cues conveying various social and emotional connotations. The observed differences in severity of impairments with most severe deficits for alluring expressions might be related to specific difficulties in recognizing the complex social emotional information of interpersonal intentions as compared to “basic” emotional states.Therefore, future studies evaluating perception of nonverbal cues should consider a broader range of social and emotional signals beyond basic emotions including attitudes and interpersonal intentions. Identifying specific domains of social perception particularly prone for misunderstandings in patients with schizophrenia might allow for a refinement of interventions aiming at improving social functioning.