Kerstin Limbrecht-Ecklundt

An investigation of facial emotion recognition impairments in alexithymia and its neural correlates

Alexithymia is a personality trait that involves difficulties identifying emotions and describing feelings. It is hypothesized that this includes facial emotion recognition but limited knowledge exists about possible neural correlates of this assumed deficit. We hence tested thirty-seven healthy subjects with either a relatively high or low degree of alexithymia (HDA versus LDA), who performed in a reliable and standardized test of facial emotion recognition (FEEL, Facially Expressed Emotion Labeling) in the functional MRI. LDA subjects had significantly better emotion recognition scores and showed relatively more activity in several brain areas associated with alexithymia and emotional awareness (anterior cingulate cortex), and the extended system of facial perception concerned with aspects of social communication and emotion (amygdala, insula, striatum). Additionally, LDA subjects had more activity in the visual area of social perception (posterior part of the superior temporal sulcus) and the inferior frontal cortex. HDA subjects, on the other hand, exhibited greater activity in the superior parietal lobule. With differences in behaviour and brain responses between two groups of otherwise healthy subjects, our results indirectly support recent conceptualizations and epidemiological data, that alexithymia is a dimensional personality trait apparent in clinically healthy subjects rather than a categorical diagnosis only applicable to clinical populations.

The effect of forced choice on facial emotion recognition: a comparison to open verbal classification of emotion labels

Objective: This article includes the examination of potential methodological problems of the application of a forced choice response format in facial emotion recognition. Methodology: 33 subjects were presented with validated facial stimuli. The task was to make a decision about which emotion was shown. In addition, the subjective certainty concerning the decision was recorded. Results: The detection rates are 68% for fear, 81% for sadness, 85% for anger, 87% for surprise, 88% for disgust, and 94% for happiness, and are thus well above the random probability. Conclusion: This study refutes the concern that the use of forced choice formats may not adequately reflect actual recognition performance. The use of standardized tests to examine emotion recognition ability leads to valid results and can be used in different contexts. For example, the images presented here appear suitable for diagnosing deficits in emotion recognition in the context of psychological disorders and for mapping treatment progress.

Automatic Pain Assessment with Facial Activity Descriptors

Pain is a primary symptom in medicine, and accurate assessment is needed for proper treatment. However, today’s pain assessment methods are not sufficiently valid and reliable in many cases. Automatic recognition systems may contribute to overcome this problem by facilitating objective and continuous assessment. In this article we propose a novel feature set for describing facial actions and their dynamics, which we call facial activity descriptors. We apply them to detect pain and estimate the pain intensity. The proposed method outperforms previous state-of-the-art approaches in sequence-level pain classification on both, the BioVid Heat Pain and the UNBC-McMaster Shoulder Pain Expression database. We further discuss major challenges of pain recognition research, benefits of temporal integration, and shortcomings of widely used frame-based pain intensity ground truth.

Recognition of Intensive Valence and Arousal Affective States via Facial Electromyographic Activity in Young and Senior Adults.

Background Research suggests that interaction between humans and digital environments characterizes a form of companionship in addition to technical convenience. To this effect, humans have attempted to design computer systems able to demonstrably empathize with the human affective experience. Facial electromyography (EMG) is one such technique enabling machines to access to human affective states. Numerous studies have investigated the effects of valence emotions on facial EMG activity captured over the corrugator supercilii (frowning muscle) and zygomaticus major (smiling muscle). The arousal emotion, specifically, has not received much research attention, however. In the present study, we sought to identify intensive valence and arousal affective states via facial EMG activity. Methods Ten blocks of affective pictures were separated into five categories: neutral valence/low arousal (0VLA), positive valence/high arousal (PVHA), negative valence/high arousal (NVHA), positive valence/low arousal (PVLA), and negative valence/low arousal (NVLA), and the ability of each to elicit corresponding valence and arousal affective states was investigated at length. One hundred and thirteen participants were subjected to these stimuli and provided facial EMG. A set of 16 features based on the amplitude, frequency, predictability, and variability of signals was defined and classified using a support vector machine (SVM). Results We observed highly accurate classification rates based on the combined corrugator and zygomaticus EMG, ranging from 75.69% to 100.00% for the baseline and five affective states (0VLA, PVHA, PVLA, NVHA, and NVLA) in all individuals. There were significant differences in classification rate accuracy between senior and young adults, but there was no significant difference between female and male participants. Conclusion Our research provides robust evidences for recognition of intensive valence and arousal affective states in young and senior adults. These findings contribute to the successful future application of facial EMG for identifying user affective states in human machine interaction (HMI) or companion robotic systems (CRS).

The complex duration perception of emotional faces: effects of face direction

The perceived duration of emotional face stimuli strongly depends on the expressed emotion. But, emotional faces also differ regarding a number of other features like gaze, face direction, or sex. Usually, these features have been controlled by only using pictures of female models with straight gaze and face direction. Doi and Shinohara (2009) reported that an overestimation of angry faces could only be found when the model’s gaze was oriented toward the observer. We aimed at replicating this effect for face direction. Moreover, we explored the effect of face direction on the duration perception sad faces. Controlling for the sex of the face model and the participant, female and male participants rated the duration of neutral, angry, and sad face stimuli of both sexes photographed from different perspectives in a bisection task. In line with current findings, we report a significant overestimation of angry compared to neutral face stimuli that was modulated by face direction. Moreover, the perceived duration of sad face stimuli did not differ from that of neutral faces and was not influenced by face direction. Furthermore, we found that faces of the opposite sex appeared to last longer than those of the same sex. This outcome is discussed with regards to stimulus parameters like the induced arousal, social relevance, and an evolutionary context.

Audio-Based Pre-classification for Semi-automatic Facial Expression Coding

The automatic classification of the users’ internal affective and emotional states is nowadays to be considered for many applications, ranging from organisational tasks to health care. Developing suitable automatic technical systems, training material is necessary for an appropriate adaptation towards users. In this paper, we present a framework which reduces the manual effort in annotation of emotional states. Mainly it pre-selects video material containing facial expressions for a detailed coding according to the Facial Action Coding System based on audio features, namely prosodic and mel-frequency features. Further, we present results of first experiments which were conducted to give a proof-of-concept and to define the parameters for the classifier that is based on Hidden Markov Models. The experiments were done on the EmoRec I dataset.

Pictures of Facial Affect-Ulm (PFA-U): A New Facs-Based set of Pictures for Basic Emotions

Abstract Emotion recognition and emotion expression/regulation are important aspects of emotional intelligence (EI). Although the construct of EI is widely used and its components are part of many investigations, there is still no sufficient picture set that can be used for systematic research of facial emotion recognition and practical applications of individual assessments. In this research we present a new Facial Action Coding System validated picture set consisting of six emotions (anger, disgust, fear, happiness, sadness, and surprise). Basic principles of stimulus development and evaluation process are described. The PFA-U can be used for future studies in organization for the assessment of emotion recognition, emotion stimulation, and emotion management.

Emotional ambivalence and post-traumatic stress disorder (PTSD) in soldiers during military operations.

Objective: This pilot study examined the extent to which a specific mechanism of emotion regulation – namely, ambivalence concerning the expressiveness of German soldiers’ emotions – affects the severity of PTSD symptoms after a military operation. Methodology: A survey was conducted at three points in time among 66 soldiers deployed on military crisis operations. The Harvard Trauma Questionaire (HTQ), the Ambivalence over Emotional Expressiveness Questionnaire (AEQ-G18), and a questionnaire on the particular stress of German soldiers during military operations were used. Results: The study showed a significant correlation between emotional ambivalence and traumatization. Furthermore, it was shown that the subjective stress of soldiers leading up to deployment is more pronounced when emotional ambivalence is stronger in the context of military operations. This particular stress is greater before and during the military operation than after. Compared to a male control sample, the average AEQ-G18 scores of the soldier sample examined here are considerably lower. Conclusion: This pilot study clearly indicates that the AEQ-G18 could be a suitable predictor of the psychological burden on soldiers. The correlations between emotional ambivalence on the one hand and the particular and post-traumatic stressors on the other hand are not only statistically significant in the present pilot study, but may also be relevant as risk factors. It is, therefore, necessary to conduct more extensive studies on soldiers participating in military operations to verify the results of this pilot study.

Normal emotion regulation in adults with cleft lip and palate: an exploratory study.

INTRODUCTION Cleft lip and palate (CLP) represent the most common congenital malformations of the midfacial region. Although these patients show differences in their facial appearance, we hypothesize that CLP-affected individuals do not show an alteration in their emotion regulation abilities compared to unaffected individuals. This is because of the strong biological basis of facial emotion and expression that is inherent and receives little influence from external factors. MATERIAL AND METHODS The present study evaluated various aspects of emotion regulation in 25 adults with CLP and an equally sized control group of unaffected volunteers. The study was divided into three parts. First, we investigated emotion regulation strategies. Here, each participant was asked to complete the Emotion Regulation Questionnaire (ERQ) and Ambivalence over Emotional Expressiveness Questionnaire G 18 (AEQ-G18). Second, we examined the recognition of facially expressed basic emotions (FEEL test). Third, we evaluated the expression of an emotion induced by an odor sample. RESULTS Habitual emotion regulation, measured by ERQ and AEQ-G18, was not different between CLP and controls subjects for all of the sub-scales. Recognition of facially expressed basic emotions was also the same for both groups. Facial emotion encoding did not differ for both groups. CONCLUSIONS To summarize, the findings suggest that individuals with an orofacial cleft show undisturbed emotion regulation and recognition. This may be explained by the strong biological basis of facial emotion recognition and regulation as well as by the healthy emotional resilience and social functioning of CLP patients.

Effort-reward imbalance among medical students and physicians

Materials and methods The questionnaire used for the practicing medics was the effort-reward-imbalance (ERI) model of Siegrist et al. The questionnaire used for the students survey was the effort-reward-imbalance (ERI) model for school and student settings. The ERI scores on a 5 point Likert scale. In total, N = 716 medical students completed the questionnaire (65.4% female, 34.6% male). 61% of the students were in their pre-clinical term, 39% in their clinical term. The practicing medics sample had a total of N = 120 (60.2% female, 39.8% male).