Laurence Conty

When eye creates the contact! ERP evidence for early dissociation between direct and averted gaze motion processing

Direct gaze or eye contact is a strong social signal, which triggers distinct processes as compared to other gaze directions. Thus, direct gaze could be early dissociated from averted gaze during the processing of gaze direction. In order to examine the processing of gaze contact relative to averted gaze, we studied evoked potentials in human adults in response to the apparent motion of gaze. Deviated and frontal faces were presented with a fixed gaze direction, followed by an apparent movement of the eyes either toward the subject or away from him/her. The results showed that the perception of direct relative to averted gaze evoked a greater, later and longer lasting N170, suggesting that gaze contact recruited more resources than averted gaze in the early stage of gaze direction processing. Furthermore, direct and averted motion of gaze elicited distinct ERP components between 160 and 210 ms, initiated over centro-parietal electrodes. Source reconstruction revealed the involvement of the Theory-of-Mind network, including the regions of the superior temporal sulcus, the medial prefrontal and the orbitofrontal cortices, in this early dissociation. In addition, the perception of gaze contact relative to averted gaze yielded increased fronto-central P3a and parieto-occipital P3b. All the results were significant whatever the head orientation. Our findings show that gaze contact, as compared to other gaze directions, is an essential social cue which recruits early specific processes. The dissociation between direct and averted gaze processing occurs as soon as 160 ms, involving the social brain network.

Early Binding of Gaze, Gesture, and Emotion: Neural Time Course and Correlates

Communicative intentions are transmitted by many perceptual cues, including gaze direction, body gesture, and facial expressions. However, little is known about how these visual social cues are integrated over time in the brain and, notably, whether this binding occurs in the emotional or the motor system. By coupling magnetic resonance and electroencephalography imaging in humans, we were able to show that, 200 ms after stimulus onset, the premotor cortex integrated gaze, gesture, and emotion displayed by a congener. At earlier stages, emotional content was processed independently in the amygdala (170 ms), whereas directional cues (gaze direction with pointing gesture) were combined at ∼190 ms in the parietal and supplementary motor cortices. These results demonstrate that the early binding of visual social signals displayed by an agent engaged the dorsal pathway and the premotor cortex, possibly to facilitate the preparation of an adaptive response to another persons immediate intention.

Oscillatory Brain Correlates of Live Joint Attention: A Dual-EEG Study

Joint attention consists in following another’s gaze onto an environmental object, which leads to the alignment of both subjects’ attention onto this object. It is a fundamental mechanism of non-verbal communication, and it is essential for dynamic, online, interindividual synchronization during interactions. Here we aimed at investigating the oscillatory brain correlates of joint attention in a face-to-face paradigm where dyads of participants dynamically oriented their attention toward the same or different objects during joint and no-joint attention periods respectively. We also manipulated task instruction: in socially driven instructions, the participants had to follow explicitly their partner’s gaze, while in color-driven instructions, the objects to be looked at were designated at by their color so that no explicit gaze following was required. We focused on oscillatory activities in the 10 Hz frequency range, where parieto-occipital alpha and the centro-parietal mu rhythms have been described, as these rhythms have been associated with attention and social coordination processes respectively. We tested the hypothesis of a modulation of these oscillatory activities by joint attention. We used dual-EEG to record simultaneously the brain activities of the participant dyads during our live, face-to-face joint attention paradigm. We showed that joint attention periods – as compared to the no-joint attention periods – were associated with a decrease of signal power between 11 and 13 Hz over a large set of left centro-parieto-occipital electrodes, encompassing the scalp regions where alpha and mu rhythms have been described. This 11–13 Hz signal power decrease was observed independently of the task instruction: it was similar when joint versus no-joint attention situations were socially driven and when they were color-driven. These results are interpreted in terms of the processes of attention mirroring, social coordination, and mutual attentiveness associated with joint attention state.

The mere perception of eye contact increases arousal during a word-spelling task

Abstract Eye contact is a highly salient and fundamentally social signal. This entails that the mere perception of direct gaze may trigger differentiated neurobehavioral responses as compared to other gaze directions. We investigated this issue using a visual word-spelling task where faces under different gaze directions and head orientations were displayed on-screen concomitantly with the words. We show evidence for automatic increase of skin conductance response (SCR), indicative of arousal, associated with the perception of direct gaze as compared to both averted gaze and closed eyes. Moreover, the perception of averted gaze was associated with an increase of electromyographic (EMG) corrugator activity. These effects were observed in two demanding word-spelling tasks, but not in a simple letter decision task. We propose to interpret these findings in terms of the social value of direct and averted gaze and conclude that some circumstances such as the task at hand may be essential for uncovering the neurobehavioral responses associated with the perception of others’ gaze.

Look at Me, I'll Remember You: The Perception of Self-Relevant Social Cues Enhances Memory and Right Hippocampal Activity

Being looked at by a person enhances the subsequent memorability of her/his identity. Here, we tested the specificity of this effect and its underlying brain processes. We manipulated three social cues displayed by an agent: Gaze Direction (Direct/Averted), Emotional Expression (Anger/Neutral), and Pointing gesture (Presence/Absence). Our behavioral experiment showed that direct as compared with averted gaze perception enhanced subsequent retrieval of face identity. Similar effect of enhanced retrieval was found when pointing finger was absent as compared with present but not for anger as compared with neutral expression. The fMRI results revealed amygdala activity for both Anger and Direct gaze conditions, suggesting emotional arousal. Yet, the right hippocampus, known to play a role in self‐relevant memory processes, was only revealed during direct gaze perception. Further investigations suggest that right hippocampal activity was maximal for the most self‐relevant social event (i.e. actor expressing anger and pointing toward the participant with direct gaze). Altogether, our results suggest that the perception of self‐relevant social cues such as direct gaze automatically prompts “self‐relevant memory” processes. Hum Brain Mapp 33:2428–2440, 2012.

Evidence for unintentional emotional contagion beyond dyads.

Little is known about the spread of emotions beyond dyads. Yet, it is of importance for explaining the emergence of crowd behaviors. Here, we experimentally addressed whether emotional homogeneity within a crowd might result from a cascade of local emotional transmissions where the perception of another’s emotional expression produces, in the observers face and body, sufficient information to allow for the transmission of the emotion to a third party. We reproduced a minimal element of a crowd situation and recorded the facial electromyographic activity and the skin conductance response of an individual C observing the face of an individual B watching an individual A displaying either joy or fear full body expressions. Critically, individual B did not know that she was being watched. We show that emotions of joy and fear displayed by A were spontaneously transmitted to C through B, even when the emotional information available in B’s faces could not be explicitly recognized. These findings demonstrate that one is tuned to react to others’ emotional signals and to unintentionally produce subtle but sufficient emotional cues to induce emotional states in others. This phenomenon could be the mark of a spontaneous cooperative behavior whose function is to communicate survival-value information to conspecifics.

Watching Eyes effects: When others meet the self

The perception of direct gaze-that is, of another individuals gaze directed at the observer-is known to influence a wide range of cognitive processes and behaviors. We present a new theoretical proposal to provide a unified account of these effects. We argue that direct gaze first captures the beholders attention and then triggers self-referential processing, i.e., a heightened processing of stimuli in relation with the self. Self-referential processing modulates incoming information processing and leads to the Watching Eyes effects, which we classify into four main categories: the enhancement of self-awareness, memory effects, the activation of pro-social behavior, and positive appraisals of others. We advance that the belief to be the object of anothers attention is embedded in direct gaze perception and gives direct gaze its self-referential power. Finally, we stress that the Watching Eyes effects reflect a positive impact on human cognition; therefore, they may have a therapeutic potential, which future research should delineate.

Eye contact elicits bodily self-awareness in human adults

Eye contact is a typical human behaviour known to impact concurrent or subsequent cognitive processing. In particular, it has been suggested that eye contact induces self-awareness, though this has never been formally proven. Here, we show that the perception of a face with a direct gaze (that establishes eye contact), as compared to either a face with averted gaze or a mere fixation cross, led adult participants to rate more accurately the intensity of their physiological reactions induced by emotional pictures. Our data support the view that bodily self-awareness becomes more acute when one is subjected to anothers gaze. Importantly, this effect was not related to a particular arousal state induced by eye contact perception. Rejecting the arousal hypothesis, we suggest that eye contact elicits a self-awareness process by enhancing self-focused attention in humans. We further discuss the implications of this proposal.

Salient Social Cues are Prioritized in Autism Spectrum Disorders Despite Overall Decrease in Social Attention

Diminished social attention is often considered to be a central deficit in autism spectrum disorders (ASDs). We further investigate this hypothesis by measuring the distracting power of social and non-social stimuli in the context of a Stroop task among children with ASD and typically developing controls (TDCs). Our results show that Stroop interference increases with social versus non-social distracters in TDCs, whereas the opposite pattern occurs in ASD. Within social stimuli, however, the superiority of direct gaze previously reported in the literature did not differ between the groups. Our data thus suggest that ASD children assign less weight to social than non-social stimuli, but that within social signals, salient stimuli remain prioritized.

Classification of autistic individuals and controls using cross-task characterization of fMRI activity

Multivariate pattern analysis (MVPA) has been applied successfully to task-based and resting-based fMRI recordings to investigate which neural markers distinguish individuals with autistic spectrum disorders (ASD) from controls. While most studies have focused on brain connectivity during resting state episodes and regions of interest approaches (ROI), a wealth of task-based fMRI datasets have been acquired in these populations in the last decade. This calls for techniques that can leverage information not only from a single dataset, but from several existing datasets that might share some common features and biomarkers. We propose a fully data-driven (voxel-based) approach that we apply to two different fMRI experiments with social stimuli (faces and bodies). The method, based on Support Vector Machines (SVMs) and Recursive Feature Elimination (RFE), is first trained for each experiment independently and each output is then combined to obtain a final classification output. Second, this RFE output is used to determine which voxels are most often selected for classification to generate maps of significant discriminative activity. Finally, to further explore the clinical validity of the approach, we correlate phenotypic information with obtained classifier scores. The results reveal good classification accuracy (range between 69% and 92.3%). Moreover, we were able to identify discriminative activity patterns pertaining to the social brain without relying on a priori ROI definitions. Finally, social motivation was the only dimension which correlated with classifier scores, suggesting that it is the main dimension captured by the classifiers. Altogether, we believe that the present RFE method proves to be efficient and may help identifying relevant biomarkers by taking advantage of acquired task-based fMRI datasets in psychiatric populations.