Manuel Mercier

Gravity and observer's body orientation influence the visual perception of human body postures

Since human behavior and perception have evolved within the Earths gravitational field, humans possess an internal model of gravity. Although gravity is known to influence the visual perception of moving objects, the evidence is less clear concerning the visual perception of static objects. We investigated whether a visual judgment of the stability of human body postures (static postures of a human standing on a platform and tilted in the roll plane) may also be influenced by gravity and by the participants orientation. Pictures of human body postures were presented in different orientations with respect to gravity and the participants body. The participants body was aligned to gravity (upright) or not (lying on one side). Participants performed stability judgments with respect to the platform, imagining that gravity operates in the direction indicated by the platform (that was or was not concordant with physical gravity). Such visual judgments were influenced by the pictures orientation with respect to physical gravity. When pictures were tilted by 90 degrees with respect to physical gravity, the human postures that were tilted toward physical gravity (down) were perceived as more unstable than similar postures tilted away from physical gravity (up). Stability judgments were also influenced by the pictures orientation with respect to the participants body. This indicates that gravity and the participants body position may influence the visual perception of static objects.

EEG-MEG evidence for early differential repetition effects for fearful, happy and neutral faces.

To determine how emotional information modulates subsequent traces for repeated stimuli, we combined simultaneous electro-encephalography (EEG) and magneto-encephalography (MEG) measures during long-lag incidental repetition of fearful, happy, and neutral faces. Repetition effects were modulated by facial expression in three different time windows, starting as early as 40-50 ms in both EEG and MEG, then arising at the time of the N170/M170, and finally between 280-320 ms in MEG only. The very early repetition effect, observed at 40-50 ms over occipito-temporo-parietal regions, showed a different MEG topography according to the facial expression. This differential response to fearful, happy and neutral faces suggests the existence of very early discriminative visual processing of expressive faces, possibly based on the low-level physical features typical of different emotions. The N170 and M170 face-selective components both showed repetition enhancement selective to neutral faces, with greater amplitude for emotional than neutral faces on the first but not the second presentation. These differential repetition effects may reflect valence acquisition for the neutral faces due to repetition, and suggest a combined influence of emotion- and experience-related factors on the early stage of face encoding. Finally, later repetition effects consisted in enhanced M300 (MEG) between 280 and 320 ms for fearful relative to happy and neutral faces that occurred on the first presentation, but levelled out on the second presentation. This effect may correspond to the higher arousing value of fearful stimuli that might habituate with repetition. Our results reveal that multiple stages of face processing are affected by the repetition of emotional information.

Spatiotemporal dynamics of visual vertical judgments: early and late brain mechanisms as revealed by high-density electrical neuroimaging

Constructing and updating an internal model of verticality is fundamental for maintaining an erect posture and facilitating visuo-spatial processing. The judgment of the visual vertical (VV) has been intensively studied in psychophysical investigations and relies mainly on the integration of visual and vestibular signals, although a contribution of postural and somatosensory signals has been reported. Here we used high-density 192-channel evoked potential (EP) mapping and distributed source localization techniques to reveal the neural mechanisms of VV judgments. VV judgments (judging the orientation of visual lines with respect to the subjective vertical) were performed with and without a tilted visual frame. EP mapping revealed a sequence of neural processing steps (EP maps) of which two were specific for VV judgments. An early EP map, observed at ∼75-105 ms post-stimulus, was localized in right lateral temporo-occipital cortex. A later EP map (∼260-290 ms) was localized in bilateral temporo-occipital and parieto-occipital cortex. These data suggest that early VV-related neural processing involves the lateral and ventral visual stream and is related to visual processing concerning orientation, attention and comparison. The later, more dorsal, activation involves multimodal cortex subtending a constantly available and updated internal model of the vertical that we can refer to for the control of ones posture, actions, and visuo-spatial processing.

Mental imagery of self-location during spontaneous and active self-other interactions: an electrical neuroimaging study

Substantial data from the cognitive neurosciences point to the importance of bodily processing for the development of a comprehensive theory of the self. A key aspect of the bodily self is self-location, the experience that the self is localized at a specific position in space within ones bodily borders (embodied self-location). Although the neural mechanisms of self-location have been studied by manipulating the spatial location of ones visual perspective during mental imagery, such experiments were conducted in constrained, explicit, and unecological contexts such as explicit instructions in a prone/seated position, although most human interactions occur spontaneously while standing/walking. Using a motor paradigm, we investigated the behavioral and neural mechanisms of spontaneous self-location and mental body transformations during active human interaction. Using own-body imagery using spontaneous and explicit changes in self-location in standing participants, we report that spontaneous interactions with an avatar are neurally indistinguishable from explicit own-body transformation with disembodied self-location but differ from explicit own-body transformation with embodied self-location at 400–600 ms after stimulus onset. We discuss these findings with respect to the neural mechanisms of perspective-taking and self-location in spontaneous human interaction.

The Cognitive And Neural Time Course Of Empathy And Sympathy: An Electrical Neuroimaging Study On Self-Other Interaction

Although extensively investigated in socio-cognitive neuroscience, empathy is difficult to study. The first difficulty originates in its multifaceted nature. According to the multidimensional model, empathy combines emotional, automatic (simulation), cognitive (mentalizing) and regulatory (executive functions) processes. Substantial functional magnetic resonance imaging (fMRI) data demonstrated that co-activations in the mirror neuron system (MNS) and mentalizing network (MENT) sustain this co-recruitment of so-called first- and second-person-like processes. Because of the poor temporal resolution of fMRI techniques, we currently lack evidence about the precise timing of the MNS-MENT combination. An important challenge is, thus, to disentangle how MNS and MENT dynamically work together along time in empathy. Moreover, the role of the executive functions in the MNS-MENT combination time course is still unknown. Second, empathy - feeling into - is closely related to sympathy - feeling with - and both phenomena are often conflated in experimental studies on intersubjectivity. In this electrical neuroimaging (EEG) pilot-study, we tested whether the egocentered vs. heterocentered visuo-spatial mechanisms respectively associated with sympathy and empathy differentially modulate the dynamic combination of the MNS-MENT activations in their respective neural time course. For that, we employed our newly developed behavioral paradigm assessing the visuo-spatial - but not emotional - features of empathy and sympathy. Using a data-driven approach, we report that empathy and sympathy are underlied by sequential activations in the MNS from the insula to the inferior frontal gyrus (IFG) between 63ms and 424ms. However, at 333-424ms, empathy triggered greater co-activations in the right IFG and dorsolateral prefrontal cortex (dlPFC) (executive functions). Linking together our present and prior (Thirioux et al., 2010) findings from the same dataset, we suggest that this greater recruitment of the right dlPFC monitors the shift from egocentered and first-person-like mechanisms in the MNS to heterocentered and second-person-like mechanisms in the left temporo-parietal junction within the MENT, i.e., reflecting the onset of perspective-change processes in the neural time course of empathy. Contrasting with sympathy, this recruitment of the executive functions could modulate the output end of the mirroring processing in the premotor and sensorimotor cortices.

Motion direction tuning in human visual cortex

A number of electrophysiological studies have been conducted in recent years in order to clarify the dynamics of visual motion processing in the human brain. Using a variety of event‐related potential (ERP) measures, several parameters such as onset, offset, contrast and velocity have been investigated, while a critical aspect of visual motion, that of direction, has received less attention. Here we used multichannel electroencephalography and distributed source localization to study brain activity for different directions of visual motion using random dot stimuli. Our data reveal differential extrastriate activation at 164–226 ms after motion onset that coded for motion direction with different ERP maps and underlying electrical generators for each tested direction. This activation was paralleled initially (164–186 ms) by a distinct extrastriate activation encoding whether the motion stimulus consisted of directed motion stimuli (as above) or contained undirected incoherent motion (control stimulus). Application of a linear inverse solution localized the brain activity for each tested motion direction to distinct brain regions within the same larger network of extrastriate brain regions. These regions included bilateral temporo‐occipital and bilateral parieto‐occipital cortex. The present data in healthy subjects are compatible with extrastriate activity that is tuned to different directions of visual motion. This extends previous clinical data and suggests the presence of distributed macroscopic motion direction tuning in primate extrastriate cortex that may complement the classical microscopic motion tuning at the columnar level.

Non-retinotopic feature integration decreases response-locked brain activity as revealed by electrical neuroimaging

When presented with dynamic scenes, the brain integrates visual elements across space and time. Such non-retinotopic processing has been intensively studied from a psychophysical point of view, but little is known about the underlying neural processes. Here we used high-density EEG to reveal neural correlates of non-retinotopic feature integration. In an offset-discrimination task we presented sequences of lines for which feature integration depended on a small, endogenous shift of attention. Attention effects were observed in the stimulus-locked evoked potentials but non-retinotopic feature integration was reflected in voltage topographies time-locked to the behavioral response, lasting for about 400 ms. Statistical parametric mapping of estimated current densities revealed that this integration reduced electrical activity in an extensive network of brain areas, with the effects progressing from high-level visual, via frontal, to central ones. The results suggest that endogenously timed neural processes, rather than bottom-up ones, underlie non-retinotopic feature integration.

Distinct mechanisms of form-from-motion perception in human extrastriate cortex

The exquisite sensitivity of the human visual system to form-from-motion (FfM) cues is well documented. However, identifying the neural correlates of this sensitivity has proven difficult, particularly determining the respective contributions of different motion areas in extrastriate visual cortex. Here we measured visual FfM perception and more elementary visual motion (VM) perception in a group of 32 patients suffering from acute posterior brain damage, and performed MRI-based lesion analysis. Our results suggest that severe FfM perception deficits without an associated deficit of VM perception are due to damage to ventral occipito-temporal cortex (VOT), whereas associated deficits of FfM and VM perception are due to damage either in proximity to area MT+/V5 or an area including lateral occipital complex (LOC) and VOT. These data suggest the existence of at least three functionally and anatomically distinct regions in human visual cortex that process FfM signals.

Dorsal and ventral stream contributions to form-from-motion perception in a patient with form-from motion deficit: a case report

The main model of visual processing in primates proposes an anatomo-functional distinction between the dorsal stream, specialized in spatio-temporal information, and the ventral stream, processing essentially form information. However, these two pathways also communicate to share much visual information. These dorso-ventral interactions have been studied using form-from-motion (FfM) stimuli, revealing that FfM perception first activates dorsal regions (e.g., MT+/V5), followed by successive activations of ventral regions (e.g., LOC). However, relatively little is known about the implications of focal brain damage of visual areas on these dorso-ventral interactions. In the present case report, we investigated the dynamics of dorsal and ventral activations related to FfM perception (using topographical ERP analysis and electrical source imaging) in a patient suffering from a deficit in FfM perception due to right extrastriate brain damage in the ventral stream. Despite the patient’s FfM impairment, both successful (observed for the highest level of FfM signal) and absent/failed FfM perception evoked the same temporal sequence of three processing states observed previously in healthy subjects. During the first period, brain source localization revealed cortical activations along the dorsal stream, currently associated with preserved elementary motion processing. During the latter two periods, the patterns of activity differed from normal subjects: activations were observed in the ventral stream (as reported for normal subjects), but also in the dorsal pathway, with the strongest and most sustained activity localized in the parieto-occipital regions. On the other hand, absent/failed FfM perception was characterized by weaker brain activity, restricted to the more lateral regions. This study shows that in the present case report, successful FfM perception, while following the same temporal sequence of processing steps as in normal subjects, evoked different patterns of brain activity. By revealing a brain circuit involving the most rostral part of the dorsal pathway, this study provides further support for neuro-imaging studies and brain lesion investigations that have suggested the existence of different brain circuits associated with different profiles of interaction between the dorsal and the ventral streams.