Roberto Caldara

Holistic Processing Is Finely Tuned for Faces of One's Own Race

Recognizing individual faces outside ones race poses difficulty, a phenomenon known as the other-race effect. Most researchers agree that this effect results from differential experience with same-race (SR) and other-race (OR) faces. However, the specific processes that develop with visual experience and underlie the other-race effect remain to be clarified. We tested whether the integration of facial features into a whole representation—holistic processing—was larger for SR than OR faces in Caucasians and Asians without life experience with OR faces. For both classes of participants, recognition of the upper half of a composite-face stimulus was more disrupted by the bottom half (the composite-face effect) for SR than OR faces, demonstrating that SR faces are processed more holistically than OR faces. This differential holistic processing for faces of different races, probably a byproduct of visual experience, may be a critical factor in the other-race effect.

Culture Shapes How We Look at Faces

Background Face processing, amongst many basic visual skills, is thought to be invariant across all humans. From as early as 1965, studies of eye movements have consistently revealed a systematic triangular sequence of fixations over the eyes and the mouth, suggesting that faces elicit a universal, biologically-determined information extraction pattern. Methodology/Principal Findings Here we monitored the eye movements of Western Caucasian and East Asian observers while they learned, recognized, and categorized by race Western Caucasian and East Asian faces. Western Caucasian observers reproduced a scattered triangular pattern of fixations for faces of both races and across tasks. Contrary to intuition, East Asian observers focused more on the central region of the face. Conclusions/Significance These results demonstrate that face processing can no longer be considered as arising from a universal series of perceptual events. The strategy employed to extract visual information from faces differs across cultures.

Facial expressions of emotion are not culturally universal

Since Darwin’s seminal works, the universality of facial expressions of emotion has remained one of the longest standing debates in the biological and social sciences. Briefly stated, the universality hypothesis claims that all humans communicate six basic internal emotional states (happy, surprise, fear, disgust, anger, and sad) using the same facial movements by virtue of their biological and evolutionary origins [Susskind JM, et al. (2008) Nat Neurosci 11:843–850]. Here, we refute this assumed universality. Using a unique computer graphics platform that combines generative grammars [Chomsky N (1965) MIT Press, Cambridge, MA] with visual perception, we accessed the mind’s eye of 30 Western and Eastern culture individuals and reconstructed their mental representations of the six basic facial expressions of emotion. Cross-cultural comparisons of the mental representations challenge universality on two separate counts. First, whereas Westerners represent each of the six basic emotions with a distinct set of facial movements common to the group, Easterners do not. Second, Easterners represent emotional intensity with distinctive dynamic eye activity. By refuting the long-standing universality hypothesis, our data highlight the powerful influence of culture on shaping basic behaviors once considered biologically hardwired. Consequently, our data open a unique nature–nurture debate across broad fields from evolutionary psychology and social neuroscience to social networking via digital avatars.

Does Prosopagnosia Take the Eyes Out of Face Representations? Evidence for a Defect in Representing Diagnostic Facial Information following Brain Damage

One of the most impressive disorders following brain damage to the ventral occipitotemporal cortex is prosopagnosia, or the inability to recognize faces. Although acquired prosopagnosia with preserved general visual and memory functions is rare, several cases have been described in the neuropsychological literature and studied at the functional and neural level over the last decades. Here we tested a brain-damaged patient (PS) presenting a deficit restricted to the category of faces to clarify the nature of the missing and preserved components of the face processing system when it is selectively damaged. Following learning to identify 10 neutral and happy faces through extensive training, we investigated patient PSs recognition of faces using Bubbles, a response classification technique that sampled facial information across the faces in different bandwidths of spatial frequencies [Gosselin, F., & Schyns, P. E., Bubbles: A technique to reveal the use of information in recognition tasks. Vision Research, 41, 2261-2271, 2001]. Although PS gradually used less information (i.e., the number of bubbles) to identify faces over testing, the total information required was much larger than for normal controls and decreased less steeply with practice. Most importantly, the facial information used to identify individual faces differed between PS and controls. Specifically, in marked contrast to controls, PS did not use the optimal eye information to identify familiar faces, but instead the lower part of the face, including the mouth and the external contours, as normal observers typically do when processing unfamiliar faces. Together, the findings reported here suggest that damage to the face processing system is characterized by an inability to use the information that is optimal to judge identity, focusing instead on suboptimal information.

Event-related potentials and time course of the "other-race" face classification advantage.

Other-race faces are less accurately recognized than same race faces but classified faster by race. Using event-related potentials (ERPs), we captured the brain temporal dynamics of face classification by race processing performed by 12 Caucasian participants. As expected, participants were faster to classify by race Asian than Caucasian faces. ERPs results identified the occurrence of the other-race face classification advantage at around 240 ms, in a stage related to the processing of visual information at the semantic level. The elaboration of individual face structural representation, reflected in the N170 face-sensitive component, was insufficient to achieve this process. Altogether, these findings suggest that the lesser experience of other-race faces engender fewer semantic representations, which in turn accelerate their speed of processing.

Face versus non-face object perception and the 'other-race' effect: a spatio-temporal event-related potential study.

OBJECTIVE To investigate a modulation of the N170 face-sensitive component related to the perception of other-race (OR) and same-race (SR) faces, as well as differences in face and non-face object processing, by combining different methods of event-related potential (ERP) signal analysis. METHODS Sixty-two channel ERPs were recorded in 12 Caucasian subjects presented with Caucasian and Asian faces along with non-face objects. Surface data were submitted to classical waveforms and ERP map topography analysis. Underlying brain sources were estimated with two inverse solutions (BESA and LORETA). RESULTS The N170 face component was identical for both race faces. This component and its topography revealed a face specific pattern regardless of race. However, in this time period OR faces evoked significantly stronger medial occipital activity than SR faces. Moreover, in terms of maps, at around 170 ms face-specific activity significantly preceded non-face object activity by 25 ms. These ERP maps were followed by similar activation patterns across conditions around 190-300 ms, most likely reflecting the activation of visually derived semantic information. CONCLUSIONS The N170 was not sensitive to the race of the faces. However, a possible pre-attentive process associated to the relatively stronger unfamiliarity for OR faces was found in medial occipital area. Moreover, our data provide further information on the time-course of face and non-face object processing.

Neural repetition suppression to identity is abolished by other-race faces.

Human beings are remarkably skilled at recognizing faces, with the marked exception of other-race faces: the so-called “other-race effect.” As reported nearly a century ago [Feingold CA (1914) Journal of Criminal Law and Police Science 5:39–51], this face-recognition impairment is accompanied by the popular belief that other-race faces all look alike. However, the neural mechanisms underlying this high-level “perceptual illusion” are still unknown. To address this question, we recorded high-resolution electrophysiological scalp signals from East Asian (EA) and Western Caucasian (WC) observers as they viewed two EA or WC faces. The first adaptor face was followed by a target face of either the same or different identity. We quantified repetition suppression (RS), a reduction in neural activity in stimulus-sensitive regions following stimulus repetition. Conventional electrophysiological analyses on target faces failed to reveal any RS effect. However, to fully account for the paired nature of RS events, we subtracted the signal elicited by target to adaptor faces for each single trial and performed unbiased spatiotemporal data-driven analyses. This unique approach revealed stronger RS to same-race faces of same identity in both groups of observers on the face-sensitive N170 component. Such neurophysiological modulation in RS suggests efficient identity coding for same-race faces. Strikingly, OR faces elicited identical RS regardless of identity, all looking alike to the neural population underlying the N170. Our data show that sensitivity to race begins early at the perceptual level, providing, after nearly 100 y of investigations, a neurophysiological correlate of the “all look alike” perceptual experience.

Inverting faces elicits sensitivity to race on the N170 component: A cross-cultural study

Human beings are natural experts at processing faces, with some notable exceptions. Same-race faces are better recognized than other-race faces: the so-called other-race effect (ORE). Inverting faces impairs recognition more than for any other inverted visual object: the so-called face inversion effect (FIE). Interestingly, the FIE is stronger for same- compared to other-race faces. At the electrophysiological level, inverted faces elicit consistently delayed and often larger N170 compared to upright faces. However, whether the N170 component is sensitive to race is still a matter of ongoing debate. Here we investigated the N170 sensitivity to race in the framework of the FIE. We recorded EEG from Western Caucasian and East Asian observers while presented with Western Caucasian, East Asian and African American faces in upright and inverted orientations. To control for potential confounds in the EEG signal that might be evoked by the intrinsic and salient differences in the low-level properties of faces from different races, we normalized their amplitude-spectra, luminance and contrast. No differences on the N170 were observed for upright faces. Critically, inverted same-race faces lead to greater recognition impairment and elicited larger N170 amplitudes compared to inverted other-race faces. Our results indicate a finer-grained neural tuning for same-race faces at early stages of processing in both groups of observers.

Controlling interstimulus perceptual variance does not abolish N170 face sensitivity.

Numerous studies report a negative event-related potential at occipito-temporal scalp sites between 130 and 200 ms (N170) that is larger when elicited by faces than by other object categories. Thierry and colleagues argued that this effect reflects an artifact of uncontrolled interstimulus perceptual (physical) variance (ISPV), which when controlled eliminates the difference between faces and nonfaces.

Actual and mental motor preparation and execution: a spatiotemporal ERP study

Studies evaluating the role of the executive motor system in motor imagery came to a general agreement in favour of the activation of the primary motor area (M1) during imagery, although in reduced proportion as compared to motor execution. It is still unclear whether this difference occurs within the preparation period or the execution period of the movement, or both. In the present study, EEG was used to investigate separately the preparation and the execution periods of overt and covert movements in adults. We designed a paradigm that randomly mixed actual and kinaesthetic imagined trials of an externally paced sequence of finger key presses. Sixty channel event-related potentials were recorded to capture the cerebral activations underlying the preparation for motor execution and motor imagery, as well as cerebral activations implied in motor execution and motor imagery. Classical waveform analysis was combined with data-driven spatiotemporal segmentation analysis. In addition, a LAURA source localization algorithm was applied to functionally define brain related motor areas. Our results showed first that the difference between actual and mental motor acts takes place at the late stage of the preparation period and consists of a quantitative modulation of the activity of common structures in M1. Second, they showed that primary motor structures are involved to the same extent in the actual or imagined execution of a motor act. These findings reinforce and refine the functional equivalence hypothesis between actual and imagined motor acts.