Christine Schiltz

Effect of familiarity on the processing of human faces

Most brain imaging studies on face perception have investigated the processing of unknown faces and addressed mainly the question of specific face processing in the human brain. The goal of this study was to highlight the effects of familiarity on the visual processing of faces. Using [15O]water 3D Positron Emission Tomography, regional cerebral blood flow distribution was measured in 11 human subjects performing an identical task (gender categorization) on both unknown and known faces. Subjects also performed two control tasks (a face recognition task and a visual pattern discrimination task). They were scanned after a training phase using videotapes during which they had been familiarized with and learned to recognize a set of faces. Two major results were obtained. On the one hand, we found bilateral activations of the fusiform gyri in the three face conditions, including the so-called fusiform-face area, a region in the right fusiform gyrus specifically devoted to face processing. This common activation suggests that different cognitive tasks performed on known and unknown faces require the involvement of this fusiform region. On the other hand, specific regional cerebral blood flow changes were related to the processing of known and unknown faces. The left amygdala, a structure involved in implicit learning of visual representations, was activated by the categorization task on unknown faces. The same task on known faces induced a relative decrease of activity in early visual areas. These differences between the two categorization tasks reveal that the human brain processes known and unknown faces differently.

Local discriminability determines the strength of holistic processing for faces in the fusiform face area

Recent evidence suggests that the Fusiform Face Area (FFA) is not exclusively dedicated to the interactive processing of face features, but also contains neurons sensitive to local features. This suggests the existence of both interactive and local processing modes, consistent with recent behavioral findings that the strength of interactive feature processing (IFP) engages most strongly when similar features need to be disambiguated. Here we address whether the engagement of the FFA into interactive versus featural representational modes is governed by local feature discriminability. We scanned human participants while they matched target features within face pairs, independently of the context of distracter features. IFP was operationalized as the failure to match the target without being distracted by distracter features. Picture-plane inversion was used to disrupt IFP while preserving input properties. We found that FFA activation was comparably strong, irrespective of whether similar target features were embedded in dissimilar contexts(i.e., inducing robust IFP) or dissimilar target features were embedded in the same context (i.e., engaging local processing). Second, inversion decreased FFA activation to faces most robustly when similar target features were embedded in dissimilar contexts, indicating that FFA engages into IFP mainly when features cannot be disambiguated at a local level. Third, by means of Spearman rank correlation tests, we show that the local processing of feature differences in the FFA is supported to a large extent by the Occipital Face Area, the Lateral Occipital Complex, and early visual cortex, suggesting that these regions encode the local aspects of face information. The present findings confirm the co-existence of holistic and featural representations in the FFA. Furthermore, they establish FFA as the main contributor to the featural/holistic representational mode switches determined by local discriminability.

Neuronal Mechanisms of Perceptual Learning: Changes in Human Brain Activity with Training in Orientation Discrimination

Using 15O-water 3D positron emission tomography, regional cerebral blood flow was measured twice in six human subjects: before and after extensive training in orientation discrimination. In each session subjects performed two orientation discrimination tasks, during which they discriminated the orientation of a grating at either the trained or untrained reference orientation, and a control task, during which they detected a randomly textured pattern. By comparing the discrimination to the detection tasks, we observed a main effect of task bilaterally in the posterior occipital cortex, extending into the left posterior fusiform gyrus and the right inferior occipital gyrus, bilaterally in the intraparietal sulcus, as well as in the cerebellum, thalamus, and brainstem. When we compared the activation pattern before and after the training period, all the changes observed were activity decreases. The nonspecific changes, which were not related to the orientation used during the training, were situated in the cerebellum and bilaterally in the extrastriate visual cortex. The orientation-specific changes, on the other hand, were restricted to the striate and extrastriate visual cortex, more precisely the right calcarine sulcus, the left lingual gyrus, the left middle occipital, and the right inferior occipital gyrus. These findings confirm our hypothesis concerning the existence of learning related changes at early levels of visual processing in human adults and suggest that mechanisms resulting in neuronal activity decreases might be involved in the present kind of learning.

How Does the Brain Discriminate Familiar and Unfamiliar Faces?: A PET Study of Face Categorical Perception

Where and how does the brain discriminate familiar and unfamiliar faces? This question has not been answered yet by neuroimaging studies partly because different tasks were performed on familiar and unfamiliar faces, or because familiar faces were associated with semantic and lexical information. Here eight subjects were trained during 3 days with a set of 30 faces. The familiarized faces were morphed with unfamiliar faces. Presented with continua of unfamiliar and familiar faces in a pilot experiment, a group of eight subjects presented a categorical perception of face familiarity: there was a sharp boundary in percentage of familiarity decisions between 40 and 60 faces. In the main experiment, subjects were scanned (PET) on the fourth day (after 3 days of training) in six conditions, all requiring a sex classification task. Completely novel faces (0) were presented in Condition 1 and familiar faces (100) in Condition 6, while faces of steps of 20 in the continuum of familiarity were presented in Conditions 2 to 5 (20 to 80). A principal component analysis (PCA) indicated that most variations in neural responses were related to the dissociation between faces perceived as familiar (60 to 100) and faces perceived as unfamiliar (0 to 40). Subtraction analyses did not disclose any increase of activation for faces perceived as familiar while there were large relative increases for faces perceived as unfamiliar in several regions of the right occipito-temporal visual pathway. These changes were all categorical and were observed mainly in the right middle occipital gyrus, the right posterior fusiform gyrus, and the right inferotemporal cortex. These results show that (1) the discrimination between familiar and unfamiliar faces is related to relative increases in the right ventral pathway to unfamiliar/novel faces; (2) familiar and unfamiliar faces are discriminated in an all-or-none fashion rather than proportionally to their resemblance to stored representations; and (3) categorical perception of faces is associated with abrupt changes of brain activity in the regions that discriminate the two extremes of the multidimensional continuum.

From Coarse to Fine? Spatial and Temporal Dynamics of Cortical Face Processing

Primary vision segregates information along 2 main dimensions: orientation and spatial frequency (SF). An important question is how this primary visual information is integrated to support high-level representations. It is generally assumed that the information carried by different SF is combined following a coarse-to-fine sequence. We directly addressed this assumption by investigating how the network of face-preferring cortical regions processes distinct SF over time. Face stimuli were flashed during 75, 150, or 300 ms and masked. They were filtered to preserve low SF (LSF), middle SF (MSF), or high SF (HSF). Most face-preferring regions robustly responded to coarse LSF, face information in early stages of visual processing (i.e., until 75 ms of exposure duration). LSF processing decayed as a function of exposure duration (mostly until 150 ms). In contrast, the processing of fine HSF, face information became more robust over time in the bilateral fusiform face regions and in the right occipital face area. The present evidence suggests the coarse-to-fine strategy as a plausible modus operandi in high-level visual cortex.

Recovery from adaptation to facial identity is larger for upright than inverted faces in the human occipito-temporal cortex

Human faces look more similar to each other when they are presented upside-down, leading to an increase of error rates and response times during individual face discrimination tasks. Here we used functional magnetic resonance imaging (fMRI) to test the hypothesis that this perceived similarity leads to a lower recovery from identity adaptation for inverted faces than for upright faces in face-sensitive areas of the occipito-temporal cortex. Ten subjects were presented with blocks of upright and inverted faces, with the same face identity repeated consecutively in half of the blocks, and different facial identities repeated in the other blocks. When face stimuli were presented upright, the percent signal change in the bilateral middle fusiform gyrus (MFG) was larger for different faces as compared to same faces, replicating previous observations of a recovery from facial identity adaptation in this region. However, there was no significant recovery from adaptation when different inverted faces were presented. Most interestingly, the difference in activation between upright and inverted faces increased progressively during a block when different facial identities were presented. A similar pattern of activation was found in the left middle fusiform gyrus, but was less clear-cut in bilateral face-sensitive areas of the inferior occipital cortex. These findings show that the differential level of activation to upright and inverted faces in the fusiform gyrus is mainly due to a difference in recovery from adaptation, and they explain the discrepancies in the results reported in previous fMRI studies which compared the processing of upright and inverted faces. The lack of recovery from adaptation for inverted faces in the fusiform gyrus may underlie the face inversion effect (FIE), which takes place during perceptual encoding of individual face representations.

The horizontal tuning of face perception relies on the processing of intermediate and high spatial frequencies

It was recently shown that expert face perception relies on the extraction of horizontally oriented visual cues. Picture-plane inversion was found to eliminate horizontal, suggesting that this tuning contributes to the specificity of face processing. The present experiments sought to determine the spatial frequency (SF) scales supporting the horizontal tuning of face perception. Participants were instructed to match upright and inverted faces that were filtered both in the frequency and orientation domains. Faces in a pair contained horizontal or vertical ranges of information in low, middle, or high SF (LSF, MSF, or HSF). Our findings confirm that upright (but not inverted) face perception is tuned to horizontal orientation. Horizontal tuning was the most robust in the MSF range, next in the HSF range, and absent in the LSF range. Moreover, face inversion selectively disrupted the ability to process horizontal information in MSF and HSF ranges. This finding was replicated even when task difficulty was equated across orientation and SF at upright orientation. Our findings suggest that upright face perception is tuned to horizontally oriented face information carried by intermediate and high SF bands. They further indicate that inversion alters the sampling of face information both in the orientation and SF domains.

PET STUDY OF HUMAN VOLUNTARY SACCADIC EYE MOVEMENTS IN DARKNESS : EFFECT OF TASK REPETITION ON THE ACTIVATION PATTERN

Using H215O 3D Positron Emission Tomography (PET), regional cerebral blood flow (rCBF) was measured in six human subjects under two different conditions: at rest and while performing self‐paced horizontal saccadic eye movements in darkness. These two conditions were repeated four times each.

Are patients with Parkinson's disease blind to blindsight?

Diederich et al. propose that patients with Parkinson’s disease are “blind to blindsight” as they show preserved conscious vision, but erroneous “guess” localization of visual stimuli, poor saccades/motion perception, and poor emotional face perception with blunted autonomic reactions. Changes may reflect dysfunction of the phylogenetically old subconscious retino-colliculo-thalamo-amygdala and retino-geniculo-extrastriate pathways.

Face perception is tuned to horizontal orientation in the N170 time window.

The specificity of face perception is thought to reside both in its dramatic vulnerability to picture-plane inversion and its strong reliance on horizontally oriented image content. Here we asked when in the visual processing stream face-specific perception is tuned to horizontal information. We measured the behavioral performance and scalp event-related potentials (ERP) when participants viewed upright and inverted images of faces and cars (and natural scenes) that were phase-randomized in a narrow orientation band centered either on vertical or horizontal orientation. For faces, the magnitude of the inversion effect (IE) on behavioral discrimination performance was significantly reduced for horizontally randomized compared to vertically or nonrandomized images, confirming the importance of horizontal information for the recruitment of face-specific processing. Inversion affected the processing of nonrandomized and vertically randomized faces early, in the N170 time window. In contrast, the magnitude of the N170 IE was much smaller for horizontally randomized faces. The present research indicates that the early face-specific neural representations are preferentially tuned to horizontal information and offers new perspectives for a description of the visual information feeding face-specific perception.