Linda Jeffery

Fitting the mind to the World Face Adaptation and Attractiveness Aftereffects

Average faces are attractive, but what is average depends on experience. We examined the effect of brief exposure to consistent facial distortions on what looks normal (average) and what looks attractive. Adaptation to a consistent distortion shifted what looked most normal, and what looked most attractive, toward that distortion. These normality and attractiveness aftereffects occurred when the adapting and test faces differed in orientation by 90° (∓45° vs. −45°), suggesting adaptation of high-level neurons whose coding is not strictly retino-topic. Our results suggest that perceptual adaptation can rapidly recalibrate peoples preferences to fit the faces they see. The results also suggest that average faces are attractive because of their central location in a distribution of faces (i.e., prototypicality), rather than because of any intrinsic appeal of particular physical characteristics. Recalibration of preferences may have important consequences, given the powerful effects of perceived attractiveness on person perception, mate choice, social interactions, and social outcomes for individuals.

The dynamics of visual adaptation to faces.

Several recent demonstrations using visual adaptation have revealed high-level aftereffects for complex patterns including faces. While traditional aftereffects involve perceptual distortion of simple attributes such as orientation or colour that are processed early in the visual cortical hierarchy, face adaptation affects perceived identity and expression, which are thought to be products of higher-order processing. And, unlike most simple aftereffects, those involving faces are robust to changes in scale, position and orientation between the adapting and test stimuli. These differences raise the question of how closely related face aftereffects are to traditional ones. Little is known about the build-up and decay of the face aftereffect, and the similarity of these dynamic processes to traditional aftereffects might provide insight into this relationship. We examined the effect of varying the duration of both the adapting and test stimuli on the magnitude of perceived distortions in face identity. We found that, just as with traditional aftereffects, the identity aftereffect grew logarithmically stronger as a function of adaptation time and exponentially weaker as a function of test duration. Even the subtle aspects of these dynamics, such as the power-law relationship between the adapting and test durations, closely resembled that of other aftereffects. These results were obtained with two different sets of face stimuli that differed greatly in their low-level properties. We postulate that the mechanisms governing these shared dynamics may be dissociable from the responses of feature-selective neurons in the early visual cortex.

Orientation-contingent face aftereffects and implications for face-coding mechanisms.

Humans have an impressive ability to discriminate between faces despite their similarity as visual patterns. This expertise relies on configural coding of spatial relations between face features and/or holistic coding of overall facial structure. These expert face-coding mechanisms appear to be engaged most effectively by upright faces, with inverted faces engaging primarily feature-coding mechanisms. We show that opposite figural aftereffects can be induced simultaneously for upright and inverted faces, demonstrating that distinct neural populations code upright and inverted faces. This result also suggests that expert (upright) face-coding mechanisms can be selectively adapted. These aftereffects occur for judgments of face normality and face gender and are robust to changes in face size, ruling out adaptation of low-level, retinotopically organized coding mechanisms. Our results suggest a resolution of a paradox in the face recognition literature. Neuroimaging studies have found surprisingly little orientation selectivity in the fusiform face area (FFA) despite evidence that this region plays a role in expert face coding and that expert face-coding mechanisms are selectively engaged by upright faces. Our results, demonstrating orientation-contingent adaptation of face-coding mechanisms, suggest that the FFAs apparent lack of orientation selectivity may be an artifact of averaging across distinct populations within the FFA that respond to upright and inverted faces.

Sex‐typicality and attractiveness: Are supermale and superfemale faces super‐attractive?

Many animals find extreme versions of secondary sexual characteristics attractive, and such preferences can enhance reproductive success (Andersson, 1994). We hypothesized, therefore, that extreme versions of sex-typical traits may be attractive in human faces. We created supermale and superfemale faces by exaggerating all spatial differences between an average male and an average female face. In Expt 1 the male average was preferred to a supermale (50% exaggeration of differences from the female average). There was no clear preference for the female average or the superfemale (50% exaggeration). In Expt 2, participants chose the most attractive face from sets of images containing feminized as well as masculinized images for each sex, and spanning a wider range of exaggeration levels than in Expt 1. Chinese sets were also shown, to see whether similar preferences would occur for a less familiar race (participants were Caucasian). The most attractive female image was significantly feminized for faces of both races. However, the most attractive male image for both races was also significantly feminized. These results indicate that feminization, rather than sex exaggeration per se, is attractive in human faces, and they corroborate similar findings by Perrett et al. (1998).

Sex-specific norms code face identity.

Face identity aftereffects suggest that an average face, which is continuously updated by experience, functions as a norm for coding identity. Sex-contingent figural face aftereffects indicate that different norms are maintained for male and female faces but do not directly implicate them in coding identity. Here, we investigated whether sex-specific norms are used to code the identities of male and female faces or whether a generic, androgynous norm is used for all faces. We measured identity aftereffects for adapt-test pairs that were opposite relative to a sex-specific average and pairs that were opposite relative to an androgynous average. Identity aftereffects are generally larger for adapt-test pairs that lie opposite an average face, which functions as a norm for coding identity, than those that do not. Therefore, we reasoned that whichever average gives the larger aftereffect would be closer to the true psychological norm. Aftereffects were substantially and significantly larger for pairs that lie opposite a sex-specific than an androgynous average. This difference remained significant after correcting for differences in test trajectory length. These results indicate that, despite the common structure shared by all faces, identity is coded using sex-specific norms. We suggest that the use of category-specific norms may increase coding efficiency and help us discriminate thousands of faces despite their similarity as patterns.

Abnormal Adaptive Face-Coding Mechanisms in Children with Autism Spectrum Disorder

In low-level vision, exquisite sensitivity to variation in luminance is achieved by adaptive mechanisms that adjust neural sensitivity to the prevailing luminance level. In high-level vision, adaptive mechanisms contribute to our remarkable ability to distinguish thousands of similar faces [1]. A clear example of this sort of adaptive coding is the face-identity aftereffect [2, 3, 4, 5], in which adaptation to a particular face biases perception toward the opposite identity. Here we investigated face adaptation in children with autism spectrum disorder (ASD) by asking them to discriminate between two face identities, with and without prior adaptation to opposite-identity faces. The ASD group discriminated the identities with the same precision as did the age- and ability-matched control group, showing that face identification per se was unimpaired. However, children with ASD showed significantly less adaptation than did their typical peers, with the amount of adaptation correlating significantly with current symptomatology, and face aftereffects of children with elevated symptoms only one third those of controls. These results show that although children with ASD can learn a simple discrimination between two identities, adaptive face-coding mechanisms are severely compromised, offering a new explanation for previously reported face-perception difficulties [6, 7, 8] and possibly for some of the core social deficits in ASD [9, 10].

A critical review of the development of face recognition: Experience is less important than previously believed

Historically, it has been argued that face individuation develops very slowly, not reaching adult levels until adolescence, with experience being the driving force behind this protracted improvement. Here, we challenge this view based on extensive review of behavioural and neural findings. Results demonstrate qualitative presence of all key phenomena related to face individuation (encoding of novel faces, holistic processing effects, face-space effects, face-selective responses in neuroimaging) at the earliest ages tested, typically 3–5 years of age and in many cases even infancy. Results further argue for quantitative maturity by early childhood, based on an increasing number of behavioural studies that have avoided the common methodological problem of restriction of range, as well as event-related potential (ERP), but not functional magnetic resonance imaging (fMRI) studies. We raise a new possibility that could account for the discrepant fMRI findings—namely, the use of adult-sized head coils on child-sized heads. We review genetic and innate contributions to face individuation (twin studies, neonates, visually deprived monkeys, critical periods, perceptual narrowing). We conclude that the role of experience in the development of the mechanisms of face identification has been overestimated. The emerging picture is that the mechanisms supporting face individuation are mature early, consistent with the social needs of children for reliable person identification in everyday life, and are also driven to an important extent by our evolutionary history.

The timecourse of higher-level face aftereffects

Perceptual aftereffects for simple visual attributes processed early in the cortical hierarchy increase logarithmically with adapting duration and decay exponentially with test duration. This classic timecourse has been reported recently for a face identity aftereffect [Leopold, D. A., Rhodes, G., Müller, K.-M., & Jeffery, L. (2005). The dynamics of visual adaptation to faces. Proceedings of the Royal Society of London, Series B, 272, 897-904], suggesting that the dynamics of visual adaptation may be similar throughout the visual system. An alternative interpretation, however, is that the classic timecourse is a flow-on effect of adaptation of a low-level, retinotopic component of the face identity aftereffect. Here, we examined the timecourse of the higher-level (size-invariant) components of two face aftereffects, the face identity aftereffect and the figural face aftereffect. Both showed the classic pattern of logarithmic build-up and exponential decay. These results indicate that the classic timecourse of face aftereffects is not a flow-on effect of low-level retinotopic adaptation, and support the hypothesis that dynamics of visual adaptation are similar at higher and lower levels of the cortical visual hierarchy. They also reinforce the perceptual nature of face aftereffects, ruling out demand characteristics and other post-perceptual factors as plausible accounts.

View-Specific Coding of Face Shape

Monkey and human cortex contain view-specific face neurons, but it remains unclear whether they code face shape. We tested the view specificity of face-shape coding by inducing figural face aftereffects at one viewpoint (3/4 left) and testing generalization to different viewpoints (front view and 3/4 right). The aftereffects were induced by adaptation to consistent figural distortions (contracted or expanded), which shifts the distortion perceived as most normal toward the adapting distortion. The strong aftereffect that was observed at the adapting view was significantly and substantially reduced for both front-view test faces and mirror-image (3/4 right) test faces, indicating view specificity. The limited transfer across mirror views is strong evidence of view specificity, given their figural similarity. The aftereffects survived a size change between adaptation and test faces (Experiment 2), a result that rules out low-level adaptation as an explanation. These results provide strong evidence that face-shape coding is view-specific.

Are average and symmetric faces attractive to infants? Discrimination and looking preferences

Young infants prefer to look at faces that adults find attractive, suggesting a biological basis for some face preferences. However, the basis for infant preferences is not known. Adults find average and symmetric faces attractive. We examined whether 5–8-month-old infants discriminate between different levels of averageness and symmetry in faces, and whether they prefer to look at faces with higher levels of these traits. Each infant saw 24 pairs of female faces. Each pair consisted of two versions of the same face differing either in averageness (12 pairs) or symmetry (12 pairs). Data from the mothers confirmed that adults preferred the more average and more symmetric versions in each pair. The infants were sensitive to differences in both averageness and symmetry, but showed no looking preference for the more average or more symmetric versions. On the contrary, longest looks were significantly longer for the less average versions, and both longest looks and first looks were marginally longer for the less symmetric versions. Mean looking times were also longer for the less average and less symmetric versions, but those differences were not significant. We suggest that the infant looking behaviour may reflect a novelty preference rather than an aesthetic preference.