James W. Tanaka

The NimStim set of facial expressions: Judgments from untrained research participants

A set of face stimuli called the NimStim Set of Facial Expressions is described. The goal in creating this set was to provide facial expressions that untrained individuals, characteristic of research participants, would recognize. This set is large in number, multiracial, and available to the scientific community online. The results of psychometric evaluations of these stimuli are presented. The results lend empirical support for the validity and reliability of this set of facial expressions as determined by accurate identification of expressions and high intra-participant agreement across two testing sessions, respectively.

Parts and wholes in face recognition

Are faces recognized using more holistic representations than other types of stimuli? Taking holistic representation to mean representation without an internal part structure, we interpret the available evidence on this issue and then design new empirical tests. Based on previous research, we reasoned that if a portion of an object corresponds to an explicitly represented part in a hierarchical visual representation, then when that portion is presented in isolation it will be identified relatively more easily than if it did not have the status of an explicitly represented part. The hypothesis that face recognition is holistic therefore predicts that a part of a face will be disproportionately more easily recognized in the whole face than as an isolated part, relative to recognition of the parts and wholes of other kinds of stimuli. This prediction was borne out in three experiments: subjects were more accurate at identifying the parts of faces, presented in the whole object, than they were at identifying the same part presented in isolation, even though both parts and wholes were tested in a forced-choice format and the whole faces differed only by one part. In contrast, three other types of stimuli–-scrambled faces, inverted faces, and houses–-did not show this advantage for part identification in whole object recognition.

Object categories and expertise : Is the basic level in the eye of the beholder?

Classic research on conceptual hierarchies has shown that the interaction be- tween the human perceiver and objects in the environment specifies one level of abstraction for categorizing objects, called the basic level, which plays a primary role in cognition. The question of whether the special psychological status of the basic level can be modified by experience was addressed in three experiments comparing the performance of subjects in expert and novice domains. The main findings were that in the domain of expertise (a) subordinate-level categories were as differentiated as the basic-level categories, (b) subordinate-level names were used as frequently as basic-level names for identifying objects, and(c) subordinate- level categorizations were as fast as basic-level categorizations. Taken together, these results demonstrate that individual differences in domain-specific knowl- edge affect the extent that the basic level is central to categorization. 8 1991 Ara&mir Prccr. Inr

Features and their configuration in face recognition.

Tanaka and Farah (1993) have proposed a holistic approach to face recognition in which information about the features of a face and their configuration are combined together in the face representation. An implication of the holistic hypothesis is that alterations in facial configuration should interfere with retrieval of features. In four experiments, the effect of configuration on feature recognition was investigated by creating two configurations of a face, one with eyes close together and one with eyes far apart. After subjects studied faces presented in one of the two configurations (eyes-close or eyes-far), they were tested for their recognition of features shown in isolation, in a new face configuration, and in the old face configuration. It was found that subjects recognized features best when presented in the old configuration, next best in the new configuration, and poorest in isolation. Moreover, subjects were not sensitive to configural information in inverted faces (Experiment 2) or nonface stimuli (i.e., houses; Experiments 3 and 4). Importantly, for normal faces, altering the spatial location of the eyes not only impaired subjects’ recognition of the eye features but also impaired their recognition of the nose and mouth features—features whose spatial locations were not directly altered. These findings emphasize the interdependency of featural and configural information in a holistic face representation.

A Neural Basis for Expert Object Recognition

Although most adults are considered to be experts in the identification of faces, fewer people specialize in the recognition of other objects, such as birds and dogs. In this research, the neurophysiological processes associated with expert bird and dog recognition were investigated using event-related potentials. An enhanced early negative component (N170, 164 ms) was found when bird and dog experts categorized objects in their domain of expertise relative to when they categorized objects outside their domain of expertise. This finding indicates that objects from well-learned categories are neurologically differentiated from objects from lesser-known categories at a relatively early stage of visual processing.

Holistic and part-based face recognition in children with autism.

BACKGROUND There is substantial evidence that children with autism are impaired in face recognition. Although many researchers have suggested that this impairment derives from a failure of holistic face processing and a tendency to represent and encode faces on a part-by-part basis, this hypothesis has not been tested directly. METHOD Holistic face processing was assessed by comparing childrens ability to recognize a face part (eyes, nose, or mouth) in the context of the whole face in which it was learned with their ability to recognize the same face part in isolation. RESULTS In Study 1, as expected, typically developing 9-year-olds (n = 27) and 11-year-olds (n = 30) were significantly better at recognizing face parts presented in the whole than in the part test condition, and this effect was limited to upright faces and not found for inverted faces. Consistent with prior findings, typically developing children were most accurate when face recognition depended on the eyes. In Study 2, high-functioning children with autism (n = 22) evidenced a whole-test advantage for mouths only, and were markedly deficient when face recognition depended on the eyes. Their pattern of performance diverged from age- and IQ-matched comparison participants (n = 20), who performed similarly to the typically developing children in Study 1. CONCLUSIONS These findings suggest that face recognition abnormalities in autism are not fully explained by an impairment of holistic face processing, and that there is an unusual significance accorded to the mouth region when children with autism process information from peoples faces.

A holistic account of the own-race effect in face recognition: evidence from a cross-cultural study

A robust finding in the cross-cultural research is that peoples memories for faces of their own race are superior to their memories for other-race faces. However, the mechanisms underlying the own-race effect have not been well defined. In this study, a holistic explanation was examined in which Caucasian and Asian participants were asked to recognize features of Caucasian and Asian faces presented in isolation and in the whole face. The main finding was that Caucasian participants recognized own-race faces more holistically than Asian faces whereas Asian participants demonstrated holistic recognition for both own-race and other-race faces. The differences in holistic recognition between Caucasian and Asian participants mirrored differences in their relative experience with own-race and other-race faces. These results suggest that the own-race effect may arise from the holistic recognition of faces from a highly familiar racial group.

Controlling low-level image properties: The SHINE toolbox

Visual perception can be influenced by top-down processes related to the observer’s goals and expectations, as well as by bottom-up processes related to low-level stimulus attributes, such as luminance, contrast, and spatial frequency. When using different physical stimuli across psychological conditions, one faces the problem of disentangling the contributions of low- and high-level factors. Here, we make available the SHINE (spectrum, histogram, and intensity normalization and equalization) toolbox for MATLAB, which we have found useful for controlling a number of image properties separately or simultaneously. The toolbox features functions for specifying the (rotational average of the) Fourier amplitude spectra, for normalizing and scaling mean luminance and contrast, and for exact histogram specification optimized for perceptual visual quality. SHINE can thus be employed for parametrically modifying a number of image properties or for equating them across stimuli to minimize potential low-level confounds in studies on higher level processes.

The Body-Inversion Effect

Researchers argue that faces are recognized via the configuration of their parts. An important behavioral finding supporting this claim is the face-inversion effect, in which inversion impairs recognition of faces more than nonface objects. Until recently, faces were the only class of objects producing the inversion effect for untrained individuals. This study investigated whether the inversion effect extends to human body positions, a class of objects whose exemplars are structurally similar to each other. Three experiments compared the recognition of upright and inverted faces, houses, and body positions using a forced-choice, same/different paradigm. For both reaction time and error data, the recognition of possible human body postures was more affected by inversion than the recognition of houses. Further, the recognition of possible human body postures and recognition of faces showed similar effects of inversion. The inversion effect was diminished for impossible body positions that violated the biomechanical constraints of human bodies. These data suggest that human body positions, like faces, may be processed configurally by untrained viewers.

Activation of Preexisting and Acquired Face Representations: The N250 Event-related Potential as an Index of Face Familiarity

Electrophysiological studies using event-related potentials have demonstrated that face stimuli elicit a greater negative brain potential in right posterior recording sites 170 msec after stimulus onset (N170) relative to nonface stimuli. Results from repetition priming paradigms have shown that repeated exposures of familiar faces elicit a larger negative brainwave (N250r) at inferior temporal sites compared to repetitions of unfamiliar faces. However, less is known about the time course and learning conditions under which the N250 face representation is acquired. In the familiarization phase of the Joe/no Joe task, subjects studied a target Joe face (Jane for female subjects) and, during the course of the experiment, identified a series of sequentially presented faces as either Joe or not Joe. The critical stimulus conditions included the subjects own face, a same-sex Joe ( Jane) face and a same-sex other face. The main finding was that the subjects own face produced a focal negative deflection (N250) in posterior channels relative to nontarget faces. The task-relevant Joe target face was not differentiated from other nontarget faces in the first half of the experiment. However, in the second half, the Joe face produced an N250 response that was similar in magnitude to the own face. These findings suggest that the N250 indexes two types of face memories: a preexperimentally familiar face representation (i.e., the own face and a newly acquired face representation (i.e., the Joe/Jane face) that was formed during the course of the experiment.