Carrie A. Joyce

Early lateralization and orientation tuning for face, word, and object processing in the visual cortex.

Event-related potential (ERP) studies of the human brain have shown that object categories can be reliably distinguished as early as 130-170 ms on the surface of occipito-temporal cortex, peaking at the level of the N170 component. Consistent with this finding, neuropsychological and neuroimaging studies suggest major functional distinctions within the human object recognition system, particularly in hemispheric advantage, between the processing of words (left), faces (right), and objects (bilateral). Given these observations, our aim was to (1) characterize the differential response properties of the N170 to pictures of faces, objects, and words across hemispheres; and (2) test whether an effect of inversion for highly familiar and monooriented nonface stimuli such as printed words can be observed at the level of the N170. Scalp EEG (53 channels) was recorded in 15 subjects performing an orientation decision task with pictures of faces, words, and cars presented upright or inverted. All three categories elicited at the same latency a robust N170 component associated with a positive counterpart at centro-frontal sites (vertex-positive potential, VPP). While there were minor amplitude differences at the level of the occipital medial P1 between linguistic and nonlinguistic categories, scalp topographies and source analyses indicated strong hemispheric and orientation effects starting at the level of the N170, which was right lateralized for faces, smaller and bilateral for cars, and as large for printed words in the left hemisphere as for faces. The entire N170/VPP complex was accounted for by two dipolar sources located in the lateral inferior occipital cortex/posterior fusiform gyrus. These two locations were roughly equivalent across conditions but differed in strength and lateralization. Inversion delayed the N170 (and VPP) response for all categories, with an increasing delay for cars, words, and faces, respectively, as suggested by source modeling analysis. Such results show that early processes in object recognition respond to category-specific visual information, and are associated with strong lateralization and orientation bias.

Evidence and a Computational Explanation of Cultural Differences in Facial Expression Recognition

Facial expressions are crucial to human social communication, but the extent to which they are innate and universal versus learned and culture dependent is a subject of debate. Two studies explored the effect of culture and learning on facial expression understanding. In Experiment 1, Japanese and U.S. participants interpreted facial expressions of emotion. Each group was better than the other at classifying facial expressions posed by members of the same culture. In Experiment 2, this reciprocal in-group advantage was reproduced by a neurocomputational model trained in either a Japanese cultural context or an American cultural context. The model demonstrates how each of us, interacting with others in a particular cultural context, learns to recognize a culture-specific facial expression dialect.

Tracking eye fixations with electroocular and electroencephalographic recordings

We describe a method, based on recordings of the electroencephalogram (EEG) and eye movement potentials (electrooculogram), to track where on a screen (x,y coordinates) an individual is fixating. The method makes use of an empirically derived beam-forming filter (derived from a sequence of calibrated eye movements) to isolate eye motion from other electrophysiological and ambient electrical signals. Electrophysiological researchers may find this method a simple and inexpensive means of tracking eye movements and a useful complement to scalp recordings in studies of cognitive phenomena. The resolution is comparable to that of many commercial systems; the method can be implemented with as few as four electrodes around the eyes to complement the EEG electrodes already in use. This method may also find some specialized applications such as studying eye movements during sleep and in human-machine interfaces that make use of gaze information.

An electrophysiological analysis of modality-specific aspects of word repetition

Priming effects to words are reduced when modality changes from study to test. This change was examined here using behavioral and electrophysiological measures of priming. During the study, half of the words were presented visually and half auditorally; during a subsequent lexical decision test, all words were presented visually. Lexical decisions were faster for within- than cross-modality repetitions. In contrast, modality influenced recognition only for low-frequency words. During lexical decision, event-related brain potentials were more positive to studied than unstudied words (200-500 ms). A larger and shorter duration effect was observed for within- than cross-modality repetitions (300-400 ms). This later effect is viewed as an electrophysiological index of modality-specific processing associated with priming. Results suggest that multiple events--both modality-specific and modality-nonspecific--underlie perceptual priming phenomena.

Memory changes with normal aging: Behavioral and electrophysiological measures

We examined performance in young and elderly on an implicit (lexical decision) and an explicit (recognition) memory test. The difference in lexical decision times between old and new words was equivalent in the two groups, although the elderly were slower. In both groups, recognition accuracy (lower in the elderly) was higher following semantic than nonsemantic encoding, whereas lexical decision times were unaffected. Divergent brain potentials for old and new words during lexical decisions constituted a repetition effect, which reflected greater positivity (200-800 ms) for old words, particularly over the left hemisphere; this effect was smaller and later in the elderly. An electrophysiological marker of enhanced recollection for words from the semantic encoding task took the form of a left-sided positivity (500-800 ms). The effect was smaller in the elderly than the young, providing an additional index of their impaired recognition processes.

Event-Related Potential Correlates of Long-Term Memory for Briefly Presented Faces

Electrophysiological studies have investigated the nature of face recognition in a variety of paradigms; some have contrasted famous and novel faces in explicit memory paradigms, others have repeated faces to examine implicit memory/ priming. If the general finding that implicit memory can last for up to several months also holds for novel faces, a reliable measure of it could have practical application for eyewitness testimony, given that explicit measures of eyewitness memory have at times proven fallible. The current study aimed to determine whether indirect behavioral and electrophysiological measures might yield reliable estimates of face memory over longer intervals than have typically been obtained with priming manipulations. Participants were shown 192 faces and then tested for recognition at four test delays ranging from immediately up to 1 week later. Three event-related brain potential components (e.g., N250r, N400f, and LPC) varied with memory measures although only the N250r varied regardless of explicit recognition, that is, with both repetition and recognition.

SOLVING THE VISUAL EXPERTISE MYSTERY

Through brain imaging studies and studies of brain-lesioned patients with face or object recognition deflcits, the fusiform face area (FFA) has been identifled as a face-speciflc processing area. Recent work, however, illustrates that the FFA is also responsive to a wide variety of non-face objects if levels of discrimination and expertise are controlled. The mystery is why an expertise area, whose initial domain of expertise is presumably faces, would be recruited for these other domains. Here we show that features tuned for flne-level discrimination within one visually homogeneous class have high-variance responses across that class. This variability generalizes to other homogenous classes, providing a foothold for learning.

Variability in AC amplifier distortions: Estimation and correction

AC amplifiers can introduce significant distortions into the low frequency and DC components of recorded electrophysiological data such as event-related potentials (ERPs). Methods for correcting such distortions (i.e., estimating the waveform of the original data) after the data have been amplified and recorded rely on an accurate estimate of the amplifiers time constant (TC). We show that the filter characteristics of AC amplifiers in at least some commercially available ERP recording instruments may vary considerably across individual channels, even when each houses an identical AC amplifier circuit. Clearly, distortion correction methods must take this variability into account. We propose an empirical means of estimating the correct TC value. This approach yields more accurate correction than those based on TCs calculated analytically.