Geoffrey F. Woodman

Event-related potential studies of attention

Over the past 30 years, recordings of event-related potentials (ERPs) from normal individuals have played an increasingly important role in our understanding of the mechanisms of attention. This article reviews some of the recent ERP studies of attention, focusing on studies that isolate the operation of attention in specific cognitive subsystems such as perception, working memory, and response selection. Several conclusions are drawn. First, under some conditions attention modulates the initial feedforward volley of neural activity in intermediate visual processing areas. Second, these early effects can be observed for both the voluntary allocation of attention and for the automatic capture of attention following a peripheral visual transient. Third, these effects are present not only when attention is directed to a location in 2-dimensional space, but also when attention is directed to one of two spatially overlapping surfaces. Fourth, attention does not modulate sensory activity unless sensory systems are overloaded; when sensory systems are not taxed, attention may instead operate to influence memory or response processes. That is, attention operates to mitigate information overload in whichever cognitive subsystems are overloaded by a particular combination of stimuli and task.

Electrophysiological measurement of rapid shifts of attention during visual search

The perception of natural visual scenes that contain many objects poses computational problems that are absent when objects are perceived in isolation. Vision researchers have captured this attribute of real-world perception in the laboratory by using visual search tasks, in which subjects search for a target object in arrays containing varying numbers of non-target distractor objects. Under many conditions, the amount of time required to detect a visual search target increases as the number of objects in the stimulus array increases, and some investigators have proposed that this reflects the serial application of attention to the individual objects in the array,. However, other investigators have argued that this pattern of results may instead be due to limitations in the processing capacity of a parallel processing system that identifies multiple objects concurrently,. Here we attempt to address this longstanding controversy by using an electrophysiological marker of the moment-by-moment direction of attention — the N2pc component of the event-related potential waveform — to show that attention shifts rapidly among objects during visual search.

Serial deployment of attention during visual search.

This study examined whether objects are attended in serial or in parallel during a demanding visual search task. A component of the event-related potential waveform, the N2pc wave, was used as a continuous measure of the allocation of attention to possible targets in the search arrays. Experiment 1 demonstrated that the relative allocation of attention shifts rapidly, favoring one item and then another. In Experiment 2, a paradigm was used that made it possible to track the absolute allocation of attention to individual items. This experiment showed that attention was allocated to one object for 100-150 ms before attention began to be allocated to the next object. These findings support models of attention that posit serial processing in demanding visual search tasks.

The time course of consolidation in visual working memory.

How long does it take to form a durable representation in visual working memory? Several theorists have proposed that this consolidation process is very slow. Here, we measured the time course of consolidation. Observers performed a change-detection task for colored squares, and shortly after the presentation of the first array, pattern masks were presented at the locations of each of the colored squares to disrupt representations that had not yet been consolidated. Performance on the memory task was impaired when the delay between the colored squares and the masks was short, and this effect became larger when the number of colored squares was increased. The rate of consolidation was approximately 50 ms per item, which is considerably faster than previous proposals.

Visual Search Remains Efficient when Visual Working Memory is Full

Many theories of attention have proposed that visual working memory plays an important role in visual search tasks. The present study examined the involvement of visual working memory in search using a dual-task paradigm in which participants performed a visual search task while maintaining no, two, or four objects in visual working memory. The presence of a working memory load added a constant delay to the visual search reaction times, irrespective of the number of items in the visual search array. That is, there was no change in the slope of the function relating reaction time to the number of items in the search array, indicating that the search process itself was not slowed by the memory load. Moreover, the search task did not substantially impair the maintenance of information in visual working memory. These results suggest that visual search requires minimal visual working memory resources, a conclusion that is inconsistent with theories that propose a close link between attention and working memory.

Do the Contents of Visual Working Memory Automatically Influence Attentional Selection During Visual Search

In many theories of cognition, researchers propose that working memory and perception operate interactively. For example, in previous studies researchers have suggested that sensory inputs matching the contents of working memory will have an automatic advantage in the competition for processing resources. The authors tested this hypothesis by requiring observers to perform a visual search task while concurrently maintaining object representations in visual working memory. The hypothesis that working memory activation produces a simple but uncontrollable bias signal leads to the prediction that items matching the contents of working memory will automatically capture attention. However, no evidence for automatic attentional capture was obtained; instead, the participants avoided attending to these items. Thus, the contents of working memory can be used in a flexible manner for facilitation or inhibition of processing.

Visual search is slowed when visuospatial working memory is occupied

Visual working memory plays a central role in most models of visual search. However, a recent study showed that search efficiency was not impaired when working memory was filled to capacity by a concurrent object memory task (Woodman, Vogel, & Luck, 2001). Objects and locations may be stored in separate working memory subsystems, and it is plausible that visual search relies on the spatial subsystem, but not on the object subsystem. In the present study, we sought to determine whether maintaining spatial information in visual working memory impairs the efficiency of a concurrent visual search task. Visual search efficiency and spatial memory accuracy were both impaired when the search and the memory tasks were performed concurrently, as compared with when the tasks were performed separately. These findings suggest that common mechanisms are used to process information during difficult visual search tasks and to maintain spatial information in working memory.

Voluntary and automatic attentional control of visual working memory

Previous studies of attention-directing cues have focused largely on the effects of cuing on perceptual processes, but cuing may also influence the transfer of perceptual representations into visual working memory. In the present study, we examined this potential role of cues, using both predictive and nonpredictive cues in the context of a visual working memory task. Each trial began with a cue, followed by an array of six colored squares, a delay interval, and then a probe square presented at the location of one of the squares in the previous array. The subjects were required to indicate whether the color of the probe square was the same as the color of the square that had previously been presented at the same location. Performance on this working memory task was more accurate when the cued location was probed than when an uncued location was probed, even when the cued location was no more likely to be probed than any of the uncued locations. An additional experiment using the abrupt-onset paradigm of Yantis and Jonides (1984) yielded similar results. Thus, visual transients may automatically influence the transfer of perceptual representations into visual working memory.

Neural fate of ignored stimuli: dissociable effects of perceptual and working memory load

Observers commonly experience functional blindness to unattended visual events, and this problem has fuelled an intense debate concerning the fate of unattended visual information in neural processing. Here we used functional magnetic resonance imaging (fMRI) to demonstrate that the type of task that a human subject engages in determines the way in which ignored visual background stimuli are processed in parahippocampal cortex. Increasing the perceptual difficulty of a foveal target task attenuated processing of task-irrelevant background scenes, whereas increasing the number of objects held in working memory did not have this effect. These dissociable effects of perceptual and working memory load clarify how task-irrelevant, unattended stimuli are processed in category-selective areas in human ventral visual cortex.

Dissociations Among Attention, Perception, and Awareness During Object-Substitution Masking

When a visual target object is surrounded by four dots that onset at the same time as the target but remain visible after the target terminates, the four dots dramatically impair target discrimination performance. This phenomenon is called object-substitution masking, reflecting the hypothesis that both the target and the four dots are identified, but the representation of the four dots replaces the representation of the target object before the target can be reported. The present study used the event-related potential technique to demonstrate that a target masked in this manner is identified by the visual system and triggers a shift of attention. However, by the time attention is shifted to the target, only the mask remains visible, leading to impaired behavioral detection performance. These findings support the object-substitution hypothesis and provide new evidence that perception, attention, and awareness can be dissociated.