Steven J. Luck

The capacity of visual working memory for features and conjunctions

Short-term memory storage can be divided into separate subsystems for verbal information and visual information, and recent studies have begun to delineate the neural substrates of these working-memory systems. Although the verbal storage system has been well characterized, the storage capacity of visual working memory has not yet been established for simple, suprathreshold features or for conjunctions of features. Here we demonstrate that it is possible to retain information about only four colours or orientations in visual working memory at one time. However, it is also possible to retain both the colour and the orientation of four objects, indicating that visual working memory stores integrated objects rather than individual features. Indeed, objects defined by a conjunction of four features can be retained in working memory just as well as single-feature objects, allowing sixteen individual features to be retained when distributed across four objects. Thus, the capacity of visual working memory must be understood in terms of integrated objects rather than individual features, which places significant constraints on cognitive and neurobiological models of the temporary storage of visual information.

Discrete fixed-resolution representations in visual working memory

Limits on the storage capacity of working memory significantly affect cognitive abilities in a wide range of domains, but the nature of these capacity limits has been elusive. Some researchers have proposed that working memory stores a limited set of discrete, fixed-resolution representations, whereas others have proposed that working memory consists of a pool of resources that can be allocated flexibly to provide either a small number of high-resolution representations or a large number of low-resolution representations. Here we resolve this controversy by providing independent measures of capacity and resolution. We show that, when presented with more than a few simple objects, human observers store a high-resolution representation of a subset of the objects and retain no information about the others. Memory resolution varied over a narrow range that cannot be explained in terms of a general resource pool but can be well explained by a small set of discrete, fixed-resolution representations.

Event-related potential studies of attention

Over the past 30 years, recordings of event-related potentials (ERPs) from normal individuals have played an increasingly important role in our understanding of the mechanisms of attention. This article reviews some of the recent ERP studies of attention, focusing on studies that isolate the operation of attention in specific cognitive subsystems such as perception, working memory, and response selection. Several conclusions are drawn. First, under some conditions attention modulates the initial feedforward volley of neural activity in intermediate visual processing areas. Second, these early effects can be observed for both the voluntary allocation of attention and for the automatic capture of attention following a peripheral visual transient. Third, these effects are present not only when attention is directed to a location in 2-dimensional space, but also when attention is directed to one of two spatially overlapping surfaces. Fourth, attention does not modulate sensory activity unless sensory systems are overloaded; when sensory systems are not taxed, attention may instead operate to influence memory or response processes. That is, attention operates to mitigate information overload in whichever cognitive subsystems are overloaded by a particular combination of stimuli and task.

The visual N1 component as an index of a discrimination process.

Many previous studies have demonstrated that the visual N1 component is larger for attended-location stimuli than for unattended-location stimuli. This difference is observed typically only for tasks involving a discrimination of the attended-location stimuli, suggesting that the N1 wave reflects a discrimination process that is applied to the attended location. The present study tested this hypothesis by examining the N1 component elicited by attended stimuli under conditions that either required or did not require the subject to perform a discrimination. Specifically, the N1 elicited by foveal stimuli during choice-reaction time (RT) tasks was compared with the N1 elicited by identical stimuli during simple-RT tasks. In three experiments, a larger posterior N1 was observed in choice-RT tasks than in simple-RT tasks, even when several potential confounds were eliminated (e.g., arousal and motor preparation). This N1 discrimination effect was observed even when no motor response was required and was present for both color- and form-based discriminations. Moreover, this discrimination effect was equally large for easy and difficult discriminations, arguing against a simple resource-based explanation of the present results. Instead, the results of this study are consistent with the hypothesis that the visual N1 component reflects the operation of a discrimination process within the focus of attention.

ERPLAB: an open-source toolbox for the analysis of event-related potentials.

ERPLAB toolbox is a freely available, open-source toolbox for processing and analyzing event-related potential (ERP) data in the MATLAB environment. ERPLAB is closely integrated with EEGLAB, a popular open-source toolbox that provides many EEG preprocessing steps and an excellent user interface design. ERPLAB adds to EEGLAB’s EEG processing functions, providing additional tools for filtering, artifact detection, re-referencing, and sorting of events, among others. ERPLAB also provides robust tools for averaging EEG segments together to create averaged ERPs, for creating difference waves and other recombinations of ERP waveforms through algebraic expressions, for filtering and re-referencing the averaged ERPs, for plotting ERP waveforms and scalp maps, and for quantifying several types of amplitudes and latencies. ERPLAB’s tools can be accessed either from an easy-to-learn graphical user interface or from MATLAB scripts, and a command history function makes it easy for users with no programming experience to write scripts. Consequently, ERPLAB provides both ease of use and virtually unlimited power and flexibility, making it appropriate for the analysis of both simple and complex ERP experiments. Several forms of documentation are available, including a detailed user’s guide, a step-by-step tutorial, a scripting guide, and a set of video-based demonstrations.

Electrophysiological measurement of rapid shifts of attention during visual search

The perception of natural visual scenes that contain many objects poses computational problems that are absent when objects are perceived in isolation. Vision researchers have captured this attribute of real-world perception in the laboratory by using visual search tasks, in which subjects search for a target object in arrays containing varying numbers of non-target distractor objects. Under many conditions, the amount of time required to detect a visual search target increases as the number of objects in the stimulus array increases, and some investigators have proposed that this reflects the serial application of attention to the individual objects in the array,. However, other investigators have argued that this pattern of results may instead be due to limitations in the processing capacity of a parallel processing system that identifies multiple objects concurrently,. Here we attempt to address this longstanding controversy by using an electrophysiological marker of the moment-by-moment direction of attention — the N2pc component of the event-related potential waveform — to show that attention shifts rapidly among objects during visual search.

Effects of Spatial Cuing on Luminance Detectability: Psychophysical and Electrophysiological Evidence for Early Selection

Three experiments were conducted to determine whether attention-related changes in luminance detectability reflect a modulation of early sensory processing. Experiments 1 and 2 used peripheral cues to direct attention and found substantial effects of cue validity on target detectability; these effects were consistent with a sensory-level locus of selection but not with certain memory- or decision-level mechanisms. In Experiment 3, event-related brain potentials were recorded in a similar paradigm using central cues, and attention was found to produce changes in sensory-evoked brain activity beginning within the 1st 100 ms of stimulus processing. These changes included both an enhancement of sensory responses to attended stimuli and a suppression of sensory responses to unattended stimuli; the enhancement and suppression effects were isolated to different neural responses, indicating that they may arise from independent attentional mechanisms.

Visual event-related potentials index focused attention within bilateral stimulus arrays. II. Functional dissociation of P1 and N1 components

Event-related potentials (ERPs) were recorded from 12 subjects as they attended to the left or right hemifield of a visual display while fixating a central point. Stimuli were presented to the left or right visual fields on separate trials (unilateral stimuli) or to both fields simultaneously (bilateral stimuli). In different conditions, the stimulus sequences contained only bilateral stimuli, only unilateral stimuli, or a mixture of unilateral and bilateral stimuli. Bilateral stimuli elicited an enhanced positivity lasting from about 75 to 250 msec that was largest at posterior electrode sites contralateral to the attended hemifield. The early phase of this attention-related positivity appeared to be an enhancement of the exogenous P1 component. In contrast, both the posterior P1 and N1 components were enhanced in response to attended unilateral stimuli. Moreover, the N1 attention effect was reduced when the preceding stimulus contained elements in the attended field. It was concluded that modulations of the N1 and P1 components in these experiments represent different aspects of visual spatial attention: N1 may represent the orienting of attention to a task-relevant stimulus, whereas P1 may represent a facilitation of early sensory processing for items presented to a location where attention is already focused.

Serial deployment of attention during visual search.

This study examined whether objects are attended in serial or in parallel during a demanding visual search task. A component of the event-related potential waveform, the N2pc wave, was used as a continuous measure of the allocation of attention to possible targets in the search arrays. Experiment 1 demonstrated that the relative allocation of attention shifts rapidly, favoring one item and then another. In Experiment 2, a paradigm was used that made it possible to track the absolute allocation of attention to individual items. This experiment showed that attention was allocated to one object for 100-150 ms before attention began to be allocated to the next object. These findings support models of attention that posit serial processing in demanding visual search tasks.

The time course of consolidation in visual working memory.

How long does it take to form a durable representation in visual working memory? Several theorists have proposed that this consolidation process is very slow. Here, we measured the time course of consolidation. Observers performed a change-detection task for colored squares, and shortly after the presentation of the first array, pattern masks were presented at the locations of each of the colored squares to disrupt representations that had not yet been consolidated. Performance on the memory task was impaired when the delay between the colored squares and the masks was short, and this effect became larger when the number of colored squares was increased. The rate of consolidation was approximately 50 ms per item, which is considerably faster than previous proposals.