René Marois

Capacity limit of visual short-term memory in human posterior parietal cortex.

At any instant, our visual system allows us to perceive a rich and detailed visual world. Yet our internal, explicit representation of this visual world is extremely sparse: we can only hold in mind a minute fraction of the visual scene. These mental representations are stored in visual short-term memory (VSTM). Even though VSTM is essential for the execution of a wide array of perceptual and cognitive functions, and is supported by an extensive network of brain regions, its storage capacity is severely limited. With the use of functional magnetic resonance imaging, we show here that this capacity limit is neurally reflected in one node of this network: activity in the posterior parietal cortex is tightly correlated with the limited amount of scene information that can be stored in VSTM. These results suggest that the posterior parietal cortex is a key neural locus of our impoverished mental representation of the visual world.

Capacity limits of information processing in the brain

Despite the impressive complexity and processing power of the human brain, it is severely capacity limited. Behavioral research has highlighted three major bottlenecks of information processing that can cripple our ability to consciously perceive, hold in mind, and act upon the visual world, illustrated by the attentional blink (AB), visual short-term memory (VSTM), and psychological refractory period (PRP) phenomena, respectively. A review of the neurobiological literature suggests that the capacity limit of VSTM storage is primarily localized to the posterior parietal and occipital cortex, whereas the AB and PRP are associated with partly overlapping fronto-parietal networks. The convergence of these two networks in the lateral frontal cortex points to this brain region as a putative neural locus of a common processing bottleneck for perception and action.

The attentional blink: A review of data and theory

Under conditions of rapid serial visual presentation, subjects display a reduced ability to report the second of two targets(Target2; T2) in a stream of distractors if it appearswithin200-500 msec of Target 1 (Tl). This effect. known as the attentional blink(AB),has been central in characterizing the limits of humans’ ability to consciously perceive stimuli distributed across time. Here, we review theoretical accounts of the AB and examine how they explain key findings in the literature. We conclude that the AB arises from attentional demands of Tl for selection, working memory encoding, episodic registration,and response selection, which prevents this high-level central resource from being applied to T2 at shortT1-T2 lags. Tl processing also transiently impairs the redeployment of these attentional resources to subsequent targets and the inhibition of distractors that appear in close temporal proximity to T2. Although these findings are consistent with a multifactorial account of the AB,they can also be largely explained by assuming that the activation of these multiple processes depends on a common capacity-limited attentional process for selecting behaviorally relevant events presented among temporally distributed distractors. Thus, at its core, the attentional blink may ultimately reveal the temporal limits of the deployment of selective attention.

Posterior parietal cortex activity predicts individual differences in visual short-term memory capacity

Humans show a severe capacity limit in the number of objects they can store in visual short-term memory (VSTM). We recently demonstrated with functional magnetic resonance imaging that VSTM storage capacity estimated in averaged group data correlated strongly with posterior parietal/superior occipital cortex activity (Todd & Marois, 2004). However, individuals varied widely in their VSTM capacity. Here, we examined the neural basis of these individual differences. A voxelwise, individualdifferences analysis revealed a significant correlation between posterior parietal cortex (PPC) activity and individuals’ VSTM storage capacity. In addition, a region-of-interest analysis indicated that other brain regions, particularly visual occipital cortex, may contribute to individual differences in VSTM capacity. Thus, although not ruling out contributions from other brain regions, the individual-differences approach supports a key role for the PPC in VSTM by demonstrating that its activity level predicts individual differences in VSTM storage capacity.

Isolation of a Central Bottleneck of Information Processing with Time-Resolved fMRI

When humans attempt to perform two tasks at once, execution of the first task usually leads to postponement of the second one. This task delay is thought to result from a bottleneck occurring at a central, amodal stage of information processing that precludes two response selection or decision-making operations from being concurrently executed. Using time-resolved functional magnetic resonance imaging (fMRI), here we present a neural basis for such dual-task limitations, e.g. the inability of the posterior lateral prefrontal cortex, and possibly the superior medial frontal cortex, to process two decision-making operations at once. These results suggest that a neural network of frontal lobe areas acts as a central bottleneck of information processing that severely limits our ability to multitask.

The Neural Fate of Consciously Perceived and Missed Events in the Attentional Blink

Cognitive models of attention propose that visual perception is a product of two stages of visual processing: early operations permit rapid initial categorization of the visual world, while later attention-demanding capacity-limited stages are necessary for the conscious report of the stimuli. Here we used the attentional blink paradigm and fMRI to neurally distinguish these two stages of vision. Subjects detected a face target and a scene target presented rapidly among distractors at fixation. Although the second, scene target frequently went undetected by the subjects, it nonetheless activated regions of the medial temporal cortex involved in high-level scene representations, the parahippocampal place area (PPA). This PPA activation was amplified when the stimulus was consciously perceived. By contrast, the frontal cortex was activated only when scenes were successfully reported. These results suggest that medial temporal cortex permits rapid categorization of the visual input, while the frontal cortex is part of a capacity-limited attentional bottleneck to conscious report.

Neural correlates of the attentional blink.

Attending to a visual event can lead to functional blindness for other events in the visual field. This limit in our attentional capacities is exemplified by the attentional blink (AB), which refers to the transient but severe impairment in perceiving the second of two temporally neighboring targets. Using functional magnetic resonance imaging (fMRI), we observed predominantly right intraparietal and frontal cortex activations associated with the AB. We further demonstrate that an AB can be elicited by both temporal and spatial distractor interference on an attended target and that both of these interference mechanisms activate the same neural circuit. These results suggest that a (right) parietofrontal network previously implicated in attentional control and enhancement is also a locus of capacity-limited processing of visual information.

A central role for the lateral prefrontal cortex in goal-directed and stimulus-driven attention

Attention is the process that selects which sensory information is preferentially processed and ultimately reaches our awareness. Attention, however, is not a unitary process; it can be captured by unexpected or salient events (stimulus driven) or it can be deployed under voluntary control (goal directed), and these two forms of attention are implemented by largely distinct ventral and dorsal parieto-frontal networks. For coherent behavior and awareness to emerge, stimulus-driven and goal-directed behavior must ultimately interact. We found that the ventral, but not dorsal, network can account for stimulus-driven attentional limits to conscious perception, and that stimulus-driven and goal-directed attention converge in the lateral prefrontal component of that network. Although these results do not rule out dorsal network involvement in awareness when goal-directed task demands are present, they point to a general role for the lateral prefrontal cortex in the control of attention and awareness.

Neural fate of ignored stimuli: dissociable effects of perceptual and working memory load

Observers commonly experience functional blindness to unattended visual events, and this problem has fuelled an intense debate concerning the fate of unattended visual information in neural processing. Here we used functional magnetic resonance imaging (fMRI) to demonstrate that the type of task that a human subject engages in determines the way in which ignored visual background stimuli are processed in parahippocampal cortex. Increasing the perceptual difficulty of a foveal target task attenuated processing of task-irrelevant background scenes, whereas increasing the number of objects held in working memory did not have this effect. These dissociable effects of perceptual and working memory load clarify how task-irrelevant, unattended stimuli are processed in category-selective areas in human ventral visual cortex.

The role of the parietal cortex in visual feature binding

When multiple objects are simultaneously present in a scene, the visual system must properly integrate the features associated with each object. It has been proposed that this “binding problem” is solved by selective attention to the locations of the objects [Treisman, A.M. & Gelade, E. (1980) Cogn. Psychol. 12, 97–136]. If spatial attention plays a role in feature integration, it should do so primarily when object location can serve as a binding cue. Using functional MRI (fMRI), we show that regions of the parietal cortex involved in spatial attention are more engaged in feature conjunction tasks than in single feature tasks when multiple objects are shown simultaneously at different locations but not when they are shown sequentially at the same location. These findings suggest that the spatial attention network of the parietal cortex is involved in feature binding but only when spatial information is available to resolve ambiguities about the relationships between object features.