Bradley R. Postle

Working Memory as an Emergent Property of the Mind and Brain

Cognitive neuroscience research on working memory has been largely motivated by a standard model that arose from the melding of psychological theory with neuroscience data. Among the tenets of this standard model are that working memory functions arise from the operation of specialized systems that act as buffers for the storage and manipulation of information, and that frontal cortex (particularly prefrontal cortex) is a critical neural substrate for these specialized systems. However, the standard model has been a victim of its own success, and can no longer accommodate many of the empirical findings of studies that it has motivated. An alternative is proposed: Working memory functions arise through the coordinated recruitment, via attention, of brain systems that have evolved to accomplish sensory-, representation-, and action-related functions. Evidence from behavioral, neuropsychological, electrophysiological, and neuroimaging studies, from monkeys and humans, is considered, as is the question of how to interpret delay-period activity in the prefrontal cortex.

Prefrontal cortical contributions to working memory: evidence from event-related fMRI studies

Abstract. Working memory refers to the short-term retention of information that is no longer accessible in the environment, and the manipulation of this information, for subsequent use in guiding behavior. In this review, we will present data from a series of event-related functional magnetic-resonance-imaging (fMRI) studies of delayed-response tasks that were designed to investigate the role of different regions of the prefrontal cortex (PFC) during different working-memory component processes. From these data, we conclude that: (1) lateral PFC is anatomically organized according to the types of cognitive operations that one performs when attempting to temporarily maintain and manipulate information; and (2) consistent with the picture that has emerged from the monkey electrophysiological literature, human lateral PFC is involved in several encoding- and response-related processes as well as mnemonic and nonmnemonic processes that are engaged during the temporary maintenance of information. Thus, lateral PFC activity cannot be ascribed to the function of a single, unitary cognitive operation.

Increased alpha-band power during the retention of shapes and shape-location associations in visual short-term memory

Studies exploring the role of neural oscillations in cognition have revealed sustained increases in alpha-band (~8–14 Hz) power during the delay period of delayed-recognition short-term memory tasks. These increases have been proposed to reflect the inhibition, for example, of cortical areas representing task-irrelevant information, or of potentially interfering representations from previous trials. Another possibility, however, is that elevated delay-period alpha-band power (DPABP) reflects the selection and maintenance of information, rather than, or in addition to, the inhibition of task-irrelevant information. In the present study, we explored these possibilities using a delayed-recognition paradigm in which the presence and task relevance of shape information was systematically manipulated across trial blocks and electroencephalographic was used to measure alpha-band power. In the first trial block, participants remembered locations marked by identical black circles. The second block featured the same instructions, but locations were marked by unique shapes. The third block featured the same stimulus presentation as the second, but with pretrial instructions indicating, on a trial-by-trial basis, whether memory for shape or location was required, the other dimension being irrelevant. In the final block, participants remembered the unique pairing of shape and location for each stimulus. Results revealed minimal DPABP in each of the location-memory conditions, whether locations were marked with identical circles or with unique task-irrelevant shapes. In contrast, alpha-band power increases were observed in both the shape-memory condition, in which location was task irrelevant, and in the critical final condition, in which both shape and location were task relevant. These results provide support for the proposal that alpha-band oscillations reflect the retention of shape information and/or shape–location associations in short-term memory.

''What''—Then—''Where'' in Visual Working Memory: An Event-Related fMRI Study

Behavioral studies indicate that spatial and object working memory are computed by dissociable subsystems. We investigated the neural bases of this dissociation with a whole-brain fMRI design and analysis technique that permitted direct assessment of delay-period activity, uncontaminated by other components of the trial. The task employed a what-then-where design, with an object and a spatial delay period incorporated in each trial; within-trial order of delay conditions was balanced across each scan. Our experiment failed to find evidence, at the single-subject level and at the group level, for anatomical segregation of spatial and object working memory function in the frontal cortex. Delay-period activity in the caudate nucleus revealed a sensitivity to position in the trial in the spatial, but not the object, condition. In posterior regions, spatial delay-period activity was associated with preferential recruitment of extrastriate areas falling within Brodmanns area 19 and, less reliably, the superior parietal lobule. Object-specific delay-period activity was found predominantly in ventral regions of the posterior cortex and demonstrated more topographic variability across subjects than did spatial working memory activity.

Superior parietal cortex is critical for the manipulation of information in working memory.

In recent years, theoretical perspectives on posterior parietal function have evolved beyond the traditional visuospatial processing models to include more diverse cognitive operations, such as long-term and working memory. However, definitive neuropsychological evidence supporting the superior parietal lobules purported role in working memory has been lacking. Here, we studied human brain lesion patients to determine whether the superior parietal lobule is indeed necessary for working memory. We assessed a wide range of memory functions in three participant groups: superior parietal lesions (n = 19), lesions not involving superior parietal cortex (n = 146), and no brain lesions (n = 55). Superior parietal damage was reliably associated with deficits on tests involving the manipulation and rearrangement of information in working memory, but not on working memory tests requiring only rehearsal and retrieval processes, nor on tests of long-term memory. These results indicate that superior parietal cortex is critically important for the manipulation of information in working memory.

An fMRI investigation of cortical contributions to spatial and nonspatial visual working memory.

The experiments presented in this report were designed to test the hypothesis that visual working memory for spatial stimuli and for object stimuli recruits separate neuronal networks in prefrontal cortex. We acquired BOLD fMRI data from subjects while they compared each serially presented stimulus to the one that had appeared two or three stimuli previously. Three experiments failed to reject the null hypothesis that prefrontal cortical activity associated with spatial working memory performance cannot be dissociated from prefrontal cortical activity associated with nonspatial working memory performance. Polymodal regions of parietal cortex (inferior and superior parietal lobules), as well as cortex surrounding the superior frontal sulcus (and encompassing the frontal eye fields), also demonstrated equivalent levels of activation in the spatial and object conditions. Posterior cortical regions associated with the ventral visual processing stream (portions of lingual, fusiform, and inferior temporal gyri), however, demonstrated greater object than spatial working memory-related activity, particularly when stimuli varied only along spatial or featural dimensions. These experiments, representing fMRI studies of spatial and object working memory in which the testing procedure and the stimuli were identical in the two conditions, suggest that domain-specific visual working memory processing may be mediated by posterior regions associated with domain-specific sensory processing.

Neural evidence for a distinction between short-term memory and the focus of attention

It is widely assumed that the short-term retention of information is accomplished via maintenance of an active neural trace. However, we demonstrate that memory can be preserved across a brief delay despite the apparent loss of sustained representations. Delay period activity may, in fact, reflect the focus of attention, rather than STM. We unconfounded attention and memory by causing external and internal shifts of attention away from items that were being actively retained. Multivariate pattern analysis of fMRI indicated that only items within the focus of attention elicited an active neural trace. Activity corresponding to representations of items outside the focus quickly dropped to baseline. Nevertheless, this information was remembered after a brief delay. Our data also show that refocusing attention toward a previously unattended memory item can reactivate its neural signature. The loss of sustained activity has long been thought to indicate a disruption of STM, but our results suggest that, even for small memory loads not exceeding the capacity limits of STM, the active maintenance of a stimulus representation may not be necessary for its short-term retention.

The Relationship between Working Memory Storage and Elevated Activity as Measured with Functional Magnetic Resonance Imaging

Does the sustained, elevated neural activity observed during working memory tasks reflect the short-term retention of information? Functional magnetic resonance imaging (fMRI) data of delayed recognition of visual motion in human participants were analyzed with two methods: a general linear model (GLM) and multivoxel pattern analysis. Although the GLM identified sustained, elevated delay-period activity in superior and lateral frontal cortex and in intraparietal sulcus, pattern classifiers were unable to recover trial-specific stimulus information from these delay-active regions. The converse—no sustained, elevated delay-period activity but successful classification of trial-specific stimulus information—was true of posterior visual regions, including area MT+ (which contains both middle temporal area and medial superior temporal area) and calcarine and pericalcarine cortex. In contrast to stimulus information, pattern classifiers were able to extract trial-specific task instruction-related information from frontal and parietal areas showing elevated delay-period activity. Thus, the elevated delay-period activity that is measured with fMRI may reflect processes other than the storage, per se, of trial-specific stimulus information. It may be that the short-term storage of stimulus information is represented in patterns of (statistically) “subthreshold” activity distributed across regions of low-level sensory cortex that univariate methods cannot detect.

Distributed patterns of activity in sensory cortex reflect the precision of multiple items maintained in visual short-term memory.

Traditionally, load sensitivity of sustained, elevated activity has been taken as an index of storage for a limited number of items in visual short-term memory (VSTM). Recently, studies have demonstrated that the contents of a single item held in VSTM can be decoded from early visual cortex, despite the fact that these areas do not exhibit elevated, sustained activity. It is unknown, however, whether the patterns of neural activity decoded from sensory cortex change as a function of load, as one would expect from a region storing multiple representations. Here, we use multivoxel pattern analysis to examine the neural representations of VSTM in humans across multiple memory loads. In an important extension of previous findings, our results demonstrate that the contents of VSTM can be decoded from areas that exhibit a transient response to visual stimuli, but not from regions that exhibit elevated, sustained load-sensitive delay-period activity. Moreover, the neural information present in these transiently activated areas decreases significantly with increasing load, indicating load sensitivity of the patterns of activity that support VSTM maintenance. Importantly, the decrease in classification performance as a function of load is correlated with within-subject changes in mnemonic resolution. These findings indicate that distributed patterns of neural activity in putatively sensory visual cortex support the representation and precision of information in VSTM.

Spatial, but Not Object, Delayed Response Is Impaired in Early Parkinson's Disease

The authors hypothesized that the pathophysiology of early Parkinsons disease (PD) may selectively target structures that support visual working memory for spatial relations but leave structures that support working memory for featural characteristics of objects relatively intact. Fifteen PD and 15 normal control participants took a visual delayed-response test with a spatial condition and a (nonspatial) object condition, equating the perceptual difficulty of the tests for each participant. The stimuli were irregular polygons presented at different locations on a computer screen. Results revealed a selective impairment of spatial delayed response in PD, indicating a disruption of spatial working memory unconfounded by sensory processing difficulties. The selectivity of this deficit may reflect the circumscribed nature of pathophysiological change affecting the caudate nucleus in early PD.