Zaifeng Gao

Storing fine detailed information in visual working memory—Evidence from event-related potentials

Visual working memory (VWM) maintains and manipulates a limited set of visual objects being actively used in visual processing. To explore whether and how the fine detailed information is stored in VWM, four experiments have been conducted while recording the contralateral delay activity (CDA), an event-related potential difference wave that reflects the information maintenance in VWM. The type of the remembered information was manipulated by adopting simple objects and complex objects as materials. We found the amplitude of CDA was modulated by object complexity: as the set size of memory array rose from 2 to 4, the amplitude of CDA stopped increasing for maintaining complex objects with detailed information, while continued increasing for storing highly discriminable simple objects. These results suggest that VWM can store the fine detailed information; however it can not store all the fine detailed information from 4 complex objects. It implies that the capacity of VWM is not only characterized by a fixed number of objects, there is at least one stage influenced by the detailed information contained in the objects. These results are further discussed within a two-stage storing model of VWM: different types of perceptual information (highly discriminable features and fine detailed features) are maintained in VWM via two distinctive mechanisms.

Contralateral delay activity tracks object identity information in visual short term memory

Previous studies suggested that ERP component contralateral delay activity (CDA) tracks the number of objects containing identity information stored in visual short term memory (VSTM). Later MEG and fMRI studies implied that its neural source lays in superior IPS. However, since the memorized stimuli in previous studies were displayed in distinct spatial locations, hence possibly CDA tracks the object-location information instead. Moreover, a recent study implied the activation in superior IPS reflected the location load. The current research thus explored whether CDA tracks the object-location load or the object-identity load, and its neural sources. Participants were asked to remember one color, four identical colors or four distinct colors. The four-identical-color condition was the critical one because it contains the same amount of identity information as that of one color while the same amount of location information as that of four distinct colors. To ensure the participants indeed selected four colors in the four-identical-color condition, we also split the participants into two groups (low- vs. high-capacity), analyzed late positive component (LPC) in the prefrontal area, and collected participants subjective-report. Our results revealed that most of the participants selected four identical colors. Moreover, regardless of capacity-group, there was no difference on CDA between one color and four identical colors yet both were lower than 4 distinct colors. Besides, the source of CDA was located in the superior parietal lobule, which is very close to the superior IPS. These results support the statement that CDA tracks the object identity information in VSTM.

Dissociated Mechanisms of Extracting Perceptual Information into Visual Working Memory

Background The processing mechanisms of visual working memory (VWM) have been extensively explored in the recent decade. However, how the perceptual information is extracted into VWM remains largely unclear. The current study investigated this issue by testing whether the perceptual information was extracted into VWM via an integrated-object manner so that all the irrelevant information would be extracted (object hypothesis), or via a feature-based manner so that only the target-relevant information would be extracted (feature hypothesis), or via an analogous processing manner as that in visual perception (analogy hypothesis). Methodology/Principal Findings High-discriminable information which is processed at the parallel stage of visual perception and fine-grained information which is processed via focal attention were selected as the representatives of perceptual information. The analogy hypothesis predicted that whereas high-discriminable information is extracted into VWM automatically, fine-grained information will be extracted only if it is task-relevant. By manipulating the information type of the irrelevant dimension in a change-detection task, we found that the performance was affected and the ERP component N270 was enhanced if a change between the probe and the memorized stimulus consisted of irrelevant high-discriminable information, but not if it consisted of irrelevant fine-grained information. Conclusions/Significance We conclude that dissociated extraction mechanisms exist in VWM for information resolved via dissociated processes in visual perception (at least for the information tested in the current study), supporting the analogy hypothesis.

Tracking object number or information load in visual working memory: Revisiting the cognitive implication of contralateral delay activity

Two accounts prevail for the ERP component contralateral delay activity (CDA). One is that CDA tracks the number of objects stored in visual working memory (VWM), the more objects the higher amplitude (object number account). The other is that CDA reflects the maintained information load (information load account), the higher load the higher amplitude. The two accounts were tested by manipulating the information load and the object number of stored objects. Two or four arrows with low- or high-resolution information were remembered in separate blocks. In two experiments we found that the CDA-amplitude was higher for 4 arrows than for 2 arrows in low-resolution condition, yet no difference in high-resolution condition. Critically, there was no difference on CDA-amplitude among 2 low- and high-resolution objects, as well as 4 high-resolution objects, yet all were significantly lower than 4 low-resolution arrows. These results supported the object number account of CDA.

Coarse-to-Fine Construction for High-Resolution Representation in Visual Working Memory

Background This study explored whether the high-resolution representations created by visual working memory (VWM) are constructed in a coarse-to-fine or all-or-none manner. The coarse-to-fine hypothesis suggests that coarse information precedes detailed information in entering VWM and that its resolution increases along with the processing time of the memory array, whereas the all-or-none hypothesis claims that either both enter into VWM simultaneously, or neither does. Methodology/Principal Findings We tested the two hypotheses by asking participants to remember two or four complex objects. An ERP component, contralateral delay activity (CDA), was used as the neural marker. CDA is higher for four objects than for two objects when coarse information is primarily extracted; yet, this CDA difference vanishes when detailed information is encoded. Experiment 1 manipulated the comparison difficulty of the task under a 500-ms exposure time to determine a condition in which the detailed information was maintained. No CDA difference was found between two and four objects, even in an easy-comparison condition. Thus, Experiment 2 manipulated the memory array’s exposure time under the easy-comparison condition and found a significant CDA difference at 100 ms while replicating Experiment 1′s results at 500 ms. In Experiment 3, the 500-ms memory array was blurred to block the detailed information; this manipulation reestablished a significant CDA difference. Conclusions/Significance These findings suggest that the creation of high-resolution representations in VWM is a coarse-to-fine process.

Does high memory load kick task-irrelevant information out of visual working memory?

The limited capacity of visual working memory (VWM) requires the existence of an efficient information selection mechanism. While it has been shown that under low VWM load, an irrelevant simple feature can be processed, its fate under high load (e.g., six objects) remains unclear. We explored this issue by probing the “irrelevant-change distracting effect,” in which the change of a stored irrelevant feature affects performance. Simple colored shapes were used as stimuli, with color as the target. Using a whole-probe method (presenting six objects in both the memory and test arrays), in Experiment 1 we found that a change to one of the six shapes led to a significant distracting effect. Using a partial-probe method (presenting the probe either at the screen center or at a location selected from the memory array), in Experiment 2 we showed the distracting effect again. These results suggest that irrelevant simple features can be stored into VWM, regardless of memory load.

Tracking the mismatch information in visual short term memory: an event-related potential study.

Although the mechanisms of visual short term memory (VSTM) are extensively investigated in the recent decade, how we compare the representation stored in VSTM to the perceptual input to detect and process the mismatch information remains largely unclear. The current study explored whether there is an ERP component tracking the mismatch process in VSTM by adopting a delayed matching task. To exclude non-memory factors, for instance, using perceptual representation which dominated in previous studies using this paradigm, we lengthened the blank interval between the two sequentially displayed stimuli to 4 s to ensure the first stimuli is stored in VSTM. In order to test the sensitivity of this potential neural index and its functional relation to VSTM comparison process, colored shapes were adopted as materials while both the target feature color and the irrelevant feature shape could be changed. We found both the target feature change and the irrelevant feature change elicited a more negative component N270 (or N2-enhancement) around the anterior areas, with their neural sources located at frontal lobe. These results suggest that the N270 can sensitively reflect the mismatch information between the representation in VSTM and the perceptual input. Moreover, it may reflect the limited-capacity process in the VSTM-perception comparison, in which a deliberative comparison was conducted after an unlimited-capacity comparison process.

Holding biological motion information in working memory.

Working memory (WM) mechanisms for verbal, spatial, and object information have been extensively examined, yet those for kinetic information are less known. The current study explored the WM capacity and architecture of kinetic information by examining the maintenance of biological motion (BM) stimuli in WM. Human BM is the most salient and biologically significant kinetic information encountered in everyday life. We isolated motion signals of human BM from non-BM sources by using point-light displays as to-be-memorized BM. During a change detection task, we found that, at most, 3 to 4 BM stimuli could be retained in WM (Experiment 1). Next, we found that extra colors, spatial locations, or shapes remembered concurrently with BM stimuli (Experiments 2, 3, and 4, respectively), did not affect BM memory considerably. However, BM memory was affected by a concurrent memory task of non-BM movements (Experiment 5). These results support the hypothesis that an independent storage buffer of WM exists for kinetic information, which can hold up to 3 to 4 motion units.

The neural mechanisms of percept–memory comparison in visual working memory

Researchers have revealed that comparing the perceptual input with the representations stored in visual working memory initiates a rapid attention-shift, which is predominantly triggered by the relevant-feature change. The comprehension of the change contents further necessitates a follow-up comparison that contrasts all the object features regardless of the task relevancy. However, whether such a distinct stage exists and how the process is carried on need further verification. We explored this issue by investigating the underlying neural mechanisms of the percept-memory comparison. By recording EEG, we found that both the task-relevant and -irrelevant feature changes elicited significantly more negative anterior N2 waves (230-340ms) rooting in the anterior cingulate cortex (ACC), and meanwhile activated the frontal theta (5-8Hz, 250-550ms). These results suggest that a distinct comparison stage does exist, which is supported by the anterior N2, ACC and frontal theta.

Organization principles in visual working memory: Evidence from sequential stimulus display

Although the mechanisms of visual working memory (VWM) have been studied extensively in recent years, the active property of VWM has received less attention. In the current study, we examined how VWM integrates sequentially presented stimuli by focusing on the role of Gestalt principles, which are important organizing principles in perceptual integration. We manipulated the level of Gestalt cues among three or four sequentially presented objects that were memorized. The Gestalt principle could not emerge unless all the objects appeared together. We distinguished two hypotheses: a perception-alike hypothesis and an encoding-specificity hypothesis. The former predicts that the Gestalt cue will play a role in information integration within VWM; the latter predicts that the Gestalt cue will not operate within VWM. In four experiments, we demonstrated that collinearity (Experiment 1) and closure (Experiment 2) cues significantly improved VWM performance, and this facilitation was not affected by the testing manner (Experiment 3) or by adding extra colors to the memorized objects (Experiment 4). Finally, we re-established the Gestalt cue benefit with similarity cues (Experiment 5). These findings together suggest that VWM realizes and uses potential Gestalt principles within the stored representations, supporting a perception-alike hypothesis.