Xiaowei Ding

Coarse-to-Fine Construction for High-Resolution Representation in Visual Working Memory

Background This study explored whether the high-resolution representations created by visual working memory (VWM) are constructed in a coarse-to-fine or all-or-none manner. The coarse-to-fine hypothesis suggests that coarse information precedes detailed information in entering VWM and that its resolution increases along with the processing time of the memory array, whereas the all-or-none hypothesis claims that either both enter into VWM simultaneously, or neither does. Methodology/Principal Findings We tested the two hypotheses by asking participants to remember two or four complex objects. An ERP component, contralateral delay activity (CDA), was used as the neural marker. CDA is higher for four objects than for two objects when coarse information is primarily extracted; yet, this CDA difference vanishes when detailed information is encoded. Experiment 1 manipulated the comparison difficulty of the task under a 500-ms exposure time to determine a condition in which the detailed information was maintained. No CDA difference was found between two and four objects, even in an easy-comparison condition. Thus, Experiment 2 manipulated the memory array’s exposure time under the easy-comparison condition and found a significant CDA difference at 100 ms while replicating Experiment 1′s results at 500 ms. In Experiment 3, the 500-ms memory array was blurred to block the detailed information; this manipulation reestablished a significant CDA difference. Conclusions/Significance These findings suggest that the creation of high-resolution representations in VWM is a coarse-to-fine process.

Holding biological motion information in working memory.

Working memory (WM) mechanisms for verbal, spatial, and object information have been extensively examined, yet those for kinetic information are less known. The current study explored the WM capacity and architecture of kinetic information by examining the maintenance of biological motion (BM) stimuli in WM. Human BM is the most salient and biologically significant kinetic information encountered in everyday life. We isolated motion signals of human BM from non-BM sources by using point-light displays as to-be-memorized BM. During a change detection task, we found that, at most, 3 to 4 BM stimuli could be retained in WM (Experiment 1). Next, we found that extra colors, spatial locations, or shapes remembered concurrently with BM stimuli (Experiments 2, 3, and 4, respectively), did not affect BM memory considerably. However, BM memory was affected by a concurrent memory task of non-BM movements (Experiment 5). These results support the hypothesis that an independent storage buffer of WM exists for kinetic information, which can hold up to 3 to 4 motion units.

The neural mechanisms of percept–memory comparison in visual working memory

Researchers have revealed that comparing the perceptual input with the representations stored in visual working memory initiates a rapid attention-shift, which is predominantly triggered by the relevant-feature change. The comprehension of the change contents further necessitates a follow-up comparison that contrasts all the object features regardless of the task relevancy. However, whether such a distinct stage exists and how the process is carried on need further verification. We explored this issue by investigating the underlying neural mechanisms of the percept-memory comparison. By recording EEG, we found that both the task-relevant and -irrelevant feature changes elicited significantly more negative anterior N2 waves (230-340ms) rooting in the anterior cingulate cortex (ACC), and meanwhile activated the frontal theta (5-8Hz, 250-550ms). These results suggest that a distinct comparison stage does exist, which is supported by the anterior N2, ACC and frontal theta.

Visual Working Memory Capacity Does Not Modulate the Feature-Based Information Filtering in Visual Working Memory

Background The limited capacity of visual working memory (VWM) requires us to select the task relevant information and filter out the irrelevant information efficiently. Previous studies showed that the individual differences in VWM capacity dramatically influenced the way we filtered out the distracters displayed in distinct spatial-locations: low-capacity individuals were poorer at filtering them out than the high-capacity ones. However, when the target and distracting information pertain to the same object (i.e., multiple-featured object), whether the VWM capacity modulates the feature-based filtering remains unknown. Methodology/Principal Findings We explored this issue mainly based on one of our recent studies, in which we asked the participants to remember three colors of colored-shapes or colored-landolt-Cs while using two types of task irrelevant information. We found that the irrelevant high-discriminable information could not be filtered out during the extraction of VWM but the irrelevant fine-grained information could be. We added 8 extra participants to the original 16 participants and then split the overall 24 participants into low- and high-VWM capacity groups. We found that regardless of the VWM capacity, the irrelevant high-discriminable information was selected into VWM, whereas the irrelevant fine-grained information was filtered out. The latter finding was further corroborated in a second experiment in which the participants were required to remember one colored-landolt-C and a more strict control was exerted over the VWM capacity. Conclusions/Significance We conclude that VWM capacity did not modulate the feature-based filtering in VWM.

Social grouping: perceptual grouping of objects by cooperative but not competitive relationships in dynamic chase.

Historically, perceptual grouping is associated with physical principles. This article reports a novel finding that social information-cooperative but not competitive relationships-can drive perceptual grouping of objects in dynamic chase. Particularly, each relationship was constructed with human-generated chasing motions (i.e., two predators and one prey), and its role on perceptual grouping was examined by grouping-induced effect-attentional consequences. The results showed that: (1) Predators can be perceived as a group due to their cooperative relationship, causing attention to automatically spread within grouped predators, thus the response to target appearing on uncued predator is also facilitated; and (2) The attentional effect on competitive predators has no difference from any condition which controls low-level motion patterns, even including the random-motion condition wherein no grouping factor was contained. These findings extend perceptual grouping into the social field, implying that social information gets involved in visual cognition at an early perceptual stage.

Social constraints from an observer’s perspective: Coordinated actions make an agent’s position more predictable

Action prediction, a crucial ability to support social activities, is sensitive to the individual goals of expected actions. This article reports a novel finding that the predictions of observed actions for a temporarily invisible agent are influenced, and even enhanced, when this agent has a joint/collective goal to implement coordinated actions with others (i.e., with coordination information). Specifically, we manipulated the coordination information by presenting two chasers and one common target to perform coordinated or individual chases, and subjects were required to predict the expected action (i.e., position) for one chaser after it became momentarily invisible. To control for possible low-level physical properties, we also established some intense paired controls for each type of chase, such as backward replay (Experiment 1), making the chasing target invisible (Experiment 2) and a direct manipulation of the goal-directedness of one chasers movements to disrupt coordination information (Experiment 3). The results show that the prediction error for invisible chasers depends on whether the second chaser is coordinated with the first, and this effect vanishes when the chasers behaves with exactly the same motions, but without coordination information between them; furthermore, this influence results in enhancing the performance of action prediction. These findings extend the influential factors of action prediction to the level of observed coordination information, implying that the functional characteristic of mutual constraints of coordinated actions can be utilized by vision.

Binding biological motion and visual features in working memory.

Working memory mechanisms for binding have been examined extensively in the last decade, yet few studies have explored bindings relating to human biological motion (BM). Human BM is the most salient and biologically significant kinetic information encountered in everyday life and is stored independently from other visual features (e.g., colors). The current study explored 3 critical issues of BM-related binding in working memory: (a) how many BM binding units can be retained in working memory, (b) whether involuntarily object-based binding occurs during BM binding, and (c) whether the maintenance of BM bindings in working memory requires attention above and beyond that needed to maintain the constituent dimensions. We isolated motion signals of human BM from non-BM sources by using point-light displays as to-be-memorized BM and presented the participants colored BM in a change detection task. We found that working memory capacity for BM-color bindings is rather low; only 1 or 2 BM-color bindings could be retained in working memory regardless of the presentation manners (Experiments 1-3). Furthermore, no object-based encoding took place for colored BM stimuli regardless of the processed dimensions (Experiments 4 and 5). Central executive attention contributes to the maintenance of BM-color bindings, yet maintaining BM bindings in working memory did not require more central attention than did maintaining the constituent dimensions in working memory (Experiment 6). Overall, these results suggest that keeping BM bindings in working memory is a fairly resource-demanding process, yet central executive attention does not play a special role in this cross-module binding.

Deployment of Attention on Handshakes.

Understanding the social structures between objects, organizing, and selecting them accordingly, is fundamental to social cognition. We report an example that demonstrates the object association learned from social interactions could impact visual attention. Particularly, when two hands approach each other to perform a handshake, they tend to be attended to as a unit because of the cooperative relationship exhibited in the action: even a cue presented on a non-target hand may facilitate a response to the targets that appear on the non-cued hand (Experiment 1), indicating that attentional shift between two hands was facilitated; furthermore, the response to a target on one hand is significantly impaired by a distractor on the other hand (Experiment 2), implying that it is difficult to selectively confine attention to a single hand. These effects were dependent on the existence of the hands when cue and target appeared (Experiment 3); neither perceptual familiarity, or physical fit can explain all the attention effects (Experiment 4). These results have bearings on the perceptual root of social cognition.

Number representation is influenced by numerical processing level: an ERP study.

The same numerical magnitude can be manifested in different physical notations. However, how the numbers with distinct notations are mentally represented is still unclear. Here, we hypothesized that how the number is mentally represented is influenced by the numerical processing level of the tasks. If the task only needed a low-level processing, the representation would be dependent on the surface forms of the numbers, exhibiting a numerical notation-dependent effect. By contrast, if the task required a deeper magnitude processing, the processing would utilize an abstract numerical format whose effects are notation independent. To test this hypothesis, we manipulated the notation type and the numerical processing level of the tasks. An ERP component N270 was taken to index the mismatch between the internal representation and the probed number. The results showed that N270 was enhanced when the magnitude was mismatched between two numbers. More importantly, under the task requiring a low-level processing (e.g., magnitude comparison), compared with the same notations, the latency of N270 difference wave was delayed by different notations, exhibiting a notation-dependent effect. However, in the task involving a deeper processing (e.g., magnitude addition), the N270 latencies were earlier for probes having distinct notations (Mandarin or Arabic number) than for probes having the same notations as in the addition operation (Mahjong). Moreover, no difference was found on N270 latencies between the two distinct notations but with similar degree of familiarity. Taken together, these results support our hypothesis that the numerical processing level affects the number representation.

Social attention directs working memory maintenance

Visual working memory (vWM) performance is enhanced when a memorized object is cued after encoding. This so-called retro-cue effect is typically observed with a predictive (80% valid), retrospective cue. The current study examined whether a nonpredictive (50% valid) retro-cue can similarly enhance internal memory representations in cases where the cue conveys social signals. To this end, gaze cues were presented during the retention interval of a change-detection task, which are capable to engender a mutual attentional focus of two individuals towards one location. In line with our prediction, Experiment 1 demonstrated that a polygon presented at the gazed-at location was remembered better than that at both non-gazed and gazed-away locations. Experiments 2 and 3 showed that low-level motion cues did not elicit attentional orienting in a comparable manner as the gaze cue, and these differences in cuing were found to be reliable and independent of memory load. Furthermore, the gaze retro-cue effect disappeared when the face was inverted (Experiment 4). In sum, these results clearly show that sharing the focus of another individual establishes a point of reference from which visual information is restored with priority, suggesting that a gaze retro-cue leads to social attention, thus, modulating vWM maintenance in a reflexive, automatic manner.