Junying Liang

Storing fine detailed information in visual working memory—Evidence from event-related potentials

Visual working memory (VWM) maintains and manipulates a limited set of visual objects being actively used in visual processing. To explore whether and how the fine detailed information is stored in VWM, four experiments have been conducted while recording the contralateral delay activity (CDA), an event-related potential difference wave that reflects the information maintenance in VWM. The type of the remembered information was manipulated by adopting simple objects and complex objects as materials. We found the amplitude of CDA was modulated by object complexity: as the set size of memory array rose from 2 to 4, the amplitude of CDA stopped increasing for maintaining complex objects with detailed information, while continued increasing for storing highly discriminable simple objects. These results suggest that VWM can store the fine detailed information; however it can not store all the fine detailed information from 4 complex objects. It implies that the capacity of VWM is not only characterized by a fixed number of objects, there is at least one stage influenced by the detailed information contained in the objects. These results are further discussed within a two-stage storing model of VWM: different types of perceptual information (highly discriminable features and fine detailed features) are maintained in VWM via two distinctive mechanisms.

Dependency distance: A new perspective on syntactic patterns in natural languages

Dependency distance, measured by the linear distance between two syntactically related words in a sentence, is generally held as an important index of memory burden and an indicator of syntactic difficulty. Since this constraint of memory is common for all human beings, there may well be a universal preference for dependency distance minimization (DDM) for the sake of reducing memory burden. This human-driven language universal is supported by big data analyses of various corpora that consistently report shorter overall dependency distance in natural languages than in artificial random languages and long-tailed distributions featuring a majority of short dependencies and a minority of long ones. Human languages, as complex systems, seem to have evolved to come up with diverse syntactic patterns under the universal pressure for dependency distance minimization. However, there always exist a small number of long-distance dependencies in natural languages, which may reflect some other biological or functional constraints. Language system may adapt itself to these sporadic long-distance dependencies. It is these universal constraints that have shaped such a rich diversity of syntactic patterns in human languages.

Coarse-to-Fine Construction for High-Resolution Representation in Visual Working Memory

Background This study explored whether the high-resolution representations created by visual working memory (VWM) are constructed in a coarse-to-fine or all-or-none manner. The coarse-to-fine hypothesis suggests that coarse information precedes detailed information in entering VWM and that its resolution increases along with the processing time of the memory array, whereas the all-or-none hypothesis claims that either both enter into VWM simultaneously, or neither does. Methodology/Principal Findings We tested the two hypotheses by asking participants to remember two or four complex objects. An ERP component, contralateral delay activity (CDA), was used as the neural marker. CDA is higher for four objects than for two objects when coarse information is primarily extracted; yet, this CDA difference vanishes when detailed information is encoded. Experiment 1 manipulated the comparison difficulty of the task under a 500-ms exposure time to determine a condition in which the detailed information was maintained. No CDA difference was found between two and four objects, even in an easy-comparison condition. Thus, Experiment 2 manipulated the memory array’s exposure time under the easy-comparison condition and found a significant CDA difference at 100 ms while replicating Experiment 1′s results at 500 ms. In Experiment 3, the 500-ms memory array was blurred to block the detailed information; this manipulation reestablished a significant CDA difference. Conclusions/Significance These findings suggest that the creation of high-resolution representations in VWM is a coarse-to-fine process.

Does high memory load kick task-irrelevant information out of visual working memory?

The limited capacity of visual working memory (VWM) requires the existence of an efficient information selection mechanism. While it has been shown that under low VWM load, an irrelevant simple feature can be processed, its fate under high load (e.g., six objects) remains unclear. We explored this issue by probing the “irrelevant-change distracting effect,” in which the change of a stored irrelevant feature affects performance. Simple colored shapes were used as stimuli, with color as the target. Using a whole-probe method (presenting six objects in both the memory and test arrays), in Experiment 1 we found that a change to one of the six shapes led to a significant distracting effect. Using a partial-probe method (presenting the probe either at the screen center or at a location selected from the memory array), in Experiment 2 we showed the distracting effect again. These results suggest that irrelevant simple features can be stored into VWM, regardless of memory load.

The neural mechanisms of percept–memory comparison in visual working memory

Researchers have revealed that comparing the perceptual input with the representations stored in visual working memory initiates a rapid attention-shift, which is predominantly triggered by the relevant-feature change. The comprehension of the change contents further necessitates a follow-up comparison that contrasts all the object features regardless of the task relevancy. However, whether such a distinct stage exists and how the process is carried on need further verification. We explored this issue by investigating the underlying neural mechanisms of the percept-memory comparison. By recording EEG, we found that both the task-relevant and -irrelevant feature changes elicited significantly more negative anterior N2 waves (230-340ms) rooting in the anterior cingulate cortex (ACC), and meanwhile activated the frontal theta (5-8Hz, 250-550ms). These results suggest that a distinct comparison stage does exist, which is supported by the anterior N2, ACC and frontal theta.

Social constraints from an observer’s perspective: Coordinated actions make an agent’s position more predictable

Action prediction, a crucial ability to support social activities, is sensitive to the individual goals of expected actions. This article reports a novel finding that the predictions of observed actions for a temporarily invisible agent are influenced, and even enhanced, when this agent has a joint/collective goal to implement coordinated actions with others (i.e., with coordination information). Specifically, we manipulated the coordination information by presenting two chasers and one common target to perform coordinated or individual chases, and subjects were required to predict the expected action (i.e., position) for one chaser after it became momentarily invisible. To control for possible low-level physical properties, we also established some intense paired controls for each type of chase, such as backward replay (Experiment 1), making the chasing target invisible (Experiment 2) and a direct manipulation of the goal-directedness of one chasers movements to disrupt coordination information (Experiment 3). The results show that the prediction error for invisible chasers depends on whether the second chaser is coordinated with the first, and this effect vanishes when the chasers behaves with exactly the same motions, but without coordination information between them; furthermore, this influence results in enhancing the performance of action prediction. These findings extend the influential factors of action prediction to the level of observed coordination information, implying that the functional characteristic of mutual constraints of coordinated actions can be utilized by vision.

Losing control in front of a fearful face: The effect of emotional information on cognitive control

How is our cognitive control system modulated by emotional information, especially fearful stimuli? An intuitive hypothesis is that fearful stimuli would enhance cognitive control so that people could switch from the ongoing task to emergent events more quickly to secure themselves. To test this hypothesis, we investigated the influence of emotional information on the shift function of cognitive control by using the task-cueing procedure, in which face images were presented as cues. With the gender of faces indicating which task to do, we manipulated the emotional valence of faces (neutral vs. fearful), finding that the switch costs were larger in the trials containing fearful cues than in the trials containing neutral cues (Experiment 1). This effect was not caused by enlarging task-set interference (Experiment 2), nor by slowing down cue encoding (Experiment 3). Contrary to the intuitive hypothesis, our results suggested that the endogenous task-set reconfiguration process was impaired when fearful faces were presented. We speculated that the benefit of decreasing cognitive flexibility in face of fearful stimuli is to speed up response in a dangerous environment, and this accelerating response is achieved by suppressing the goal-directed system to permit the fast, automatic stimulus-driven system to govern behaviours.

Nonabstract representation for number - evidence from event-related potentials.

We investigated whether the mental representation of numbers was abstract amodal or modality-dependent by taking N270 as an index, the amplitude that represents the conflict between internal representation and perceptual input. Participants were instructed to justify whether the magnitude of the second number (S2) was similar to that of the preceding number (S1), whereas the surface formats of numbers between S1 and S2 were manipulated. The result indicated that N270 was elicited even when the two numbers were in the same magnitude but displayed in different surface formats. Therefore, our results supported an encoding-complex model for number representations, that is, there are no abstract amodal representations for numbers; instead, they are represented by surface-format-specific codes.

Dependency Distance Differences across Interpreting Types: Implications for Cognitive Demand

Interpreting is generally recognized as a particularly demanding language processing task for the cognitive system. Dependency distance, the linear distance between two syntactically related words in a sentence, is an index of sentence complexity and is also able to reflect the cognitive constraints during various tasks. In the current research, we examine the difference in dependency distance among three interpreting types, namely, simultaneous interpreting, consecutive interpreting and read-out translated speech based on a treebank comprising these types of interpreting output texts with dependency annotation. Results show that different interpreting renditions yield different dependency distances, and consecutive interpreting texts entail the smallest dependency distance other than those of simultaneous interpreting and read-out translated speech, suggesting that consecutive interpreting bears heavier cognitive demands than simultaneous interpreting. The current research suggests for the first time that interpreting is an extremely demanding cognitive task that can further mediate the dependency distance of output sentences. Such findings may be due to the minimization of dependency distance under cognitive constraints.

Noun distribution in natural languages

Abstract Previous research on word class distribution claimed that 37% of word tokens are nouns, suggesting that there might exist a certain regularity of noun proportion among human languages. To explore this possibility, we examined the proportion of noun and four other word classes within British and American English, and across seven languages in terms of different word frequency band. Results indicated that the noun proportion is evidently about or larger than 37%, and meanwhile increases with word rarity. Among frequent words, nouns increase as minor word classes decrease, whereas among rare words, the noun proportion remains a stable level.