Jifan Zhou

Does high memory load kick task-irrelevant information out of visual working memory?

The limited capacity of visual working memory (VWM) requires the existence of an efficient information selection mechanism. While it has been shown that under low VWM load, an irrelevant simple feature can be processed, its fate under high load (e.g., six objects) remains unclear. We explored this issue by probing the “irrelevant-change distracting effect,” in which the change of a stored irrelevant feature affects performance. Simple colored shapes were used as stimuli, with color as the target. Using a whole-probe method (presenting six objects in both the memory and test arrays), in Experiment 1 we found that a change to one of the six shapes led to a significant distracting effect. Using a partial-probe method (presenting the probe either at the screen center or at a location selected from the memory array), in Experiment 2 we showed the distracting effect again. These results suggest that irrelevant simple features can be stored into VWM, regardless of memory load.

Visual Working Memory Capacity Does Not Modulate the Feature-Based Information Filtering in Visual Working Memory

Background The limited capacity of visual working memory (VWM) requires us to select the task relevant information and filter out the irrelevant information efficiently. Previous studies showed that the individual differences in VWM capacity dramatically influenced the way we filtered out the distracters displayed in distinct spatial-locations: low-capacity individuals were poorer at filtering them out than the high-capacity ones. However, when the target and distracting information pertain to the same object (i.e., multiple-featured object), whether the VWM capacity modulates the feature-based filtering remains unknown. Methodology/Principal Findings We explored this issue mainly based on one of our recent studies, in which we asked the participants to remember three colors of colored-shapes or colored-landolt-Cs while using two types of task irrelevant information. We found that the irrelevant high-discriminable information could not be filtered out during the extraction of VWM but the irrelevant fine-grained information could be. We added 8 extra participants to the original 16 participants and then split the overall 24 participants into low- and high-VWM capacity groups. We found that regardless of the VWM capacity, the irrelevant high-discriminable information was selected into VWM, whereas the irrelevant fine-grained information was filtered out. The latter finding was further corroborated in a second experiment in which the participants were required to remember one colored-landolt-C and a more strict control was exerted over the VWM capacity. Conclusions/Significance We conclude that VWM capacity did not modulate the feature-based filtering in VWM.

Social grouping: perceptual grouping of objects by cooperative but not competitive relationships in dynamic chase.

Historically, perceptual grouping is associated with physical principles. This article reports a novel finding that social information-cooperative but not competitive relationships-can drive perceptual grouping of objects in dynamic chase. Particularly, each relationship was constructed with human-generated chasing motions (i.e., two predators and one prey), and its role on perceptual grouping was examined by grouping-induced effect-attentional consequences. The results showed that: (1) Predators can be perceived as a group due to their cooperative relationship, causing attention to automatically spread within grouped predators, thus the response to target appearing on uncued predator is also facilitated; and (2) The attentional effect on competitive predators has no difference from any condition which controls low-level motion patterns, even including the random-motion condition wherein no grouping factor was contained. These findings extend perceptual grouping into the social field, implying that social information gets involved in visual cognition at an early perceptual stage.

The working memory Ponzo illusion: Involuntary integration of visuospatial information stored in visual working memory

Visual working memory (VWM) has been traditionally viewed as a mental structure subsequent to visual perception that stores the final output of perceptual processing. However, VWM has recently been emphasized as a critical component of online perception, providing storage for the intermediate perceptual representations produced during visual processing. This interactive view holds the core assumption that VWM is not the terminus of perceptual processing; the stored visual information rather continues to undergo perceptual processing if necessary. The current study tests this assumption, demonstrating an example of involuntary integration of the VWM content, by creating the Ponzo illusion in VWM: when the Ponzo illusion figure was divided into its individual components and sequentially encoded into VWM, the temporally separated components were involuntarily integrated, leading to the distorted length perception of the two horizontal lines. This VWM Ponzo illusion was replicated when the figure components were presented in different combinations and presentation order. The magnitude of the illusion was significantly correlated between VWM and perceptual versions of the Ponzo illusion. These results suggest that the information integration underling the VWM Ponzo illusion is constrained by the laws of visual perception and similarly affected by the common individual factors that govern its perception. Thus, our findings provide compelling evidence that VWM functions as a buffer serving perceptual processes at early stages.

Perceived Causalities of Physical Events Are Influenced by Social Cues

In simple mechanical events, we can directly perceive causal interactions of the physical objects. Physical cues (especially spatiotemporal features of the display) are found to associate with causal perception. Here, we demonstrate that cues of a completely different domain--social cues--also impact the causal perception of physical events: The causally ambiguous events are more likely to be perceived as causal if the faces superimposed on the objects change from neutral to fearful. This effect has the following major properties: (a) The effect is caused by social information because it disappears when the faces are inverted or when the expression changes are unreasonable; (b) the social cues are integrated in a temporal window different from physical cues; and (c) the social cues impact the perception process rather than the decision process as the impact also appears in the causality-induced illusion. These findings suggest that the visual system relies on social information to infer the causal structure of the physical world.

Losing control in front of a fearful face: The effect of emotional information on cognitive control

How is our cognitive control system modulated by emotional information, especially fearful stimuli? An intuitive hypothesis is that fearful stimuli would enhance cognitive control so that people could switch from the ongoing task to emergent events more quickly to secure themselves. To test this hypothesis, we investigated the influence of emotional information on the shift function of cognitive control by using the task-cueing procedure, in which face images were presented as cues. With the gender of faces indicating which task to do, we manipulated the emotional valence of faces (neutral vs. fearful), finding that the switch costs were larger in the trials containing fearful cues than in the trials containing neutral cues (Experiment 1). This effect was not caused by enlarging task-set interference (Experiment 2), nor by slowing down cue encoding (Experiment 3). Contrary to the intuitive hypothesis, our results suggested that the endogenous task-set reconfiguration process was impaired when fearful faces were presented. We speculated that the benefit of decreasing cognitive flexibility in face of fearful stimuli is to speed up response in a dangerous environment, and this accelerating response is achieved by suppressing the goal-directed system to permit the fast, automatic stimulus-driven system to govern behaviours.

Attentional bias in competitive situations: winner does not take all

Compared to previous studies of competition with participants’ direct involvement, the current study for the first time investigated the influence of competitive outcomes on attentional bias from a perspective of an onlooker. Two simple games were employed: the Rock-Paper-Scissors game (Experiment 1) in which the outcome is based on luck, and Arm-wrestling (Experiment 2), in which the outcome is based on the competitors’ strength. After observing one of these games, participants were asked to judge a stimulus presented on either the winner’s or loser’s side of a screen. Both experiments yielded the same results, indicating that the onlookers made much quicker judgments on stimuli presented on the loser’s side than the winner’s side. This suggests the existence of an attention bias for loser-related information once a competition has ended. Our findings provide a new lens through which the influence of competition results on human cognitive processing can be understood.

The role of spatial configuration in multiple identity tracking.

Background The simultaneous tracking and identification of multiple moving objects encountered in everyday life requires one to correctly bind identities to objects. In the present study, we investigated the role of spatial configuration made by multiple targets when observers are asked to track multiple moving objects with distinct identities. Methodology/Principal Findings The overall spatial configuration made by the targets was manipulated: In the constant condition, the configuration remained as a virtual convex polygon throughout the tracking, and in the collapsed condition, one of the moving targets (critical target) crossed over an edge of the virtual polygon during tracking, destroying it. Identification performance was higher when the configuration remained intact than when it collapsed (Experiments 1a, 1b, and 2). Moreover, destroying the configuration affected the allocation of dynamic attention: the critical target captured more attention than did the other targets. However, observers were worse at identifying the critical target and were more likely to confuse it with the targets that formed the virtual crossed edge (Experiments 3–5). Experiment 6 further showed that the visual system constructs an overall configuration only by using the targets (and not the distractors); identification performance was not affected by whether the distractor violated the spatial configuration. Conclusions/Significance In sum, these results suggest that the visual system may integrate targets (but not distractors) into a spatial configuration during multiple identity tracking, which affects the distribution of dynamic attention and the updating of identity-location binding.

Perceiving crowd attention: Gaze following in human crowds with conflicting cues

People automatically redirect their visual attention by following others’ gaze orientation, a phenomenon called “gaze following.” This is an evolutionarily generated socio-cognitive process that provides people with information about their environments. Often, however, people in crowds can have rather different gaze orientations. This study investigated how gaze following occurs in situations with many conflicting gazes. In two experiments, we modified the gaze cueing paradigm to use a crowd rather than a single individual. Specifically, participants were presented with a group of human avatars with differing gaze orientations, and the target appeared randomly on the left or right side of a display. We found that (a) when a marked difference existed in the number of avatars with divergent gaze orientations, participants automatically followed the majority’s gaze orientation, and (b) the strongest gaze cue effect occurred when all gazes shared the same orientation, with the response superiority of the majority’s oriented location monotonically diminishing with the number of gazes with divergent orientations. These findings suggested that the majority rule plays a role in gaze following behavior when individuals are confronted with conflicting multigaze scenes, and that an increasing subgroup size appears to enlarge the strength of the gaze cueing effect.

Deployment of Attention on Handshakes.

Understanding the social structures between objects, organizing, and selecting them accordingly, is fundamental to social cognition. We report an example that demonstrates the object association learned from social interactions could impact visual attention. Particularly, when two hands approach each other to perform a handshake, they tend to be attended to as a unit because of the cooperative relationship exhibited in the action: even a cue presented on a non-target hand may facilitate a response to the targets that appear on the non-cued hand (Experiment 1), indicating that attentional shift between two hands was facilitated; furthermore, the response to a target on one hand is significantly impaired by a distractor on the other hand (Experiment 2), implying that it is difficult to selectively confine attention to a single hand. These effects were dependent on the existence of the hands when cue and target appeared (Experiment 3); neither perceptual familiarity, or physical fit can explain all the attention effects (Experiment 4). These results have bearings on the perceptual root of social cognition.