Nathan Van der Stoep

Exploring near and far regions of space: Distance- specific visuospatial neglect after stroke

Visuospatial neglect has been observed in the horizontal (left/right) and vertical (up/down) dimension and depends on the distance at which a task is presented (near/far). Previously, studies have mainly focused on investigating the overall severity of neglect in near and far space in a group of neglect patients instead of examining subgroups of neglect patients with different types of distance-specific neglect. We investigated the spatial specificity (near vs. far space), frequency, and severity of neglect in the horizontal and vertical dimensions in a large group of stroke patients. We used three tasks to assess neglect in near (30 cm) and far (120 cm) space: a shape cancellation, letter cancellation, and a line bisection task. Patients were divided into four groups based on their performance: a group without neglect (N–F–), a near only neglect (N+F–), a far only neglect (N–F+), and a near and far neglect group (N+F+). About 40% of our sample showed neglect. Depending on the task, N+F– was observed in 8 to 22% of the sample, whereas N–F+ varied between 8% and 11%, and N+F+ varied between 11% to 14% of the sample. The current findings indicate that horizontal and vertical biases in performance can be confined to one region of space and are task dependent. We recommend testing for far space neglect during neuropsychological assessments in clinical practice, because this cannot be diagnosed using standard paper-and-pencil tasks.

One Way and the Other: The Bidirectional Relationship Between Ambivalence and Body Movement

Prior research exploring the relationship between evaluations and body movements has focused on one-sided evaluations. However, people regularly encounter objects or situations about which they simultaneously hold both positive and negative views, which results in the experience of ambivalence. Such experiences are often described in physical terms: For example, people say they are “wavering” between two sides of an issue or are “torn.” Building on this observation, we designed two studies to explore the relationship between the experience of ambivalence and side-to-side movement, or wavering. In Study 1, we used a Wii Balance Board to measure movement and found that people who are experiencing ambivalence move from side to side more than people who are not experiencing ambivalence. In Study 2, we induced body movement to explore the reverse relationship and found that when people are made to move from side to side, their experiences of ambivalence are enhanced.

Language comprehension in the balance: The Robustness of the action-compatibility effect (ACE)

How does language comprehension interact with motor activity? We investigated the conditions under which comprehending an action sentence affects peoples balance. We performed two experiments to assess whether sentences describing forward or backward movement modulate the lateral movements made by subjects who made sensibility judgments about the sentences. In one experiment subjects were standing on a balance board and in the other they were seated on a balance board that was mounted on a chair. This allowed us to investigate whether the action compatibility effect (ACE) is robust and persists in the face of salient incompatibilities between sentence content and subject movement. Growth-curve analysis of the movement trajectories produced by the subjects in response to the sentences suggests that the ACE is indeed robust. Sentence content influenced movement trajectory despite salient inconsistencies between implied and actual movement. These results are interpreted in the context of the current discussion of embodied, or grounded, language comprehension and meaning representation.

Neglecting posture: differences in balance impairments between peripersonal and extrapersonal neglect

Neglect is a heterogeneous disorder and may be specific for only peripersonal or extrapersonal space. Behavioural consequences at the level of independency in basic activities of daily living differ between patients with peripersonal and those with extrapersonal neglect. One of the most important factors that determine independency in basic activities of daily living is balance. Here, potential differences in postural imbalance between patients with peripersonal and those with extrapersonal neglect were investigated. A total of 81 stroke patients were screened within the first 2 weeks after admission to the rehabilitation centre. Mediolateral (horizontal) and anteroposterior (vertical) displacements of the centre of pressure (CoP) were measured using a Nintendo Wii Balance Board in an eyes-open and eyes-closed condition. Patients with peripersonal neglect showed a significant displacement of mediolateral CoP from the ideal CoP, but not in the anteroposterior dimension or postural sway. Patients with extrapersonal neglect did not differ from the no-neglect patients in terms of displacement of both mediolateral and anteroposterior CoP and postural sway. There were no differences between the eyes-open and eyes-closed conditions in any of the groups. Consequences of region-specific neglect on postural imbalance appear to be very specific and cannot be accounted for by neglecting visual information only. The current findings might directly reflect a relation between body perception and body representation and (actions in) peripersonal space. When diagnosing neglect, it is relevant to distinguish the type of region-specific neglect and, when needed, to adjust the rehabilitation programme accordingly.

On the contribution of overt tactile expectations to visuo-tactile interactions within the peripersonal space

Since the discovery of neural regions in the monkey brain that respond preferentially to multisensory stimuli presented in proximal space, researchers have been studying this specialised spatial representation in humans. It has been demonstrated that approaching auditory or visual stimuli modulate tactile processing, while they are within the peripersonal space (PPS). The aim of the current study is to investigate the additional effects of tactile expectation on the PPS-related multisensory interactions. Based on the output of a computational simulation, we expected that as tactile expectation increases rapidly during the course of the motion of the visual stimulus, the outcome RT curves would mask the multisensory contribution of PPS. When the tactile expectation remains constant during the motion, the PPS-related spatially selective multisensory processes become apparent. The behavioural results on human experiments followed the pattern predicted by the simulation. That is, rapidly changing levels of tactile expectation, caused by dynamic visual stimuli, masks the outcome of the multisensory processes within peripersonal space. This indicates that both PPS-related multisensory interactions and tactile expectations play an important role in anticipating and responding to interactions with the body.

Exogenous orienting of crossmodal attention in 3-D space: Support for a depth-aware crossmodal attentional system

The aim of the present study was to investigate exogenous crossmodal orienting of attention in three-dimensional (3-D) space. Most studies in which the orienting of attention has been examined in 3-D space concerned either exogenous intramodal or endogenous crossmodal attention. Evidence for exogenous crossmodal orienting of attention in depth is lacking. Endogenous and exogenous attention are behaviorally different, suggesting that they are two different mechanisms. We used the orthogonal spatial-cueing paradigm and presented auditory exogenous cues at one of four possible locations in near or far space before the onset of a visual target. Cues could be presented at the same (valid) or at a different (invalid) depth from the target (radial validity), and on the same (valid) or on a different (invalid) side (horizontal validity), whereas we blocked the depth at which visual targets were presented. Next to an overall validity effect (valid RTs < invalid RTs) in horizontal space, we observed an interaction between the horizontal and radial validity of the cue: The horizontal validity effect was present only when the cue and the target were presented at the same depth. No horizontal validity effect was observed when the cue and the target were presented at different depths. These results suggest that exogenous crossmodal attention is “depth-aware,” and they are discussed in the context of the supramodal hypothesis of attention.

The cost of making an eye movement: A direct link between visual working memory and saccade execution

To facilitate visual continuity across eye movements, the visual system must presaccadically acquire information about the future foveal image. Previous studies have indicated that visual working memory (VWM) affects saccade execution. However, the reverse relation, the effect of saccade execution on VWM load is less clear. To investigate the causal link between saccade execution and VWM, we combined a VWM task and a saccade task. Participants were instructed to remember one, two, or three shapes and performed either a No Saccade-, a Single Saccade- or a Dual (corrective) Saccade-task. The results indicate that items stored in VWM are reported less accurately if a single saccade-or a dual saccade-task is performed next to retaining items in VWM. Importantly, the loss of response accuracy for items retained in VWM by performing a saccade was similar to committing an extra item to VWM. In a second experiment, we observed no cost of executing a saccade for auditory working memory performance, indicating that executing a saccade exclusively taxes the VWM system. Our results suggest that the visual system presaccadically stores the upcoming retinal image, which has a similar VWM load as committing one extra item to memory and interferes with stored VWM content. After the saccade, the visual system can retrieve this item from VWM to evaluate saccade accuracy. Our results support the idea that VWM is a system which is directly linked to saccade execution and promotes visual continuity across saccades.

Object files across eye movements: Previous fixations affect the latencies of corrective saccades

One of the factors contributing to a seamless visual experience is object correspondence—that is, the integration of pre- and postsaccadic visual object information into one representation. Previous research had suggested that before the execution of a saccade, a target object is loaded into visual working memory and subsequently is used to locate the target object after the saccade. Until now, studies on object correspondence have not taken previous fixations into account. In the present study, we investigated the influence of previously fixated information on object correspondence. To this end, we adapted a gaze correction paradigm in which a saccade was executed toward either a previously fixated or a novel target. During the saccade, the stimuli were displaced such that the participant’s gaze landed between the target stimulus and a distractor. Participants then executed a corrective saccade to the target. The results indicated that these corrective saccades had lower latencies toward previously fixated than toward nonfixated targets, indicating object-specific facilitation. In two follow-up experiments, we showed that presaccadic spatial and object (surface feature) information can contribute separately to the execution of a corrective saccade, as well as in conjunction. Whereas the execution of a corrective saccade to a previously fixated target object at a previously fixated location is slowed down (i.e., inhibition of return), corrective saccades toward either a previously fixated target object or a previously fixated location are facilitated. We concluded that corrective saccades are executed on the basis of object files rather than of unintegrated feature information.

Responding to sounds from unseen locations: Crossmodal attentional orienting in response to sounds presented from the rear

To date, most of the research on spatial attention has focused on probing peoples responses to stimuli presented in frontal space. That is, few researchers have attempted to assess what happens in the space that is currently unseen (essentially rear space). In a sense, then, ‘out of sight’ is, very much, ‘out of mind’. In this review, we highlight what is presently known about the perception and processing of sensory stimuli (focusing on sounds) whose source is not currently visible. We briefly summarize known differences in the localizability of sounds presented from different locations in 3D space, and discuss the consequences for the crossmodal attentional and multisensory perceptual interactions taking place in various regions of space. The latest research now clearly shows that the kinds of crossmodal interactions that take place in rear space are very often different in kind from those that have been documented in frontal space. Developing a better understanding of how people respond to unseen sound sources in naturalistic environments by integrating findings emerging from multiple fields of research will likely lead to the design of better warning signals in the future. This review highlights the need for neuroscientists interested in spatial attention to spend more time researching what happens (in terms of the covert and overt crossmodal orienting of attention) in rear space.

Auditory spatial attention is encoded in a retinotopic reference frame across eye-movements

The retinal location of visual information changes each time we move our eyes. Although it is now known that visual information is remapped in retinotopic coordinates across eye-movements (saccades), it is currently unclear how head-centered auditory information is remapped across saccades. Keeping track of the location of a sound source in retinotopic coordinates requires a rapid multi-modal reference frame transformation when making saccades. To reveal this reference frame transformation, we designed an experiment where participants attended an auditory or visual cue and executed a saccade. After the saccade had landed, an auditory or visual target could be presented either at the prior retinotopic location or at an uncued location. We observed that both auditory and visual targets presented at prior retinotopic locations were reacted to faster than targets at other locations. In a second experiment, we observed that spatial attention pointers obtained via audition are available in retinotopic coordinates immediately after an eye-movement is made. In a third experiment, we found evidence for an asymmetric cross-modal facilitation of information that is presented at the retinotopic location. In line with prior single cell recording studies, this study provides the first behavioral evidence for immediate auditory and cross-modal transsaccadic updating of spatial attention. These results indicate that our brain has efficient solutions for solving the challenges in localizing sensory input that arise in a dynamic context.