Anja Schlack

Polymodal Motion Processing in Posterior Parietal and Premotor Cortex: A Human fMRI Study Strongly Implies Equivalencies between Humans and Monkeys

In monkeys, posterior parietal and premotor cortex play an important integrative role in polymodal motion processing. In contrast, our understanding of the convergence of senses in humans is only at its beginning. To test for equivalencies between macaque and human polymodal motion processing, we used functional MRI in normals while presenting moving visual, tactile, or auditory stimuli. Increased neural activity evoked by all three stimulus modalities was found in the depth of the intraparietal sulcus (IPS), ventral premotor, and lateral inferior postcentral cortex. The observed activations strongly suggest that polymodal motion processing in humans and monkeys is supported by equivalent areas. The activations in the depth of IPS imply that this area constitutes the human equivalent of macaque area VIP.

Multisensory Space Representations in the Macaque Ventral Intraparietal Area

Animals can use different sensory signals to localize objects in the environment. Depending on the situation, the brain either integrates information from multiple sensory sources or it chooses the modality conveying the most reliable information to direct behavior. This suggests that somehow, the brain has access to a modality-invariant representation of external space. Accordingly, neural structures encoding signals from more than one sensory modality are best suited for spatial information processing. In primates, the posterior parietal cortex (PPC) is a key structure for spatial representations. One substructure within human and macaque PPC is the ventral intraparietal area (VIP), known to represent visual, vestibular, and tactile signals. In the present study, we show for the first time that macaque area VIP neurons also respond to auditory stimulation. Interestingly, the strength of the responses to the acoustic stimuli greatly depended on the spatial location of the stimuli [i.e., most of the auditory responsive neurons had surprisingly small spatially restricted auditory receptive fields (RFs)]. Given this finding, we compared the auditory RF locations with the respective visual RF locations of individual area VIP neurons. In the vast majority of neurons, the auditory and visual RFs largely overlapped. Additionally, neurons with well aligned visual and auditory receptive fields tended to encode multisensory space in a common reference frame. This suggests that area VIP constitutes a part of a neuronal circuit involved in the computation of a modality-invariant representation of external space.

Space Coding in Primate Posterior Parietal Cortex

Neuropsychological studies of patients with lesions of right frontal (premotor) or posterior parietal cortex often show severe impairments of attentive sensorimotor behavior. Such patients frequently manifest symptoms like hemispatial neglect or extinction. Interestingly, these behavioral deficits occur across different sensory modalities and are often organized in head- or body-centered coordinates. These neuropsychological data provide evidence for the existence of a network of polymodal areas in (primate) premotor and inferior parietal cortex representing visual spatial information in a nonretinocentric frame of reference. In the monkey, a highly modular structural and functional specialization has been demonstrated especially within posterior parietal cortex. One such functionally specialized area is the ventral intraparietal area (VIP). This area is located in the fundus of the intraparietal sulcus and contains many neurons that show polymodal directionally selective discharges, i.e., these neurons respond to moving visual, tactile, vestibular, or auditory stimuli. Many of these neurons also encode sensory information from different modalities in a common, probably head-centered, frame of reference. Functional imaging data on humans reveal a network of cortical areas that respond to polymodal stimuli conveying motion information. One of these regions of activation is located in the depth of human intraparietal sulcus. Accordingly, it is suggested that this area constitutes the human equivalent of monkey area VIP. The functional role of area VIP for polymodal spatial perception in normals as well as the functional implications of lesions of area VIP in parietal patients needs to be established in further experiments.

Interaction of linear vestibular and visual stimulation in the macaque ventral intraparietal area (VIP)

Navigation in space requires the brain to combine information arising from different sensory modalities with the appropriate motor commands. Sensory information about self‐motion in particular is provided by the visual and the vestibular system. The macaque ventral intraparietal area (VIP) has recently been shown to be involved in the processing of self‐motion information provided by optical flow, to contain multimodal neurons and to receive input from areas involved in the analysis of vestibular information. By studying responses to linear vestibular, visual and bimodal stimulation we aimed at gaining more insight into the mechanisms involved in multimodal integration and self‐motion processing. A large proportion of cells (77%) revealed a significant response to passive linear translation of the monkey. Of these cells, 59% encoded information about the direction of self‐motion. The phase relationship between vestibular stimulation and neuronal responses covered a broad spectrum, demonstrating the complexity of the spatio‐temporal pattern of vestibular information encoded by neurons in area VIP. For 53% of the direction‐selective neurons the preferred directions for stimuli of both modalities were the same; they were opposite for the remaining 47% of the neurons. During bimodal stimulation the responses of neurons with opposite direction selectivity in the two modalities were determined either by the visual (53%) or the vestibular (47%) modality. These heterogeneous responses to unimodal and bimodal stimulation might be used to prevent misjudgements about self‐ and/or object‐motion, which could be caused by relying on information of one sensory modality alone.

Selectivity of macaque ventral intraparietal area (area VIP) for smooth pursuit eye movements

In the posterior parietal cortex (PPC) of the macaque, spatial and motion signals arising from different sensory signals converge. One of the functional subregions within the PPC, the ventral intraparietal area (VIP), is thought to play an important role for the multisensory encoding of self‐ and object motion. In the present study we analysed the activity of area VIP neurons related to smooth pursuit eye movements (SPEMs). Fifty‐three per cent of the neurons (123/234) were selective for the direction of the SPEMs. As evident from control experiments, activity observed during smooth eye movements was more closely related to extraretinal signals than visual parameters. In addition, we examined the sensitivity of area VIP neurons for the velocity of SPEMs. Seventy‐four per cent of the pursuit‐related neurons had a significant velocity tuning. There was a clear preference for high velocities. Eighty‐six per cent of the neurons preferred the highest pursuit velocity (40 deg s−1) employed in our study. In everyday life, high pursuit velocities most frequently occur if the pursuit target is located in near‐extrapersonal space, i.e. the action space of the head. Together with previous findings, the current results thus suggest that the information provided by VIP neurons may be used to encode motion in near‐extrapersonal space and to guide and co‐ordinate smooth eye and head movements within this very part of space.

Remembering visual motion: neural correlates of associative plasticity and motion recall in cortical area MT.

The pictorial content of visual memories recalled by association is embodied by neuronal activity at the highest processing stages of primate visual cortex. This activity is elicited by top-down signals from the frontal lobe and recapitulates the bottom-up pattern normally obtained by the recalled stimulus. To explore the generality and mechanisms of this phenomenon, we recorded motion-sensitive neurons at an early stage of cortical processing. After monkeys learned to associate directions of motion with static shapes, these neurons exhibited unprecedented selectivity for the shapes. This emergent shape selectivity reflects activation of neurons representing the motion stimuli recalled by association, and it suggests that recall-related activity may be a general feature of neurons in visual cortex.

Speed perception during acceleration and deceleration

We have recently shown that stimulus acceleration affects subsequent preferred speed and tuning widths of macaque area MT neurons (A. Schlack, B. Krekelberg, & T. D. Albright, 2007). Given the close link between area MT and speed perception, this predicts that speed perception should depend on the acceleration context. Here, we show that this is indeed the case for both speed discrimination and speed perception. Specifically, speed discrimination thresholds improve in an acceleration context but absolute speeds are more underestimated than in a deceleration context. In line with our physiological data, these changes can be understood in terms of speed-dependent adaptation mechanisms in MT and do not require an explicit acceleration dependence of speed perception.

Encoding of movement in near extrapersonal space in primate area VIP

Many neurons in the macaque ventral intraparietal area (VIP) are multimodal, i.e., they respond not only to visual but also to tactile, auditory and vestibular stimulation. Anatomical studies have shown distinct projections between area VIP and a region of premotor cortex controlling head movements. A specific function of area VIP could be to guide movements in order to head for and/or to avoid objects in near extrapersonal space. This behavioral role would require a consistent representation of visual motion within 3-D space and enhanced activity for nearby motion signals. Accordingly, in our present study we investigated whether neurons in area VIP are sensitive to moving visual stimuli containing depth signals from horizontal disparity. We recorded single unit activity from area VIP of two awake behaving monkeys (Macaca mulatta) fixating a central target on a projection screen. Sensitivity of neurons to horizontal disparity was assessed by presenting large field moving images (random dot fields) stereoscopically to the two eyes by means of LCD shutter goggles synchronized with the stimulus computer. During an individual trial, stimuli had one of seven different disparity values ranging from 3° uncrossed- (far) to 3° crossed- (near) disparity in 1° steps. Stimuli moved at constant speed in all simulated depth planes. Different disparity values were presented across trials in pseudo-randomized order. Sixty-one percent of the motion sensitive cells had a statistically significant selectivity for the horizontal disparity of the stimulus (p < 0.05, distribution free ANOVA). Seventy-five percent of them preferred crossed-disparity values, i.e., moving stimuli in near space, with the highest mean activity for the nearest stimulus. At the population level, preferred direction of visual stimulus motion was not affected by horizontal disparity. Thus, our findings are in agreement with the behavioral role of area VIP in the representation of movement in near extrapersonal space.

Visual selectivity for heading in the macaque ventral intraparietal area

The patterns of optic flow seen during self-motion can be used to determine the direction of ones own heading. Tracking eye movements which typically occur during everyday life alter this task since they add further retinal image motion and (predictably) distort the retinal flow pattern. Humans employ both visual and nonvisual (extraretinal) information to solve a heading task in such case. Likewise, it has been shown that neurons in the monkey medial superior temporal area (area MST) use both signals during the processing of self-motion information. In this article we report that neurons in the macaque ventral intraparietal area (area VIP) use visual information derived from the distorted flow patterns to encode heading during (simulated) eye movements. We recorded responses of VIP neurons to simple radial flow fields and to distorted flow fields that simulated self-motion plus eye movements. In 59% of the cases, cell responses compensated for the distortion and kept the same heading selectivity irrespective of different simulated eye movements. In addition, response modulations during real compared with simulated eye movements were smaller, being consistent with reafferent signaling involved in the processing of the visual consequences of eye movements in area VIP. We conclude that the motion selectivities found in area VIP, like those in area MST, provide a way to successfully analyze and use flow fields during self-motion and simultaneous tracking movements.

Multisensory self-motion encoding in parietal cortex

Navigation through the environment requires the brain to process a number of incoming sensory signals, such as visual optical flow on the retina and motion information originating from the vestibular organs. In addition, tactile as well as auditory signals can help to disambiguate the continuous stream of incoming information and determining the signals resulting from ones own set of motion. In this review I will focus on the cortical processing of motion information in one subregion of the posterior parietal cortex, i.e., the ventral intraparietal area (VIP). I will review (1) electrophysiological data from single cell recordings in the awake macaque showing how self‐motion signals across different sensory modalities are represented within this area and (2) data from fMRI recordings in normal human subjects providing evidence for the existence of a functionally equivalent area of macaque area VIP in the human cortex.