A. David Milner

Separate visual pathways for perception and action.

Accumulating neuropsychological, electrophysiological and behavioural evidence suggests that the neural substrates of visual perception may be quite distinct from those underlying the visual control of actions. In other words, the set of object descriptions that permit identification and recognition may be computed independently of the set of descriptions that allow an observer to shape the hand appropriately to pick up an object. We propose that the ventral stream of projections from the striate cortex to the inferotemporal cortex plays the major role in the perceptual identification of objects, while the dorsal stream projecting from the striate cortex to the posterior parietal region mediates the required sensorimotor transformations for visually guided actions directed at such objects.

Chapter 28 Visual pathways to perception and action

Publisher Summary There appears to be important integrative areas within the superior temporal sulcus in the monkey where a great deal of the necessary interaction to ensure behavioral and perceptual unity. Indeed there are many polysensory neurons in these areas, such that not only visual but also cross-modal perceptual integration may be enabled by these networks. Despite the crosstalk between the dorsal and ventral streams, the chapter discusses that each stream uses visual information in different ways. Both streams process information about orientation and shape, and probably about spatial relationships, including depth; and both are subject to the modulatory influences of an animals shifting spatial attention. The ventral stream provide object-centered coding, while the dorsal provide entirely viewer-centered information: the former would enable a monkey to identify an object as being of an edible type, the latter to guide its actions in picking it up. Although there will be differences in the ways that visual information is processed in the two systems, these differences are not a reflection of some biologically arbitrary separation of inputs, but rather a consequence of the special transformations required for perception and action, respectively.

Two distinct modes of control for object-directed action.

There are multiple routes from vision to action that play a role in the production of visually guided reaching and grasping. What remain to be resolved, however, are the conditions under which these various routes are recruited in the generation of actions and the nature of the information they convey. We argue in this chapter that the production of real-time actions to visible targets depends on pathways that are separate from those mediating memory-driven actions. Furthermore, the transition from real-time to memory-driven control occurs as soon as the intended target is no longer visible. Real-time movements depend on pathways from the early visual areas through to relatively encapsulated visuomotor mechanisms in the dorsal stream. These dedicated visuomotor mechanisms, together with motor centers in the premotor cortex and brainstem, compute the absolute metrics of the target object and its position in the egocentric coordinates of the effector used to perform the action. Such real-time programming is essential for the production of accurate and efficient movements in a world where the location and disposition of a goal object with respect to the observer can change quickly and often unpredictably. In contrast, we argue that memory-driven actions make use of a perceptual representation of the target object generated by the ventral stream. Unlike the real-time visuomotor mechanisms, perception-based movement planning makes use of relational metrics and scene-based coordinates. Such computations make it possible, however, to plan and execute actions upon objects long after they have vanished from view.

The fusiform face area is not sufficient for face recognition: evidence from a patient with dense prosopagnosia and no occipital face area.

We tested functional activation for faces in patient D.F., who following acquired brain damage has a profound deficit in object recognition based on form (visual form agnosia) and also prosopagnosia that is undocumented to date. Functional imaging demonstrated that like our control observers, D.F. shows significantly more activation when passively viewing face compared to scene images in an area that is consistent with the fusiform face area (FFA) (p < 0.01). Control observers also show occipital face area (OFA) activation; however, whereas D.F.s lesions appear to overlap the OFA bilaterally. We asked, given that D.F. shows FFA activation for faces, to what extent is she able to recognize faces? D.F. demonstrated a severe impairment in higher level face processing--she could not recognize face identity, gender or emotional expression. In contrast, she performed relatively normally on many face categorization tasks. D.F. can differentiate faces from non-faces given sufficient texture information and processing time, and she can do this is independent of color and illumination information. D.F. can use configural information for categorizing faces when they are presented in an upright but not a sideways orientation and given that she also cannot discriminate half-faces she may rely on a spatially symmetric feature arrangement. Faces appear to be a unique category, which she can classify even when she has no advance knowledge that she will be shown face images. Together, these imaging and behavioral data support the importance of the integrity of a complex network of regions for face identification, including more than just the FFA--in particular the OFA, a region believed to be associated with low-level processing.

Distortion of size perception in visuospatial neglect

BACKGROUND A number of studies have shown that most patients with symptoms of unilateral (left-sided) visuospatial neglect make consistently rightward errors when attempting to bisect a horizontal line at its midpoint. One possible interpretation of this impairment is that such patients misperceive the left half of the line: that is, that they underestimate its extent relative to the right half. RESULTS We have carried out direct tests for such a perceptual distortion in three neglect patients by asking them to make matching judgements on pairs of horizontal rectangles, vertical rectangles or nonsense shapes, of varying relative size, presented on a computer screen. We report here that all of the patients tested showed a significant and substantial relative underestimation of the horizontal extent or area of stimuli presented on the left side of their egocentric space. There was no such misperception of vertical extent. CONCLUSIONS It is suggested that size perception may be partially determined by a representational system that is anatomically centred in the parieto-temporal region of the brain. The results are interpreted in terms of damage to this system in neglect patients.

Prism adaptation improves chronic visual and haptic neglect: A single case study

Visuomotor adaptation to rightward displacing optical prisms is known to induce temporary improvements in the symptoms of left visual neglect. We report a 74 year-old woman with severe and chronic neglect of nine months duration, who underwent three weekly sessions of prism adaptation. Substantial improvements were obtained on tests of visual neglect (cancellation, copying and bisection). Improvement was also observed on a spatial judgement task, with no explicit visual component, in which CS was required to locate the centre of a haptically explored circle. These observations confirm that brief periods of prism exposure can benefit even chronic neglect disorders. Moreover, the improvement observed on the haptic task supports the belief that this procedure can influence higher levels of spatial representation.

The neurological basis of visual neglect

Purpose of reviewA recent study has confirmed the enormous impact of visual neglect on the health services of the western world. Neglect was present in 48% of a sample of 166 right hemisphere stroke patients, and the severity of neglect predicted the extent of functional disability and family burden more accurately than did the extent of brain damage. Given the medical significance of neglect and its tantalizing relevance to understanding human conscious experience, it is unsurprising that the neuropsychological literature concerning the syndrome continues to grow rapidly. Recent findingsWe include brief surveys of six topics currently attracting attention in the field: the anatomical focus of neglect; the visual input pathways implicated; impairments of spatial working memory; the nature of visual extinction; perceptual distortions in neglect; studies on healthy subjects using transcranial magnetic stimulation; and the use of prism adaptation for the rehabilitation of neglect. SummaryThere is steady progress in understanding the essential components of neglect and their brain localization. Every step towards clarity, however, seems to be matched by a new discovery of the inherent complexity of the syndrome. The clinical expression of neglect may reflect the interaction of a variety of spatially lateralized and non-lateralized impairments, not all of which are present in all patients. The quest for an effective technique for the clinical rehabilitation of neglect continues, with prism adaptation emerging as the most promising approach to date.

Two illusions of perceived orientation: one fools all of the people some of the time; the other fools all of the people all of the time

AbstractIn a series of three separate experiments, we studied two different orientation illusions, in both of which vertical lines appear tilted as a result of being set against a tilted background pattern. The ‘simultaneous tilt illusion’ (STI), in which a target grating is viewed within an abutting tilted grating surround, is thought to originate early in the cortical processing of visual contours. In contrast, the ‘rod-and-frame’ illusion (RFI), which is induced by a distant tilted frame, is thought to originate much later in the perceptual processing system. In the first two experiments we found that orientationguided action was virtually impervious to the RFI, whereas both perceptual experience and action were equally influenced by the STI. In the third experiment, in which the two illusions were pitted one against the other, an opposite pattern of effects emerged, such that visuomotor performance was now deceived by the illusion much more than was perceptual experience. This pattern of association and dissociation in the effects of visual illusions on perception versus action can best be explained within a two-visual-systems model of cortical processing.

Behavioral and Neuroimaging Evidence for a Contribution of Color and Texture Information to Scene Classification in a Patient with Visual Form Agnosia

A common notion is that object perception is a necessary precursor to scene perception. Behavioral evidence suggests, however, that scene perception can operate independently of object perception. Further, neuroimaging has revealed a specialized human cortical area for viewing scenes that is anatomically distinct from areas activated by viewing objects. Here we show that an individual with visual form agnosia, D.F., who has a profound deficit in object recognition but spared color and visual texture perception, could still classify scenes and that she was fastest when the scenes were presented in the appropriate color. When scenes were presented as black-and-white images, she made a large number of errors in classification. Functional magnetic resonance imaging revealed selective activation in the parahippocampal place area (PPA) when D.F. viewed scenes. Unlike control observers, D.F. demonstrated higher activation in the PPA for scenes presented in the appropriate color than for black-and-white versions. The results demonstrate that an individual with profound form vision deficits can still use visual texture and color to classify scenesand that this intact ability is reflected in differential activation of the PPA with colored versions of scenes.

Central Fixations are Inadequately Controlled by Instructions Alone: Implications for Studying Cerebral Asymmetry

A fundamental concern when using visual presentations to study cerebral asymmetry is to ensure that stimuli are presented with the same degree of retinal eccentricity from a central fixation point in either visual field. However, a widely used procedure intended to control fixation location merely instructs participants to fixate appropriately without any other means of ensuring that central fixations actually occur. We assessed the validity of assuming that instructions alone ensure central fixation by using the traditional R VF advantage for words and either (a) only instructions to fixate centrally, or (b) an eye-tracking device that ensured central fixation on every trial. Experiments 1 and 2 found that when only instructions were given, the vast majority of fixations were not central, and more occurred to the right of centre than to the left. Moreover, the prevalence of non-central fixations was otherwise disguised by the finding that both fixation procedures produced similar R VF advantages in overt performance. The impact of typical non-central fixations on performance was revealed by systematically manipulating fixation location in Experiment 3, where deviations in fixation of only 0.25° from centre had a reliable impact on visual field effects. Implications of these findings for studies of cerebral asymmetry are discussed.