Lynn C. Robertson

Neuropsychological contributions to theories of part/whole organization ☆ ☆☆

Recent evidence from neuropsychology has proven useful in defining neural and cognitive subsystems involved in certain cognitive processes such as spatial attention (Posner, Walker, Friedrich, & Rafal, 1984) and imagery (Farah, 1988; Kosslyn, 1986). In this article we discuss neuropsychological evidence that suggests a modular system is responsible for the organization of parts and wholes by the visual system. We review both normal and neuropsychological evidence that suggest that hierarchical organization of objects within objects involves the coordination of at least four separate subsystems, one that emphasizes the global properties of a figure (association with right posterior superior temporal-parietal regions), one that emphasizes the local properties of a figure (associated with left posterior superior temporal-parietal regions), one that controls the distribution of attentional resources to these subsystems (associated with right or left lateral parietal lobe), and one that interconnects global and local properties and relies on the integrity of posterior temporal-temporal pathways.

Hemispheric specialization of memory for visual hierarchical stimuli

Unilateral brain-damaged patients and normal control subjects were asked to remember visual hierarchical stimuli consisting of larger forms constructed from smaller forms. The right-hemisphere damaged patients made more errors in remembering the larger forms relative to the smaller forms, whereas the left-hemisphere damaged patients made more errors in remembering the smaller forms relative to the larger forms. These findings are discussed as they relate to hemispheric specialization for visuospatial processing.

The interaction of spatial and object pathways: Evidence from balint's syndrome

An earlier report described a patient (RM) with bilateral parietal damage who showed severe binding problems between shape and color and shape and size (Friedman-Hill, Robertson, & Treisman, 1995). When shown two different-colored letters, RM reported a large number of illusory conjunctions (ICs) combining the shape of one letter with the color of the other, even when he was looking directly at one of them and had as long as 10 sec to respond. The lesions also produced severe deficits in locating and reaching for objects, and difficulty in seeing more than one object at a time, resulting in a neuropsychological diagnosis of Balints syndrome or dorsal simultanagnosia. The pattern of deficits supported predictions of Treismans Feature Integration Theory (FIT) that the loss of spatial information would lead to binding errors. They further suggested that the spatial information used in binding depends on intact parietal function. In the present paper we extend these findings and examine other deficits in RM that would be predicted by FIT. We show that: (1) Object individuation is impaired, making it impossible for him correctly to count more than one or two objects, even when he is aware that more are present. (2) Visual search for a target defined by a conjunction of features (requiring binding) is impaired, while the detection of a target defined by a unique feature is not. Search for the absence of a feature (0 among Qs) is also severely impaired, while search for the presence (Q among 0s) is not. Feature absence can only be detected when all the present features are bound to the nontarget items. (3) RMs deficits cannot be attributed to a general binding problem: binding errors were far more likely with simultaneous presentation where spatial information was required than with sequential presentation where time could be used as the medium for binding. (4) Selection for attention was severely impaired, whether it was based on the position of a marker or on some other feature (color). (5) Spatial information seems to exist that RM cannot access, suggesting that feature binding relies on a relatively late stage where implicit spatial information is made explicitly accessible. The data converge to support our conclusions that explicit spatial knowledge is necessary for the perception of accurately bound features, for accurate attentional selection, and for accurate and rapid search for a conjunction of features in a multiitem display. It is obviously necessary for directing attention to spatial locations, but the consequences of impairments in this ability seem also to affect object selection, object individuation, and feature integration. Thus, the functional effects of parietal damage are not limited to the spatial and attentional problems that have long been described in patients with Balints syndrome. Damage to parietal areas also affects object perception through damage to spatial representations that are fundamental for spatial awareness.

Component mechanisms underlying the processing of hierarchically organized patterns: inferences from patients with unilateral cortical lesions.

Subjects identified target letters that occurred randomly at the local or global level in a divided attention task. The visual angle of the stimuli was varied. Neurologically intact controls showed a reaction time advantage for local targets which increased as visual angle increased. Patients with lesions centered in the posterior superior temporal gyrus (STG) showed a larger local advantage than controls if the lesion was on the right and a global advantage if the lesion was on the left. STG patients were no more influenced by visual angle than were controls. Control subjects also showed the usual interference of global distractors on responding to local targets. STG patients showed little evidence of interference. Control patients with lesions centered in the rostral inferior parietal lobe performed normally. The findings suggest that several component mechanisms are involved in the processing of hierarchical levels of structure, each linked to specific anatomical regions.

The processing of hierarchical stimuli: Effects of retinal locus, locational uncertainty, and stimulus identity

Three experiments examined the effects of changes in retinal locus and locational uncertainty in the processing of hierarchical stimuli. In Experiment 1, stimuli were presented randomly in the left, center, or right portions of a display. Central presentation decreased reaction times for identifying small letters presented within a hierarchical stimulus pattern (i.e., local letters) but not for a single small letter presented alone. In Experiment 2, all stimuli were presented centrally, thus eliminating the locational uncertainty that existed in Experiment 1. The elimination of locational uncertainty resulted in faster reaction times (as compared with the central data of Experiment 1) for identifying small letters, whether or not they appeared in a hierarchical pattern. In Experiment 3, eye movements were monitored and eliminated as a possible source of these effects. The results are discussed in terms of possible effects of an attentional “spotlight” on hierarchical stimulus processing. It was also found that the identity of the target letter (i.e., whether it was an H or an S) had a large effect on performance. Finally, in contrast to earlier findings (Hoffman, 1980; Martin, 1979), the response-time advantage at a given level and the amount of Stroop-type interference produced at the other level did not always covary, suggesting that these two effects may reflect the operation of separate mechanisms.

Visual search performance in the neglect syndrome

Patients with hemispatial neglect fail to respond to stimuli on one side of space. We assessed to what extent the complexity and number of visual stimuli on both sides determine the severity of neglect. Patients with neglect were required to find specified targets in a cluttered visual field. Two sets of stimuli were used. One set produced effortless and parallel search performance in normal controls; the other set was more complex and produced serial search performance in normal controls. Both sets of stimuli resulted in a serial performance pattern in the patients. Their baseline search performance on both sides was similar when all stimulus items were restricted to one side. A pronounced difference between the two sides was evident when stimuli appeared on both sides. Search for targets on the intact side of space was unaffected by distractors on the neglected side, whereas search for targets on the neglected side was slowed disproportionately by distractors on the intact side. The slowing on the neglected side was more severe during the more demanding search task and when more items were present on the intact side. The results indicate that neglect is associated with an inability to move attention from objects on the intact side to items on the neglected side.

Posterior parietal cortex and the filtering of distractors

Neural systems for visual processing can focus attention on behaviorally relevant objects, filtering out competing distractors. Neurophysiological studies in animals and brain imaging studies in humans suggest that such filtering depends on top-down inputs to extrastriate visual areas, originating in structures important for attentional control. To test whether the posterior parietal cortex may be a necessary source of signals that filter distractors, we measured the ability of a patient with bilateral parietal lesions to discriminate the features of a target surrounded by distractors of variable contrast. In the presence of distractors, the patient was impaired at discriminating both grating orientation and faces, and the magnitude of the impairment increased with distractor salience. These attentional deficits are remarkably similar to those caused by damage to monkey extrastriate regions V4 and/or TEO, which are thought to be recipients of top-down attentional feedback. In contrast to the effects of V4 and TEO lesions, however, the parietal lesions impaired performance even with widely spaced targets and distractors, a finding consistent with the projections of parietal cortex to visual processing areas covering a wide range of receptive field sizes and eccentricities.

'Part-whole' processing in unilateral brain-damaged patients: dysfunction of hierarchical organization.

Visuospatial processing in unilateral brain-damaged patients was investigated by aligning two elements along different axes of an equilateral triangle and asking subjects to report the direction the triangle appeared to point when first observed. Left brain-damaged patients were more affected by the alignment than right brain-damaged patients, with controls performing in between the two brain-damaged groups. The implications of these findings for hemispheric differentiation in visuospatial processing are discussed.

The effect of visual angle on global and local reaction times depends on the set of visual angles presented.

It has been shown that there is a transition from a global to a local advantage in reaction time as visual angle increases (Kinchla & Wolfe, 1979), and it has been assumed that this transition reflects lower level (e.g., retinal) processes. In three experiments, we examined whether higher level (e.g., attentional) processes play a role in this transition. In each experiment, subjects received a different stimulus set in each of two blocks of trials. In Experiment 1, stimuli subtending 1.5°, 3°, 4.5°, or 6° of visual angle vertically (small-stimuli set) were randomly presented in one block, while the other block consisted of random presentations of 3°, 6°, 9°, or 12° stimuli (large-stimuli set), The subjects’ task was to identify targets that appeared randomly at either the local or the global level. It was found that the transition from a global to a local reaction-time advantage took place at a larger visual angle for the large-stimuli set than for the small-stimuli set. The same effects of stimulus set were found in Experiment 2, in which the small-stimuli set included 1.5°, 3°, or 6° stimuli while the large-stimuli set included 3°, 6°, or 9° stimuli. In Experiment 3, eye position was monitored to rule out the possibility that subjects adopted different fixation strategies depending on which stimulus set was being presented. The findings suggest that attention plays a major role in determining the relative speed of processing of local-and global-level information.

Coming Unbound: Disrupting Automatic Integration of Synesthetic Color and Graphemes by Transcranial Magnetic Stimulation of the Right Parietal Lobe

In some individuals, a visually presented letter or number automatically evokes the perception of a specific color, an experience known as color-grapheme synesthesia. It has been suggested that parietal binding mechanisms play a role in the phenomenon. We used a noninvasive stimulation technique, transcranial magnetic stimulation (TMS), to determine whether the posterior parietal lobe is critical for the integration of color and shape in color-grapheme synesthesia, as it appears to be for normal color-shape binding. Using a color-naming task with colored letters that were either congruent or incongruent with the synesthetic photism, we demonstrate that inhibition of the right posterior parietal lobe with repetitive TMS transiently attenuates synesthetic binding. These findings suggest that synesthesia (the induction of color from shape) relies on similar mechanisms as found in normal perception (where the perception of color is induced by wavelength).