Edgar A. DeYoe

Concurrent processing streams in monkey visual cortex.

Abstract The concept of multiple processing streams has emerged as a major theme in many studies of the primate visual system. However, the perception of basic attributes such as color, form, depth, and movement cannot be mapped onto different neuronal pathways as a set of simple, one-to-one relationships. Rather, we suggest that many aspects of perception involve significant overlap across a number of paths and cortical areas. Anatomical divergences and convergences that have been reported among processing streams may be related to the multiplicity of strategies for deriving perceptual attributes from the low-level cues provided by retinal images.

A physiological correlate of the 'spotlight' of visual attention.

Here we identify a neural correlate of the ability to precisely direct visual attention to locations other than the center of gaze. Human subjects performed a task requiring shifts of visual attention (but not of gaze) from one location to the next within a dense array of targets and distracters while functional MRI was used to map corresponding displacements of neural activation within visual cortex. The cortical topography of the purely attention-driven activity precisely matched the topography of activity evoked by the cued targets when presented in isolation. Such retinotopic mapping of attention-related activation was found in primary visual cortex, as well as in dorsomedial and ventral occipital visual areas previously implicated in processing the attended target features. These results identify a physiological basis for the effects of spatially directed visual attention.

Functional magnetic resonance imaging (FMRI) of the human brain

Functional magnetic resonance imaging (FMRI) can provide detailed images of human brain that reflect localized changes in cerebral blood flow and oxygenation induced by sensory, motor, or cognitive tasks. This review presents methods for gradient-recalled echo-planar functional magnetic resonance imaging (FMRI). Also included is a discussion of the hypothesized basis of FMRI, imaging hardware, a unique visual stimulation apparatus, image post-processing and statistical analysis. Retinotopic mapping of striate and extrastriate visual cortex is discussed as an example application. The described echo-planar technique permitted acquisition of an image in 40 ms with a repetition rate of up to 2 per second. However, FMRI responses are slow compared to changes in neural activity. Onset of a visual checkerboard test pattern evoked a response that was delayed by 1-2 s and reached 90% of peak in 5 s. Return to baseline following stimulation was slightly slower. Alternating control (blank) and test (checkerboard) patterns every 20 s induced a cyclic response that was detected in the presence of noise using a cross-correlation technique that was verified by parametric statistics. FMRI revealed retinotopically organized patterns of visually evoked activity in response to annular stimuli that increased in visual field eccentricity. Retinotopy was also observed with test patterns rotated around the fixation point (center of gaze). Results from repeated tests 1 week apart were highly similar. Compared to passive viewing, an active visual discrimination task enhanced responses from extrastriate association cortex.

Distinct Cortical Pathways for Processing Tool versus Animal Sounds

Human listeners can effortlessly categorize a wide range of environmental sounds. Whereas categorizing visual object classes (e.g., faces, tools, houses, etc.) preferentially activates different regions of visually sensitive cortex, it is not known whether the auditory system exhibits a similar organization for different types or categories of complex sounds outside of human speech. Using functional magnetic resonance imaging, we show that hearing and correctly or incorrectly categorizing animal vocalizations (as opposed to hand-manipulated tool sounds) preferentially activated middle portions of the left and right superior temporal gyri (mSTG). On average, the vocalization sounds had much greater harmonic and phase-coupling content (acoustically similar to human speech sounds), which may represent some of the signal attributes that preferentially activate the mSTG regions. In contrast, correctly categorized tool sounds (and even animal sounds that were miscategorized as being tool-related sounds) preferentially activated a widespread, predominantly left hemisphere cortical “mirror network.” This network directly overlapped substantial portions of motor-related cortices that were independently activated when participants pantomimed tool manipulations with their right (dominant) hand. These data suggest that the recognition processing for some sounds involves a causal reasoning mechanism (a high-level auditory “how” pathway), automatically evoked when attending to hand-manipulated tool sounds, that effectively associates the dynamic motor actions likely to have produced the sound(s).

Lesion-induced pseudo-dominance at functional magnetic resonance imaging: implications for preoperative assessments

OBJECTIVE:To illustrate how lesion-induced neurovascular uncoupling at functional magnetic resonance imaging (fMRI) can mimic hemispheric dominance opposite the side of a lesion preoperatively. METHODS:We retrospectively reviewed preoperative fMRI mapping data from 50 patients with focal brain abnormalities to establish patterns of hemispheric dominance of language, speech, visual, or motor system functions. Abnormalities included gliomas (31 patients), arteriovenous malformations (AVMs) (11 patients), other congenital lesions (4 patients), encephalomalacia (3 patients), and tumefactive encephalitis (1 patient). A laterality ratio of fMRI hemispheric dominance was compared with actual hemispheric dominance as verified by electrocortical stimulation, Wada testing, postoperative and posttreatment deficits, and/or lesion-induced deficits. fMRI activation maps were generated with cross-correlation (P < 0.001) or t test (P < 0.001) analysis. RESULTS:In 50 patients, a total of 85 functional areas were within 5 mm of the edge of a potentially resectable lesion. In 23 of these areas (27%), reduced fMRI signal in perilesional eloquent cortex in conjunction with preserved or increased signal in homologous contralateral brain areas revealed functional dominance opposite the side of the lesion. This suggested possible lesion-induced transhemispheric cortical reorganization to homologous brain regions (homotopic reorganization). In seven patients, however, the fMRI data were inconsistent with other methods of functional localization. In two patients with left inferior frontal gyrus gliomas and in one patient with focal tumefactive meningoencephalitis, fMRI incorrectly suggested strong right hemispheric speech dominance. In two patients with lateral precentral gyrus region gliomas and one patient with a left central sulcus AVM, the fMRI pattern incorrectly suggested primary corticobulbar motor dominance contralateral to the side of the lesion. In a patient with a right superior frontal gyrus AVM, fMRI revealed pronounced left dominant supplementary motor area activity in response to a bilateral complex motor task, but right superior frontal gyrus perilesional hemorrhage and edema subsequently caused left upper-extremity plegia. Pathophysiological factors that might have caused neurovascular uncoupling and facilitated pseudo-dominance at fMRI in these patients included direct tumor infiltration, neovascularity, cerebrovascular inflammation, and AVM-induced hemodynamic effects. Sixteen patients had proven (1 patient), probable (2 patients), or possible (13 patients) but unproven lesion-induced homotopic cortical reorganization. CONCLUSION:Lesion-induced neurovascular uncoupling causing reduced fMRI signal in perilesional eloquent cortex, in conjunction with normal or increased activity in homologous brain regions, may simulate hemispheric dominance and lesion-induced homotopic cortical reorganization.

Analysis and use of FMRI response delays

In this study, we implemented a new method for measuring the temporal delay of functional magnetic resonance imaging (fMRI) responses and then estimated the statistical distribution of response delays evoked by visual stimuli (checkered annuli) within and across voxels in human visual cortex. We assessed delay variability among different cortical sites and between parenchyma and blood vessels. Overall, 81% of all responsive voxels showed activation in phase with the stimulus while the remaining voxels showed antiphase, suppressive responses. Mean delays for activated and suppressed voxels were not significantly different (P < 0.001). Cortical flat maps showed that the pattern of activated and suppressed voxels was dynamically induced and depended on stimulus size. Mean delays for blood vessels were 0.7–2.4 sec longer than for parenchyma (P < 0.01). However, both parenchyma and blood vessels produced responses with long delays. We developed a model to identify and quantify different components contributing to variability in the empirical delay measurements. Within‐voxel changes in delay over time were fully accounted for by the effects of empirically measured fMRI noise with virtually no measurable variability associated with the stimulus‐induced response itself. Across voxels, as much as 47% of the delay variance was also the result of fMRI noise, with the remaining variance reflecting fixed differences in response delay among brain sites. In all cases, the contribution of fMRI noise to the delay variance depended on the noise power at the stimulus frequency. White noise models significantly underestimated the fMRI noise effects. Hum. Brain Mapping 13:74–93, 2001.

Antibody labeling of functional subdivisions in visual cortex: Cat-301 immunoreactivity in striate and extrastriate cortex of the macaque monkey

We have examined the distribution of immunoreactivity for the monoclonal antibody Cat-301 in visual cortex of the macaque monkey. Remarkably, those portions of striate cortex (V1) and extrastriate cortex that are most immunoreactive for Cat-301 are anatomically interconnected and are dominated by inputs arising from the magnocellular layers of the LGN (which are themselves highly immunoreactive). In particular, we found that a band of Cat-301 labeled neurons known to exist in layer 4 of V1 is centered on the boundary between layers 4C alpha and 4B and thus includes portions of both the primary target of the magnocellular LGN and its subsequent relay through layer 4B. We also demonstrated consistently strong Cat-301 immunoreactivity in all three extrastriate targets of layer 4B: areas V3, MT, and the cytochrome-oxidase (CO) enriched thick stripes of V2. In V2, there was a close correlation between Cat-301 labeling and clusters of cells projecting to MT but not to V4. This was true even in regions where the CO pattern was equivocal or irregular, indicating that Cat-301 is a more reliable marker than CO for the thick-stripe subregions of V2. Finally, we found strong Cat-301 immunoreactivity in at least parts of areas V3A, the MST complex, and the posterior parietal complex, but not in area V4 or inferotemporal cortex. The molecular specificity revealed by this single marker thus correlates with functionally specific subdivisions at each hierarchical level over nearly the entire known extent of the visual pathway in macaques. This supports the notion that these subdivisions form an anatomically, physiologically, and now molecularly distinct pathway known as the M-stream.

Neuropsychological evidence for a topographical learning mechanism in parahippocampal cortex

The Parahippocampal Place Area (PPA; Epstein & Kanwisher, 1998) is a region within posterior parahippocampal cortex that responds selectively to visual stimuli that convey information about the layout of local space. Here we describe two patients who suffered damage to the PPA after vascular incidents. Both subsequently exhibited memory problems for topographical materials and were unable to navigate unassisted in unfamiliar environments. Performance on a continuous n-back visual memory test was significantly lower for novel scene-like stimuli than for novel object-like stimuli. In contrast, performance was normal on a famous landmark recognition task and on two perceptual tasks that required on-line analysis of scene geometry. Both patients were able to produce accurate maps of premorbidly learned places but were unable to produce accurate maps of new places. These results converge with previous neuroimaging work to demonstrate that the PPA (1) is selectively involved in processing information about the geometry of surrounding space, and (2) may play a more critical role in the encoding of this information into memory than in the initial perceptual processing, recognition, or recall of this information.

Lefties Get It “Right” When Hearing Tool Sounds

Our ability to manipulate and understand the use of a wide range of tools is a feature that sets humans apart from other animals. In right-handers, we previously reported that hearing hand-manipulated tool sounds preferentially activates a left hemisphere network of motor-related brain regions hypothesized to be related to handedness. Using functional magnetic resonance imaging, we compared cortical activation in strongly right-handed versus left-handed listeners categorizing tool sounds relative to animal vocalizations. Here we show that tool sounds preferentially evoke activity predominantly in the hemisphere opposite the dominant hand, in specific high-level motor-related and multisensory cortical regions, as determined by a separate task involving pantomiming tool-use gestures. This organization presumably reflects the idea that we typically learn the meaning of tool sounds in the context of using them with our dominant hand, such that the networks underlying motor imagery or action schemas may be recruited to facilitate recognition.

The spatial extent of the BOLD response

Functional magnetic resonance imaging is routinely used to localize brain function, with multiple brain scans averaged together to reveal activation volumes. In this study, we examine the seldom-studied effect of multiple scan averaging on the extent of activation volume. Using restricted visual field stimulation, we obtained a large number of scan repetitions and analyzed changes in activation volume with progressively increased averaging and across single scans. Activation volume increased monotonically with averaging and failed to asymptote when as many as 22 scans were averaged together. Expansions in the spatial extent of activation were not random; rather, they were centered about activation loci that appear with little or no averaging. Using empirical and simulated data, changes with averaging in activation volumes and cross correlation coefficient distributions revealed the presence of considerably more activated voxels than commonly surmised. Many voxels have low SNR and remain undetected without extensive averaging. The primary source of such voxels was not downstream venous drainage since there was no significant and consistent delay difference between voxels activated at different averaging levels. Voxels with low SNR may reflect a diffuse subthreshold activity centered about spiking neurons, dephasing gradients from distal veins, or simply a blood flow response extending beyond the locus of neuronal firing. Across single scans, as much as twofold changes in activation volume were observed. These changes were not correlated with the order of scan acquisition, subject task performance, or signal and noise properties of activated voxels. Instead, they may reflect subtle changes between overlapping noise and signal frequency components.