Rafael Malach

Differential Processing of Objects under Various Viewing Conditions in the Human Lateral Occipital Complex

The invariant properties of human cortical neurons cannot be studied directly by fMRI due to its limited spatial resolution. Here, we circumvented this limitation by using fMR adaptation, namely, reduction of the fMR signal due to repeated presentation of identical images. Object-selective regions (lateral occipital complex [LOC]) showed a monotonic signal decrease as repetition frequency increased. The invariant properties of fMR adaptation were studied by presenting the same object in different viewing conditions. LOC exhibited stronger fMR adaptation to changes in size and position (more invariance) compared to illumination and viewpoint. The effect revealed two putative subdivisions within LOC: caudal-dorsal (LO), which exhibited substantial recovery from adaptation under all transformations, and posterior fusiform (PF/LOa), which displayed stronger adaptation. This study demonstrates the utility of fMR adaptation for revealing functional characteristics of neurons in fMRI studies.

fmr-adaptation: a tool for studying the functional properties of human cortical neurons

The invariant properties of human cortical neurons cannot be studied directly by fMRI due to its limited spatial resolution. One voxel obtained from a fMRI scan contains several hundred thousands neurons. Therefore, the fMRI signal may average out a heterogeneous group of highly selective neurons. Here, we present a novel experimental paradigm for fMRI, functional magnetic resonance-adaptation (fMR-A), that enables to tag specific neuronal populations within an area and investigate their functional properties. This approach contrasts with conventional mapping methods that measure the averaged activity of a region. The application of fMR-A to study the functional properties of cortical neurons proceeds in two stages: First, the neuronal population is adapted by repeated presentation of a single stimulus. Second, some property of the stimulus is varied and the recovery from adaptation is assessed. If the signal remains adapted, it will indicate that the neurons are invariant to that attribute. However, if the fMRI signal will recover from the adapted state it would imply that the neurons are sensitive to the property that was varied. Here, an application of fMR-A for studying the invariant properties of high-order object areas (lateral occipital complex--LOC) to changes in object size, position, illumination and rotation is presented. The results show that LOC is less sensitive to changes in object size and position compared to changes of illumination and viewpoint. fMR-A can be extended to other neuronal systems in which adaptation is manifested and can be used with event-related paradigms as well. By manipulating experimental parameters and testing recovery from adaptation it should be possible to gain insight into the functional properties of cortical neurons which are beyond the spatial resolution limits imposed by conventional fMRI.

Visuo-haptic object-related activation in the ventral visual pathway

The ventral pathway is involved in primate visual object recognition. In humans, a central stage in this pathway is an occipito–temporal region termed the lateral occipital complex (LOC), which is preferentially activated by visual objects compared to scrambled images or textures. However, objects have characteristic attributes (such as three-dimensional shape) that can be perceived both visually and haptically. Therefore, object-related brain areas may hold a representation of objects in both modalities. Using fMRI to map object-related brain regions, we found robust and consistent somatosensory activation in the occipito–temporal cortex. This region showed clear preference for objects compared to textures in both modalities. Most somatosensory object-selective voxels overlapped a part of the visual object-related region LOC. Thus, we suggest that neuronal populations in the occipito–temporal cortex may constitute a multimodal object-related network.

Center-periphery organization of human object areas.

The organizing principles that govern the layout of human object-related areas are largely unknown. Here we propose a new organizing principle in which object representations are arranged according to a central versus peripheral visual field bias. The proposal is based on the finding that building-related regions overlap periphery-biased visual field representations, whereas face-related regions are associated with center-biased representations. Furthermore, the eccentricity maps encompass essentially the entire extent of object-related occipito-temporal cortex, indicating that most object representations are organized with respect to retinal eccentricity. A control experiment ruled out the possibility that the results are due exclusively to unequal feature distribution in these images. We hypothesize that brain regions representing object categories that rely on detailed central scrutiny (such as faces) are more strongly associated with processing of central information, compared to representations of objects that may be recognized by more peripheral information (such as buildings or scenes).

Early 'visual' cortex activation correlates with superior verbal memory performance in the blind

The visual cortex may be more modifiable than previously considered. Using functional magnetic resonance imaging (fMRI) in ten congenitally blind human participants, we found robust occipital activation during a verbal-memory task (in the absence of any sensory input), as well as during verb generation and Braille reading. We also found evidence for reorganization and specialization of the occipital cortex, along the anterior–posterior axis. Whereas anterior regions showed preference for Braille, posterior regions (including V1) showed preference for verbal-memory and verb generation (which both require memory of verbal material). No such occipital activation was found in sighted subjects. This difference between the groups was mirrored by superior performance of the blind in various verbal-memory tasks. Moreover, the magnitude of V1 activation during the verbal-memory condition was highly correlated with the blind individuals abilities in a variety of verbal-memory tests, suggesting that the additional occipital activation may have a functional role.

A sequence of object-processing stages revealed by fMRI in the human occipital lobe.

Functional magnetic resonance imaging was used in combined functional selectivity and retinotopic mapping tests to reveal object‐related visual areas in the human occpital lobe. Subjects were tested with right, left, up, or down hemivisual field stimuli which were composed of images of natural objects (faces, animals, man‐made objects) or highly scrambled (1,024 elements) versions of the same images. In a similar fashion, the horizontal and vertical meridians were mapped to define the borders of these areas. Concurrently, the same cortical sites were tested for their sensitivity to image‐scrambling by varying the number of scrambled picture fragments (from 16–1,024) while controlling for the Fourier power spectrum of the pictures and their order of presentation. Our results reveal a stagewise decrease in retinotopy and an increase in sensitivity to image‐scrambling. Three main distinct foci were found in the human visual object recognition pathway (Ungerleider and Haxby [1994]: Curr Opin Neurobiol 4:157–165): 1) Retinotopic primary areas V1–3 did not exhibit significant reduction in activation to scrambled images. 2) Areas V4v (Sereno et al., [1995]: Science 268:889–893) and V3A (DeYoe et al., [1996]: Proc Natl Acad Sci USA 93:2382–2386; Tootell et al., [1997]: J Neurosci 71:7060–7078) manifested both retinotopy and decreased activation to highly scrambled images. 3) The essentially nonretinotopic lateral occipital complex (LO) (Malach et al., [1995]: Proc Natl Acad Sci USA 92:8135–8139; Tootell et al., [1996]: Trends Neurosci 19:481–489) exhibited the highest sensitivity to image scrambling, and appears to be homologous to macaque the infero‐temporal (IT) cortex (Tanaka [1996]: Curr Opin Neurobiol 523–529). Breaking the images into 64, 256, or 1,024 randomly scrambled blocks reduced activation in LO voxels. However, many LO voxels remained significantly activated by mildly scrambled images (16 blocks). These results suggest the existence of object‐fragment representation in LO. Hum. Brain Mapping 6:316–328, 1998.

Eccentricity Bias as an Organizing Principle for Human High-Order Object Areas

We have recently proposed a center-periphery organization based on resolution needs, in which objects engaging in recognition processes requiring central-vision (e.g., face-related) are associated with center-biased representations, while objects requiring large-scale feature integration (e.g., buildings) are associated with periphery-biased representations. Here we tested this hypothesis by comparing the center-periphery organization with activations to five object categories: faces, buildings, tools, letter strings, and words. We found that faces, letter strings, and words were mapped preferentially within the center-biased representation. Faces showed a hemispheric lateralization opposite to that of letter strings and words. In contrast, buildings were mapped mainly to the periphery-biased representation, while tools activated both central and peripheral representations. The results are compatible with the notion that center-periphery organization allows the optimal allocation of cortical magnification to the specific requirements of various recognition processes.

Coupling between Neuronal Firing Rate, Gamma LFP, and BOLD fMRI Is Related to Interneuronal Correlations

BACKGROUND To what extent is activity of individual neurons coupled to the local field potential (LFP) and to blood-oxygenation-level dependent (BOLD) functional magnetic resonance imaging (fMRI)? This issue is of high significance for understanding brain function and for relating animal studies to fMRI, yet it is still under debate. RESULTS Here we report data from simultaneous recordings of isolated unit activity and LFP by using multiple electrodes in the human auditory cortex. We found a wide range of coupling levels between the activity of individual neurons and gamma LFP. However, this large variability could be predominantly explained (r = 0.66) by the degree of firing-rate correlations between neighboring neurons. Importantly, this phenomenon occurred during both sensory stimulation and spontaneous activity. Concerning the coupling of neuronal activity to BOLD fMRI, we found that gamma LFP was well coupled to BOLD measured across different individuals (r = 0.62). By contrast, the coupling of single units to BOLD was highly variable and, again, tightly related to interneuronal-firing-rate correlations (r = 0.70). CONCLUSIONS Our results offer a resolution to a central controversy regarding the coupling between neurons, LFP, and BOLD signals by demonstrating, for the first time, that the coupling of single units to the other measures is variable yet it is tightly related to the degree of interneuronal correlations in the human auditory cortex.

New images from human visual cortex

Recent developments in imaging and histology have greatly clarified our understanding of the nature and organization of human visual cortex. More than ten human cortical visual areas can now be differentiated, compared with the approximately 30 areas described in macaque monkeys. Most human areas and columns described so far appear quite similar to those in macaque but distinctive species differences also exist. Imaging studies suggest two general information-processing streams (parietal and temporal) in human visual cortex, as proposed in macaque. Several human areas are both motion- and direction-selective, and a progression of motion-processing steps can be-inferred from the imaging data. Human visual areas for recognizing form are less well defined but the evidence again suggests a progression of information-processing steps and areas, beginning posterior to the human middle temporal area (or V5), and extending inferiorly then anteriorly. This is consistent with findings from macaque, and with human clinical reports.

Interhemispheric correlations of slow spontaneous neuronal fluctuations revealed in human sensory cortex

Animal studies have shown robust electrophysiological activity in the sensory cortex in the absence of stimuli or tasks. Similarly, recent human functional magnetic resonance imaging (fMRI) revealed widespread, spontaneously emerging cortical fluctuations. However, it is unknown what neuronal dynamics underlie this spontaneous activity in the human brain. Here we studied this issue by combining bilateral single-unit, local field potentials (LFPs) and intracranial electrocorticography (ECoG) recordings in individuals undergoing clinical monitoring. We found slow (<0.1 Hz, following 1/f-like profiles) spontaneous fluctuations of neuronal activity with significant interhemispheric correlations. These fluctuations were evident mainly in neuronal firing rates and in gamma (40–100 Hz) LFP power modulations. Notably, the interhemispheric correlations were enhanced during rapid eye movement and stage 2 sleep. Multiple intracranial ECoG recordings revealed clear selectivity for functional networks in the spontaneous gamma LFP power modulations. Our results point to slow spontaneous modulations in firing rate and gamma LFP as the likely correlates of spontaneous fMRI fluctuations in the human sensory cortex.