Randall Stilla

Multisensory cortical processing of object shape and its relation to mental imagery

Here, we used functional magnetic resonance imaging to investigate the multisensory processing of object shape in the human cerebral cortex and explored the role of mental imagery in such processing. Regions active bilaterally during both visual and haptic shape perception, relative to texture perception in the respective modality, included parts of the superior parietal gyrus, the anterior intraparietal sulcus, and the lateral occipital complex. Of these bimodal regions, the lateral occipital complexes preferred visual over haptic stimuli, whereas the parietal areas preferred haptic over visual stimuli. Whereas most subjects reported little haptic imagery during visual shape perception, experiences of visual imagery during haptic shape perception were common. Across subjects, ratings of the vividness of visual imagery strongly predicted the amount of haptic shape-selective activity in the right, but not in the left, lateral occipital complex. Thus, visual imagery appears to contribute to activation of some, but not all, visual cortical areas during haptic perception.

SELECTIVE VISUO-HAPTIC PROCESSING OF SHAPE AND TEXTURE

Previous functional neuroimaging studies have described shape‐selectivity for haptic stimuli in many cerebral cortical regions, of which some are also visually shape‐selective. However, the literature is equivocal on the existence of haptic or visuo‐haptic texture‐selectivity. We report here on a human functional magnetic resonance imaging (fMRI) study in which shape and texture perception were contrasted using haptic stimuli presented to the right hand, and visual stimuli presented centrally. Bilateral selectivity for shape, with overlap between modalities, was found in a dorsal set of parietal areas: the postcentral sulcus and anterior, posterior and ventral parts of the intraparietal sulcus (IPS); as well as ventrally in the lateral occipital complex. The magnitude of visually‐ and haptically‐evoked activity was significantly correlated across subjects in the left posterior IPS and right lateral occipital complex, suggesting that these areas specifically house representations of object shape. Haptic shape‐selectivity was also found in the left postcentral gyrus, the left lingual gyrus, and a number of frontal cortical sites. Haptic texture‐selectivity was found in ventral somatosensory areas: the parietal operculum and posterior insula bilaterally, as well as in the right medial occipital cortex, overlapping with a medial occipital cortical region, which was texture‐selective for visual stimuli. The present report corroborates and elaborates previous suggestions of specialized visuo‐haptic processing of texture and shape. Hum Brain Mapp 2008.

Effective Connectivity During Haptic Perception: A Study Using Granger Causality Analysis Of Functional Magnetic Resonance Imaging Data

Although it is accepted that visual cortical areas are recruited during touch, it remains uncertain whether this depends on top-down inputs mediating visual imagery or engagement of modality-independent representations by bottom-up somatosensory inputs. Here we addressed this by examining effective connectivity in humans during haptic perception of shape and texture with the right hand. Multivariate Granger causality analysis of functional magnetic resonance imaging (fMRI) data was conducted on a network of regions that were shape- or texture-selective. A novel network reduction procedure was employed to eliminate connections that did not contribute significantly to overall connectivity. Effective connectivity during haptic perception was found to involve a variety of interactions between areas generally regarded as somatosensory, multisensory, visual and motor, emphasizing flexible cooperation between different brain regions rather than rigid functional separation. The left postcentral sulcus (PCS), left precentral gyrus and right posterior insula were important sources of connections in the network. Bottom-up somatosensory inputs from the left PCS and right posterior insula fed into visual cortical areas, both the shape-selective right lateral occipital complex (LOC) and the texture-selective right medial occipital cortex (probable V2). In addition, top-down inputs from left postero-supero-medial parietal cortex influenced the right LOC. Thus, there is strong evidence for the bottom-up somatosensory inputs predicted by models of visual cortical areas as multisensory processors and suggestive evidence for top-down parietal (but not prefrontal) inputs that could mediate visual imagery. This is consistent with modality-independent representations accessible through both bottom-up sensory inputs and top-down processes such as visual imagery.

Activity and effective connectivity of parietal and occipital cortical regions during haptic shape perception

It is now widely accepted that visual cortical areas are active during normal tactile perception, but the underlying mechanisms are still not clear. The goal of the present study was to use functional magnetic resonance imaging (fMRI) to investigate the activity and effective connectivity of parietal and occipital cortical areas during haptic shape perception, with a view to potentially clarifying the role of top-down and bottom-up inputs into visual areas. Subjects underwent fMRI scanning while engaging in discrimination of haptic shape or texture, and in separate runs, visual shape or texture. Accuracy did not differ significantly between tasks. Haptic shape-selective regions, identified on a contrast between the haptic shape and texture conditions in individual subjects, were found bilaterally in the postcentral sulcus (PCS), multiple parts of the intraparietal sulcus (IPS) and the lateral occipital complex (LOC). The IPS and LOC foci tended to be shape-selective in the visual modality as well. Structural equation modelling was used to study the effective connectivity among the haptic shape-selective regions in the left hemisphere, contralateral to the stimulated hand. All possible models were tested for their fit to the correlations among the observed time-courses of activity. Two equivalent models emerged as the winners. These models, which were quite similar, were characterized by both bottom-up paths from the PCS to parts of the IPS, and top-down paths from the LOC and parts of the IPS to the PCS. We conclude that interactions between unisensory and multisensory cortical areas involve bidirectional information flow.

Art for Reward’s Sake: Visual Art Recruits the Ventral Striatum

A recent study showed that people evaluate products more positively when they are physically associated with art images than similar non-art images. Neuroimaging studies of visual art have investigated artistic style and esthetic preference but not brain responses attributable specifically to the artistic status of images. Here we tested the hypothesis that the artistic status of images engages reward circuitry, using event-related functional magnetic resonance imaging (fMRI) during viewing of art and non-art images matched for content. Subjects made animacy judgments in response to each image. Relative to non-art images, art images activated, on both subject- and item-wise analyses, reward-related regions: the ventral striatum, hypothalamus and orbitofrontal cortex. Neither response times nor ratings of familiarity or esthetic preference for art images correlated significantly with activity that was selective for art images, suggesting that these variables were not responsible for the art-selective activations. Investigation of effective connectivity, using time-varying, wavelet-based, correlation-purged Granger causality analyses, further showed that the ventral striatum was driven by visual cortical regions when viewing art images but not non-art images, and was not driven by regions that correlated with esthetic preference for either art or non-art images. These findings are consistent with our hypothesis, leading us to propose that the appeal of visual art involves activation of reward circuitry based on artistic status alone and independently of its hedonic value.

Activation and Effective Connectivity Changes Following Explicit-Memory Training for Face–Name Pairs in Patients With Mild Cognitive Impairment A Pilot Study

Background. Mild cognitive impairment (MCI) is often a precursor to Alzheimer disease. Little research has examined the efficacy of cognitive rehabilitation in patients with MCI, and the relevant neural mechanisms have not been explored. The authors previously showed the behavioral efficacy of cognitive rehabilitation using mnemonic strategies for face–name associations in patients with MCI. Here, the authors used functional magnetic resonance imaging (fMRI) to test whether there were training-specific changes in activation and connectivity within memory-related areas. Methods. A total of 6 patients with amnestic, multidomain MCI underwent pretraining and posttraining fMRI scans, during which they encoded 90 novel face–name pairs and completed a 4-choice recognition memory test immediately after scanning. Patients were taught mnemonic strategies for half the face–name pairs during 3 intervening training sessions. Results. Training-specific effects comprised significantly increased activation within a widespread cerebral cortical network involving medial frontal, parietal, and occipital regions; the left frontal operculum and angular gyrus; and regions in the left lateral temporal cortex. Increased activation common to trained and untrained stimuli was found in a separate network involving inferior frontal, lateral parietal, and occipital cortical regions. Effective connectivity analysis using multivariate, correlation-purged Granger causality analysis revealed generally increased connectivity after training, particularly involving the middle temporal gyrus and foci in the occipital cortex and the precuneus. Conclusion. The authors’ findings suggest that the effectiveness of explicit-memory training in patients with MCI is associated with training-specific increases in activation and connectivity in a distributed neural system that includes areas involved in explicit memory.

Tactile discrimination of grating orientation: fMRI activation patterns.

Grating orientation discrimination is employed widely to test tactile spatial acuity. We used functional magnetic resonance imaging (fMRI) to investigate the neural circuitry underlying performance of this task. Two studies were carried out. In the first study, an extensive set of parietal and frontal cortical areas was activated during covert task performance, relative to a rest baseline. The active regions included the postcentral sulcus bilaterally and foci in the left parietal operculum, left anterior intraparietal sulcus, and bilateral premotor and prefrontal cortex. The second study examined selective recruitment of cortical areas during discrimination of grating orientation (a task with a macrospatial component) compared to discrimination of grating spacing (a purely microspatial task). The foci activated on this contrast were in the left anterior intraparietal sulcus, right postcentral sulcus and gyrus, left parieto‐occipital cortex, bilateral frontal eye fields, and bilateral ventral premotor cortex. These findings not only confirm and extend previous studies of the neural processing underlying grating orientation discrimination, but also demonstrate that a distributed network of putatively multisensory areas is involved. Hum Brain Mapp, 2005.

Object Familiarity Modulates Effective Connectivity During Haptic Shape Perception

In the preceding paper (Lacey, S., Flueckiger, P., Stilla, R., Lava, M., Sathian, K., 2009a. Object familiarity modulates involvement of visual imagery in haptic shape perception), we showed that the activations evoked by visual imagery overlapped more extensively, and their magnitudes were more correlated, with those evoked during haptic shape perception of familiar, compared to unfamiliar, objects. Here we used task-specific analyses of functional and effective connectivity to provide convergent evidence. These analyses showed that the visual imagery and familiar haptic shape tasks activated similar networks, whereas the unfamiliar haptic shape task activated a different network. Multivariate Granger causality analyses of effective connectivity, in both a conventional form and one purged of zero-lag correlations, showed that the visual imagery and familiar haptic shape networks involved top-down paths from prefrontal cortex into the lateral occipital complex (LOC), whereas the unfamiliar haptic shape network was characterized by bottom-up, somatosensory inputs into the LOC. We conclude that shape representations in the LOC are flexibly accessible, either top-down or bottom-up, according to task demands, and that visual imagery is more involved in LOC activation during haptic shape perception when objects are familiar, compared to unfamiliar.

DUAL PATHWAYS FOR HAPTIC AND VISUAL PERCEPTION OF SPATIAL AND TEXTURE INFORMATION

Segregation of information flow along a dorsally directed pathway for processing object location and a ventrally directed pathway for processing object identity is well established in the visual and auditory systems, but is less clear in the somatosensory system. We hypothesized that segregation of location vs. identity information in touch would be evident if texture is the relevant property for stimulus identity, given the salience of texture for touch. Here, we used functional magnetic resonance imaging (fMRI) to investigate whether the pathways for haptic and visual processing of location and texture are segregated, and the extent of bisensory convergence. Haptic texture-selectivity was found in the parietal operculum and posterior visual cortex bilaterally, and in parts of left inferior frontal cortex. There was bisensory texture-selectivity at some of these sites in posterior visual and left inferior frontal cortex. Connectivity analyses demonstrated, in each modality, flow of information from unisensory non-selective areas to modality-specific texture-selective areas and further to bisensory texture-selective areas. Location-selectivity was mostly bisensory, occurring in dorsal areas, including the frontal eye fields and multiple regions around the intraparietal sulcus bilaterally. Many of these regions received input from unisensory areas in both modalities. Together with earlier studies, the activation and connectivity analyses of the present study establish that somatosensory processing flows into segregated pathways for location and object identity information. The location-selective somatosensory pathway converges with its visual counterpart in dorsal frontoparietal cortex, while the texture-selective somatosensory pathway runs through the parietal operculum before converging with its visual counterpart in visual and frontal cortex. Both segregation of sensory processing according to object property and multisensory convergence appear to be universal organizing principles.

METAPHORICALLY FEELING: COMPREHENDING TEXTURAL METAPHORS ACTIVATES SOMATOSENSORY CORTEX

Conceptual metaphor theory suggests that knowledge is structured around metaphorical mappings derived from physical experience. Segregated processing of object properties in sensory cortex allows testing of the hypothesis that metaphor processing recruits activity in domain-specific sensory cortex. Using functional magnetic resonance imaging (fMRI) we show that texture-selective somatosensory cortex in the parietal operculum is activated when processing sentences containing textural metaphors, compared to literal sentences matched for meaning. This finding supports the idea that comprehension of metaphors is perceptually grounded.