Jonathan S. Cant

fMR-adaptation reveals separate processing regions for the perception of form and texture in the human ventral stream

We recently demonstrated that attending to the form of objects and attending to their surface properties activated anatomically distinct regions of occipito-temporal cortex (Cant and Goodale, Cereb Cortex 17:713–731, 2007). Specifically, attending to form activated the lateral occipital area (LO), whereas attending to texture activated the collateral sulcus (CoS). Although these regions showed preferential activation to one particular stimulus dimension (e.g. texture in CoS), they also showed activation to other, non-preferred stimulus dimensions (e.g. form in CoS). This raises the question as to whether the activation associated with attention to form in CoS, for example, represents the actual processing of object form or instead represents the obligatory processing of object texture that occurred when people attended to form. To investigate this, we conducted an fMR-adaptation experiment which allowed us to examine the response properties of regions specialized for processing form, texture, and colour when participants were not explicitly attending to a particular stimulus dimension. Participants passively viewed blocks where only one dimension varied and blocks where no dimensions varied, while fixating a cross in the centre of the display. Area LO was most sensitive to variations in form, whereas the CoS was most sensitive to variations in texture. As in our previous study, no regions were found that were most sensitive to variations in colour, but unlike the results from that study, medial regions of the ventral stream along the fusiform gyrus and CoS showed some selectivity to colour. Taken together, these results replicate the findings from our previous study and provide additional evidence for the existence of separate processing pathways for form and surface properties (particularly texture) in the ventral stream.

Scratching beneath the surface: new insights into the functional properties of the lateral occipital area and parahippocampal place area.

We used fMRI on neurologically intact humans to investigate whether or not there are different neural substrates for the different kinds of information that a visual surface signals (shape from texture vs material properties from texture). Participants attended to differences in the shape (flat/convex), texture and color (wood/rock), or material properties (soft/hard) of a set of circular surfaces. Attending to shape activated the contour-sensitive lateral occipital (LO) area, and attending to texture activated a region of the collateral sulcus (CoS) that overlaps with the parahippocampal place area (PPA). Interestingly, attending to material properties activated the same texture-sensitive region in the CoS. These results demonstrate the existence of different neural substrates for the different types of information that a visual surface signals. With regard to object shape, the organization of the LO area may be complex, with neurons tuned not only to the outline shape of objects, but also to their surface curvature independent of contour. Moreover, to our knowledge, this is the first study to demonstrate that processing surface texture, which occurs within the scene-sensitive PPA, is a route to accessing knowledge about an objects material properties. With this in mind, we propose that models of visual cortical organization should focus not only on the particular stimulus category to which a region maximally responds (e.g., objects, scenes), but also on the stimulus attributes that best support the processing of that category (e.g., shape, texture, material properties).

Independent Processing of Form, Colour, and Texture in Object Perception

Most investigations of object recognition have focused on the form rather than the material properties of objects. Nevertheless, knowledge of the material properties of an object (via its surface cues) can provide important information about that objects identity. In this study, we used Garners speeded-classification task to explore whether or not the processing of form and the processing of surface properties are independent. In experiment 1, participants made length and width classifications in an initial form task. Participants were unable to ignore length while making width classifications, and were unable to ignore width while making length classifications. This suggests that the perception of length and the perception of width share common processing resources. In a subsequent task, we examined possible interactions between the processing of form and the processing of surface properties. In contrast to the findings with the form task, participants were able to ignore form while making surface-property classifications, and to ignore surface properties while making form classifications. This suggests that the form of objects and their surface properties are processed independently. In experiment 2, we went on to show that the two prominent surface-property dimensions of colour and texture can also be processed independently. In other words, participants were able to ignore colour while making texture classifications, and vice versa. Finally, in experiment 3, we examined the possibility that the stimuli and required responses that we used in experiment 2 were too categorical and thus not optimal for assessing whether or not colour and texture share common processing resources. Using a different stimulus set, participants were again able to ignore colour while making texture classifications, and vice versa. Taken together, these results provided convincing evidence that the separate ventral-stream brain regions identified for form, texture, and colour in a recent neuroimaging study (Cant and Goodale, 2007 Cerebral Cortex 17 713–731) can indeed function independently.

Object Ensemble Processing in Human Anterior-Medial Ventral Visual Cortex

Our visual system can extract summary statistics from large collections of similar objects without forming detailed representations of the individual objects in the ensemble. Such object ensemble representation is adaptive and allows us to overcome the capacity limitation associated with representing specific objects. Surprisingly, little is known about the neural mechanisms supporting such object ensemble representation. Here we showed human observers identical photographs of the same object ensemble, different photographs depicting the same ensemble, or different photographs depicting different ensembles. We observed fMRI adaptation in anterior-medial ventral visual cortex whenever object ensemble statistics repeated, even when local image features differed across photographs. Interestingly, such object ensemble processing is closely related to texture and scene processing in the brain. In contrast, the lateral occipital area, a region involved in object–shape processing, showed adaptation only when identical photographs were repeated. These results provide the first step toward understanding the neural underpinnings of real-world object ensemble representation.

Representation of Object Weight in Human Ventral Visual Cortex

Skilled manipulation requires the ability to predict the weights of viewed objects based on learned associations linking object weight to object visual appearance. However, the neural mechanisms involved in extracting weight information from viewed object properties are unknown. Given that ventral visual pathway areas represent a wide variety of object features, one intriguing but as yet untested possibility is that these areas also represent object weight, a nonvisual motor-relevant object property. Here, using event-related fMRI and pattern classification techniques, we tested the novel hypothesis that object-sensitive regions in occipitotemporal cortex (OTC), in addition to traditional motor-related brain areas, represent object weight when preparing to lift that object. In two studies, the same participants prepared and then executed lifting actions with objects of varying weight. In the first study, we show that when lifting visually identical objects, where predicted weight is based solely on sensorimotor memory, weight is represented in object-sensitive OTC. In the second study, we show that when object weight is associated with a particular surface texture, that texture-sensitive OTC areas also come to represent object weight. Notably, these texture-sensitive areas failed to carry information about weight in the first study, when object surface properties did not specify weight. Our results indicate that the integration of visual and motor-relevant object information occurs at the level of single OTC areas and provide evidence that the ventral visual pathway is actively and flexibly engaged in processing object weight, an object property critical for action planning and control.

Crinkling and crumpling: An auditory fMRI study of material properties

Knowledge of an objects material composition (i.e., what it is made of) alters how we interact with that object. Seeing the bright glint or hearing the metallic crinkle of a foil plate for example, confers information about that object before we have even touched it. Recent research indicates that the medial aspect of the ventral visual pathway is sensitive to the surface properties of objects. In the present functional magnetic resonance imaging (fMRI) study, we investigated whether the ventral pathway is also sensitive to material properties derived from sound alone. Relative to scrambled material sounds and non-verbal human vocalizations, audio recordings of materials being manipulated (i.e., crumpled) in someones hands elicited greater BOLD activity in the right parahippocampal cortex of neurologically intact listeners, as well as a cortically blind participant. Additional left inferior parietal lobe activity was also observed in the neurologically intact group. Taken together, these results support a ventro-medial pathway that is specialized for processing the material properties of objects, and suggest that there are sub-regions within this pathway that subserve the processing of acoustically-derived information about material composition.

Feature diagnosticity and task context shape activity in human scene-selective cortex.

Scenes are constructed from multiple visual features, yet previous research investigating scene processing has often focused on the contributions of single features in isolation. In the real world, features rarely exist independently of one another and likely converge to inform scene identity in unique ways. Here, we utilize fMRI and pattern classification techniques to examine the interactions between task context (i.e., attend to diagnostic global scene features; texture or layout) and high-level scene attributes (content and spatial boundary) to test the novel hypothesis that scene-selective cortex represents multiple visual features, the importance of which varies according to their diagnostic relevance across scene categories and task demands. Our results show for the first time that scene representations are driven by interactions between multiple visual features and high-level scene attributes. Specifically, univariate analysis of scene-selective cortex revealed that task context and feature diagnosticity shape activity differentially across scene categories. Examination using multivariate decoding methods revealed results consistent with univariate findings, but also evidence for an interaction between high-level scene attributes and diagnostic visual features within scene categories. Critically, these findings suggest visual feature representations are not distributed uniformly across scene categories but are shaped by task context and feature diagnosticity. Thus, we propose that scene-selective cortex constructs a flexible representation of the environment by integrating multiple diagnostically relevant visual features, the nature of which varies according to the particular scene being perceived and the goals of the observer.

Seeing the Forest and the Trees: Default Local Processing in Individuals with High Autistic Traits Does Not Come at the Expense of Global Attention

Atypical sensory perception is one of the most ubiquitous symptoms of autism, including a tendency towards a local-processing bias. We investigated whether local-processing biases were associated with global-processing impairments on a global/local attentional-scope paradigm in conjunction with a composite-face task. Behavioural results were related to individuals’ levels of autistic traits, specifically the Attention to Detail subscale of the Autism Quotient, and the Sensory Profile Questionnaire. Individuals showing high rates of Attention to Detail were more susceptible to global attentional-scope manipulations, suggesting that local-processing biases associated with Attention to Detail do not come at the cost of a global-processing deficit, but reflect a difference in default global versus local bias. This relationship operated at the attentional/perceptual level, but not response criterion.

The Impact of Density and Ratio on Object-Ensemble Representation in Human Anterior-Medial Ventral Visual Cortex

Behavioral research has demonstrated that observers can extract summary statistics from ensembles of multiple objects. We recently showed that a region of anterior-medial ventral visual cortex, overlapping largely with the scene-sensitive parahippocampal place area (PPA), participates in object-ensemble representation. Here we investigated the encoding of ensemble density in this brain region using fMRI-adaptation. In Experiment 1, we varied density by changing the spacing between objects and found no sensitivity in PPA to such density changes. Thus, density may not be encoded in PPA, possibly because object spacing is not perceived as an intrinsic ensemble property. In Experiment 2, we varied relative density by changing the ratio of 2 types of objects comprising an ensemble, and observed significant sensitivity in PPA to such ratio change. Although colorful ensembles were shown in Experiment 2, Experiment 3 demonstrated that sensitivity to object ratio change was not driven mainly by a change in the ratio of colors. Thus, while anterior-medial ventral visual cortex is insensitive to density (object spacing) changes, it does code relative density (object ratio) within an ensemble. Object-ensemble processing in this region may thus depend on high-level visual information, such as object ratio, rather than low-level information, such as spacing/spatial frequency.

Asymmetric interference between the perception of shape and the perception of surface properties

We previously showed that the processing of shape and the processing of surface properties linked to material properties engage different regions of the ventral stream (J. S. Cant & M. A. Goodale, 2007). Moreover, we recently used Garners speeded-classification task to show that varying the surface (material) properties of objects does not interfere with shape judgments and vice versa (J. S. Cant, M. E. Large, L. McCall, & M. A. Goodale, 2008). In the present study, we looked at Garner interference when surface cues contributed to the perception of object shape and hypothesized that this would interfere with judgments about the width and the length of the objects. In contrast, we predicted that varying the width and the length of the objects would not interfere with surface-property judgments. This is precisely what we found. These results suggest that the shape and the surface properties of an object cannot be processed independently when both these sets of cues are linked to the perception of the objects overall shape. These observations, together with our previous findings, suggest that the surface cues that contribute to object shape are processed quite separately from the surface cues that are linked to an objects material properties.