Scott L. Fairhall

Brain Regions That Represent Amodal Conceptual Knowledge

To what extent do the brain regions implicated in semantic processing contribute to the representation of amodal conceptual content rather than modality-specific mechanisms or mechanisms of semantic access and manipulation? Here, we propose that a brain region can be considered to represent amodal conceptual object knowledge if it is supramodal and plays a role in distinguishing among the conceptual representations of different objects. In an fMRI study, human participants made category typicality judgments about pictured objects or their names drawn from five different categories. Crossmodal multivariate pattern analysis revealed a network of six left-lateralized regions largely outside of category-selective visual cortex that showed a supramodal representation of object categories. These were located in the posterior middle/inferior temporal gyrus (pMTG/ITG), angular gyrus, ventral temporal cortex, posterior cingulate/precuneus (PC), and lateral and dorsomedial prefrontal cortex. Representational similarity analysis within these regions determined that the similarity between category-specific patterns of neural activity in the pMTG/ITG and the PC was consistent with the semantic similarity between these categories. This finding supports the PC and pMTG/ITG as candidate regions for the amodal representation of the conceptual properties of objects.

Decoding Representations of Face Identity That are Tolerant to Rotation

In order to recognize the identity of a face we need to distinguish very similar images (specificity) while also generalizing identity information across image transformations such as changes in orientation (tolerance). Recent studies investigated the representation of individual faces in the brain, but it remains unclear whether the human brain regions that were found encode representations of individual images (specificity) or face identity (specificity plus tolerance). In the present article, we use multivoxel pattern analysis in the human ventral stream to investigate the representation of face identity across rotations in depth, a kind of transformation in which no point in the face image remains unchanged. The results reveal representations of face identity that are tolerant to rotations in depth in occipitotemporal cortex and in anterior temporal cortex, even when the similarity between mirror symmetrical views cannot be used to achieve tolerance. Converging evidence from different analysis techniques shows that the right anterior temporal lobe encodes a comparable amount of identity information to occipitotemporal regions, but this information is encoded over a smaller extent of cortex.

Perception, memory and aesthetics of indeterminate art

Indeterminate art, in which familiar objects are only suggestive, invokes a perceptual conundrum as apparently detailed and vivid images resist identification. We hypothesized that compared with paintings that depict meaningful content, object recognition in indeterminate images would be delayed, and tested whether aesthetic affect depends on meaningful content. Subjects performed object recognition and judgment of aesthetic affect tasks. Response latencies were significantly longer for indeterminate images and subjects perceived recognizable objects in 24% of these paintings. Although the aesthetic affect rating of all paintings was similar, judgement latencies for the indeterminate paintings were significantly longer. A surprise memory test revealed that more representational than indeterminate paintings were remembered and that affective strength increased the probability of subsequent recall. Our results suggest that perception and memory of art depend on semantic aspects, whereas, aesthetic affect depends on formal visual features. The longer latencies associated with indeterminate paintings reflect the underlying cognitive processes that mediate object resolution. Indeterminate art works therefore comprise a rich set of stimuli with which the neural correlates of visual perception can be investigated.

Impaired sensorimotor integration in focal hand dystonia patients in the absence of symptoms

Background Functional imaging studies of people with focal hand dystonia (FHD) have indicated abnormal activity in sensorimotor brain regions. Few studies however, have examined FHD during movements that do not provoke symptoms of the disorder. It is possible, therefore, that any differences between FHD and controls are confounded by activity due to the occurrence of symptoms. Thus, in order to characterise impairments in patients with FHD during movements that do not induce dystonic symptoms, we investigated the neural correlates of externally paced finger tapping movements. Methods Functional MRI (fMRI) was used to compare patients with FHD to controls with respect to activation in networks modulated by task complexity and hand used to perform simple and complex tapping movements. Results In the ‘complexity network,’ patients with FHD showed significantly less activity relative to controls in posterior parietal cortex, medial supplementary motor area (SMA), anterior putamen and cerebellum. In the ‘hand network,’ patients with FHD showed less activation than controls in primary motor (M1) and somatosensory (S1) cortices, SMA and cerebellum. Conjunction analysis revealed that patients with FHD demonstrated reduced activation in the majority of combined network regions (M1, S1 and cerebellum). Conclusion Dysfunction in FHD is widespread in both complexity and hand networks, and impairments are demonstrated even when performing tasks that do not evoke dystonic symptoms. These results suggest that such impairments are inherent to, rather than symptomatic of, the disorder.

Neural correlates of object indeterminacy in art compositions

Indeterminate art invokes a perceptual dilemma in which apparently detailed and vivid images resist identification. We used event-related fMRI to study visual perception of representational, indeterminate and abstract paintings. We hypothesized increased activation along a gradient of posterior-to-anterior ventral visual areas with increased object resolution, and postulated that object resolution would be associated with visual imagery. Behaviorally, subjects were faster to recognize familiar objects in representational than in both indeterminate and abstract paintings. We found activation within a distributed cortical network that includes visual, parietal, limbic and prefrontal regions. Representational paintings, which depict scenes cluttered with familiar objects, evoked stronger activation than indeterminate and abstract paintings in higher-tier visual areas. Perception of scrambled paintings was associated with imagery-related activation in the precuneus and prefrontal cortex. Finally, representational paintings evoked stronger activation than indeterminate paintings in the temporoparietal junction. Our results suggest that perception of familiar content in art works is mediated by object recognition, memory recall and mental imagery, cognitive processes that evoke activation within a distributed cortical network.

Induction of orientation-specific LTP-like changes in human visual evoked potentials by rapid sensory stimulation.

Recent research suggests that rapid visual stimulation can induce long-term potentiation-like effects non-invasively in humans. However, to date, this research has provided only limited evidence for input-specificity, a fundamental property of cellular long-term potentiation. In the present study we extend the evidence for input-specificity by investigating the effect of stimulus orientation. We use sine wave gratings of two different orientations to show that rapid visual stimulation can induce orientation-specific potentiation, as indexed by changes in the amplitude of a late phase of the N1 complex of the visual-evoked potential. This result suggests that discrete populations of orientation-tuned neurons can be selectively potentiated by rapid visual stimulation. Furthermore, our results support earlier studies that have suggested that the locus of potentiation induced by rapid visual stimulation is visual cortex.

Category-selective neural substrates for person- and place-related concepts

The influence of object-category on the representation of semantic knowledge remains unresolved. We present a functional magnetic resonance imaging study that investigates whether there are distinct neural substrates for semantic knowledge of kinds of people (e.g., lawyer, nurse etc.) and places (e.g., bank, prison etc.). Access to semantic details about kinds of people produced selective responses in the precuneus, medial prefrontal cortex, left anterior temporal lobe, posterior middle temporal gyrus and the temporoparietal junction. Corresponding place-selective responses were present in the parahippocampal gyrus and retrosplenial complex. Category selectivity was found to be less pronounced when conceptual information was accessed about kinds of people compared to unique people (e.g., Obama). We attribute this to the greater importance of cross-categorical semantic knowledge in the conceptual representation of kinds. Together, these results show the importance of object-category in non-perceptual semantic representations and indicate the manner in which these systems may interact to create full conceptual representations.

Predication drives verb cortical signatures

Verbs and nouns are fundamental units of language, but their neural instantiation remains poorly understood. Neuropsychological research has shown that nouns and verbs can be damaged independently of each other, and neuroimaging research has found that several brain regions respond differentially to the two word classes. However, the semantic–lexical properties of verbs and nouns that drive these effects remain unknown. Here we show that the most likely candidate is predication: a core lexical feature involved in binding constituent arguments (boy, candies) into a unified syntactic–semantic structure expressing a proposition (the boy likes the candies). We used functional neuroimaging to test whether the intrinsic “predication-building” function of verbs is what drives the verb–noun distinction in the brain. We first identified verb-preferring regions with a localizer experiment including verbs and nouns. Then, we examined whether these regions are sensitive to transitivity—an index measuring its tendency to select for a direct object. Transitivity is a verb-specific property lying at the core of its predication function. Neural activity in the left posterior middle temporal and inferior frontal gyri correlates with transitivity, indicating sensitivity to predication. This represents the first evidence that grammatical class preference in the brain is driven by a words function to build predication structures.

Temporal Integration Windows for Naturalistic Visual Sequences

There is increasing evidence that the brain possesses mechanisms to integrate incoming sensory information as it unfolds over time-periods of 2–3 seconds. The ubiquity of this mechanism across modalities, tasks, perception and production has led to the proposal that it may underlie our experience of the subjective present. A critical test of this claim is that this phenomenon should be apparent in naturalistic visual experiences. We tested this using movie-clips as a surrogate for our day-to-day experience, temporally scrambling them to require (re-) integration within and beyond the hypothesized 2–3 second interval. Two independent experiments demonstrate a step-wise increase in the difficulty to follow stimuli at the hypothesized 2–3 second scrambling condition. Moreover, only this difference could not be accounted for by low-level visual properties. This provides the first evidence that this 2–3 second integration window extends to complex, naturalistic visual sequences more consistent with our experience of the subjective present.

Temporal dynamics of masked word reading

The repercussions of unconscious priming on the neural correlates subsequent cognition have been explored previously. However, the neural dynamics during the unconscious processing remains largely uncharted. To assess both the complexity and temporal dynamics of unconscious cognition the present study contrasts the evoked response from classes of masked stimuli with three different levels of complexity; words, consonant strings, and blanks. The evoked response to masked word stimuli differed from both consonant strings and blanks, which did not differ from each other. This response was qualitatively different to any evoked potential observed when stimuli were consciously visible and peaked at 140ms, earlier than is usually associated with differences between words and strings and 100ms earlier than word-consonant string differences in the visible condition. The evoked response demonstrates a qualitatively distinct signature of unconscious cognition and directly demonstrates the extraction of abstract information under subliminal conditions.