Eun-Jin Sim

The Sound of Concepts: Four Markers for a Link between Auditory and Conceptual Brain Systems

Traditionally, concepts are conceived as abstract mental entities distinct from perceptual or motor brain systems. However, recent results let assume modality-specific representations of concepts. The ultimate test for grounding concepts in perception requires the fulfillment of the following four markers: conceptual processing during (1) an implicit task should activate (2) a perceptual region (3) rapidly and (4) selectively. Here, we show using functional magnetic resonance imaging and recordings of event-related potentials, that acoustic conceptual features recruit auditory brain areas even when implicitly presented through visual words. Fulfilling the four markers, the findings of our study unequivocally link the auditory and conceptual brain systems: recognition of words denoting objects, for which acoustic features are highly relevant (e.g.,“telephone”), ignited cell assemblies in posterior superior and middle temporal gyri (pSTG/MTG) within 150 ms that were also activated by sound perception. Importantly, activity within a cluster of pSTG/MTG increased selectively as a function of acoustic, but not of visual and action-related feature relevance. The implicitness of the conceptual task, the selective modulation of left pSTG/MTG activity by acoustic feature relevance, the early onset of this activity at 150 ms and its anatomical overlap with perceptual sound processing are four markers for a modality-specific representation of auditory conceptual features in left pSTG/MTG. Our results therefore provide the first direct evidence for a link between perceptual and conceptual acoustic processing. They demonstrate that access to concepts involves a partial reinstatement of brain activity during the perception of objects.

Conceptual flexibility in the human brain: Dynamic recruitment of semantic maps from visual, motor, and motion-related areas

Traditionally, concepts are assumed to be situational invariant mental knowledge entities (conceptual stability), which are represented in a unitary brain system distinct from sensory and motor areas (amodality). However, accumulating evidence suggests that concepts are embodied in perception and action in that their conceptual features are stored within modality-specific semantic maps in the sensory and motor cortex. Nonetheless, the first traditional assumption of conceptual stability largely remains unquestioned. Here, we tested the notion of flexible concepts using functional magnetic resonance imaging and event-related potentials (ERPs) during the verification of two attribute types (visual, action-related) for words denoting artifactual and natural objects. Functional imaging predominantly revealed crossover interactions between category and attribute type in visual, motor, and motion-related brain areas, indicating that access to conceptual knowledge is strongly modulated by attribute type: Activity in these areas was highest when nondominant conceptual attributes had to be verified. ERPs indicated that these category-attribute interactions emerged as early as 116 msec after stimulus onset, suggesting that they reflect rapid access to conceptual features rather than postconceptual processing. Our results suggest that concepts are situational-dependent mental entities. They are composed of semantic features which are flexibly recruited from distributed, yet localized, semantic maps in modality-specific brain regions depending on contextual constraints.

Experience-dependent Plasticity of Conceptual Representations in Human Sensory-Motor Areas

Concepts are composed of features related to different sensory and motor modalities such as vision, sound, and action. It is a matter of controversy whether conceptual features are represented in sensory-motor areas reflecting the specific learning experience during acquisition. In order to address this issue, we assessed the plasticity of conceptual representations by training human participants with novel objects under different training conditions. These objects were assigned to categories such that for one class of categories, the overall shape was diagnostic for category membership, whereas for the other class, a detail feature affording a particular action was diagnostic. During training, participants were asked to either make an action pantomime toward the detail feature of the novel object or point to it. In a categorization task at test, we assessed the neural correlates of the acquired conceptual representations by measuring electrical brain activity. Here, we show that the same object is differentially processed depending on the sensory-motor interactions during knowledge acquisition. Only in the pantomime group did we find early activation in frontal motor regions and later activation in occipito-parietal visual-motor regions. In the pointing training group, these effects were absent. These results show that action information contributes to conceptual processing depending on the specific learning experience. In line with modality-specific theories of conceptual memory, our study suggests that conceptual representations are established by the learning-based formation of cell assemblies in sensory-motor areas.

Tracking the time course of action priming on object recognition: Evidence for fast and slow influences of action on perception

Perception and action are classically thought to be supported by functionally and neuroanatomically distinct mechanisms. However, recent behavioral studies using an action priming paradigm challenged this view and showed that action representations can facilitate object recognition. This study determined whether action representations influence object recognition during early visual processing stages, that is, within the first 150 msec. To this end, the time course of brain activation underlying such action priming effects was examined by recording ERPs. Subjects were sequentially presented with two manipulable objects (e.g., tools), which had to be named. In the congruent condition, both objects afforded similar actions, whereas dissimilar actions were afforded in the incongruent condition. In order to test the influence of the prime modality on action priming, the first object (prime) was presented either as picture or as word. We found an ERP effect of action priming over the central scalp as early as 100 msec after target onset for pictorial, but not for verbal primes. A later action priming effect on the N400 ERP component known to index semantic integration processes was obtained for both picture and word primes. The early effect was generated in a fronto-parietal motor network, whereas the late effect reflected activity in anterior temporal areas. The present results indicate that action priming influences object recognition through both fast and slow pathways: Action priming affects rapid visuomotor processes only when elicited by pictorial prime stimuli. However, it also modulates comparably slow conceptual integration processes independent of the prime modality.

Neuroplasticity of semantic representations for musical instruments in professional musicians

Professional musicians constitute a model par excellence for understanding experience-dependent plasticity in the human brain, particularly in the auditory domain. Their intensive sensorimotor experience with musical instruments has been shown to entail plastic brain alterations in cortical perceptual and motor maps. It remains an important question whether this neuroplasticity might extend beyond basic perceptual and motor functions and even shape higher-level conceptualizations by which we conceive our physical and social world. Here we show using functional magnetic resonance imaging (fMRI) that conceptual processing of visually presented musical instruments activates auditory association cortex encompassing right posterior superior temporal gyrus, as well as adjacent areas in the superior temporal sulcus and the upper part of middle temporal gyrus (pSTG/MTG) only in musicians, but not in musical laypersons. These areas in and adjacent to auditory association cortex were not only recruited by conceptual processing of musical instruments during visual object recognition, but also by auditory perception of real sounds. Hence, the unique intensive experience of musicians with musical instruments establishes a link between auditory perceptual and conceptual brain systems. Experience-driven neuroplasticity in musicians is thus not confined to alterations of perceptual and motor maps, but even leads to the establishment of higher-level semantic representations for musical instruments in and adjacent to auditory association cortex. These findings highlight the eminent importance of sensory and motor experience for acquiring rich concepts.

Baseline Brain Perfusion and the Serotonin Transporter Promoter Polymorphism

BACKGROUND The serotonin transporter length repeat polymorphism (5-HTTLPR) in the promoter region of the serotonin transporter gene (SLC6A4) has been associated in healthy subjects with changes in basal perfusion levels in the limbic system and ventral prefrontal areas, regions involved in the pathophysiology of depression and anxiety, suggesting the existence of a neurobiological trait predisposing to these disorders. We reassess the findings of an increased baseline perfusion in the amygdala and ventral prefrontal areas in healthy carriers of the risk genotype in a much larger sample than in previous studies. METHODS A cohort of 183 healthy European individuals underwent perfusion imaging with continuous arterial spin-labeling (CASL) while resting quietly in the scanner for 8 minutes. Participants were genotyped to assess the occurrence of the short allele and the Lg and La variants of the long repeat. RESULTS No association between the 5-HTTLPR polymorphism and baseline brain perfusion was detected in the regions of interest or elsewhere in the brain. In the amygdala, variability in baseline perfusion was explained in large part by global cerebral flow levels (between 50% and 55%), in minor part by sex (between 4% and 5%), but not by genotype (less than .5%). Power analyses showed that the study was of sufficient size to be informative. CONCLUSIONS The findings did not confirm the existence of a biological marker of the effect of 5-HTTLPR polymorphism in the amygdala or in the orbitofrontal cortex.

When Action Observation Facilitates Visual Perception: Activation in Visuo-Motor Areas Contributes to Object Recognition

Recent evidence suggests an interaction between the ventral visual-perceptual and dorsal visuo-motor brain systems during the course of object recognition. However, the precise function of the dorsal stream for perception remains to be determined. The present study specified the functional contribution of the visuo-motor system to visual object recognition using functional magnetic resonance imaging and event-related potential (ERP) during action priming. Primes were movies showing hands performing an action with an object with the object being erased, followed by a manipulable target object, which either afforded a similar or a dissimilar action (congruent vs. incongruent condition). Participants had to recognize the target object within a picture-word matching task. Priming-related reductions of brain activity were found in frontal and parietal visuo-motor areas as well as in ventral regions including inferior and anterior temporal areas. Effective connectivity analyses suggested functional influences of parietal areas on anterior temporal areas. ERPs revealed priming-related source activity in visuo-motor regions at about 120 ms and later activity in the ventral stream at about 380 ms. Hence, rapidly initiated visuo-motor processes within the dorsal stream functionally contribute to visual object recognition in interaction with ventral stream processes dedicated to visual analysis and semantic integration.

Components of variance in brain perfusion and the design of studies of individual differences: The baseline study

Simple baseline studies correlate average perfusion levels measured at rest with individual variables, or contrast subject groups as in case-control studies. In this methodological work, we summarize some formal properties of the design of these studies, and investigate the sources of variance that characterize data acquired with the arterial spin labeling technique, with the purpose of alerting users to the main sources of variation that determine background variance and affect the power of statistical tests. This design typology is characterized by two variance components: between acquisitions and between subjects. We show that variation between acquisitions is affected by the presence of large vessels and venous sinuses, with potential adverse effects especially in the temporal and insular regions, and provide maps of the number of acquisitions or subjects required to reach the desired estimate precision. Furthermore, we show that the largest source of variation between subjects is captured by global perfusion levels, and can in principle be removed by adjusting the data. Significance levels, however, are not always only improved by the adjustment procedure; we provide an example in the correlation with age, and attempt to explain the consequences of the adjustment with the help of a principal component analysis of the data. We also show the existence of variation between subjects in the perfusion in the territory of the posterior cerebral artery and in hemispheric asymmetry.

Mechanisms underlying flexible adaptation of cognitive control: Behavioral and neuroimaging evidence in a flanker task

Cognitive control can be adapted flexibly according to the conflict level in a given situation. In the Eriksen flanker task, interference evoked by flankers is larger in conditions with a higher, rather than a lower proportion of compatible trials. Such compatibility ratio effects also occur for stimuli presented at two spatial locations suggesting that different cognitive control settings can be simultaneously maintained. However, the conditions and the neural correlates of this flexible adaptation of cognitive control are only poorly understood. In the present study, we further elucidated the mechanisms underlying the simultaneous maintenance of two cognitive control settings. In behavioral experiments, stimuli were presented centrally above and below fixation and hence processed by both hemispheres or lateralized to stimulate hemispheres differentially. The different compatibility ratio at two stimulus locations had a differential influence on the flanker effect in both experiments. In an fMRI experiment, blocks with an identical compatibility ratio at two central spatial locations elicited stronger activity in a network of prefrontal and parietal brain areas, which are known to be involved in conflict resolution and cognitive control, as compared with blocks with a different compatibility ratio at the same spatial locations. This demonstrates that the simultaneous maintenance of two conflicting control settings vs. one single setting does not recruit additional neural circuits suggesting the involvement of one single cognitive control system. Instead a crosstalk between multiple control settings renders adaptation of cognitive control more efficient when only one uniform rather than two different control settings has to be simultaneously maintained.

Dissociating the representation of action- and sound-related concepts in middle temporal cortex.

Modality-specific models of conceptual memory propose close links between concepts and the sensory-motor systems. Neuroimaging studies found, in different subject groups, that action-related and sound-related concepts activated different parts of posterior middle temporal gyrus (pMTG), suggesting a modality-specific representation of conceptual features. However, as these different parts of pMTG are close to each other, it is possible that the observed anatomical difference is merely related to interindividual variability. In the present functional magnetic resonance imaging study, we now investigated within the same participant group a possible conceptual feature-specific organization in pMTG. Participants performed lexical decisions on sound-related (e.g., telephone) and action-related (hammer) words. Sound words elicited higher activity in anterior pMTG adjacent to auditory association cortex, but action-related words did so in posterior pMTG close to motion sensitive areas. These results confirm distinct conceptual representations of sound and action in pMTG, just adjacent to the respective modality-specific cortices.