Marc Sato

Processing abstract language modulates motor system activity

Embodiment theory proposes that neural systems for perception and action are also engaged during language comprehension. Previous neuroimaging and neurophysiological studies have only been able to demonstrate modulation of action systems during comprehension of concrete language. We provide neurophysiological evidence for modulation of motor system activity during the comprehension of both concrete and abstract language. In Experiment 1, when the described direction of object transfer or information transfer (e.g., away from the reader to another) matched the literal direction of a hand movement used to make a response, speed of responding was faster than when the two directions mismatched (an action–sentence compatibility effect). In Experiment 2, we used single-pulse transcranial magnetic stimulation to study changes in the corticospinal motor pathways to hand muscles while reading the same sentences. Relative to sentences that do not describe transfer, there is greater modulation of activity in the hand muscles when reading sentences describing transfer of both concrete objects and abstract information. These findings are discussed in relation to the human mirror neuron system.

Use-induced motor plasticity affects the processing of abstract and concrete language

Summary Traditional analyses of language [1] emphasize an arbitrary correspondence between linguistic symbols and their extensions in the world, but recent behavioral and neurophysiological [2,3] studies have demonstrated a processing link between a symbol and its extension: that is, comprehension of language about concrete events relies in part on a simulation process that calls on neural systems used in perceiving and acting on those extensions. It is an open question, however, whether this simulation process is necessary for abstract language understanding [4,5]. Here we report how, using a new technique based on use-induced neural plasticity [6], we have obtained evidence for a causal link between the motor system and the comprehension of both concrete and abstract language.

A mediating role of the premotor cortex in phoneme segmentation.

Consistent with a functional role of the motor system in speech perception, disturbing the activity of the left ventral premotor cortex by means of repetitive transcranial magnetic stimulation (rTMS) has been shown to impair auditory identification of syllables that were masked with white noise. However, whether this region is crucial for speech perception under normal listening conditions remains debated. To directly test this hypothesis, we applied rTMS to the left ventral premotor cortex and participants performed auditory speech tasks involving the same set of syllables but differing in the use of phonemic segmentation processes. Compared to sham stimulation, rTMS applied over the ventral premotor cortex resulted in slower phoneme discrimination requiring phonemic segmentation. No effect was observed in phoneme identification and syllable discrimination tasks that could be performed without need for phonemic segmentation. The findings demonstrate a mediating role of the ventral premotor cortex in speech segmentation under normal listening conditions and are interpreted in relation to theories assuming a link between perception and action in the human speech processing system.

The Perception for Action Control Theory (PACT): a perceptuo-motor theory of speech perception

It is an old-standing debate in the field of speech communication to determine whether speech perception involves auditory or multisensory representations and processing, independently on any procedural knowledge about the production of speech units or on the contrary if it is based on a recoding of the sensory input in terms of articulatory gestures, as posited in the Motor Theory of Speech Perception. The discovery of mirror neurons in the last 15 years has strongly renewed the interest for motor theories. However, while these neurophysiological data clearly reinforce the plausibility of the role of motor properties in perception, it could lead in our view to incorrectly de-emphasise the role of perceptual shaping, crucial in speech communication. The so-called Perception-for-Action-Control Theory (PACT) aims at defining a theoretical framework connecting in a principled way perceptual shaping and motor procedural knowledge in speech multisensory processing in the human brain. In this paper, the theory is presented in details. It is described how this theory fits with behavioural and linguistic data, concerning firstly vowel systems in human languages, and secondly the perceptual organization of the speech scene. Finally a neuro-computational framework is presented in connection with recent data on the possible functional role of the motor system in speech perception.

Task related modulation of the motor system during language processing

Recent neurophysiological and brain imaging studies have shown that the motor system is involved in language processing. However, it is an open question whether this involvement is a necessary requisite to understand language or rather a side effect of distinct cognitive processes underlying it. In order to clarify this issue we carried out three behavioral experiments, using a go-no go paradigm. Italian verbs expressing hand actions, foot actions or an abstract content served as stimuli. Participants used their right hands to respond. In Experiment 1, in which a semantics decision task with an early delivery of the go signal (during processing language material) was used, slower responses were found for hand action-related verbs than for foot action-related verbs. In Experiment 2, using the same task with either an early or a delayed delivery of the go signal (when language material had been already processed), no difference was found between responses to the two verb categories in the delayed delivery condition. In Experiment 3, in which a lexical decision task with an early delivery of the go signal was used, again no difference between the two verb categories was found. The present findings demonstrate that during language processing the modulation of the motor system crucially occurs while performing a semantics decision task, thus supporting the notion that this involvement is a necessary step to understand language rather than a side effect of upstream cognitive processes.

Numbers within Our Hands: Modulation of Corticospinal Excitability of Hand Muscles during Numerical Judgment

Developmental and cross-cultural studies show that finger counting represents one of the basic number learning strategies. However, despite the ubiquity of such an embodied strategy, the issue of whether there is a neural link between numbers and fingers in adult, literate individuals remains debated. Here, we used transcranial magnetic stimulation to study changes of excitability of hand muscles of individuals performing a visual parity judgment task, a task not requiring counting, on Arabic numerals from 1 to 9. Although no modulation was observed for the left hand muscles, an increase in amplitude of motor-evoked potentials was found for the right hand muscles. This increase was specific for smaller numbers (1 to 4) as compared to larger numbers (6 to 9). These findings indicate a close relationship between hand/finger and numerical representations.

Functional MRI assessment of orofacial articulators: Neural correlates of lip, jaw, larynx, and tongue movements

Compared with complex coordinated orofacial actions, few neuroimaging studies have attempted to determine the shared and distinct neural substrates of supralaryngeal and laryngeal articulatory movements when performed independently. To determine cortical and subcortical regions associated with supralaryngeal motor control, participants produced lip, tongue and jaw movements while undergoing functional magnetic resonance imaging (fMRI). For laryngeal motor activity, participants produced the steady‐state/i/vowel. A sparse temporal sampling acquisition method was used to minimize movement‐related artifacts. Three main findings were observed. First, the four tasks activated a set of largely overlapping, common brain areas: the sensorimotor and premotor cortices, the right inferior frontal gyrus, the supplementary motor area, the left parietal operculum and the adjacent inferior parietal lobule, the basal ganglia and the cerebellum. Second, differences between tasks were restricted to the bilateral auditory cortices and to the left ventrolateral sensorimotor cortex, with greater signal intensity for vowel vocalization. Finally, a dorso‐ventral somatotopic organization of lip, jaw, vocalic/laryngeal, and tongue movements was observed within the primary motor and somatosensory cortices using individual region‐of‐interest (ROI) analyses. These results provide evidence for a core neural network involved in laryngeal and supralaryngeal motor control and further refine the sensorimotor somatotopic organization of orofacial articulators. Hum Brain Mapp 33:2306–2321, 2012.

On the relationship between handedness and hand-digit mapping in finger counting.

The purpose of the current investigation was to evaluate hand-digit mapping in finger counting in French children and adults and whether handedness might constraint hand-digit mapping. To this aim, hand-digit mapping used when counting from one to ten by means of fingers, together with performance-based and preference-based measures of handedness, were evaluated in French individuals of four different age groups (4-5 years old, 6-7 years old, 10-11 years old and 24-47 years old). Irrespective of the age group, analyses revealed a strong tendency to use first the right hand to count from one to five and then the left hand to count from six to ten. In addition, a significant interaction between hand-digit mapping and hand preference was found, with participants who used first their right hand to count reporting higher right-hand preference in unimanual activities. These findings are discussed in light of recent studies assuming a link between finger-counting habits and numerical processing.

Multistable representation of speech forms: a functional MRI study of verbal transformations

We used functional magnetic resonance imaging (fMRI) to localize the brain areas involved in the imagery analogue of the verbal transformation effect, that is, the perceptual changes that occur when a speech form is cycled in rapid and continuous mental repetition. Two conditions were contrasted: a baseline condition involving the simple mental repetition of speech sequences, and a verbal transformation condition involving the mental repetition of the same items with an active search for verbal transformation. Our results reveal a predominantly left-lateralized network of cerebral regions activated by the verbal transformation task, similar to the neural network involved in verbal working memory: the left inferior frontal gyrus, the left supramarginal gyrus, the left superior temporal gyrus, the anterior part of the right cingulate cortex, and the cerebellar cortex, bilaterally. Our results strongly suggest that the imagery analogue of the verbal transformation effect, which requires percept analysis, form interpretation, and attentional maintenance of verbal material, relies on a working memory module sharing common components of speech perception and speech production systems.

Enhanced early-latency electromagnetic activity in the left premotor cortex is associated with successful phonetic categorization

Sensory-motor interactions between auditory and articulatory representations in the dorsal auditory processing stream are suggested to contribute to speech perception, especially when bottom-up information alone is insufficient for purely auditory perceptual mechanisms to succeed. Here, we hypothesized that the dorsal stream responds more vigorously to auditory syllables when one is engaged in a phonetic identification/repetition task subsequent to perception compared to passive listening, and that this effect is further augmented when the syllables are embedded in noise. To this end, we recorded magnetoencephalography while twenty subjects listened to speech syllables, with and without noise masking, in four conditions: passive perception; overt repetition; covert repetition; and overt imitation. Compared to passive listening, left-hemispheric N100m equivalent current dipole responses were amplified and shifted posteriorly when perception was followed by covert repetition task. Cortically constrained minimum-norm estimates showed amplified left supramarginal and angylar gyri responses in the covert repetition condition at ~100ms from stimulus onset. Longer-latency responses at ~200ms were amplified in the covert repetition condition in the left angular gyrus and in all three active conditions in the left premotor cortex, with further enhancements when the syllables were embedded in noise. Phonetic categorization accuracy and magnitude of voice pitch change between overt repetition and imitation conditions correlated with left premotor cortex responses at ~100 and ~200ms, respectively. Together, these results suggest that the dorsal stream involvement in speech perception is dependent on perceptual task demands and that phonetic categorization performance is influenced by the left premotor cortex.