Riccardo Dalla Volta

Spoken Language and arm Gestures are Controlled by the same Motor Control System

Arm movements can influence language comprehension much as semantics can influence arm movement planning. Arm movement itself can be used as a linguistic signal. We reviewed neurophysiological and behavioural evidence that manual gestures and vocal language share the same control system. Studies of primate premotor cortex and, in particular, of the so-called “mirror system”, including humans, suggest the existence of a dual hand/mouth motor command system involved in ingestion activities. This may be the platform on which a combined manual and vocal communication system was constructed. In humans, speech is typically accompanied by manual gesture, speech production itself is influenced by executing or observing transitive hand actions, and manual actions play an important role in the development of speech, from the babbling stage onwards. Behavioural data also show reciprocal influence between word and symbolic gestures. Neuroimaging and repetitive transcranial magnetic stimulation (rTMS) data suggest that the system governing both speech and gesture is located in Brocas area. In general, the presented data support the hypothesis that the hand motor-control system is involved in higher order cognition.

The Dynamics of Sensorimotor Cortical Oscillations during the Observation of Hand Movements: An EEG Study

Background The observation of action done by others determines a desynchronization of the rhythms recorded from cortical central regions. Here, we examined whether the observation of different types of hand movements (target directed, non-target directed, cyclic and non-cyclic) elicits different EEG cortical temporal patterns. Methodology Video-clips of four types of hand movements were shown to right-handed healthy participants. Two were target directed (grasping and pointing) motor acts; two were non-target directed (supinating and clenching) movements. Grasping and supinating were performed once, while pointing and clenching twice (cyclic movements). High-density EEG was recorded and analyzed by means of wavelet transform, subdividing the time course in time bins of 200 ms. The observation of all presented movements produced a desynchronization of alpha and beta rhythms in central and parietal regions. The rhythms desynchronized as soon as the hand movement started, the nadir being reached around 700 ms after movement onset. At the end of the movement, a large power rebound occurred for all bands. Target and non-target directed movements produced an alpha band desynchronization in the central electrodes at the same time, but with a stronger desynchronization and a prolonged rebound for target directed motor acts. Most interestingly, there was a clear correlation between the velocity profile of the observed movements and beta band modulation. Significance Our data show that the observation of motor acts determines a modulation of cortical rhythm analogous to that occurring during motor act execution. In particular, the cortical motor system closely follows the velocity of the observed movements. This finding provides strong evidence for the presence in humans of a mechanism (mirror mechanism) mapping action observation on action execution motor programs.

Repetitive Transcranial Magnetic Stimulation of Broca's Area Affects Verbal Responses to Gesture Observation

The aim of the present study was to determine whether Brocas area is involved in translating some aspects of arm gesture representations into mouth articulation gestures. In Experiment 1, we applied low-frequency repetitive transcranial magnetic stimulation over Brocas area and over the symmetrical loci of the right hemisphere of participants responding verbally to communicative spoken words, to gestures, or to the simultaneous presentation of the two signals. We performed also sham stimulation over the left stimulation loci. In Experiment 2, we performed the same stimulations as in Experiment 1 to participants responding with words congruent and incongruent with gestures. After sham stimulation voicing parameters were enhanced when responding to communicative spoken words or to gestures as compared to a control condition of word reading. This effect increased when participants responded to the simultaneous presentation of both communicative signals. In contrast, voicing was interfered when the verbal responses were incongruent with gestures. The left stimulation neither induced enhancement on voicing parameters of words congruent with gestures nor interference on words incongruent with gestures. We interpreted the enhancement of the verbal response to gesturing in terms of intention to interact directly. Consequently, we proposed that Brocas area is involved in the process of translating into speech aspects concerning the social intention coded by the gesture. Moreover, we discussed the results in terms of evolution to support the theory [Corballis, M. C. (2002). From hand to mouth: The origins of language. Princeton, NJ: Princeton University Press] proposing spoken language as evolved from an ancient communication system using arm gestures.

Seven years of recording from monkey cortex with a chronically implanted multiple microelectrode

A brush of 64 microwires was chronically implanted in the ventral premotor cortex of a macaque monkey. Contrary to common approaches, the wires were inserted from the white matter side. This approach, by avoiding mechanical pressure on the dura and pia mater during penetration, disturbed only minimally the cortical recording site. With this approach isolated potentials and multiunit activity were recorded for more than 7 years in about one-third of electrodes. The indirect insertion method also provided an excellent stability within each recording session, and in some cases even allowed recording from the same neurons for several years. Histological examination of the implanted brain region shows only a very marginal damage to the recording area. Advantages and problems related to long-term recording are discussed.

Social Requests and Social Affordances: How They Affect the Kinematics of Motor Sequences during Interactions between Conspecifics

The present study aimed at determining whether and what factors affect the control of motor sequences related to interactions between conspecifics. Experiment 1 demonstrated that during interactions between conspecifics guided by the social intention of feeding, a social affordance was activated, which modified the kinematics of sequences constituted by reaching-grasping and placing. This was relative to the same sequence directed to an inanimate target. Experiments 2 and 4 suggested that the related-to-feeding social request emitted by the receiver (i.e. the request gesture of mouth opening) is prerequisite in order to activate a social affordance. Specifically, the two experiments showed that the social request to be fed activated a social affordance even when the sequences directed towards a conspecific were not finalized to feed. Experiment 3 showed that moving inside the peripersonal space of a conspecific, who did not produce any social request, marginally affected the sequence. Finally, experiments 5 and 6 indicated that the gaze of a conspecific is necessary to make a social request effective at activating a social affordance. Summing up, the results of the present study suggest that the control of motor sequences can be changed by the interaction between giver and receiver: the interaction is characterized by a social affordance that the giver activates on the basis of social requests produced by the receiver. The gaze of the receiver is a prerequisite to make a social request effective.

Action word understanding and overt motor behavior

Is the motor system involved in language processing? In order to clarify this issue, we carried out three behavioral experiments, using go–no-go and choice paradigms. In all the experiments, we used a semantic decision task with an early delivery of the go signal (during processing language material). Italian verbs expressing hand actions, foot actions or an abstract content served as stimuli. Participants executed intransitive (Experiment 1) or transitive (Experiment 2) actions with their right hand in response to the acoustic presentation of action-related verbs and refrained from responding to abstract verbs. The kinematics of the actions was slowed down by hand action-related verbs when compared with foot action-related verbs. In Experiment 3, hand-related and foot-related verbs were presented. Participants responded to hand-related and foot-related verbs with their hand and their foot (compatible condition) and in another block of trials they responded to hand-related and foot-related verbs with their foot and their hand (incompatible condition), respectively. In the compatible condition, the beginning of the action was faster, whereas the kinematics of the action was slower. The present findings suggest complete activation of verb-related motor programs during language processing. The data are discussed in support of the hypothesis that this complete activation is necessary requisite to understand the exact meaning of action words because goal and consequence of the actions are represented.

When the hands speak.

In the present review we will summarize evidence that the control of spoken language shares the same system involved in the control of arm gestures. Studies of primate premotor cortex discovered the existence of the so-called mirror system as well as of a system of double commands to hand and mouth. These systems may have evolved initially in the context of ingestion, and later formed a platform for combined manual and vocal communication. In humans, manual gestures are integrated with speech production, when they accompany speech. Lip kinematics and parameters of voice spectra during speech production are influenced by executing or observing transitive actions (i.e. guided by an object). Manual actions also play an important role in language acquisition in children, from the babbling stage onwards. Behavioural data reported here even show a reciprocal influence between words and symbolic gestures and studies employing neuroimaging and repetitive transcranial magnetic stimulation (rTMS) techniques suggest that the system governing both speech and gesture is located in Brocas area.

To me or to you? When the self is advantaged.

The present study aimed at verifying whether and why sequences of actions directed to oneself are facilitated when compared to action sequences directed to conspecifics. In experiment 1, participants reached to grasp and brought a piece of food either to their own mouth for self-feeding or to the mouth of a conspecific for feeding. In control conditions, they executed the same sequence to place the piece of food into a mouth-like aperture in a flat container placed upon either their own mouth or the mouth of a conspecific. Kinematic analysis showed that the actions of reaching and bringing were faster when directed to the participant’s own body, especially for self-feeding. The data support the hypothesis that reaching to grasp and bringing to one’s own body and, in particular, one’s own mouth for self-feeding, form an automatic sequence, because this is the result of more frequent execution and coordination between different effectors of one’s own body, such as arm and mouth. In contrast, the same sequence directed toward a conspecific is not automatic and requires more accuracy probably because it is guided by social intentions. This hypothesis was supported by the results of control experiment 2 in which we compared the kinematics of reaching to grasp and placing the piece of food into the mouth of a conspecific (i.e. feeding) with those of reaching to grasp and placing the same piece of food into a mouth-like aperture in a human body shape (i.e. placing). Indeed, the entire sequence was slowed down during feeding when compared to placing.

How symbolic gestures and words interact with each other.

Previous repetitive Transcranial Magnetic Stimulation and neuroimaging studies showed that Brocas area is involved in the interaction between gestures and words. However, in these studies the nature of this interaction was not fully investigated; consequently, we addressed this issue in three behavioral experiments. When compared to the expression of one signal at a time, arm kinematics slowed down and voice parameters were amplified when congruent words plus gestures were simultaneously produced (experiment 1). When word and gesture were incongruent, arm kinematics did not change regardless of word category, whereas the gesture induced variation in vocal parameters of communicative and action words only (experiments 2 and 3). Data are discussed according to the hypothesis that integration between gesture and word occurs by transferring the social intention to interact directly with the interlocutor from the gesture to the word.

Spatiotemporal dynamics during processing of abstract and concrete verbs: an ERP study.

Different accounts have been proposed to explain the nature of concept representations. Embodied accounts claim a key involvement of sensory-motor systems during semantic processing while more traditional accounts posit that concepts are abstract mental entities independent of perceptual and motor brain systems. While the involvement of sensory-motor areas in concrete language processing is supported by a large number of studies, this involvement is far from being established when considering abstract language. The present study addressed abstract and concrete verb processing, by investigating the spatiotemporal dynamics of evoked responses by means of high density EEG while participants performed a semantic decision task. In addition, RTs to the same set of stimuli were collected. In both early and late time intervals, ERP scalp topography significantly differed according to word categories. Concrete verbs showed involvement of parieto-frontal networks for action, according to the implied body effector. In contrast, abstract verbs recruited mostly frontal regions outside the motor system, suggesting a non-motor semantic processing for this category. In addition, differently from what has been reported during action observation, the parietal recruitment related to concrete verbs presentation followed the frontal one. The present findings suggest that action word semantic is grounded in sensory-motor systems, provided a bodily effector is specified, while abstract concepts׳ representation cannot be easily explained by a motor embodiment.