Daniel R. Lametti

Sensory Preference in Speech Production Revealed by Simultaneous Alteration of Auditory and Somatosensory Feedback

The idea that humans learn and maintain accurate speech by carefully monitoring auditory feedback is widely held. But this view neglects the fact that auditory feedback is highly correlated with somatosensory feedback during speech production. Somatosensory feedback from speech movements could be a primary means by which cortical speech areas monitor the accuracy of produced speech. We tested this idea by placing the somatosensory and auditory systems in competition during speech motor learning. To do this, we combined two speech-learning paradigms to simultaneously alter somatosensory and auditory feedback in real time as subjects spoke. Somatosensory feedback was manipulated by using a robotic device that altered the motion path of the jaw. Auditory feedback was manipulated by changing the frequency of the first formant of the vowel sound and playing back the modified utterance to the subject through headphones. The amount of compensation for each perturbation was used as a measure of sensory reliance. All subjects were observed to correct for at least one of the perturbations, but auditory feedback was not dominant. Indeed, some subjects showed a stable preference for either somatosensory or auditory feedback during speech.

The hearing ear is always found close to the speaking tongue: Review of the role of the motor system in speech perception

HIGHLIGHTSThe role of the motor system in speech perception is reviewed.Distributed production regions/networks ubiquitously participate in perception.Regions/networks specific to production and vary dynamically with context.Data consistent with a sensorimotor/complex network models of speech perception.Existing models of the organization of language and the brain fail to explain results. ABSTRACT Does “the motor system” play “a role” in speech perception? If so, where, how, and when? We conducted a systematic review that addresses these questions using both qualitative and quantitative methods. The qualitative review of behavioural, computational modelling, non‐human animal, brain damage/disorder, electrical stimulation/recording, and neuroimaging research suggests that distributed brain regions involved in producing speech play specific, dynamic, and contextually determined roles in speech perception. The quantitative review employed region and network based neuroimaging meta‐analyses and a novel text mining method to describe relative contributions of nodes in distributed brain networks. Supporting the qualitative review, results show a specific functional correspondence between regions involved in non‐linguistic movement of the articulators, covertly and overtly producing speech, and the perception of both nonword and word sounds. This distributed set of cortical and subcortical speech production regions are ubiquitously active and form multiple networks whose topologies dynamically change with listening context. Results are inconsistent with motor and acoustic only models of speech perception and classical and contemporary dual‐stream models of the organization of language and the brain. Instead, results are more consistent with complex network models in which multiple speech production related networks and subnetworks dynamically self‐organize to constrain interpretation of indeterminant acoustic patterns as listening context requires.

Brief Periods of Auditory Perceptual Training Can Determine the Sensory Targets of Speech Motor Learning

The perception of speech is notably malleable in adults, yet alterations in perception seem to have little impact on speech production. However, we hypothesized that speech perceptual training might immediately influence speech motor learning. To test this, we paired a speech perceptual-training task with a speech motor-learning task. Subjects performed a series of perceptual tests designed to measure and then manipulate the perceptual distinction between the words head and had. Subjects then produced head with the sound of the vowel altered in real time so that they heard themselves through headphones producing a word that sounded more like had. In support of our hypothesis, the amount of motor learning in response to the voice alterations depended on the perceptual boundary acquired through perceptual training. The studies show that plasticity in adults’ speech perception can have immediate consequences for speech production in the context of speech learning.

Postural Constraints on Movement Variability

Movements are inherently variable. When we move to a particular point in space, a cloud of final limb positions is observed around the target. Previously we noted that patterns of variability at the end of movement to a circular target were not circular, but instead reflected patterns of limb stiffness-in directions where limb stiffness was high, variability in end position was low, and vice versa. Here we examine the determinants of variability at movement end in more detail. To do this, we have subjects move the handle of a robotic device from different starting positions into a circular target. We use position servocontrolled displacements of the robots handle to measure limb stiffness at the end of movement and we also record patterns of end position variability. To examine the effect of change in posture on movement variability, we use a visual motor transformation in which we change the limb configuration and also the actual movement target, while holding constant the visual display. We find that, regardless of movement direction, patterns of variability at the end of movement vary systematically with limb configuration and are also related to patterns of limb stiffness, which are likewise configuration dependent. The result suggests that postural configuration determines the base level of movement variability, on top of which control mechanisms can act to further alter variability.

Cerebellar tDCS dissociates the timing of perceptual decisions from perceptual change in speech

Neuroimaging studies suggest that the cerebellum might play a role in both speech perception and speech perceptual learning. However, it remains unclear what this role is: does the cerebellum help shape the perceptual decision, or does it contribute to the timing of perceptual decisions? To test this, we used transcranial direct current stimulation (tDCS) in combination with a speech perception task. Participants experienced a series of speech perceptual tests designed to measure and then manipulate (via training) their perception of a phonetic contrast. One group received cerebellar tDCS during speech perceptual learning, and a different group received sham tDCS during the same task. Both groups showed similar learning-related changes in speech perception that transferred to a different phonetic contrast. For both trained and untrained speech perceptual decisions, cerebellar tDCS significantly increased the time it took participants to indicate their decisions with a keyboard press. By analyzing perceptual responses made by both hands, we present evidence that cerebellar tDCS disrupted the timing of perceptual decisions, while leaving the eventual decision unaltered. In support of this conclusion, we use the drift diffusion model to decompose the data into processes that determine the outcome of perceptual decision-making and those that do not. The modeling suggests that cerebellar tDCS disrupted processes unrelated to decision-making. Taken together, the empirical data and modeling demonstrate that right cerebellar tDCS dissociates the timing of perceptual decisions from perceptual change. The results provide initial evidence in healthy humans that the cerebellum critically contributes to speech timing in the perceptual domain.

Cortico-cerebellar Networks Drive Sensorimotor Learning in Speech.

The motor cortex and cerebellum are thought to be critical for learning and maintaining motor behaviors. Here we use transcranial direct current stimulation (tDCS) to test the role of the motor cortex and cerebellum in sensorimotor learning in speech. During productions of “head,” “bed,” and “dead,” the first formant of the vowel sound was altered in real time toward the first formant of the vowel sound in “had,” “bad,” and “dad.” Compensatory changes in first and second formant production were used as a measure of motor adaptation. tDCS to either the motor cortex or the cerebellum improved sensorimotor learning in speech compared with sham stimulation (n = 20 in each group). However, in the case of cerebellar tDCS, production changes were restricted to the source of the acoustical error (i.e., the first formant). Motor cortex tDCS drove production changes that offset errors in the first formant, but unlike cerebellar tDCS, adaptive changes in the second formant also occurred. The results suggest that motor cortex and cerebellar tDCS have both shared and dissociable effects on motor adaptation. The study provides initial causal evidence in speech production that the motor cortex and the cerebellum support different aspects of sensorimotor learning. We propose that motor cortex tDCS drives sensorimotor learning toward previously learned patterns of movement, whereas cerebellar tDCS focuses sensorimotor learning on error correction.

Auditory plasticity and sensorimotor learning in speech production

Numerous studies have shown the speech motor system to be highly flexible and responsive to changes in sensory input, revealing a central role for both auditory and somatosensory feedback in the acquisition and maintenance of speech motor control. Consistent with these studies, models of speech production have highlighted the role of accurate, stable sensory representations that serve, in part, as the goals of speech movements. A separate (and considerable) body of work has demonstrated that auditory-sensory representations of speech sounds are not perfectly stable, but rather exhibit rapid adaptation to changing input conditions in both children and adults. The plasticity of auditory representations has important implications for the control of speech production, both in early speech motor development and in the sensory-based maintenance of speech accuracy that characterizes adult speech motor control. In this talk, I will describe a series of studies that explore the link between sensory and motor plast...