Raphaël Fargier

Grasp it loudly! Supporting actions with semantically congruent spoken action words

Evidence for cross-talk between motor and language brain structures has accumulated over the past several years. However, while a significant amount of research has focused on the interaction between language perception and action, little attention has been paid to the potential impact of language production on overt motor behaviour. The aim of the present study was to test whether verbalizing during a grasp-to-displace action would affect motor behaviour and, if so, whether this effect would depend on the semantic content of the pronounced word (Experiment I). Furthermore, we sought to test the stability of such effects in a different group of participants and investigate at which stage of the motor act language intervenes (Experiment II). For this, participants were asked to reach, grasp and displace an object while overtly pronouncing verbal descriptions of the action (“grasp” and “put down”) or unrelated words (e.g. “butterfly” and “pigeon”). Fine-grained analyses of several kinematic parameters such as velocity peaks revealed that when participants produced action-related words their movements became faster compared to conditions in which they did not verbalize or in which they produced words that were not related to the action. These effects likely result from the functional interaction between semantic retrieval of the words and the planning and programming of the action. Therefore, links between (action) language and motor structures are significant to the point that language can refine overt motor behaviour.

Neural dynamics of object noun, action verb and action noun production in picture naming.

The verb/noun dissociation has often involved the semantic/grammatical confound. We conducted two event-related potentials (ERPs) studies with the aim of minimizing this confound. In Experiment 1 participants named pictures depicting actions, with verbs or nouns and pictures depicting objects with nouns. In Experiment 2, participants named objects (nouns) or actions (verbs/nouns) from the same set of action pictures. Compatible with lexical-semantic processes, semantic category modulated waveform amplitudes and topographic patterns between 250 and 380 ms after picture-onset in Experiment 1. No such effects were observed in Experiment 2. No effects were found for grammatical class in both experiments suggesting that grammatical information is not mandatorily activated during lexical-semantic processes. Given the absence of dissociation when same pictures were used the results are described as feed-forward effects from visual to semantic processing, indicating differential neural networks for lexical selection of action and object words from their corresponding visual referents.

Word onset phonetic properties and motor artifacts in speech production EEG recordings

Electrophysiological research using verbal response paradigms faces the problem of muscle artifacts that occur during speech production or in the period preceding articulation. In this context, this paper has two related aims. The first is to show how the nature of the first phoneme influences the alignment of the ERPs. The second is to further characterize the EEG signal around the onset of articulation, both in temporal and frequency domains. Participants were asked to name aloud pictures of common objects. We applied microstate analyses and time-frequency transformations of ERPs locked to vocal onset to compare the EEG signal between voiced and unvoiced labial plosive word onset consonants. We found a delay of about 40 ms in the set of stable topographic patterns for /b/ relative to /p/ onset words. A similar shift was observed in the power increase of gamma oscillations (30-50 Hz), which had an earlier onset for /p/ trials (∼150 ms before vocal onset). This 40-ms shift is consistent with the length of the voiced proportion of the acoustic signal prior to the release of the closure in the vocal responses. These results demonstrate that phonetic features are an important parameter affecting response-locked ERPs, and hence that the onset of the acoustic energy may not be an optimal trigger for synchronizing the EEG activity to the response in vocal paradigms. The indexes explored in this study provide a step forward in the characterization of muscle-related artifacts in electrophysiological studies of speech and language production.

Neurophysiological Modulations of Non-Verbal and Verbal Dual-Tasks Interference during Word Planning

Running a concurrent task while speaking clearly interferes with speech planning, but whether verbal vs. non-verbal tasks interfere with the same processes is virtually unknown. We investigated the neural dynamics of dual-task interference on word production using event-related potentials (ERPs) with either tones or syllables as concurrent stimuli. Participants produced words from pictures in three conditions: without distractors, while passively listening to distractors and during a distractor detection task. Production latencies increased for tasks with higher attentional demand and were longer for syllables relative to tones. ERP analyses revealed common modulations by dual-task for verbal and non-verbal stimuli around 240 ms, likely corresponding to lexical selection. Modulations starting around 350 ms prior to vocal onset were only observed when verbal stimuli were involved. These later modulations, likely reflecting interference with phonological-phonetic encoding, were observed only when overlap between tasks was maximal and the same underlying neural circuits were engaged (cross-talk).

Neurobiological Correlates of Inhibition of the Right Broca Homolog during New-Word Learning

Repetitive transcranial magnetic stimulation (rTMS) has demonstrated beneficial effects on motor learning. It would be important to obtain a similar enhancement for verbal learning. However, previous studies have mostly assessed short-term effects of rTMS on language performance and the effect on learning is largely unknown. This study examined whether an inhibition of the right Broca homolog has long-term impact on neural processes underlying the acquisition of new words in healthy individuals. Sixteen young participants trained a new-word learning paradigm with rare, mostly unknown objects and their corresponding words immediately after continuous theta burst stimulation (cTBS) or sham stimulation of right inferior frontal gyrus (IFG) in a cross-over design. Neural effects were assessed with electroencephalography (EEG) source power analyses during the naming task as well as coherence analyses at rest 1 day before and after training. Inhibition of the right Broca homolog did not affect new word learning performance at the group level. Behavioral and neural responses to cTBS were variable across participants and were associated with the magnitude of resting-state alpha-band coherence between the stimulated area and the rest of the brain before stimulation. Only participants with high intrinsic alpha-band coherence between the stimulated area and the rest of the brain before stimulation showed the expected inhibition during naming and greater learning performance. In conclusion, our study confirms that cTBS can induce lasting modulations of neural processes which are associated with learning, but the effect depends on the individual network state.

Differentiating semantic categories during the acquisition of novel words: Correspondence analysis applied to event-related potentials

Growing evidence suggests that semantic knowledge is represented in distributed neural networks that include modality-specific structures. Here, we examined the processes underlying the acquisition of words from different semantic categories to determine whether the emergence of visual- and action-based categories could be tracked back to their acquisition. For this, we applied correspondence analysis (CA) to ERPs recorded at various moments during acquisition. CA is a multivariate statistical technique typically used to reveal distance relationships between words of a corpus. Applied to ERPs, it allows isolating factors that best explain variations in the data across time and electrodes. Participants were asked to learn new action and visual words by associating novel pseudowords with the execution of hand movements or the observation of visual images. Words were probed before and after training on two consecutive days. To capture processes that unfold during lexical access, CA was applied on the 100–400 msec post-word onset interval. CA isolated two factors that organized the data as a function of test sessions and word categories. Conventional ERP analyses further revealed a category-specific increase in the negativity of the ERPs to action and visual words at the frontal and occipital electrodes, respectively. The distinct neural processes underlying action and visual words can thus be tracked back to the acquisition of word-referent relationships and may have its origin in association learning. Given current evidence for the flexibility of language-induced sensory-motor activity, we argue that these associative links may serve functions beyond word understanding, that is, the elaboration of situation models.

ERP evidence of distinct processes underlying semantic facilitation and interference in word production

In everyday conversations, we take advantage of lexical-semantic contexts to facilitate speech production, but at the same time, we also have to reduce interference and inhibit semantic competitors. The blocked cyclic naming paradigm (BCNP) has been used to investigate such context effects. Typical results on production latencies showed semantic facilitation (or no effect) during the first presentation cycle, and interference emerging in subsequent cycles. Even if semantic contexts might be just as facilitative as interfering, previous BCNP studies focused on interference, which was interpreted as reflecting lemma selection and self-monitoring processes. Facilitation in the first cycle was rarely considered/analysed, although it potentially informs on word production to the same extent as interference. Here we contrasted the event-related potential (ERP) signatures of both semantic facilitation and interference in a BCNP. ERPs differed between homogeneous and heterogeneous blocks from about 365 msec post picture onset in the first cycle (facilitation) and in an earlier time-window (270 msec post picture onset) in the third cycle (interference). Three different analyses of the ERPs converge towards distinct processes underlying semantic facilitation and interference (post-lexical vs lexical respectively). The loci of semantic facilitation and interference are interpreted in the context of different theoretical frameworks of language production: the post-lexical locus of semantic facilitation involves interactive phonological-semantic processes and/or self-monitoring, whereas the lexical locus of semantic interference is in line with selection through increased lexical competition.

When Wine and Apple Both Help the Production of Grapes: ERP Evidence for Post-lexical Semantic Facilitation in Picture Naming

Background: Producing a word in referential naming requires to select the right word in our mental lexicon among co-activated semantically related words. The mechanisms underlying semantic context effects during speech planning are still controversial, particularly for semantic facilitation which investigation remains under-represented in contrast to the plethora of studies dealing with interference. Our aim is to study the time-course of semantic facilitation in picture naming, using a picture-word “interference” paradigm and event-related potentials (ERPs). Methods: We compared two different types of semantic relationships, associative and categorical, in a single word priming and a double word priming paradigm. The primes were presented visually with a long negative Stimulus Onset Asynchrony (SOA), which is expected to cause facilitation. Results: Shorter naming latencies were observed after both associative and categorical primes, as compared to unrelated primes, and even shorter latencies after two primes. Electrophysiological results showed relatively late modulations of waveform amplitudes for both types of primes (beginning ~330 ms post picture onset with a single prime and ~275 ms post picture onset with two primes), corresponding to a shift in latency of similar topographic maps across conditions. Conclusion: The present results are in favor of a post-lexical locus of semantic facilitation for associative and categorical priming in picture naming and confirm that semantic facilitation is as relevant as semantic interference to inform on word production. The post-lexical locus argued here might be related to self-monitoting or/and to modulations at the level of word-form planning, without excluding the participation of strategic processes.

Commentary: Oscillatory Neuronal Activity Reflects Lexical-Semantic Feature Integration within and across Sensory Modalities in Distributed Cortical Networks

Semantic knowledge relies on widely distributed brain networks. According to embodied semantics, retrieving features associated to words reactivate the sensory systems used during the encoding of the objects or entities they refer to Barsalou (2008). This does not preclude that semantic knowledge is organized hierarchically from modality-specific brain regions to higher-level, “convergence zones” or “hubs” (Meyer and Damasio, 2009). This organization could provide the necessary dynamic neural network for flexible lexical-semantic representations (Willems and Casasanto, 2011), although it could alternatively be interpreted in favor of amodal abstract representations (Mahon, 2015). Nevertheless, to what extent are these regions differentially activated and functionally participate to context-directed semantic integration? Eventually, which parts of this network are fundamentally modal, cross-modal, or amodal, and what is the specific role of the anterior temporal lobe (ATL), remains an area of debate.