Manuela Macedonia

Bringing back the body into the mind: gestures enhance word learning in foreign language

Foreign language education in the twenty-first century still teaches vocabulary mainly through reading and listening activities. This is due to the link between teaching practice and traditional philosophy of language, where language is considered to be an abstract phenomenon of the mind. However, a number of studies have shown that accompanying words or phrases of a foreign language with gestures leads to better memory results. In this paper, I review behavioral research on the positive effects of gestures on memory. Then I move to the factors that have been addressed as contributing to the effect, and I embed the reviewed evidence in the theoretical framework of embodiment. Finally, I argue that gestures accompanying foreign language vocabulary learning create embodied representations of those words. I conclude by advocating the use of gestures in future language education as a learning tool that enhances the mind.

A Virtual Agent as Vocabulary Trainer: Iconic Gestures Help to Improve Learners’ Memory Performance

An important and often laborious task in foreign language acquisition is vocabulary learning. Research has repeatedly demonstrated that performing iconic gestures together with novel words has a beneficial effect on learning performance. Can these findings be transferred onto virtual agents applied in gesture-supported vocabulary training? We present a study investigating whether iconic gestures performed by a virtual agent and imitated by learners have an impact on verbal memory for words in a foreign language. In a within-subject design we compared participants’ memory performance achieved with the help of a virtual agent and those achieved with the help of a human trainer regarding both short-term learning effects and long-term decay effects. The overall results demonstrate improved memory scores when participants learned with a virtual agent. Especially high performers could profit from gesture-supported training with a virtual agent.

Exploring the Neural Representation of Novel Words Learned through Enactment in a Word Recognition Task

Vocabulary learning in a second language is enhanced if learners enrich the learning experience with self-performed iconic gestures. This learning strategy is called enactment. Here we explore how enacted words are functionally represented in the brain and which brain regions contribute to enhance retention. After an enactment training lasting 4 days, participants performed a word recognition task in the functional Magnetic Resonance Imaging (fMRI) scanner. Data analysis suggests the participation of different and partially intertwined networks that are engaged in higher cognitive processes, i.e., enhanced attention and word recognition. Also, an experience-related network seems to map word representation. Besides core language regions, this latter network includes sensory and motor cortices, the basal ganglia, and the cerebellum. On the basis of its complexity and the involvement of the motor system, this sensorimotor network might explain superior retention for enactment.

Intelligent virtual agents as language trainers facilitate multilingualism.

In this paper we introduce a new generation of language trainers: intelligent virtual agents (IVAs) with human appearance and the capability to teach foreign language vocabulary. We report results from studies that we have conducted with Billie, an IVA employed as a vocabulary trainer, as well as research findings on the acceptance of the agent as a trainer by adults and children. The results show that Billie can train humans as well as a human teacher can and that both adults and children accept the IVA as a trainer. The advantages of IVAs are multiple. First, their teaching methods can be based on neuropsychological research findings concerning memory and learning practice. Second, virtual teachers can provide individualized training. Third, they coach users during training, are always supportive, and motivate learners to train. Fourth, agents will reside in the users mobile devices and thus be at the users disposal everywhere and anytime. Agents in apps will make foreign language training accessible to anybody at low cost. This will enable people around the world, including physically, financially, and geographically disadvantaged persons, to learn a foreign language and help to facilitate multilingualism.

Virtual Reality as an embodied tool to enhance episodic memory in elderly

In the last decade, embodiment has dramatically influenced our conception of cognition. In this new frame, episodic memory, and particularly memory decline have been reinterpreted. Interventions supporting memory in the aging population address the connection between mind and body. Here, we discuss the use of Virtual Reality (VR) as an innovative tool to support episodic memory in older adults.

Recently learned foreign abstract and concrete nouns are represented in distinct cortical networks similar to the native language

In the native language, abstract and concrete nouns are represented in distinct areas of the cerebral cortex. Currently, it is unknown whether this is also the case for abstract and concrete nouns of a foreign language. Here, we taught adult native speakers of German 45 abstract and 45 concrete nouns of a foreign language. After learning the nouns for 5 days, participants performed a vocabulary translation task during functional magnetic resonance imaging. Translating abstract nouns in contrast to concrete nouns elicited responses in regions that are also responsive to abstract nouns in the native language: the left inferior frontal gyrus and the left middle and superior temporal gyri. Concrete nouns elicited larger responses in the angular gyri bilaterally and the left parahippocampal gyrus than abstract nouns. The cluster in the left angular gyrus showed psychophysiological interaction (PPI) with the left lingual gyrus. The left parahippocampal gyrus showed PPI with the posterior cingulate cortex. Similar regions have been previously found for concrete nouns in the native language. The results reveal similarities in the cortical representation of foreign language nouns with the representation of native language nouns that already occur after 5 days of vocabulary learning. Furthermore, we showed that verbal and enriched learning methods were equally suitable to teach foreign abstract and concrete nouns. Hum Brain Mapp 38:4398–4412, 2017.

Why Your Body Can Jog Your Mind

Philosophical tradition influences the way we think about body and mind (Rogers, 1936). We have a body to move around and a mind to think and to learn (Descartes, 1637). At school, we sit, listen, and read, but we are not allowed to move. However, cognitive science has shown that our body is tightly linked to the mind (Wilson, 2002; Pecher and Zwaan, 2005; Gärtner, 2013). In this paper, we provide evidence that better learning is achieved if the body supports the mind. We review studies showing how physical movement impacts brain functions and structures, and why physical movement is beneficial to learning. Thereafter, we explain how the body supports themind in difficult cognitive tasks. Finally, we discuss how the body can be employed as a tool in second language learning and mathematics.

Enrichment effects of gestures and pictures on abstract words in a second language

Laboratory research has demonstrated that multisensory enrichment promotes verbal learning in a foreign language (L2). Enrichment can be done in various ways, e.g., by adding a picture that illustrates the L2 word’s meaning or by the learner performing a gesture to the word (enactment). Most studies have tested enrichment on concrete but not on abstract words. Unlike concrete words, the representation of abstract words is deprived of sensory-motor features. This has been addressed as one of the reasons why abstract words are difficult to remember. Here, we ask whether a brief enrichment training by means of pictures and by self-performed gestures also enhances the memorability of abstract words in L2. Further, we explore which of these two enrichment strategies is more effective. Twenty young adults learned 30 novel abstract words in L2 according to three encoding conditions: (1) reading, (2) reading and pairing the novel word to a picture, and (3) reading and enacting the word by means of a gesture. We measured memory performance in free and cued recall tests, as well as in a visual recognition task. Words encoded with gestures were better remembered in the free recall in the native language (L1). When recognizing the novel words, participants made less errors for words encoded with gestures compared to words encoded with pictures. The reaction times in the recognition task did not differ across conditions. The present findings support, even if only partially, the idea that enactment promotes learning of abstract words and that it is superior to enrichment by means of pictures even after short training.

Learning Styles and Vocabulary Acquisition in Second Language: How the Brain Learns.

In recent years, foreign language education has been focussing on learning styles. However, despite the quantity of articles and practice books, websites on the topic, and investment in teacher training, there is no empirical evidence for the existence of learning styles. Furthermore, if one agrees that it is the brain that learns, there should be indicators in the brain for the existence of learning styles, anatomically, and/or functionally. This is not the case. In this paper, the validity and reliability of tests assessing learning styles are questioned. Thereafter, following on basics of cognitive neuroscience and experimental evidence it is argued that the natural way for the brain to learn words is by collecting multiple sensory and sensorimotor experiences. In fact, evidence-based literature in the domain of vocabulary acquisition demonstrates that the inclusion of multiple modalities leads to best results. Impoverished linguistic input by allowing only one modality, for example only acoustic or visual input—the so called learning style (Pashler et al., 2008) of the student—reduces the chances of acquiring words. Also, the article briefly outlines brain related factors that lead to high performance in vocabulary learning.

A Bizarre Virtual Trainer Outperforms a Human Trainer in Foreign Language Word Learning

In this study, the effects that a human trainer and a pedagogical virtual agent have on the memory for words in a foreign language (L2) were investigated. In a recent study on L2 word learning, Bergmann and Macedonia (2013) cued participants to memorize novel words both audiovisually and by performing additional gestures. The gestures were performed by both a human and a virtual trainer. In some of the tests, the virtual agent had a greater positive influence on memory performance than the human trainer. In order to determine why the agent was a better trainer than the human, 18 naive subjects were invited to rate the gestures performed by both trainers. Furthermore, participants were asked to evaluate their perception of the human and the agent. It was hypothesized that the gestures performed by the agent would be more peculiar than those by the human and possibly attract greater attention. It was also hypothesized that the agent’s personality might be more appealing than that of the human. The results showed that the agent’s gestures were perceived as less natural than those of the human. This might have triggered greater attention and/ or more emotional involvement of the participants. The perception of both trainers as “personalities” did not differ, with the exception of a few traits for which the human trainer was considered to be better. Altogether, because of the peculiar gestures it made and because of its looks, the agent may have been perceived as bizarre. Therefore, he might have induced the bizarreness effect in the memory for words. KeywordsVirtual Agen; Evaluatio; Foreign Language; Learning