Autumn B. Hostetter

Visible embodiment: Gestures as simulated action

Spontaneous gestures that accompany speech are related to both verbal and spatial processes. We argue that gestures emerge from perceptual and motor simulations that underlie embodied language and mental imagery. We first review current thinking about embodied cognition, embodied language, and embodied mental imagery. We then provide evidence that gestures stem from spatial representations and mental images. We then propose the gestures-as-simulated-action framework to explain how gestures might arise from an embodied cognitive system. Finally, we compare this framework with other current models of gesture production, and we briefly outline predictions that derive from the framework.

I see it in my hands’ eye: Representational gestures reflect conceptual demands

The Information Packaging Hypothesis (Kita, 2000) holds that gestures play a role in conceptualising information for speaking. According to this view, speakers will gesture more when describing difficult-to-conceptualise information than when describing easy-to-conceptualise information. In the present study, 24 participants described ambiguous dot patterns under two conditions. In the dots-plus-shapes condition, geometric shapes connected the dots, and participants described the patterns in terms of those shapes. In the dots-only condition, no shapes were present, and participants generated their own geometric conceptualisations and described the patterns. Participants gestured at a higher rate in the dots-only condition than in the dots-plus-shapes condition. The results support the Information Packaging Hypothesis and suggest that gestures occur when information is difficult to conceptualise.

Now you see me, now you don't: evidence that chimpanzees understand the role of the eyes in attention

Chimpanzees appear to understand something about the attentional states of others; in the present experiment, we investigated whether they understand that the attentional state of a human is based on eye gaze. In all, 116 adult chimpanzees were offered food by an experimenter who engaged in one of the four experimental manipulations: eyes closed, eyes open, hand over eyes, and hand over mouth. The communicative behavior of the chimpanzees was observed. More visible behaviors were produced when the experimenters eyes were visible than when the experimenters eyes were not visible. More vocalizations were produced when the experimenters eyes were closed than when they were open, but there were no differences in other attention getting behaviors. There was no effect of age or rearing history. The results suggest that chimpanzees use the presence of the eyes as a cue that their visual gestures will be effective.

Gesture–speech integration in children with specific language impairment

BACKGROUND Previous research suggests that speakers are especially likely to produce manual communicative gestures when they have relative ease in thinking about the spatial elements of what they are describing, paired with relative difficulty organizing those elements into appropriate spoken language. Children with specific language impairment (SLI) exhibit poor expressive language abilities together with within-normal-range nonverbal IQs. AIMS This study investigated whether weak spoken language abilities in children with SLI influence their reliance on gestures to express information. We hypothesized that these children would rely on communicative gestures to express information more often than their age-matched typically developing (TD) peers, and that they would sometimes express information in gestures that they do not express in the accompanying speech. METHODS & PROCEDURES Participants were 15 children with SLI (aged 5;6-10;0) and 18 age-matched TD controls. Children viewed a wordless cartoon and retold the story to a listener unfamiliar with the story. Childrens gestures were identified and coded for meaning using a previously established system. Speech-gesture combinations were coded as redundant if the information conveyed in speech and gesture was the same, and non-redundant if the information conveyed in speech was different from the information conveyed in gesture. OUTCOMES & RESULTS Children with SLI produced more gestures than children in the TD group; however, the likelihood that speech-gesture combinations were non-redundant did not differ significantly across the SLI and TD groups. In both groups, younger children were significantly more likely to produce non-redundant speech-gesture combinations than older children. CONCLUSIONS & IMPLICATIONS The gesture-speech integration system functions similarly in children with SLI and TD, but children with SLI rely more on gesture to help formulate, conceptualize or express the messages they want to convey. This provides motivation for future research examining whether interventions focusing on increasing manual gesture use facilitate language and communication in children with SLI.

Action attenuates the effect of visibility on gesture rates.

Much evidence suggests that semantic characteristics of a message (e.g., the extent to which the message evokes thoughts of spatial or motor properties) and social characteristics of a speaking situation (e.g., whether there is a listener who can see the speaker) both influence how much speakers gesture. However, the Gesture as Simulated Action (GSA) framework (Hostetter & Alibali, ) predicts that these effects should not be independent but should interact such that the effect of visibility is lessened when a message evokes strong thoughts of action. This study tested this claim by comparing the gesture rates produced by speakers as they described 24 nouns that vary in how strongly they evoke thoughts of action. Further, half of the words were described with visibility between speaker and listener blocked. The results demonstrated a significant interaction as predicted by the GSA framework.

Chapter 5. If you don’t already know, I’m certainly not going to show you!: Motivation to communicate affects gesture production

The present study aimed to determine if variations in a speaker’s motivation to communicate influence the frequency or size of the gestures the speaker produces. We observed the gestures produced by speakers as they gave route directions to a listener who they believed would use the information either to cooperate with them in a later game, compete with them, or merely play simultaneously. Gesture rates were not affected. However, speakers produced a higher proportion of gestures that were large in size when they expected their listener to cooperate with them than when they expected their listener to compete with them. These findings suggest that gestures are shaped in part by speakers’ desire to communicate information clearly to their listeners.

Ecological Validity of the Testing Effect: The Use of Daily Quizzes in Introductory Psychology

The testing effect is the enhanced retention of learned information by individuals who have studied and completed a test over the material relative to individuals who have only studied the material. Although numerous laboratory studies and simulated classroom studies have provided evidence of the testing effect, data from a natural class setting with motivated students are scant. The present two-class quasi-experiment explored the external validity of the testing effect in the Introductory Psychology classroom. The control class studied assigned chapters from the textbook whereas the quiz class studied chapters and completed daily quizzes on those readings. Subsequently, both classes completed exams over this textbook information. The quiz class scored significantly higher than the control class on these test questions about the textbook information; these differences were significant both when the test questions were the same as the quiz questions and when they were new, related questions from the textbook. These data suggest the use of daily quizzes to embed the testing effect into the Introductory Psychology classroom can improve student learning.

The role of retrieval practice in memory and analogical problem-solving

Retrieval practice (e.g., testing) has been shown to facilitate long-term retention of information. In two experiments, we examine whether retrieval practice also facilitates use of the practised information when it is needed to solve analogous problems. When retrieval practice was not limited to the information most relevant to the problems (Experiment 1), it improved memory for the information a week later compared with copying or rereading the information, although we found no evidence that it improved participants’ ability to apply the information to the problems. In contrast, when retrieval practice was limited to only the information most relevant to the problems (Experiment 2), we found that retrieval practice enhanced memory for the critical information, the ability to identify the schematic similarities between the two sources of information, and the ability to apply that information to solve an analogous problem after a hint was given to do so. These results suggest that retrieval practice, through its effect on memory, can facilitate application of information to solve novel problems but has minimal effects on spontaneous realisation that the information is relevant.

Chapter 7. Gestures highlight perceptual-motor representations in thinking

Abstract Gestures are adept at expressing perceptual and motor information. In this chapter, we propose that, as representational actions, gestures both stem from and influence perceptual representations, in much the same way that action and perception more generally exist in an inextricable relationship. We review evidence that gestures emerge from perceptual-motor representations that are activated during thinking and speaking (Hostetter & Alibali, 2008). We then consider how gesture’s connection to perceptual-motor representations may play a functional role in strengthening those representations in the minds of speakers.