Benjamin Straube

Neural Integration of Iconic and Unrelated Coverbal Gestures: A Functional MRI Study

Gestures are an important part of interpersonal communication, for example by illustrating physical properties of speech contents (e.g., “the ball is round”). The meaning of these so‐called iconic gestures is strongly intertwined with speech. We investigated the neural correlates of the semantic integration for verbal and gestural information. Participants watched short videos of five speech and gesture conditions performed by an actor, including variation of language (familiar German vs. unfamiliar Russian), variation of gesture (iconic vs. unrelated), as well as isolated familiar language, while brain activation was measured using functional magnetic resonance imaging. For familiar speech with either of both gesture types contrasted to Russian speech‐gesture pairs, activation increases were observed at the left temporo‐occipital junction. Apart from this shared location, speech with iconic gestures exclusively engaged left occipital areas, whereas speech with unrelated gestures activated bilateral parietal and posterior temporal regions. Our results demonstrate that the processing of speech with speech‐related versus speech‐unrelated gestures occurs in two distinct but partly overlapping networks. The distinct processing streams (visual versus linguistic/spatial) are interpreted in terms of “auxiliary systems” allowing the integration of speech and gesture in the left temporo‐occipital region. Hum Brain Mapp, 2009.

Neural interaction of speech and gesture: Differential activations of metaphoric co-verbal gestures

Gestures are an important part of human communication. However, little is known about the neural correlates of gestures accompanying speech comprehension. The goal of this study is to investigate the neural basis of speech-gesture interaction as reflected in activation increase and decrease during observation of natural communication. Fourteen German participants watched video clips of 5 s duration depicting an actor who performed metaphoric gestures to illustrate the abstract content of spoken sentences. Furthermore, video clips of isolated gestures (without speech), isolated spoken sentences (without gestures) and gestures in the context of an unknown language (Russian) were additionally presented while functional magnetic resonance imaging (fMRI) data were acquired. Bimodal speech and gesture processing led to left hemispheric activation increases of the posterior middle temporal gyrus, the premotor cortex, the inferior frontal gyrus, and the right superior temporal sulcus. Activation reductions during the bimodal condition were located in the left superior temporal gyrus and the left posterior insula. Gesture related activation increases and decreases were dependent on language semantics and were not found in the unknown-language condition. Our results suggest that semantic integration processes for bimodal speech plus gesture comprehension are reflected in activation increases in the classical left hemispheric language areas. Speech related gestures seem to enhance language comprehension during the face-to-face communication.

Neural Substrates of Treatment Response to Cognitive-Behavioral Therapy in Panic Disorder With Agoraphobia

OBJECTIVE Although exposure-based cognitive-behavioral therapy (CBT) is an effective treatment option for panic disorder with agoraphobia, the neural substrates of treatment response remain unknown. Evidence suggests that panic disorder with agoraphobia is characterized by dysfunctional safety signal processing. Using fear conditioning as a neurofunctional probe, the authors investigated neural baseline characteristics and neuroplastic changes after CBT that were associated with treatment outcome in patients with panic disorder with agoraphobia. METHOD Neural correlates of fear conditioning and extinction were measured using functional MRI before and after a manualized CBT program focusing on behavioral exposure in 49 medication-free patients with a primary diagnosis of panic disorder with agoraphobia. Treatment response was defined as a reduction exceeding 50% in Hamilton Anxiety Rating Scale scores. RESULTS At baseline, nonresponders exhibited enhanced activation in the right pregenual anterior cingulate cortex, the hippocampus, and the amygdala in response to a safety signal. While this activation pattern partly resolved in nonresponders after CBT, successful treatment was characterized by increased right hippocampal activation when processing stimulus contingencies. Treatment response was associated with an inhibitory functional coupling between the anterior cingulate cortex and the amygdala that did not change over time. CONCLUSIONS This study identified brain activation patterns associated with treatment response in patients with panic disorder with agoraphobia. Altered safety signal processing and anterior cingulate cortex-amygdala coupling may indicate individual differences among these patients that determine the effectiveness of exposure-based CBT and associated neuroplastic changes. Findings point to brain networks by which successful CBT in this patient population is mediated.

Memory effects of speech and gesture binding: Cortical and hippocampal activation in relation to subsequent memory performance

In human face-to-face communication, the content of speech is often illustrated by coverbal gestures. Behavioral evidence suggests that gestures provide advantages in the comprehension and memory of speech. Yet, how the human brain integrates abstract auditory and visual information into a common representation is not known. Our study investigates the neural basis of memory for bimodal speech and gesture representations. In this fMRI study, 12 participants were presented with video clips showing an actor performing meaningful metaphoric gestures (MG), unrelated, free gestures (FG), and no arm and hand movements (NG) accompanying sentences with an abstract content. After the fMRI session, the participants performed a recognition task. Behaviorally, the participants showed the highest hit rate for sentences accompanied by meaningful metaphoric gestures. Despite comparable old/new discrimination performances (d′) for the three conditions, we obtained distinct memory-related left-hemispheric activations in the inferior frontal gyrus (IFG), the premotor cortex (BA 6), and the middle temporal gyrus (MTG), as well as significant correlations between hippocampal activation and memory performance in the metaphoric gesture condition. In contrast, unrelated speech and gesture information (FG) was processed in areas of the left occipito-temporal and cerebellar region and the right IFG just like the no-gesture condition (NG). We propose that the specific left-lateralized activation pattern for the metaphoric speech–gesture sentences reflects semantic integration of speech and gestures. These results provide novel evidence about the neural integration of abstract speech and gestures as it contributes to subsequent memory performance.

MAOA and mechanisms of panic disorder revisited: from bench to molecular psychotherapy

Panic disorder with agoraphobia (PD/AG) is a prevalent mental disorder featuring a substantial complex genetic component. At present, only a few established risk genes exist. Among these, the gene encoding monoamine oxidase A (MAOA) is noteworthy given that genetic variation has been demonstrated to influence gene expression and monoamine levels. Long alleles of the MAOA-uVNTR promoter polymorphism are associated with PD/AG and correspond with increased enzyme activity. Here, we have thus investigated the impact of MAOA-uVNTR on therapy response, behavioral avoidance and brain activity in fear conditioning in a large controlled and randomized multicenter study on cognitive behavioral therapy (CBT) in PD/AG. The study consisted of 369 PD/AG patients, and genetic information was available for 283 patients. Carriers of the risk allele had significantly worse outcome as measured by the Hamilton Anxiety scale (46% responders vs 67%, P=0.017). This was accompanied by elevated heart rate and increased fear during an anxiety-provoking situation, that is, the behavioral avoidance task. All but one panic attack that happened during this task occurred in risk allele carriers and, furthermore, risk allele carriers did not habituate to the situation during repetitive exposure. Finally, functional neuroimaging during a classical fear conditioning paradigm evidenced that the protective allele is associated with increased activation of the anterior cingulate cortex upon presentation of the CS+ during acquisition of fear. Further differentiation between high- and low-risk subjects after treatment was observed in the inferior parietal lobes, suggesting differential brain activation patterns upon CBT. Taken together, we established that a genetic risk factor for PD/AG is associated with worse response to CBT and identify potential underlying neural mechanisms. These findings might govern how psychotherapy can include genetic information to tailor individualized treatment approaches.

The differentiation of iconic and metaphoric gestures: Common and unique integration processes

Recent research on the neural integration of speech and gesture has examined either gesture in the context of concrete [iconic (IC) gestures] or abstract sentence content [metaphoric (MP) gestures]. However, there has not yet been a direct comparison of the processing of both gesture types. This study tested the theory that left posterior temporal and inferior frontal brain regions are each uniquely involved in the integration of IC and MP gestures. During fMRI‐data acquisition, participants were shown videos of an actor performing IC and MP gestures and associated sentences. An isolated gesture (G) and isolated sentence condition (S) were included to separate unimodal from bimodal effects at the neural level. During IC conditions, we found increased activity in the left posterior middle temporal gyrus and its right hemispheric homologue. The same regions in addition to the left inferior frontal gyrus (IFG) were activated during MP conditions in contrast to the isolated conditions (G&S). These findings support the hypothesis that there are distinct integration processes for IC and MP gestures. In line with recent claims of the semantic unification theory, there seems to be a division between perceptual‐matching processes within the posterior temporal lobe and higher‐order relational processes within the IFG. Hum Brain Mapp, 2011.

Don’t fear ‘fear conditioning’: Methodological considerations for the design and analysis of studies on human fear acquisition, extinction, and return of fear

HighlightsOriginates from discussions on replicability and researchers degrees of freedom.Aims at stimulating discussions on methods applied in fear conditioning research.Addresses critical issues on terminology, design, methods, analysis.Serves as comprehensive compendium and critical evaluation of read‐out measures.Highlights methodological considerations when studying individual differences. ABSTRACT The so‐called ‘replicability crisis’ has sparked methodological discussions in many areas of science in general, and in psychology in particular. This has led to recent endeavours to promote the transparency, rigour, and ultimately, replicability of research. Originating from this zeitgeist, the challenge to discuss critical issues on terminology, design, methods, and analysis considerations in fear conditioning research is taken up by this work, which involved representatives from fourteen of the major human fear conditioning laboratories in Europe. This compendium is intended to provide a basis for the development of a common procedural and terminology framework for the field of human fear conditioning. Whenever possible, we give general recommendations. When this is not feasible, we provide evidence‐based guidance for methodological decisions on study design, outcome measures, and analyses. Importantly, this work is also intended to raise awareness and initiate discussions on crucial questions with respect to data collection, processing, statistical analyses, the impact of subtle procedural changes, and data reporting specifically tailored to the research on fear conditioning.

Predicting Treatment Response to Cognitive Behavioral Therapy in Panic Disorder With Agoraphobia by Integrating Local Neural Information

IMPORTANCE Although neuroimaging research has made substantial progress in identifying the large-scale neural substrate of anxiety disorders, its value for clinical application lags behind expectations. Machine-learning approaches have predictive potential for individual-patient prognostic purposes and might thus aid translational efforts in psychiatric research. OBJECTIVE To predict treatment response to cognitive behavioral therapy (CBT) on an individual-patient level based on functional magnetic resonance imaging data in patients with panic disorder with agoraphobia (PD/AG). DESIGN, SETTING, AND PARTICIPANTS We included 49 patients free of medication for at least 4 weeks and with a primary diagnosis of PD/AG in a longitudinal study performed at 8 clinical research institutes and outpatient centers across Germany. The functional magnetic resonance imaging study was conducted between July 2007 and March 2010. INTERVENTIONS Twelve CBT sessions conducted 2 times a week focusing on behavioral exposure. MAIN OUTCOMES AND MEASURES Treatment response was defined as exceeding a 50% reduction in Hamilton Anxiety Rating Scale scores. Blood oxygenation level-dependent signal was measured during a differential fear-conditioning task. Regional and whole-brain gaussian process classifiers using a nested leave-one-out cross-validation were used to predict the treatment response from data acquired before CBT. RESULTS Although no single brain region was predictive of treatment response, integrating regional classifiers based on data from the acquisition and the extinction phases of the fear-conditioning task for the whole brain yielded good predictive performance (accuracy, 82%; sensitivity, 92%; specificity, 72%; P < .001). Data from the acquisition phase enabled 73% correct individual-patient classifications (sensitivity, 80%; specificity, 67%; P < .001), whereas data from the extinction phase led to an accuracy of 74% (sensitivity, 64%; specificity, 83%; P < .001). Conservative reanalyses under consideration of potential confounders yielded nominally lower but comparable accuracy rates (acquisition phase, 70%; extinction phase, 71%; combined, 79%). CONCLUSIONS AND RELEVANCE Predicting treatment response to CBT based on functional neuroimaging data in PD/AG is possible with high accuracy on an individual-patient level. This novel machine-learning approach brings personalized medicine within reach, directly supporting clinical decisions for the selection of treatment options, thus helping to improve response rates.

Social cues, mentalizing and the neural processing of speech accompanied by gestures

Body orientation and eye gaze influence how information is conveyed during face-to-face communication. However, the neural pathways underpinning the comprehension of social cues in everyday interaction are not known. In this study we investigated the influence of addressing vs. non-addressing body orientation on the neural processing of speech accompanied by gestures. While in an fMRI scanner, participants viewed short video clips of an actor speaking sentences with object- (O; e.g., shape) or person-related content (P; e.g., saying goodbye) accompanied by iconic (e.g., circle) or emblematic gestures (e.g., waving), respectively. The actors body was oriented either toward the participant (frontal, F) or toward a third person (lateral, L) not visible. For frontal vs. lateral actor orientation (F>L), we observed activation of bilateral occipital, inferior frontal, medial frontal, right anterior temporal and left parietal brain regions. Additionally, we observed activity in the occipital and anterior temporal lobes due to an interaction effect between actor orientation and content of the communication (PF>PL)>(OF>OL). Our findings indicate that social cues influence the neural processing of speech-gesture utterances. Mentalizing (the process of inferring the mental state of another individual) could be responsible for these effects. In particular, socially relevant cues seem to activate regions of the anterior temporal lobes if abstract person-related content is communicated by speech and gesture. These new findings illustrate the complexity of interpersonal communication, as our data demonstrate that multisensory information pathways interact at both perceptual and semantic levels.

Superior Temporal Sulcus Disconnectivity During Processing of Metaphoric Gestures in Schizophrenia

The left superior temporal sulcus (STS) plays an important role in integrating audiovisual information and is functionally connected to disparate regions of the brain. For the integration of gesture information in an abstract sentence context (metaphoric gestures), intact connectivity between the left STS and the inferior frontal gyrus (IFG) should be important. Patients with schizophrenia have problems with the processing of metaphors (concretism) and show aberrant structural connectivity of long fiber bundles. Thus, we tested the hypothesis that patients with schizophrenia differ in the functional connectivity of the left STS to the IFG for the processing of metaphoric gestures. During functional magnetic resonance imaging data acquisition, 16 patients with schizophrenia (P) and a healthy control group (C) were shown videos of an actor performing gestures in a concrete (iconic, IC) and abstract (metaphoric, MP) sentence context. A psychophysiological interaction analysis based on the seed region from a previous analysis in the left STS was performed. In both groups we found common positive connectivity for IC and MP of the STS seed region to the left middle temporal gyrus (MTG) and left ventral IFG. The interaction of group (C>P) and gesture condition (MP>IC) revealed effects in the connectivity to the bilateral IFG and the left MTG with patients exhibiting lower connectivity for the MP condition. In schizophrenia the left STS is misconnected to the IFG, particularly during the processing of MP gestures. Dysfunctional integration of gestures in an abstract sentence context might be the basis of certain interpersonal communication problems in the patients.