Kathrin Rothermich

Temporal regularity effects on pre-attentive and attentive processing of deviance

Temporal regularity allows predicting the temporal locus of future information thereby potentially facilitating cognitive processing. We applied event-related brain potentials (ERPs) to investigate how temporal regularity impacts pre-attentive and attentive processing of deviance in the auditory modality. Participants listened to sequences of sinusoidal tones differing exclusively in pitch. The inter-stimulus interval (ISI) in these sequences was manipulated to convey either isochronous or random temporal structure. In the pre-attentive session, deviance processing was unaffected by the regularity manipulation as evidenced in three event-related-potentials (ERPs): mismatch negativity (MMN), P3a, and reorienting negativity (RON). In the attentive session, the P3b was smaller for deviant tones embedded in irregular temporal structure, while the N2b component remained unaffected. These findings confirm that temporal regularity can reinforce cognitive mechanisms associated with the attentive processing of deviance. Furthermore, they provide evidence for the dynamic allocation of attention in time and dissociable pre-attentive and attention-dependent temporal processing mechanisms.

Functional dissociation of pre-SMA and SMA-proper in temporal processing.

The ability to assess temporal structure is crucial in order to adapt to an ever-changing environment. Increasing evidence suggests that the supplementary motor area (SMA) is involved in both sensory and sensorimotor processing of temporal structure. However, it is not entirely clear whether the structural differentiation of the SMA translates into functional specialization, and how the SMA relates to other systems that engage in temporal processing, namely the cerebellum and cortico-striatal circuits. Anatomically, the SMA comprises at least two subareas, the rostral pre-SMA and the caudal SMA-proper. Each displays a characteristic pattern of connections to motor and non-motor structures. Crucially, these connections establish a potential hub among cerebellar and cortico-striatal systems, possibly forming a dedicated subcortico-cortical temporal processing network. To further explore the functional role of each SMA subarea, we performed a meta-analysis of functional neuroimaging studies by contrasting activations according to whether they linked with either sensory, sensorimotor, sequential, non-sequential, explicit, non-explicit, subsecond, or suprasecond temporal processing. This procedure yielded a set of functional differences, which mirror the rostro-caudal anatomical dimension. Activations associated with sensory, non-sequential, and suprasecond temporal processing tend to locate to the rostral SMA, while the opposite is true for the caudal SMA. These findings confirm a functional dissociation of pre-SMA and SMA-proper in temporal processing.

Event-related potential responses to metric violations: rules versus meaning

In stress-timed languages, the alternation of stressed and unstressed syllables (or ‘meter’) is an important formal and temporal cue to guide speech processing. Previous electroencephalography studies have shown that metric violations result in an early negative event-related potential. It is unclear whether this ‘metric’ negativity is an N400 elicited by misplaced stress or whether it responds to error detection. The aim of this study was to investigate the nature of the ‘metric’ negativity as a function of rule-based, predictive sequencing. Our results show that the negativity occurs independent of the lexical-semantic content. We therefore suggest that the metric negativity reflects a rule-based sequencing mechanism.

Predictions in speech comprehension: fMRI evidence on the meter–semantic interface

When listening to speech we not only form predictions about what is coming next, but also when something is coming. For example, metric stress may be utilized to predict the next salient speech event (i.e. the next stressed syllable) and in turn facilitate speech comprehension. However, speech comprehension can also be facilitated by semantic context, that is, which content word is likely to appear next. In the current fMRI experiment we investigated (1) the brain networks that underlie metric and semantic predictions by means of prediction errors, (2) how semantic processing is influenced by a metrically regular or irregular sentence context, and (3) whether task demands influence both processes. The results are three-fold: First, while metrically incongruent sentences activated a bilateral fronto-striatal network, semantically incongruent trials led to activation of fronto-temporal areas. Second, metrically regular context facilitated speech comprehension in the left-fronto-temporal language network. Third, attention directed to metric or semantic aspects in speech engaged different subcomponents of the left inferior frontal gyrus (IFG). The current results suggest that speech comprehension relies on different forms of prediction, and extends known speech comprehension networks to subcortical sensorimotor areas.

Preferential decoding of emotion from human non-linguistic vocalizations versus speech prosody

This study used event-related brain potentials (ERPs) to compare the time course of emotion processing from non-linguistic vocalizations versus speech prosody, to test whether vocalizations are treated preferentially by the neurocognitive system. Participants passively listened to vocalizations or pseudo-utterances conveying anger, sadness, or happiness as the EEG was recorded. Simultaneous effects of vocal expression type and emotion were analyzed for three ERP components (N100, P200, late positive component). Emotional vocalizations and speech were differentiated very early (N100) and vocalizations elicited stronger, earlier, and more differentiated P200 responses than speech. At later stages (450-700ms), anger vocalizations evoked a stronger late positivity (LPC) than other vocal expressions, which was similar but delayed for angry speech. Individuals with high trait anxiety exhibited early, heightened sensitivity to vocal emotions (particularly vocalizations). These data provide new neurophysiological evidence that vocalizations, as evolutionarily primitive signals, are accorded precedence over speech-embedded emotions in the human voice.

Exercising during learning improves vocabulary acquisition: Behavioral and ERP evidence

Numerous studies have provided evidence that physical activity promotes cortical plasticity in the adult brain and in turn facilitates learning. However, until now, the effect of simultaneous physical activity (e.g. bicycling) on learning performance has not been investigated systematically. The current study aims at clarifying whether simultaneous motor activity influences verbal learning compared to learning in a physically passive situation. Therefore the learning behavior of 12 healthy subjects (4 male, 19-33 years) was monitored over a period of 3 weeks. During that time, behavioral and electrophysiological responses to memorized materials were measured. We found a larger N400 effect and better performance in vocabulary tests when subjects were physically active during the encoding phase. Thus, our data indicate that simultaneous physical activity during vocabulary learning facilitates memorization of new items.

Introducing RISC: A New Video Inventory for Testing Social Perception

Indirect forms of speech, such as sarcasm, jocularity (joking), and ‘white lies’ told to spare another’s feelings, occur frequently in daily life and are a problem for many clinical populations. During social interactions, information about the literal or nonliteral meaning of a speaker unfolds simultaneously in several communication channels (e.g., linguistic, facial, vocal, and body cues); however, to date many studies have employed uni-modal stimuli, for example focusing only on the visual modality, limiting the generalizability of these results to everyday communication. Much of this research also neglects key factors for interpreting speaker intentions, such as verbal context and the relationship of social partners. Relational Inference in Social Communication (RISC) is a newly developed (English-language) database composed of short video vignettes depicting sincere, jocular, sarcastic, and white lie social exchanges between two people. Stimuli carefully manipulated the social relationship between communication partners (e.g., boss/employee, couple) and the availability of contextual cues (e.g. preceding conversations, physical objects) while controlling for major differences in the linguistic content of matched items. Here, we present initial perceptual validation data (N = 31) on a corpus of 920 items. Overall accuracy for identifying speaker intentions was above 80 % correct and our results show that both relationship type and verbal context influence the categorization of literal and nonliteral interactions, underscoring the importance of these factors in research on speaker intentions. We believe that RISC will prove highly constructive as a tool in future research on social cognition, inter-personal communication, and the interpretation of speaker intentions in both healthy adults and clinical populations.

Unaltered emotional experience in Parkinson's disease : Pupillometry and behavioral evidence

ABSTRACT Introduction: Recognizing emotions in others is a pivotal part of socioemotional functioning and plays a central role in social interactions. It has been shown that individuals suffering from Parkinson’s disease (PD) are less accurate at identifying basic emotions such as fear, sadness, and happiness; however, previous studies have predominantly assessed emotion processing using unimodal stimuli (e.g., pictures) that do not reflect the complexity of real-world processing demands. Dynamic, naturalistic stimuli (e.g., movies) have been shown to elicit stronger subjective emotional experiences than unimodal stimuli and can facilitate emotion recognition. Method: In this experiment, pupil measurements of PD patients and matched healthy controls (HC) were recorded while they watched short film clips. Participants’ task was to identify the emotion elicited by each clip and rate the intensity of their emotional response. We explored (a) how PD affects subjective emotional experience in response to dynamic, ecologically valid film stimuli, and (b) whether there are PD-related changes in pupillary response, which may contribute to the differences in emotion processing reported in the literature. Results: Behavioral results showed that identification of the felt emotion as well as perceived intensity varies by emotion, but no significant group effect was found. Pupil measurements revealed differences in dilation depending on the emotion evoked by the film clips (happy, tender, sadness, fear, and neutral) for both groups. Conclusions: Our results suggest that differences in emotional response may be negligible when PD patients and healthy controls are presented with dynamic, ecologically valid emotional stimuli. Given the limited data available on pupil response in PD, this study provides new evidence to suggest that the PD-related deficits in emotion processing reported in the literature may not translate to real-world differences in physiological or subjective emotion processing in early-stage PD patients.

The role of attention in processing jabberwocky sentences: Revisiting the P600

Summary & Conclusions Percentage correct for both tasks. Means and standard deviations are displayed. Figure 1Figure 2 Figure 3Behavioral DataERP Data References Canseco-Gonzales, E. (2000), ‘Using the recording of event-related brain potentials in the study of sentence processing’, in Grodzinsky, Y., Shapiro, L.P. and Swinney, D. (Editors), Language and the brain representation and processing, Academic Press, London , pp. 229-266.Hahne A. & Jescheniak, J.D. (2001), ‘Whats left if the Jabberwock gets the semantics? An ERP in-vestigation into semantic and syntactic processes during auditory sentence comprehension’, Cognitive Brain Research ;11(2), pp. 199-212.Jackendoff, R. (2002), ‘Foundations of language’, Oxford University Press , New York.Knaus, J. et al. (2007), ‘The processing of word stress: EEG studies on task-related components’, Proceedings of the International Congress of Phonetic Sciences , Saarbruecken, pp. 709–712.Kolk, H. & Chwilla, D. (2007), ‘Late positivites in unusual situations’,

Emotional responses to speech accommodation: A systematic review

Five percent of the U.S. population speak English “not well” or not at all, often leading to miscommunication, which can be especially problematic in a healthcare environment or at the workplace. According to socio-linguistic frameworks such as Communication Accommodation Theory, native speakers have interactional goals and strategies to communicate effectively with non-native speakers. One of these strategies, foreign-directed speech, involves modifying the speech output acoustically and linguistically by slowing down, simplifying speech, and exaggerating vowels. While the acoustic properties of foreign-directed speech are well documented, research is limited on how non-native speakers interpret them emotionally and pragmatically. For instance, do non-native speakers find foreign-direct speech helpful or does it come across as condescending? The purpose of this systematic review is to determine the current evidence on how speech accommodation affects the listener, with a special focus on how it is perceived by non-native speakers. In this review, we outline the basic components of communication accommodation, provide a systematic review of the literature related to the emotional effects of speech accommodation, and discuss current issues. We conclude by formulating recommendations for future research.Five percent of the U.S. population speak English “not well” or not at all, often leading to miscommunication, which can be especially problematic in a healthcare environment or at the workplace. According to socio-linguistic frameworks such as Communication Accommodation Theory, native speakers have interactional goals and strategies to communicate effectively with non-native speakers. One of these strategies, foreign-directed speech, involves modifying the speech output acoustically and linguistically by slowing down, simplifying speech, and exaggerating vowels. While the acoustic properties of foreign-directed speech are well documented, research is limited on how non-native speakers interpret them emotionally and pragmatically. For instance, do non-native speakers find foreign-direct speech helpful or does it come across as condescending? The purpose of this systematic review is to determine the current evidence on how speech accommodation affects the listener, with a special focus on how it is percei...