Thomas C. Gunter

Musical syntax is processed in Broca's area: an MEG study

The present experiment was designed to localize the neural substrates that process music-syntactic incongruities, using magnetoencephalography (MEG). Electrically, such processing has been proposed to be indicated by early right-anterior negativity (ERAN), which is elicited by harmonically inappropriate chords occurring within a major-minor tonal context. In the present experiment, such chords elicited an early effect, taken as the magnetic equivalent of the ERAN (termed mERAN). The source of mERAN activity was localized in Brocas area and its right-hemisphere homologue, areas involved in syntactic analysis during auditory language comprehension. We find that these areas are also responsible for an analysis of incoming harmonic sequences, indicating that these regions process syntactic information that is less language-specific than previously believed.

Bach Speaks: A Cortical "Language-Network" Serves the Processing of Music

The aim of the present study was the investigation of neural correlates of music processing with fMRI. Chord sequences were presented to the participants, infrequently containing unexpected musical events. These events activated the areas of Broca and Wernicke, the superior temporal sulcus, Heschls gyrus, both planum polare and planum temporale, as well as the anterior superior insular cortices. Some of these brain structures have previously been shown to be involved in music processing, but the cortical network comprising all these structures has up to now been thought to be domain-specific for language processing. To what extent this network might also be activated by the processing of non-linguistic information has remained unknown. The present fMRI-data reveal that the human brain employs this neuronal network also for the processing of musical information, suggesting that the cortical network known to support language processing is less domain-specific than previously believed.

Brain Indices of Music Processing: Nonmusicians are Musical

Only little systematic research has examined event-related brain potentials (ERPs) elicited by the cognitive processing of music. The present study investigated how music processing is influenced by a preceding musical context, affected by the task relevance of unexpected chords, and influenced by the degree and the probability of violation. Four experiments were conducted in which nonmusicians listened to chord sequences, which infrequently contained a chord violating the sound expectancy of listeners. Integration of in-key chords into the musical context was reflected as a late negative-frontal deflection in the ERPs. This negative deflection declined towards the end of a chord sequence, reflecting normal buildup of musical context. Brain waves elicited by chords with unexpected notes revealed two ERP effects: an early right-hemispheric preponderant-anterior negativity, which was taken to reflect the violation of sound expectancy; and a late bilateral-frontal negativity. The late negativity was larger compared to in-key chords and taken to reflect the higher degree of integration needed for unexpected chords. The early right-anterior negativity (ERAN) was unaffected by the task relevance of unexpected chords. The amplitudes of both early and late negativities were found to be sensitive to the degree of musical expectancy induced by the preceding harmonic context, and to the probability for deviant acoustic events. The employed experimental design opens a new field for the investigation of music processing. Results strengthen the hypothesis of an implicit musical ability of the human brain.

Music, language and meaning: Brain signatures of semantic processing

Semantics is a key feature of language, but whether or not music can activate brain mechanisms related to the processing of semantic meaning is not known. We compared processing of semantic meaning in language and music, investigating the semantic priming effect as indexed by behavioral measures and by the N400 component of the event-related brain potential (ERP) measured by electroencephalography (EEG). Human subjects were presented visually with target words after hearing either a spoken sentence or a musical excerpt. Target words that were semantically unrelated to prime sentences elicited a larger N400 than did target words that were preceded by semantically related sentences. In addition, target words that were preceded by semantically unrelated musical primes showed a similar N400 effect, as compared to target words preceded by related musical primes. The N400 priming effect did not differ between language and music with respect to time course, strength or neural generators. Our results indicate that both music and language can prime the meaning of a word, and that music can, as language, determine physiological indices of semantic processing.

Syntactic Gender and Semantic Expectancy: ERPs Reveal Early Autonomy and Late Interaction

This experiment explored the effect of semantic expectancy on the processing of grammatical gender, and vice versa, in German using event-related-potentials (ERPs). Subjects were presented with correct sentences and sentences containing an article-noun gender agreement violation. The cloze probability of the nouns was either high or low. ERPs were measured on the nouns. The low-cloze nouns evoked a larger N400 than the high-cloze nouns. Gender violations elicited a left-anterior negativity (LAN, 300-600 msec) for all nouns. An additional P600 component was found only in high-cloze nouns. The N400 was independent of the gender mismatch variable; the LAN was independent of the semantic variable, whereas an interaction of the two variables was found in the P600. This finding indicates that syntactic and semantic processes are autonomous during an early processing stage, whereas these information types interact during a later processing phase.

Interaction between Syntax Processing in Language and in Music: An ERP Study

The present study investigated simultaneous processing of language and music using visually presented sentences and auditorily presented chord sequences. Music-syntactically regular and irregular chord functions were presented synchronously with syntactically correct or incorrect words, or with words that had either a high or a low semantic cloze probability. Music-syntactically irregular chords elicited an early right anterior negativity (ERAN). Syntactically incorrect words elicited a left anterior negativity (LAN). The LAN was clearly reduced when words were presented simultaneously with music-syntactically irregular chord functions. Processing of high and low cloze-probability words as indexed by the N400 was not affected by the presentation of irregular chord functions. In a control experiment, the LAN was not affected by physically deviant tones that elicited a mismatch negativity (MMN). Results demonstrate that processing of musical syntax (as reflected in the ERAN) interacts with the processing of linguistic syntax (as reflected in the LAN), and that this interaction is not due to a general effect of deviance-related negativities that precede an LAN. Findings thus indicate a strong overlap of neural resources involved in the processing of syntax in language and music.

Working memory constraints on syntactic processing: An electrophysiological investigation

Event-related potentials (ERPs) and reaction times (RTs) were used to study how the processing of sentences with morphosyntactic violations is constrained by working memory (WM) capacity. The available WM capacity was varied by three orthogonal manipulations: (1) syntactic complexity; (2) additional WM load; and (3) verbal WM span. The processing of the morphosyntactic violations was reflected in longer RTs in ungrammatical compared with grammatical sentences, and in an anterior negativity and a centroparietal positivity in the ERPs. While the behavioral grammaticality effect was not influenced by the WM manipulations, the ERP effects were. The amplitude of the anterior negativity was modulated by the combination of complexity and load, and by WM span. The onset of the centroparietal positivity was delayed in the high-load condition, and for the low-span group. ERPs over the course of the sentences showed a frontal negative slow wave under high WM load, largest for the low-span group. The finding that online syntactic processing is related to WM span and to additional WM load does not support the theory that there is a WM capacity specific for syntactic processing.

Brain Responses to Segmentally and Tonally Induced Semantic Violations in Cantonese

The present event-related potential (ERP) study examined the role of tone and segmental information in Cantonese word processing. To this end, participants listened to sentences that were either semantically correct or contained a semantically incorrect word. Semantically incorrect words differed from the most expected sentence completion at the tone level, at the segmental level, or at both levels. All semantically incorrect words elicited an increased frontal negativity that was maximal 300 msec following word onset and an increased centroparietal positivity that was maximal 650 msec following word onset. There were differences between completely incongruous words and the other two violation conditions with respect to the latency and amplitude of the ERP effects. These differences may be due to differences in the onset of acoustic deviation of the presented from the expected word and different mechanisms involved in the processing of complete as compared to partial acoustic deviations. Most importantly, however, tonally and segmentally induced semantic violations were comparable. This suggests that listeners access tone and segmental information at a similar point in time and that both types of information play comparable roles during word processing in Cantonese.

The Role of Iconic Gestures in Speech Disambiguation: ERP Evidence

The present series of experiments explored the extent to which iconic gestures convey information not found in speech. Electroencephalogram (EEG) was recorded as participants watched videos of a person gesturing and speaking simultaneously. The experimental sentences contained an unbalanced homonym in the initial part of the sentence (e.g., She controlled the ball ) and were disambiguated at a target word in the subsequent clause (which during the game vs. which during the dance ). Coincident with the initial part of the sentence, the speaker produced an iconic gesture which supported either the dominant or the subordinate meaning. Event-related potentials were time-locked to the onset of the target word. In Experiment 1, participants were explicitly asked to judge the congruency between the initial homonym-gesture combination and the subsequent target word. The N400 at target words was found to be smaller after a congruent gesture and larger after an incongruent gesture, suggesting that listeners can use gestural information to disambiguate speech. Experiment 2 replicated the results using a less explicit task, indicating that the disambiguating effect of gesture is somewhat task-independent. Unrelated grooming movements were added to the paradigm in Experiment 3. The N400 at subordinate targets was found to be smaller after subordinate gestures and larger after dominant gestures as well as grooming, indicating that an iconic gesture can facilitate the processing of a lesser frequent word meaning. The N400 at dominant targets no longer varied as a function of the preceding gesture in Experiment 3, suggesting that the addition of meaningless movements weakened the impact of gesture. Thus, the integration of gesture and speech in comprehension does not appear to be an obligatory process but is modulated by situational factors such as the amount of observed meaningful hand movements.

Children Processing Music: Electric Brain Responses Reveal Musical Competence and Gender Differences

Numerous studies investigated physiological correlates of the processing of musical information in adults. How these correlates develop during childhood is poorly understood. In the present study, we measured event-related electric brain potentials elicited in 5- and 9-year-old children while they listened to (major-minor tonal) music. Stimuli were chord sequences, infrequently containing harmonically inappropriate chords. Our results demonstrate that the degree of (in)appropriateness of the chords modified the brain responses in both groups according to music-theoretical principles. This suggests that already 5-year-old children process music according to a well-established cognitive representation of the major-minor tonal system and according to music-syntactic regularities. Moreover, we show that, in contrast to adults, an early negative brain response was left predominant in boys, whereas it was bilateral in girls, indicating a gender difference in children processing music, and revealing that children process music with a hemispheric weighting different from that of adults. Because children process, in contrast to adults, music in the same hemispheres as they process language, results indicate that children process music and language more similarly than adults. This finding might support the notion of a common origin of music and language in the human brain, and concurs with findings that demonstrate the importance of musical features of speech for the acquisition of language.