Reijo Aulanko

Seeing speech: visual information from lip movements modifies activity in the human auditory cortex

Neuromagnetic responses were recorded over the left hemisphere to find out in which cortical area the heard and seen speech are integrated. Auditory stimuli were Finnish/pa/syllables presented together with a videotaped face articulating either the concordant syllable/pa/(84% of stimuli, V = A) or the discordant syllable/ka/(16%, V not equal to A). In some subjects the probabilities were reversed. The subjects heard V not equal to A stimuli as/ta/ or ka. The magnetic responses to infrequent perceptions elicited a specific waveform which could be explained by activity in the supratemporal auditory cortex. The results show that visual information from articulatory movements has an entry into the auditory cortex.

Hemispheric lateralization in preattentive processing of speech sounds.

Event-related magnetoencephalographic (MEG) responses to infrequently presented spoken deviant syllables [di] and [ba] among repetitive standard [da)]syllables were recorded in subjects who either attended to these stimuli in order to discriminate the [ba] syllables or ignored them while attending a silent movie. In both conditions, the deviant syllables elicited a mismatch response (MMNm, the magnetic counterpart of mismatch negativity), which was stronger in the left than in the right auditory cortex, indicating left-hemispheric dominance in speech processing already at a preattentive processing level.

Phonetic invariance in the human auditory cortex

Neuromagnetic signals evoked by synthesized syllables (/bae/ and /gae/) were recorded over the left auditory cortex of healthy humans. The fundamental frequencies of the syllables varied as if the same speaker had pronounced them at 16 different pitches. Specific mismatch responses to infrequent syllables among frequent syllables of the other type indicated that phonetically invariant information had been extracted at the level of the auditory cortex from the extensive irrelevant pitch variation. Such a detection mechanism is necessary for perceiving speech sounds in natural situations with a great deal of acoustic variation present.