Huan Luo

Phase Patterns of Neuronal Responses Reliably Discriminate Speech in Human Auditory Cortex

How natural speech is represented in the auditory cortex constitutes a major challenge for cognitive neuroscience. Although many single-unit and neuroimaging studies have yielded valuable insights about the processing of speech and matched complex sounds, the mechanisms underlying the analysis of speech dynamics in human auditory cortex remain largely unknown. Here, we show that the phase pattern of theta band (4-8 Hz) responses recorded from human auditory cortex with magnetoencephalography (MEG) reliably tracks and discriminates spoken sentences and that this discrimination ability is correlated with speech intelligibility. The findings suggest that an approximately 200 ms temporal window (period of theta oscillation) segments the incoming speech signal, resetting and sliding to track speech dynamics. This hypothesized mechanism for cortical speech analysis is based on the stimulus-induced modulation of inherent cortical rhythms and provides further evidence implicating the syllable as a computational primitive for the representation of spoken language.

Auditory Cortex Tracks Both Auditory and Visual Stimulus Dynamics Using Low-Frequency Neuronal Phase Modulation

How is naturalistic multisensory information combined in the human brain? Based on MEG data we show that phase modulation of visual and auditory signals captures the dynamics of complex scenes.

Cortical Oscillations in Auditory Perception and Speech: Evidence for Two Temporal Windows in Human Auditory Cortex

Natural sounds, including vocal communication sounds, contain critical information at multiple time scales. Two essential temporal modulation rates in speech have been argued to be in the low gamma band (∼20–80 ms duration information) and the theta band (∼150–300 ms), corresponding to segmental and diphonic versus syllabic modulation rates, respectively. It has been hypothesized that auditory cortex implements temporal integration using time constants closely related to these values. The neural correlates of a proposed dual temporal window mechanism in human auditory cortex remain poorly understood. We recorded MEG responses from participants listening to non-speech auditory stimuli with different temporal structures, created by concatenating frequency-modulated segments of varied segment durations. We show that such non-speech stimuli with temporal structure matching speech-relevant scales (∼25 and ∼200 ms) elicit reliable phase tracking in the corresponding associated oscillatory frequencies (low gamma and theta bands). In contrast, stimuli with non-matching temporal structure do not. Furthermore, the topography of theta band phase tracking shows rightward lateralization while gamma band phase tracking occurs bilaterally. The results support the hypothesis that there exists multi-time resolution processing in cortex on discontinuous scales and provide evidence for an asymmetric organization of temporal analysis (asymmetrical sampling in time, AST). The data argue for a mesoscopic-level neural mechanism underlying multi-time resolution processing: the sliding and resetting of intrinsic temporal windows on privileged time scales.

Behavioral Oscillations in Attention: Rhythmic α Pulses Mediated through θ Band

Neuronal oscillations are ubiquitous in the brain and contribute to perception and attention. However, most associated evidence derives from post hoc correlations between brain dynamics and behavior. Although a few recent studies demonstrate rhythms in behavior, it remains largely unknown whether behavioral performances manifest spectrotemporal dynamics in a neurophysiologically relevant manner (e.g., the temporal modulation of ongoing oscillations, the cross-frequency coupling). To investigate the issue, we examined fine spectrotemporal dynamics of behavioral time courses in a large sample of human participants (n = 49), by taking a high time-resolved psychophysical measurement in a precuing attentional task. We observed compelling dynamic oscillatory patterns directly in behavior. First, typical attentional effects are demonstrated in low-pass (0–2 Hz) filtered time courses of behavioral responses. Second, an uninformative peripheral cue elicits recurring α-band (8–20 Hz) pulses in behavioral performances, and the elicited α pulses for cued and uncued conditions are in a temporally alternating relationship. Finally, ongoing α-band power is phase locked to ongoing θ-bands (3–5 Hz) in behavioral time courses. Our findings constitute manifestation of oscillations at physiologically relevant rhythms and power-phase locking, as widely observed in neurophysiological recordings, in behavior. The findings suggest that behavioral performance actually consists of rich dynamic information and may reflect underlying neuronal oscillatory substrates. Our data also speak to a neural mechanism for item attention based on successive cycles (θ) of a sequential attentional sampling (α) process.

Neural Response Phase Tracks How Listeners Learn New Acoustic Representations

Humans are remarkable at rapidly learning regularities through experience from a dynamic environment. For example, long-lasting memories are formed even for auditory noise patterns after short, repeated exposure in an unsupervised manner. Although animal neurophysiological and human studies demonstrate adaptive cortical plasticity after sensory learning and memory formation, the mechanisms by which the auditory system extracts and encodes holistic patterns from random noise, which contains neither semantic labels nor prominent acoustic features to facilitate encoding, remains unknown. Here we combined magnetoencephalography (MEG) with psychophysics to address the issue. We demonstrate that the establishment of a reliable neuronal phase pattern in low-frequency (3-8 Hz) auditory cortical responses mirrors the noise memory formation process. Specifically, with repeated exposure, originally novel noise patterns are memorized, as reflected in behavior, and gradually produce robust phase responses in auditory cortex. Moreover, different memorized noises elicit distinguishable phase responses, suggesting their specificity to noise structure. The results indicate that the gradual establishment of low-frequency oscillatory phase patterns in auditory neuronal responses mediates the implicit learning process by which originally undifferentiated noises become new auditory objects.

The perception of FM sweeps by Chinese and English listeners

Frequency-modulated (FM) signals are an integral acoustic component of ecologically natural sounds and are analyzed effectively in the auditory systems of humans and animals. Linearly frequency-modulated tone sweeps were used here to evaluate two questions. First, how rapid a sweep can listeners accurately perceive? Second, is there an effect of native language insofar as the language (phonology) is differentially associated with processing of FM signals? Speakers of English and Mandarin Chinese were tested to evaluate whether being a speaker of a tone language altered the perceptual identification of non-speech tone sweeps. In two psychophysical studies, we demonstrate that Chinese subjects perform better than English subjects in FM direction identification, but not in an FM discrimination task, in which English and Chinese speakers show similar detection thresholds of approximately 20 ms duration. We suggest that the better FM direction identification in Chinese subjects is related to their experience with FM direction analysis in the tone-language environment, even though supra-segmental tonal variation occurs over a longer time scale. Furthermore, the observed common discrimination temporal threshold across two language groups supports the conjecture that processing auditory signals at durations of approximately 20 ms constitutes a fundamental auditory perceptual threshold.

Discrimination and categorization of speech and non-speech sounds in an MEG delayed-match-to-sample study

We investigated the perception and categorization of speech (vowels, syllables) and non-speech (tones, tonal contours) stimuli using MEG. In a delayed-match-to-sample paradigm, participants listened to two sounds and decided if they sounded exactly the same or different (auditory discrimination, AUD), or if they belonged to the same or different categories (category discrimination, CAT). Stimuli across the two conditions were identical; the category definitions for each kind of sound were learned in a training session before recording. MEG data were analyzed using an induced wavelet transform method to investigate task-related differences in time-frequency patterns. In auditory cortex, for both AUD and CAT conditions, an alpha (8-13 Hz) band activation enhancement during the delay period was found for all stimulus types. A clear difference between AUD and CAT conditions was observed for the non-speech stimuli in auditory areas and for both speech and non-speech stimuli in frontal areas. The results suggest that alpha band activation in auditory areas is related to both working memory and categorization for new non-speech stimuli. The fact that the dissociation between speech and non-speech occurred in auditory areas, but not frontal areas, points to different categorization mechanisms and networks for newly learned (non-speech) and natural (speech) categories.

Topological change disturbs object continuity in attentive tracking

The question of what is a perceptual object is one of the most central and also controversial issues in cognitive science. According to the topological approach to perceptual organization, the core intuitive notion of an object—the holistic identity preserved over shape-changing transformations—may be characterized precisely as topological invariance. Here we show that, across a series of multiple-object tracking tasks, performance was not disrupted when the moving items underwent massive featural changes. However, performance was significantly impaired when the items changed their topological properties of holes, demonstrating that topological invariance constrains what counts as an object in the first place. Consistent with previous findings, fMRI studies indicated that the anterior temporal lobe may be involved in the formation of object representation defined by topological constraints.