Elyse Sussman

An investigation of the auditory streaming effect using event‐related brain potentials

There is uncertainty concerning the extent to which the auditory streaming effect is a function of attentive or preattentive mechanisms. The mismatch negativity (MMN), which indexes preattentive acoustic processing, was used to probe whether the segregation associated with the streaming effect occurs preattentively. In Experiment 1, alternating high and low those were presented at fast and slow paces while subjects ignored the stimuli. At the slow pace, tones were heard as alternating high and low pitches, and no MMN was elicited. At the fast pace a streaming effect was induced and an MMN was observed for the low stream, indicating a preattentive locus for the streaming effect. The high deviant did not elicit an MMN. MMNs were obtained to both the high and low deviants when the interval between the across-stream deviance was lengthened to more than 250 ms in Experiment 2, indicating that the MMN system is susceptible to processing constraints.

Newborn infants can organize the auditory world

The perceptual world of neonates is usually regarded as not yet being fully organized in terms of objects in the same way as it is for adults. Using a recently developed method based on electric brain responses, we found that, similarly to adults, newborn infants segregate concurrent streams of sound, allowing them to organize the auditory input according to the existing sound source. The segregation of concurrent sound streams is a crucial step in the path leading to the identification of objects in the environment. Its presence in newborn infants shows that the basic abilities required for the development of conceptual objects are available already at the time of birth.

Attention affects the organization of auditory input associated with the mismatch negativity system.

The mismatch negativity (MMN), a component of event-related potentials (ERP), was used to investigate the effect of attention on auditory stream segregation. Subjects were presented with sequences of alternating high and low tones that occurred at a constant rate, which they ignored. When subjects ignored the stimuli, the three-tone standard and deviant sequences contained within the high- and low-pitched tones did not emerge and no MMNs were obtained. Subjects were then instructed to attend to the high-pitched tones of the stimulus sequences and detect the within-stream deviants. When subjects selectively attended the high-pitched tones, MMNs were obtained to the deviants within both the attended and unattended streams. These results indicate that attention can produce segregation such that the sequences of low- and high-pitched tones are available to the automatic deviance detection system that underlies the generation of the MMN. Selective attention can alter the organization of sensory input in the early stages of acoustic processing.

Top-down control over involuntary attention switching in the auditory modality

We tested the effects of predictability on involuntary attention switching to task-irrelevant sound changes (distraction). Behavioral and neurophysiological evidence are provided, showing that the predictability of task-irrelevant sound changes eliminates effects of distraction even though the automatic auditory change detection system remains responsive. Two indices of distraction, slower task performance and cortical brain responses associated with attention switching, were seen only in the unpredictable condition, in which the irrelevant acoustic changes were unexpected. Attention wasnot involuntarily drawn away from the primary task when the subjects had foreknowledge of when the irrelevant changes would occur. These results demonstrate attentional control over orienting to sound changes and suggest that involuntary attention switching occurs mainly when an irrelevant stimulus change is unexpected. The present data allowed observation of the temporal dynamics of attention switching in the human brain.

Top-down effects can modify the initially stimulus-driven auditory organization

We recorded event-related potentials (ERPs) and magnetic fields (ERFs) of the human brain to determine whether top-down control could modulate the initial organization of sound representations in the auditory cortex. We presented identical sound stimulation and manipulated top-down processes by instructing participants to either ignore the sounds (Ignore condition), to detect pitch changes (Attend-pitch condition), or to detect violations of a repeating tone pattern (Attend-pattern condition). The ERP results obtained in the Attend-pattern condition dramatically differed from those obtained with the other two task instructions. The magnetoencephalogram (MEG) findings were fully compatible, showing that the neural populations involved in detecting pattern violations differed from those involved in detecting pitch changes. The results demonstrate a top-down effect on the sound representation maintained in auditory cortex.

The role of attention in the formation of auditory streams.

There is controversy over whether stream segregation is an attention-dependent process. Part of the argument is related to the initial formation of auditory streams. It has been suggested that attention is needed only to form the streams, but not to maintain them once they have been segregated. The question of whether covert attention at the beginning of a to-be-ignored set of sounds will be enough to initiate the segregation process remains open. Here, we investigate this question by (1) using a methodology that does not require the participant to make an overt response to assess how the unattended sounds are organized and (2) structuring the test sound sequence to account for the covert attention explanation. The results of four experiments provide evidence to support the view that attention is not always required for the formation of auditory streams.

Dynamic sensory updating in the auditory system

Typically, in everyday situations, auditory input is constantly changing. Change is an important cue for the auditory system, which can signal the start of new sources of information or that some action may be required. Using an event-related brain potential that can be elicited whether or not attention is focused on the sounds (the mismatch negativity, MMN) we measured the time course of the effects of contextual changes on the brains response to the same stimulus event. The onset or cessation of a sound in a stimulus block brought about context changes. The effect of the context was observed through changes in the MMN response to a deviant event that was present throughout the sound sequence. These results suggest the existence of a dynamic system of change detection, which updates its model of the sensory input on-line as the changes occur.

MMN and attention: Competition for deviance detection

We addressed the question of whether the mismatch negativity (MMN) event-related potential reflects an attention-independent process. Previous studies have shown that the MMN response to intensity deviation was significantly reduced or even abolished when attention was highly focused on a concurrent sound channel, whereas no conclusive evidence of attentional sensitivity has been obtained for frequency deviation. We tested a new hypothesis suggesting that competition between detection of identical deviations in attended and unattended channels and the biasing of this competition induced by the subjects task account for the observed MMN effects. In a fast-paced dichotic paradigm, we set up competition for frequency MMN and removed it for intensity MMN. We found that frequency MMN was now abolished in the unattended channel, whereas the amplitude of the intensity MMN was unaffected. These results support the competition hypothesis and suggest that selective attention in and of itself does not affect the MMN. Top-down processes can determine what information reaches the deviance-detection process when changes in multiple channels vie for the same MMN resource and one of the competing changes is relevant for the subjects task.

Preattentive Binding of Auditory and Visual Stimulus Features

We investigated the role of attention in feature binding in the auditory and the visual modality. One auditory and one visual experiment used the mismatch negativity (MMN and vMMN, respectively) event-related potential to index the memory representations created from stimulus sequences, which were either task-relevant and, therefore, attended or task-irrelevant and ignored. In the latter case, the primary task was a continuous demanding within-modality task. The test sequences were composed of two frequently occurring stimuli, which differed from each other in two stimulus features (standard stimuli) and two infrequently occurring stimuli (deviants), which combined one feature from one standard stimulus with the other feature of the other standard stimulus. Deviant stimuli elicited MMN responses of similar parameters across the different attentional conditions. These results suggest that the memory representations involved in the MMN deviance detection response encoded the frequently occurring feature combinations whether or not the test sequences were attended. A possible alternative to the memory-based interpretation of the visual results, the elicitation of the McCollough color-contingent aftereffect, was ruled out by the results of our third experiment. The current results are compared with those supporting the attentive feature integration theory. We conclude that (1) with comparable stimulus paradigms, similar results have been obtained in the two modalities, (2) there exist preattentive processes of feature binding, however, (3) conjoining features within rich arrays of objects under time pressure and/or long-term retention of the feature-conjoined memory representations may require attentive processes.

Simultaneously active pre-attentive representations of local and global rules for sound sequences in the human brain.

Regular sequences of sounds (i.e., non-random) can usually be described by several, equally valid rules. Rules allowing extrapolation from one sound to the next are termed local rules, those that define relations between temporally non-adjacent sounds are termed global rules. The aim of the present study was to determine whether both local and global rules can be simultaneously extracted from a sound sequence even when attention is directed away from the auditory stimuli. The pre-attentive representation of a sequence of two alternating tones (differing only in frequency) was investigated using the mismatch negativity (MMN) auditory event-related potential. Both local- and global-rule violations of tone alternation elicited the MMN component while subjects ignored the auditory stimuli. This finding suggests that (a) pre-attentive auditory processes can extract both local and global rules from sound sequences, and (b) that several regularity representations of a sound sequence are simultaneously maintained during the pre-attentive phase of auditory stimulus processing.