Mircea Ariel Schoenfeld

Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices

The brain should integrate related but not unrelated information from different senses. Temporal patterning of inputs to different modalities may provide critical information about whether those inputs are related or not. We studied effects of temporal correspondence between auditory and visual streams on human brain activity with functional magnetic resonance imaging (fMRI). Streams of visual flashes with irregularly jittered, arrhythmic timing could appear on right or left, with or without a stream of auditory tones that coincided perfectly when present (highly unlikely by chance), were noncoincident with vision (different erratic, arrhythmic pattern with same temporal statistics), or an auditory stream appeared alone. fMRI revealed blood oxygenation level-dependent (BOLD) increases in multisensory superior temporal sulcus (mSTS), contralateral to a visual stream when coincident with an auditory stream, and BOLD decreases for noncoincidence relative to unisensory baselines. Contralateral primary visual cortex and auditory cortex were also affected by audiovisual temporal correspondence or noncorrespondence, as confirmed in individuals. Connectivity analyses indicated enhanced influence from mSTS on primary sensory areas, rather than vice versa, during audiovisual correspondence. Temporal correspondence between auditory and visual streams affects a network of both multisensory (mSTS) and sensory-specific areas in humans, including even primary visual and auditory cortex, with stronger responses for corresponding and thus related audiovisual inputs.

Attention to features precedes attention to locations in visual search: evidence from electromagnetic brain responses in humans

Single-unit recordings in macaque extrastriate cortex have shown that attentional selection of nonspatial features can operate in a location-independent manner. Here, we investigated analogous neural correlates at the neural population level in human observers by using simultaneous event-related potential (ERP) and event-related magnetic field (ERMF) recordings. The goals were to determine (1) whether task-relevant features are selected before attention is allocated to the location of the target, and (2) whether this selection reflects the locations of the relevant features. A visual search task was used in which the spatial distribution of nontarget items with attended feature values was varied independently of the location of the target. The presence of task-relevant features in a given location led to a change in ERP/ERMF activity beginning ∼140 msec after stimulus onset, with a neural origin in the ventral occipito-temporal cortex. This effect was independent of the location of the actual target. This effect was followed by lateralized activity reflecting the allocation of attention to the location of the target (the well known N2pc component), which began at ∼170 msec poststimulus. Current source localization indicated that the allocation of attention to the location of the target originated in more anterior regions of occipito-temporal cortex anterior than the feature-related effects. These findings suggest that target detection in visual search begins with the detection of task-relevant features, which then allows spatial attention to be allocated to the location of a likely target, which in turn allows the target to be positively identified.

Dynamics of feature binding during object-selective attention

Objects in the environment may be attended selectively and perceived as unified ensembles of their constituent features. To investigate the timing and cortical localization of feature-integration mechanisms in object-based attention, recordings of event-related potentials and magnetic fields were combined with functional MRI while subjects attended to one of two superimposed transparent surfaces formed by arrays of dots moving in opposite directions. A spatiotemporal analysis revealed evidence for a rapid increase in neural activity localized to a color-selective region of the fusiform gyrus when the surface moving in the attended direction displayed an irrelevant color feature. These data provide support for the “integrated-competition” model of object-selective attention and point to a dynamic neural substrate for the rapid binding process that links relevant and irrelevant features to form a unified perceptual object.

Differentiation of idiopathic Parkinson's disease, multiple system atrophy, progressive supranuclear palsy, and healthy controls using magnetization transfer imaging

The differentiation of multiple system atrophy (MSA) and progressive supranuclear palsy (PSP) from idiopathic Parkinsons disease (IPD) is difficult. Magnetization transfer imaging (MTI), a measure that correlates with myelination and axonal density, was employed in this study in the attempt to distinguish between these disorders. Measurements were carried out in 15 patients with IPD, 12 patients with MSA, 10 patients with PSP, and in 20 aged-matched healthy control subjects. The main finding was a change in the magnetization transfer ratio in the globus pallidus, putamen, caudate nucleus, substantia nigra, and white matter in IPD, MSA, and PSP patients, matching the pathological features of the underlying disorder. Furthermore, stepwise linear discriminant analysis provided a good classification of the individual patients into the different disease groups. All IPD patients and control subjects were correctly separated from the MSA and PSP cohort, and all PSP patients and 11 of 12 MSA patients were correctly separated from the IPD and control cohort. There was also a fairly good discrimination of IPD patients from control subjects and of MSA from PSP patients. In conclusion, MTI revealed degenerative changes in patients with different parkinsonian syndromes matching the underlying pathological features of the different diseases, underlining the high potential of this method in distinguishing MSA and PSP from IPD.

Functional magnetic resonance tomography correlates of taste perception in the human primary taste cortex

The present study investigated the functional magnetic resonance tomography correlates of taste perception in the human primary taste cortex. There is conflicting evidence in the literature about chemotopical organization in this brain region. The topography of hemodynamic activity elicited by five taste stimuli (sweet, sour, salty, bitter and umami) was analyzed on the flattened cortical surfaces of six single subjects. A high inter-individual topographical variability had to be noted. The results showed different patterns of hemodynamic activity for the investigated tastes with some considerable overlap. However, the taste specific patterns were stable over time in each subject. Such an individual taste specific pattern was also found for the umami taste within the primary taste cortex of each subject. These results suggest that input from glutamate receptors on the tongue might be processed in an exclusive way in the primary taste cortex rather than as a combination of inputs from the classical taste receptors.

Rapid recurrent processing gates awareness in primary visual cortex

Visual awareness has been proposed to depend on recurrent processing in early visual cortex areas including the primary visual cortex (V1). Here, we address this hypothesis with high spatiotemporal resolution magnetoencephalographic recordings in subjects performing a substitution masking paradigm. Neural activity reflecting awareness is assessed by directly comparing the neuromagnetic response elicited by effectively and ineffectively masked targets after the proportion of trials leading to masking was individually adjusted to match the proportion of trials without masking. This revealed a modulation of recurrent activity in the primary visual cortex rapidly after the onset of the feedforward sweep of processing in striate and extrastriate areas but significantly before the onset of attention-dependent recurrent modulations in V1. Our data provide direct support for the notion that (i) recurrent processing in V1 correlates with visual awareness and (ii) that attention and awareness involve distinct recurrent processing operations.

Functional motor compensation in amyotrophic lateral sclerosis

The present study investigated the fMRI correlates of functional compensation/neural reorganization of the motor system in patients with amyotrophic lateral sclerosis (ALS). The hypothesis was that ALS patients would recruit additional brain regions compared with controls in a motor task and that activity in these regions would vary as a function of task difficulty. Patients and controls executed a motor task with two sequences (a simple and a more difficult one) of consecutive button presses. Patients and controls both activated brain regions known to be involved in motor execution and control. Activity in ipsilateral motor areas as well as difficulty–related activity in the left cerebellum could only be observed in patients. The behavioral data indicated that the motor task was much more difficult for patients than for controls. At nearly equal difficulty the observed patterns of hemodynamic activity in controls were very similar to those observed in ALS. The findings suggest that functional compensation in ALS relies on existing resources and mechanisms that are not primarily developed as a consequence of the lesion.

The Neural Site of Attention Matches the Spatial Scale of Perception

What is the neural locus of visual attention? Here we show that the locus is not fixed but instead changes rapidly to match the spatial scale of task-relevant information in the current scene. To accomplish this, we obtained electrical, magnetic, and hemodynamic measures of attention from human subjects while they detected large-scale or small-scale targets within multiscale stimulus patterns. Subjects did not know the scale of the target before stimulus onset, and yet the neural locus of attention-related activity between 250 and 300 ms varied according to the scale of the target. Specifically, maximal attention-related activity spread from a high-level, relatively anterior visual area (the lateral occipital complex) for large-scale targets to include a lower-level, more posterior area (visual area V4) for small-scale targets. This rapid change indicates that the neural locus of attention in visual cortex is not static but is instead determined rapidly and dynamically by means of an interaction between top-down task information and local information about the current visual input.

Analysis of pathways mediating preserved vision after striate cortex lesions.

This study investigated the neural substrates of preserved visual functioning in a patient with homonymous hemianopsia and Riddoch syndrome after a posterior cerebral artery stroke affecting the primary visual cortex (area V1). The limited visual abilities of this patient included above‐chance verbal reports of movement and color change as well as discrimination of movement direction in the hemianopic field. Functional magnetic resonance imaging showed that motion and color‐change stimuli presented to the hemianopic field produced activation in several extrastriate areas of the lesioned hemisphere that were defined using retinotopic mapping. Magnetoencephalographic recordings indicated that evoked activity occurred earlier in the higher‐tier visual areas V4/V8 and V5 than in the lower‐tier areas V2/V3 adjacent to the lesion. In addition, the functional magnetic resonance imaging analysis showed an increased functional connectivity between areas V4/V8 and V5 of the lesioned hemisphere in comparison with the same areas in the intact hemisphere during the presentation of color changes. These results suggest that visual perception after the V1 lesion in Riddoch syndrome is mediated by subcortical pathways that bypass V1 and project first to higher‐tier visual areas V5 and V4/V8 and subsequently to lower‐tier areas V2/V3.

Task-load-dependent activation of dopaminergic midbrain areas in the absence of reward

Dopamine release in cortical and subcortical structures plays a central role in reward-related neural processes. Within this context, dopaminergic inputs are commonly assumed to play an activating role, facilitating behavioral and cognitive operations necessary to obtain a prospective reward. Here, we provide evidence from human fMRI that this activating role can also be mediated by task-demand-related processes and thus extends beyond situations that only entail extrinsic motivating factors. Using a visual discrimination task in which varying levels of task demands were precued, we found enhanced hemodynamic activity in the substantia nigra (SN) for high task demands in the absence of reward or similar extrinsic motivating factors. This observation thus indicates that the SN can also be activated in an endogenous fashion. In parallel to its role in reward-related processes, reward-independent activation likely serves to recruit the processing resources needed to meet enhanced task demands. Simultaneously, activity in a wide network of cortical and subcortical control regions was enhanced in response to high task demands, whereas areas of the default-mode network were deactivated more strongly. The present observations suggest that the SN represents a core node within a broader neural network that adjusts the amount of available neural and behavioral resources to changing situational opportunities and task requirements, which is often driven by extrinsic factors but can also be controlled endogenously.