Hendrik Strumpf

Repetition Suppression versus Enhancement—It's Quantity That Matters

Upon repetition, certain stimuli induce reduced neural responses (i.e., repetition suppression), whereas others evoke stronger signals (i.e., repetition enhancement). It has been hypothesized that stimulus properties (e.g., visibility) determine the direction of the repetition effect. Here, we show that the very same stimuli can induce both repetition suppression and enhancement, whereby the only determining factor is the number of repetitions. Repeating the same, initially novel low-visible pictures of scenes for up to 5 times enhanced the blood oxygen level-dependent (BOLD) response in scene-selective areas, that is, the parahippocampal place area (PPA) and the transverse occipital sulcus (TOS), presumably reflecting the strengthening of the internal representation. Additional repetitions (6-9) resulted in progressively attenuated neural responses indicating a more efficient representation of the now familiar stimulus. Behaviorally, repetition led to increasingly faster responses and higher visibility ratings. Novel scenes induced the largest BOLD response in the PPA and also higher activity in yet another scene-selective region, the retrospenial cortex (RSC). We propose that 2 separable processes modulate activity in the PPA: one process optimizes the internal stimulus representation and involves TOS and the other differentiates between familiar and novel scenes and involves RSC.

Neural correlates of exemplar novelty processing under different spatial attention conditions

The detection of novel events and their identification is a basic prerequisite in a rapidly changing environment. Recently, the processing of novelty has been shown to rely on the hippocampus and to be associated with activity in reward‐related areas. The present study investigated the influence of spatial attention on neural processing of novel relative to frequently presented standard and target stimuli. Never‐before‐seen Mandelbrot‐fractals absent of semantic content were employed as stimulus material. Consistent with current theories, novelty activated a widespread network of brain areas including the hippocampus. No activity, however, could be observed in reward‐related areas with the novel stimuli absent of a semantic meaning employed here. In the perceptual part of the novelty‐processing network a region in the lingual gyrus was found to specifically process novel events when they occurred outside the focus of spatial attention. These findings indicate that the initial detection of unexpected novel events generally occurs in specialized perceptual areas within the ventral visual stream, whereas activation of reward‐related areas appears to be restricted to events that do possess a semantic content indicative of the biological relevance of the stimulus. Hum Brain Mapp, 2009.

Reward-and attention-related biasing of sensory selection in visual cortex

Attention to task-relevant features leads to a biasing of sensory selection in extrastriate cortex. Features signaling reward seem to produce a similar bias, but how modulatory effects due to reward and attention relate to each other is largely unexplored. To address this issue, it is critical to separate top–down settings defining reward relevance from those defining attention. To this end, we used a visual search paradigm in which the targets definition (attention to color) was dissociated from reward relevance by delivering monetary reward on search frames where a certain task-irrelevant color was combined with the target-defining color to form the target object. We assessed the state of neural biasing for the attended and reward-relevant color by analyzing the neuromagnetic brain response to asynchronously presented irrelevant distractor probes drawn in the target-defining color, the reward-relevant color, and a completely irrelevant color as a reference. We observed that for the prospect of moderate rewards, the target-defining color but not the reward-relevant color produced a selective enhancement of the neuromagnetic response between 180 and 280 msec in ventral extrastriate visual cortex. Increasing reward prospect caused a delayed attenuation (220–250 msec) of the response to reward probes, which followed a prior (160–180 msec) response enhancement in dorsal ACC. Notably, shorter latency responses in dorsal ACC were associated with stronger attenuation in extrastriate visual cortex. Finally, an analysis of the brain response to the search frames revealed that the presence of the reward-relevant color in search distractors elicited an enhanced response that was abolished after increasing reward size. The present data together indicate that when top–down definitions of reward relevance and attention are separated, the behavioral significance of reward-associated features is still rapidly coded in higher-level cortex areas, thereby commanding effective top–down inhibitory control to counter a selection bias for those features in extrastriate visual cortex.

Neural processing of reward magnitude under varying attentional demands

Central to the organization of behavior is the ability to represent the magnitude of a prospective reward and the costs related to obtaining it. Therein, reward-related neural activations are discounted in dependence of the effort required to resolve a given task. Varying attentional demands of the task might however affect reward-related neural activations. Here we employed fMRI to investigate the neural representation of expected values during a monetary incentive delay task with varying attentional demands. Following a cue, indicating at the same time the difficulty (hard/easy) and the reward magnitude (high/low) of the upcoming trial, subjects performed an attention task and subsequently received feedback about their monetary reward. Consistent with previous results, activity in anterior-cingulate, insular/orbitofrontal and mesolimbic regions co-varied with the anticipated reward-magnitude, but also with the attentional requirements of the task. These activations occurred contingent on action-execution and resembled the response time pattern of the subjects. In contrast, cue-related activations, signaling the forthcoming task-requirements, were only observed within attentional control structures. These results suggest that anticipated reward-magnitude and task-related attentional demands are concurrently processed in partially overlapping neural networks of anterior-cingulate, insular/orbitofrontal, and mesolimbic regions.

Feature‐based attention modulates direction‐selective hemodynamic activity within human MT

Attending to the spatial location or to nonspatial features of a stimulus modulates neural activity in cortical areas that process its perceptual attributes. The feature‐based attentional selection of the direction of a moving stimulus is associated with increased firing of individual neurons tuned to the direction of the movement in area V5/MT, while responses of neurons tuned to opposite directions are suppressed. However, it is not known how these multiplicatively scaled responses of individual neurons tuned to different motion‐directions are integrated at the population level, in order to facilitate the processing of stimuli that match the perceptual goals. Using functional magnetic resonance imaging (fMRI) the present study revealed that attending to the movement direction of a dot field enhances the response in a number of areas including the human MT region (hMT) as a function of the coherence of the stimulus. Attending the opposite direction, however, lead to a suppressed response in hMT that was inversely correlated with stimulus‐coherence. These findings demonstrate that the multiplicative scaling of single‐neuron responses by feature‐based attention results in an enhanced direction‐selective population response within those cortical modules that processes the physical attributes of the attended stimuli. Our results provide strong support for the validity of the “feature similarity gain model” on the integrated population response as quantified by parametric fMRI in humans. Hum Brain Mapp, 2011.

Distinct Representations of Attentional Control During Voluntary and Stimulus-Driven Shifts Across Objects and Locations

Efficient interaction with the sensory environment requires the rapid reallocation of attentional resources between spatial locations, perceptual features, and objects. It is still a matter of debate whether one single domain-general network or multiple independent domain-specific networks mediate control during shifts of attention across features, locations, and objects. Here, we employed functional magnetic resonance imaging to directly compare the neural mechanisms controlling attention during voluntary and stimulus-driven shifts across objects and locations. Subjects either maintained or switched voluntarily and involuntarily their attention to objects located at the same or at a different visual location. Our data demonstrate shift-related activity in multiple frontoparietal, extrastriate visual, and default-mode network regions, several of which were commonly recruited by voluntary and stimulus-driven shifts between objects and locations. However, our results also revealed object- and location-selective activations, which, moreover, differed substantially between voluntary and stimulus-driven attention. These results suggest that voluntary and stimulus-driven shifts between objects and locations recruit partially overlapping, but also separable, cortical regions, implicating the parallel existence of domain-independent and domain-specific reconfiguration signals that initiate attention shifts in dependence of particular demands.

Spatiotemporal Dynamics of Feature-Based Attention Spread: Evidence from Combined Electroencephalographic and Magnetoencephalographic Recordings

Attentional selection on the basis of nonspatial stimulus features induces a sensory gain enhancement by increasing the firing-rate of individual neurons tuned to the attended feature, while responses of neurons tuned to opposite feature-values are suppressed. Here we recorded event-related potentials (ERPs) and magnetic fields (ERMFs) in human observers to investigate the underlying neural correlates of feature-based attention at the population level. During the task subjects attended to a moving transparent surface presented in the left visual field, while task-irrelevant probe stimuli executing brief movements into varying directions were presented in the opposite visual field. ERP and ERMF amplitudes elicited by the unattended task-irrelevant probes were modulated as a function of the similarity between their movement direction and the task-relevant movement direction in the attended visual field. These activity modulations reflecting globally enhanced processing of the attended feature were observed to start not before 200 ms poststimulus and were localized to the motion-sensitive area hMT. The current results indicate that feature-based attention operates in a global manner but needs time to spread and provide strong support for the feature-similarity gain model.

Distinct neural correlates of attending speed vs. coherence of motion.

Attention to specific features of moving visual stimuli modulates the activity in human cortical motion sensitive areas. In this study we employed combined event-related electrophysiological, magnetencephalographic (EEG, MEG) and hemodynamic functional magnetic resonance imaging (fMRI) measures of brain activity to investigate the precise time course and the neural correlates of feature-based attention to speed and coherence. Subjects were presented with an aperture of dots randomly moving either slow or fast, at the same time displaying a high or low level of coherence. The task was to attend either the speed or the coherence and press a button upon the high speed or high coherence stimulus respectively. When attention was directed to the speed of motion enhanced neural activity was found in the dorsal visual area V3a and in the IPL, areas previously shown to be specialized for motion processing. In contrast, when attention was directed to the coherence of motion significant hemodynamic activity was observed in the parietal areas fIPS and SPL that are specialized for the processing of complex motion patterns. Concurrent recordings of the event-related electro- and magnetencephalographic responses revealed that the speed-related attentional modulations of activity occurred at an earlier time range (around 240-290 ms), while the coherence-related ones occurred later (around 320-370 ms) post-stimulus. The current results suggest that the attentional selection of motion features modulates neural processing in the lowest-tier regions required to perform the task-critical discrimination.

Deep Brain Stimulation of the Pedunculopontine Tegmental Nucleus (PPN) Influences Visual Contrast Sensitivity in Human Observers.

The parapontine nucleus of the thalamus (PPN) is a neuromodulatory midbrain structure with widespread connectivity to cortical and subcortical motor structures, as well as the spinal cord. The PPN also projects to the thalamus, including visual relay nuclei like the LGN and the pulvinar. Moreover, there is intense connectivity with sensory structures of the tegmentum in particular with the superior colliculus (SC). Given the existence and abundance of projections to visual sensory structures, it is likely that activity in the PPN has some modulatory influence on visual sensory selection. Here we address this possibility by measuring the visual discrimination performance (luminance contrast thresholds) in a group of patients with Parkinson’s Disease (PD) treated with deep-brain stimulation (DBS) of the PPN to control gait and postural motor deficits. In each patient we measured the luminance-contrast threshold of being able to discriminate an orientation-target (Gabor-grating) as a function of stimulation frequency (high 60Hz, low 8/10, no stimulation). Thresholds were determined using a standard staircase-protocol that is based on parameter estimation by sequential testing (PEST). We observed that under low frequency stimulation thresholds increased relative to no and high frequency stimulation in five out of six patients, suggesting that DBS of the PPN has a frequency-dependent impact on visual selection processes at a rather elementary perceptual level.

Enhanced spatial focusing increases feature-based selection in unattended locations

Attention is a multifaceted phenomenon, which operates on features (e.g., colour or motion) and over space. A fundamental question is whether the attentional selection of features is confined to the spatially-attended location or operates independently across the entire visual field (global feature-based attention, GFBA). Studies providing evidence for GFBA often employ feature probes presented at spatially unattended locations, which elicit enhanced brain responses when they match a currently-attended target feature. However, the validity of this interpretation relies on consistent spatial focusing onto the target. If the probe were to temporarily attract spatial attention, the reported effects could reflect transient spatial selection processes, rather than GFBA. Here, using magnetoencephalographic recordings (MEG) in humans, we manipulate the strength and consistency of spatial focusing to the target by increasing the target discrimination difficulty (Experiment 1), and by demarcating the upcoming target’s location with a placeholder (Experiment 2), to see if GFBA effects are preserved. We observe that motivating stronger spatial focusing to the target did not diminish the effects of GFBA. Instead, aiding spatial pre-focusing with a placeholder enhanced the feature response at unattended locations. Our findings confirm that feature selection effects measured with spatially-unattended probes reflect a true location-independent neural bias.