Éva M. Bankó

Dissociating the Effect of Noise on Sensory Processing and Overall Decision Difficulty

It has been proposed that perceptual decision making involves a task-difficulty component, which detects perceptual uncertainty and guides allocation of attentional resources. It is thought to take place immediately after the early extraction of sensory information and is specifically reflected in a positive component of the event related potentials, peaking at ∼220 ms after stimulus onset. However, in the previous research, neural processes associated with the monitoring of overall task difficulty were confounded by those associated with the increased sensory processing demands as a result of adding noise to the stimuli. Here we dissociated the effect of phase noise on sensory processing and overall decision difficulty using a face gender categorization task. Task difficulty was manipulated either by adding noise to the stimuli or by adjusting the female/male characteristics of the face images. We found that it is the presence of noise and not the increased overall task difficulty that affects the electrophysiological responses in the first 300 ms following stimulus onset in humans. Furthermore, we also showed that processing of phase-randomized as compared to intact faces is associated with increased fMRI responses in the lateral occipital cortex. These results revealed that noise-induced modulation of the early electrophysiological responses reflects increased visual cortical processing demands and thus failed to provide support for a task-difficulty component taking place between the early sensory processing and the later sensory accumulation stages of perceptual decision making.

Learning to filter out visual distractors

When learning to master a visual task in a cluttered natural environment, it is important to optimize the processing of task‐relevant information and to efficiently filter out distractors. However, the mechanisms that suppress task‐irrelevant information are not well understood. Here we show that training leads to a selective increase in motion coherence detection thresholds for task‐irrelevant motion directions that interfered with the processing of task‐relevant directions during training. Furthermore, using functional magnetic resonance imaging we found that training attenuated neural responses associated with the task‐irrelevant direction compared with the task‐relevant direction in the visual cortical areas involved in processing of visual motion. The strongest suppression of functional magnetic resonance imaging responses to task‐irrelevant motion information was observed in human area MT+. These findings reveal that perceptual learning leads to the suppression and efficient filtering of task‐irrelevant visual information.

Amblyopic deficits in the timing and strength of visual cortical responses to faces

Behavioral research revealed that object vision is impaired in amblyopia. Nevertheless, neurophysiological research in humans has focused on the amblyopic effects at the earliest stage of visual cortical processing, leaving the question of later, object-specific neural processing deficits unexplored. By measuring event-related potentials (ERPs) to foveal face stimuli we characterized the amblyopic effects on the N170 component, reflecting higher-level structural face processing. Single trial analysis revealed that latencies of the ERP components increased and were more variable in the amblyopic eye compared to the fellow eye both in strabismic and anisometropic patent groups. Moreover, there was an additional delay of N170 relative to the early P1 component over the right hemisphere, which was absent in the fellow eye, suggesting a slower evolution of face specific cortical responses in amblyopia. On the other hand, distribution of single trial N170 peak amplitudes differed between the amblyopic and fellow eye only in the strabismic but not in the anisometropic patients. Furthermore, the amblyopic N170 latency increment but not the amplitude reduction correlated with the interocular differences in visual acuity and fixation stability. We found no difference in the anticipatory neural oscillations between stimulation of the amblyopic and the fellow eye implying that impairment of the neural processes underlying generation of stimulus-driven visual cortical responses might be the primary reason behind the observed amblyopic effects. These findings provide evidence that amblyopic disruption of early visual experience leads to deficits in the strength and timing of higher-level, face specific visual cortical responses, reflected in the N170 component.

Flawless visual short-term memory for facial emotional expressions

Facial emotions are important cues of human social interactions. Emotional expressions are continuously changing and thus should be monitored, memorized, and compared from time to time during social intercourse. However, it is not known how efficiently emotional expressions can be stored in short-term memory. Here we show that emotion discrimination is not impaired when the faces to be compared are separated by several seconds, requiring storage of fine-grained emotion-related information in short-term memory. Likewise, we found no significant effect of increasing the delay between the sample and the test face in the case of facial identity discrimination. Furthermore, a second experiment conducted on a large subject sample (N = 160) revealed flawless short-term memory for both facial emotions and facial identity also when observers performed the discrimination tasks only twice with novel faces. We also performed an fMRI experiment, which confirmed that discrimination of fine-grained emotional expressions in our experimental paradigm involved processing of high-level facial emotional attributes. Significantly stronger fMRI responses were found in a cortical network--including the posterior superior temporal sulcus--that is known to be involved in processing of facial emotional expression during emotion discrimination than during identity discrimination. These findings reveal flawless, high-resolution visual short-term memory for emotional expressions, which might underlie efficient monitoring of continuously changing facial emotions.

How the visual cortex handles stimulus noise: insights from amblyopia.

Adding noise to a visual image makes object recognition more effortful and has a widespread effect on human electrophysiological responses. However, visual cortical processes directly involved in handling the stimulus noise have yet to be identified and dissociated from the modulation of the neural responses due to the deteriorated structural information and increased stimulus uncertainty in the case of noisy images. Here we show that the impairment of face gender categorization performance in the case of noisy images in amblyopic patients correlates with amblyopic deficits measured in the noise-induced modulation of the P1/P2 components of single-trial event-related potentials (ERP). On the other hand, the N170 ERP component is similarly affected by the presence of noise in the two eyes and its modulation does not predict the behavioral deficit. These results have revealed that the efficient processing of noisy images depends on the engagement of additional processing resources both at the early, feature-specific as well as later, object-level stages of visual cortical processing reflected in the P1 and P2 ERP components, respectively. Our findings also suggest that noise-induced modulation of the N170 component might reflect diminished face-selective neuronal responses to face images with deteriorated structural information.

Visual cortical responses to the input from the amblyopic eye are suppressed during binocular viewing

Amblyopia is a visual disorder caused by an anomalous early visual experience. It has been suggested that suppression of the visual input from the weaker eye might be a primary underlying mechanism of the amblyopic syndrome. However, it is still an unresolved question to what extent neural responses to the visual information coming from the amblyopic eye are suppressed during binocular viewing. To address this question we measured event-related potentials (ERP) to foveal face stimuli in amblyopic patients, both in monocular and binocular viewing conditions. The results revealed no difference in the amplitude and latency of early components of the ERP responses between the binocular and fellow eye stimulation. On the other hand, early ERP components were reduced and delayed in the case of monocular stimulation of the amblyopic eye as compared to the fellow eye stimulation or to binocular viewing. The magnitude of the amblyopic effect measured on the ERP amplitudes was comparable to that found on the fMRI responses in the fusiform face area using the same face stimuli and task conditions. Our findings showing that the amblyopic effects present on the early ERP components in the case of monocular stimulation are not manifested in the ERP responses during binocular viewing suggest that input from the amblyopic eye is completely suppressed already at the earliest stages of visual cortical processing when stimuli are viewed by both eyes.

Amblyopic Deficit Beyond the Fovea: Delayed and Variable Single-Trial ERP Response Latencies, but Unaltered Amplitudes

PURPOSE Amblyopia was first described as a deficit of central vision. However, it has long been debated whether this dysfunction is limited to the fovea or whether extrafoveal vision is also affected, as studies concerning the latter are equivocal. The purpose of the study was to resolve this issue. METHODS We investigated the amblyopic effect on event-related potentials (ERPs) with foveal and perifoveal stimuli, either matched in size based on cortical magnification or presented as large annular stimuli. In two separate experiments we measured ERPs on amblyopic patients and control subjects using face images. Latency and amplitude of averaged ERPs and their single-trial distributions were analyzed. RESULTS When the fovea was stimulated, latency and amplitude of the early averaged ERP components increased and were reduced, respectively, in the amblyopic compared with the fellow eye. Importantly, perifoveal stimulation also elicited similar amblyopic deficits, which were clearly significant in the case of using cortical magnification scaled stimuli. However, single-trial peak analysis revealed that foveal and perifoveal effects differed in nature: Peak amplitudes were reduced only in foveal stimulation, while latencies were delayed and jittered at both the fovea and perifovea. Event-related potentials obtained from fellow eyes were not significantly different from those of normal observers. CONCLUSIONS Our findings revealed the existence of amblyopic deficits at the perifovea when the stimulated cortical area was matched in size to that of foveal stimulation. These deficits manifested themselves only in the temporal structure of the responses, unlike foveal deficits, which affected both component amplitude and latency.

Electrophysiological correlates of learning-induced modulation of visual motion processing in humans

Training on a visual task leads to increased perceptual and neural responses to visual features that were attended during training as well as decreased responses to neglected distractor features. However, the time course of these attention-based modulations of neural sensitivity for visual features has not been investigated before. Here we measured event related potentials (ERP) in response to motion stimuli with different coherence levels before and after training on a speed discrimination task requiring object-based attentional selection of one of the two competing motion stimuli. We found that two peaks on the ERP waveform were modulated by the strength of the coherent motion signal; the response amplitude associated with motion directions that were neglected during training was smaller than the response amplitude associated with motion directions that were attended during training. The first peak of motion coherence-dependent modulation of the ERP responses was at 300 ms after stimulus onset and it was most pronounced over the occipitotemporal cortex. The second peak was around 500 ms and was focused over the parietal cortex. A control experiment suggests that the earlier motion coherence-related response modulation reflects the extraction of the coherent motion signal whereas the later peak might index accumulation and readout of motion signals by parietal decision mechanisms. These findings suggest that attention-based learning affects neural responses both at the sensory and decision processing stages.