Anna Montagnini

Spatiotemporal dynamics of visual attention during saccade preparation: Independence and coupling between attention and movement planning

During the preparation of a saccadic eye movement, a visual stimulus is more efficiently processed when it is spatially coincident with the saccadic target as compared to when the visual and the saccadic targets are displayed at different locations. We studied the coupling between visual selective attention and saccadic preparation by measuring orientation acuity of human subjects at different locations relative to the saccadic target and at different delays relative to the saccade cue onset. First, we generalized previous results (E. Castet, S. Jeanjean, A. Montagnini, D. Laugier, & G. S. Masson, 2006) revealing that a dramatic perceptual advantage at the saccadic target emerges dynamically within the first 150-200 ms from saccade cue onset. Second, by varying the validity of the spatial cue for the discrimination task, we encouraged subjects to modulate the spatial distribution of attentional resources independently from the automatic deployment to saccadic target. We found that an independent component of attention can be voluntarily deployed away from the saccadic target. The relative weight of the automatic versus the independent component of attention increases across time during saccadic preparation.

Do we track what we see? Common versus independent processing for motion perception and smooth pursuit eye movements: A review

Many neurophysiological studies in monkeys have indicated that visual motion information for the guidance of perception and smooth pursuit eye movements is - at an early stage - processed in the same visual pathway in the brain, crucially involving the middle temporal area (MT). However, these studies left some questions unanswered: Are perception and pursuit driven by the same or independent neuronal signals within this pathway? Are the perceptual interpretation of visual motion information and the motor response to visual signals limited by the same source of neuronal noise? Here, we review psychophysical studies that were motivated by these questions and compared perception and pursuit behaviorally in healthy human observers. We further review studies that focused on the interaction between perception and pursuit. The majority of results point to similarities between perception and pursuit, but dissociations were also reported. We discuss recent developments in this research area and conclude with suggestions for common and separate principles for the guidance of perceptual and motor responses to visual motion information.

Dynamics of attentional deployment during saccadic programming.

The dynamics of attentional deployment before saccade execution was studied with a dual-task paradigm. Observers made a horizontal saccade whose direction was indicated by a symbolic precue and had to discriminate the orientation of a Gabor patch displayed at different delays after the precue (but before saccade onset). The patch location relative to the saccadic target was indicated to observers before each block. Therefore, on each trial, observers were informed simultaneously about the respective absolute locations of the saccadic and perceptual targets. The main result is that orientational acuity improved over a period of 150-200 ms after the precue onset at the saccadic target location, where overall performance is best, and at distant locations. This effect is due to attentional factors rather than to an alerting effect. It is also dependent on the efficiency of the temporal masks displayed before and after the Gabor patches.

Bayesian modeling of dynamic motion integration

The quality of the representation of an objects motion is limited by the noise in the sensory input as well as by an intrinsic ambiguity due to the spatial limitation of the visual motion analyzers (aperture problem). Perceptual and oculomotor data demonstrate that motion processing of extended objects is initially dominated by the local 1D motion cues, related to the objects edges and orthogonal to them, whereas 2D information, related to terminators (or edge-endings), takes progressively over and leads to the final correct representation of global motion. A Bayesian framework accounting for the sensory noise and general expectancies for object velocities has proven successful in explaining several experimental findings concerning early motion processing [Weiss, Y., Adelson, E., 1998. Slow and smooth: a Bayesian theory for the combination of local motion signals in human vision. MIT Technical report, A.I. Memo 1624]. In particular, these models provide a qualitative account for the initial bias induced by the 1D motion cue. However, a complete functional model, encompassing the dynamical evolution of object motion perception, including the integration of different motion cues, is still lacking. Here we outline several experimental observations concerning human smooth pursuit of moving objects and more particularly the time course of its initiation phase, which reflects the ongoing motion integration process. In addition, we propose a recursive extension of the Bayesian model, motivated and constrained by our oculomotor data, to describe the dynamical integration of 1D and 2D motion information. We compare the model predictions for object motion tracking with human oculomotor recordings.

More is not always better: adaptive gain control explains dissociation between perception and action

Moving objects generate motion information at different scales, which are processed in the visual system with a bank of spatiotemporal frequency channels. It is not known how the brain pools this information to reconstruct object speed and whether this pooling is generic or adaptive; that is, dependent on the behavioral task. We used rich textured motion stimuli of varying bandwidths to decipher how the human visual motion system computes object speed in different behavioral contexts. We found that, although a simple visuomotor behavior such as short-latency ocular following responses takes advantage of the full distribution of motion signals, perceptual speed discrimination is impaired for stimuli with large bandwidths. Such opposite dependencies can be explained by an adaptive gain control mechanism in which the divisive normalization pool is adjusted to meet the different constraints of perception and action.

Using Covert Response Activation to Test Latent Assumptions of Formal Decision-Making Models in Humans

Most decisions that we make build upon multiple streams of sensory evidence and control mechanisms are needed to filter out irrelevant information. Sequential sampling models of perceptual decision making have recently been enriched by attentional mechanisms that weight sensory evidence in a dynamic and goal-directed way. However, the framework retains the longstanding hypothesis that motor activity is engaged only once a decision threshold is reached. To probe latent assumptions of these models, neurophysiological indices are needed. Therefore, we collected behavioral and EMG data in the flanker task, a standard paradigm to investigate decisions about relevance. Although the models captured response time distributions and accuracy data, EMG analyses of response agonist muscles challenged the assumption of independence between decision and motor processes. Those analyses revealed covert incorrect EMG activity (“partial error”) in a fraction of trials in which the correct response was finally given, providing intermediate states of evidence accumulation and response activation at the single-trial level. We extended the models by allowing motor activity to occur before a commitment to a choice and demonstrated that the proposed framework captured the rate, latency, and EMG surface of partial errors, along with the speed of the correction process. In return, EMG data provided strong constraints to discriminate between competing models that made similar behavioral predictions. Our study opens new theoretical and methodological avenues for understanding the links among decision making, cognitive control, and motor execution in humans. SIGNIFICANCE STATEMENT Sequential sampling models of perceptual decision making assume that sensory information is accumulated until a criterion quantity of evidence is obtained, from where the decision terminates in a choice and motor activity is engaged. The very existence of covert incorrect EMG activity (“partial error”) during the evidence accumulation process challenges this longstanding assumption. In the present work, we use partial errors to better constrain sequential sampling models at the single-trial level.

Shifts in reported gaze position due to changes in pupil size: ground truth and compensation

Camera-based eye trackers are the mainstay of todays eye movement research and countless practical applications of eye tracking. Recently, a significant impact of changes in pupil size on the accuracy of camera-based eye trackers during fixation has been reported [Wyatt 2010]. We compared the pupil-size effect between a scleral search coil based eye tracker (DNI) and an up-to-date infrared camera-based eye tracker (SR Research Eyelink 1000) by simultaneously recording human eye movements with both techniques. Between pupil-constricted and pupil-relaxed conditions we find a subject-specific shift in reported gaze position exceeding 2 degrees only with the camera based eye tracker, while the scleral search coil system simultaneously reported steady fixation. This confirms that the actual point of fixation did not change during pupil constriction/relaxation, and the resulting shift in measured gaze position is solely an artifact of the camera-based eye tracking system. We demonstrate a method to partially compensate the pupil-based shift using separate calibrations in pupil-constricted and pupil-dilated conditions, with pupil size as an index to dynamically weight the two calibrations.

Conflict tasks and the diffusion framework: Insight in model constraints based on psychological laws

Formal models of decision-making have traditionally focused on simple, two-choice perceptual decisions. To date, one of the most influential account of this process is Ratcliffs drift diffusion model (DDM). However, the extension of the model to more complex decisions is not straightforward. In particular, conflicting situations, such as the Eriksen, Stroop, or Simon tasks, require control mechanisms that shield the cognitive system against distracting information. We adopted a novel strategy to constrain response time (RT) models by concurrently investigating two well-known empirical laws in conflict tasks, both at experimental and modeling levels. The two laws, predicted by the DDM, describe the relationship between mean RT and (i) target intensity (Piérons law), (ii) standard deviation of RT (Wagenmakers-Browns law). Pioneering work has shown that Piérons law holds in the Stroop task, and has highlighted an additive relationship between target intensity and compatibility. We found similar results in both Eriksen and Simon tasks. Compatibility also violated Wagenmakers-Browns law in a very similar and particular fashion in the two tasks, suggesting a common model framework. To investigate the nature of this commonality, predictions of two recent extensions of the DDM that incorporate selective attention mechanisms were simulated and compared to the experimental results. Both models predict Piérons law and the violation of Wagenmakers-Browns law by compatibility. Fits of the models to the RT distributions and accuracy data allowed us to further reveal their relative strengths and deficiencies. Combining experimental and computational results, this study sets the groundwork for a unified model of decision-making in conflicting environments.

Dynamic interaction between retinal and extraretinal signals in motion integration for smooth pursuit

Due to the aperture problem, the initial direction of tracking responses to a translating bar is biased towards the direction orthogonal to the bar. This observation offers a powerful way to explore the interactions between retinal and extraretinal signals in controlling our actions. We conducted two experiments to probe these interactions by briefly (200 and 400 ms) blanking the moving target (45° or 135° tilted bar) during steady state (Experiment 1) and at different moments during the early phase of pursuit (Experiment 2). In Experiment 1, we found a marginal but statistically significant directional bias on target reappearance for all subjects in at least one blank condition (200 or 400 ms). In Experiment 2, no systematic significant directional bias was observed at target reappearance after a blank. These results suggest that the weighting of retinal and extraretinal signals is dynamically modulated during the different phases of pursuit. Based on our previous theoretical work on motion integration, we propose a new closed-loop two-stage recurrent Bayesian model where retinal and extraretinal signals are dynamically weighted based on their respective reliabilities and combined to compute the visuomotor drive. With a single free parameter, the model reproduces many aspects of smooth pursuit observed across subjects during and immediately after target blanking. It provides a new theoretical framework to understand how different signals are dynamically combined based on their relative reliability to adaptively control our actions. Overall, the model and behavioral results suggest that human subjects rely more strongly on prediction during the early phase than in the steady state phase of pursuit.

Linking theoretical decision-making mechanisms in the simon task with electrophysiological data: A model-based neuroscience study in humans

A current challenge for decision-making research is in extending models of simple decisions to more complex and ecological choice situations. Conflict tasks (e.g., Simon, Stroop, Eriksen flanker) have been the focus of much interest, because they provide a decision-making context representative of everyday life experiences. Modeling efforts have led to an elaborated drift diffusion model for conflict tasks (DMC), which implements a superimposition of automatic and controlled decision activations. The DMC has proven to capture the diversity of behavioral conflict effects across various task contexts. This study combined DMC predictions with EEG and EMG measurements to test a set of linking propositions that specify the relationship between theoretical decision-making mechanisms involved in the Simon task and brain activity. Our results are consistent with a representation of the superimposed decision variable in the primary motor cortices. The decision variable was also observed in the EMG activity of response agonist muscles. These findings provide new insight into the neurophysiology of human decision-making. In return, they provide support for the DMC model framework.