Ralf Engbert

SWIFT: A dynamical model of saccade generation during reading

Mathematical models have become an important tool for understanding the control of eye movements during reading. Main goals of the development of the SWIFT model (R. Engbert, A. Longtin, & R. Kliegl, 2002) were to investigate the possibility of spatially distributed processing and to implement a general mechanism for all types of eye movements observed in reading experiments. The authors present an advanced version of SWIFT that integrates properties of the oculomotor system and effects of word recognition to explain many of the experimental phenomena faced in reading research. They propose new procedures for the estimation of model parameters and for the test of the models performance. They also present a mathematical analysis of the dynamics of the SWIFT model. Finally, within this framework, they present an analysis of the transition from parallel to serial processing.

Microsaccades uncover the orientation of covert attention

Fixational eye movements are subdivided into tremor, drift, and microsaccades. All three types of miniature eye movements generate small random displacements of the retinal image when viewing a stationary scene. Here we investigate the modulation of microsaccades by shifts of covert attention in a classical spatial cueing paradigm. First, we replicate the suppression of microsaccades with a minimum rate about 150 ms after cue onset. Second, as a new finding we observe microsaccadic enhancement with a maximum rate about 350 ms after presentation of the cue. Third, we find a modulation of the orientation towards the cue direction. These multiple influences of visual attention on microsaccades accentuate their role for visual information processing. Furthermore, our results suggest that microsaccades can be used to map the orientation of visual attention in psychophysical experiments.

Tracking the Mind during Reading: The Influence of Past, Present, and Future Words on Fixation Durations.

Reading requires the orchestration of visual, attentional, language-related, and oculomotor processing constraints. This study replicates previous effects of frequency, predictability, and length of fixated words on fixation durations in natural reading and demonstrates new effects of these variables related to 144 sentences. Such evidence for distributed processing of words across fixation durations challenges psycholinguistic immediacy-of-processing and eye-mind assumptions. Most of the time the mind processes several words in parallel at different perceptual and cognitive levels. Eye movements can help to unravel these processes.

Length, frequency, and predictability effects of words on eye movements in reading

We tested the effects of word length, frequency, and predictability on inspection durations (first fixation, single fixation, gaze duration, and reading time) and inspection probabilities during first‐pass reading (skipped, once, twice) for a corpus of 144 German sentences (1138 words) and a subset of 144 target words uncorrelated in length and frequency, read by 33 young and 32 older adults. For corpus words, length and frequency were reliably related to inspection durations and probabilities, predictability only to inspection probabilities. For first‐pass reading of target words all three effects were reliable for inspection durations and probabilities. Low predictability was strongly related to second‐pass reading. Older adults read slower than young adults and had a higher frequency of regressive movements. The data are to serve as a benchmark for computational models of eye movement control in reading.

A dynamical model of saccade generation in reading based on spatially distributed lexical processing

The understanding of the control of eye movements has greatly benefited from the analysis of mathematical models. Currently most comprehensive models include sequential shifts of visual attention. Here we propose an alternative model of eye movement control, which includes three new principles: spatially distributed lexical processing, a separation of saccade timing from saccade target selection, and autonomous (random) generation of saccades with foveal inhibition. These three features provide a common control mechanism for fixations, refixations, and regressions. Consequently, the model is called SWIFT (Saccade-generation with inhibition by foveal targets). Results from numerical simulations are in good agreement with effects of word frequency on single-fixation, first-fixation, and gaze durations as well as fixation and word skipping probabilities in first-pass analysis. The model inherently produces complex eye movement patterns including refixations and regressions due to its underlying dynamical principles.

Microsaccades: A microcosm for research on oculomotor control, attention, and visual perception.

Miniature eye movements occur involuntarily during visual fixation. The most prominent contribution to these fixational eye movements is generated by microsaccades, which are rapid small-amplitude saccades with a rate of about one per second. Recent work demonstrates that microsaccades are optimized to counteract perceptual fading during perception of a stationary scene. Furthermore, microsaccades are modulated by visual attention and turned out to generate rich spatio-temporal dynamics. We conclude that the investigation of microsaccades will evolve into a new research field contributing to many facets of oculomotor control, visual perception, and the allocation of attention.

Microsaccades Keep the Eyes' Balance During Fixation

During fixation of a stationary target, small involuntary eye movements exhibit an erratic trajectory—a random walk. Two types of these fixational eye movements are drift and microsaccades (small-amplitude saccades). We investigated fixational eye movements and binocular coordination using a statistical analysis that had previously been applied to human posture control. This random-walk analysis uncovered two different time scales in fixational eye movements and identified specific functions for microsaccades. On a short time scale, microsaccades enhanced perception by increasing fixation errors. On a long time scale, microsaccades reduced fixation errors and binocular disparity (relative to pure drift movements). Thus, our findings clarify the role of oculomotor processes during fixation.

Toward a model of microsaccade generation: the case of microsaccadic inhibition.

Microsaccades are one component of the small eye movements that constitute fixation. Their implementation in the oculomotor system is unknown. To better understand the physiological and mechanistic processes underlying microsaccade generation, we studied microsaccadic inhibition, a transient drop of microsaccade rate, in response to irrelevant visual and auditory stimuli. Quantitative descriptions of the time course and strength of inhibition revealed a strong dependence of microsaccadic inhibition on stimulus characteristics. In Experiment 1, microsaccadic inhibition occurred sooner after auditory than after visual stimuli and after luminance-contrast than after color-contrast visual stimuli. Moreover, microsaccade amplitude strongly decreased during microsaccadic inhibition. In Experiment 2, the latency of microsaccadic inhibition increased with decreasing luminance contrast. We develop a conceptual model of microsaccade generation in which microsaccades result from fixation-related activity in a motor map coding for both fixation and saccades. In this map, fixation is represented at the central site. Saccades are generated by activity in the periphery, their amplitude increasing with eccentricity. The activity at the central, fixation-related site of the map predicts the rate of microsaccades as well as their amplitude and direction distributions. This model represents a framework for understanding the dynamics of microsaccade behavior in a broad range of tasks.

CRISP: A computational model of fixation durations in scene viewing.

Eye-movement control during scene viewing can be represented as a series of individual decisions about where and when to move the eyes. While substantial behavioral and computational research has been devoted to investigating the placement of fixations in scenes, relatively little is known about the mechanisms that control fixation durations. Here, we propose a computational model (CRISP) that accounts for saccade timing and programming and thus for variations in fixation durations in scene viewing. First, timing signals are modeled as continuous-time random walks. Second, difficulties at the level of visual and cognitive processing can inhibit and thus modulate saccade timing. Inhibition generates moment-by-moment changes in the random walks transition rate and processing-related saccade cancellation. Third, saccade programming is completed in 2 stages: an initial, labile stage that is subject to cancellation and a subsequent, nonlabile stage. Several simulation studies tested the models adequacy and generality. An initial simulation study explored the role of cognitive factors in scene viewing by examining how fixation durations differed under different viewing task instructions. Additional simulations investigated the degree to which fixation durations were under direct moment-to-moment control of the current visual scene. The present work further supports the conclusion that fixation durations, to a certain degree, reflect perceptual and cognitive activity in scene viewing. Computational model simulations contribute to an understanding of the underlying processes of gaze control.

Crossmodal coupling of oculomotor control and spatial attention in vision and audition

Fixational eye movements occur involuntarily during visual fixation of stationary scenes. The fastest components of these miniature eye movements are microsaccades, which can be observed about once per second. Recent studies demonstrated that microsaccades are linked to covert shifts of visual attention. Here, we generalized this finding in two ways. First, we used peripheral cues, rather than the centrally presented cues of earlier studies. Second, we spatially cued attention in vision and audition to visual and auditory targets. An analysis of microsaccade responses revealed an equivalent impact of visual and auditory cues on microsaccade-rate signature (i.e. an initial inhibition followed by an overshoot and a final return to the pre-cue baseline rate). With visual cues or visual targets, microsaccades were briefly aligned with cue direction and then opposite to cue direction during the overshoot epoch, probably as a result of an inhibition of an automatic saccade to the peripheral cue. With left auditory cues and auditory targets microsaccades oriented in cue direction. We argue that microsaccades can be used to study crossmodal integration of sensory information and to map the time course of saccade preparation during covert shifts of visual and auditory attention.