Mieke Donk

The role of stimulus-driven and goal-driven control in saccadic visual selection

Four experiments were conducted to investigate the role of stimulus-driven control in saccadic eye movements. Participants were required to make a speeded saccade toward a predefined target presented concurrently with multiple nontargets and possibly 1 distractor. Target and distractor were either equally salient (Experiments 1 and 2) or not (Experiments 3 and 4). The results uniformly demonstrated that fast eye movements were completely stimulus driven, whereas slower eye movements were goal driven. These results are in line with neither a bottom-up account nor a top-down notion of visual selection. Instead, they indicate that visual selection is the outcome of 2 independent processes, one stimulus driven and the other goal driven, operating in different time windows.

Visual marking beside the mark: Prioritizing selection by abrupt onsets

In a standard visual marking experiment, observers are presented with a display containing one set of elements (old elements) followed after a certain time interval by a second set of elements (new elements). The task of observers is to search for a target among the new elements. Typically, the time to find the target depends only on the number of new elements in the display and not on the number of old elements, showing that observers search only among the new elements. This effect of prioritizing new elements over old elements is explained in terms of top-down inhibition of old objects—that is, visual marking (Watson & Humphreys, 1997). The present study addressed whether this prioritizing is in fact mediated by top-down inhibition of old objects, as suggested by Watson and Humphreys (1997), or whether it is mediated by the abrupt onsets of the newly presented elements (Yantis & Jonides, 1984). In three experiments, the presentations of the old and new elements were or were not accompanied by a luminance change. The results showed that if new elements were equiluminant with the background, no visual marking occurred, suggesting that new elements must have a luminance onset in order to be prioritized over old elements. Implications for current theories on visual selection are discussed.

Effects of Salience Are Short-Lived

A salient event in the visual field tends to attract attention and the eyes. To account for the effects of salience on visual selection, models generally assume that the human visual system continuously holds information concerning the relative salience of objects in the visual field. Here we show that salience in fact drives vision only during the short time interval immediately following the onset of a visual scene. In a saccadic target-selection task, human performance in making an eye movement to the most salient element in a display was accurate when response latencies were short, but was at chance when response latencies were long. In a manual discrimination task, performance in making a judgment of salience was more accurate with brief than with long display durations. These results suggest that salience is represented in the visual system only briefly after a visual image enters the brain.

Prioritizing selection of new elements: bottom-up versus top-down control.

Watson and Humphreys (1997) have proposed that prioritized selection of new over old elements occurs because observers can apply top-down inhibition to the locations of the old elements by a mechanism they refer to as visual marking. However, recent evidence has suggested that the top-down mechanism is questionable (Donk & Theeuwes, 2001). In the present study, we investigated whether prioritized selection of new over old elements occurs in a bottom-up or a top-down fashion. Observers were presented with displays containing one set of elements (old elements) followed, after a certain time interval, by a second set of elements (new elements). The observers were instructed to search for the presence of a target that was presented with equal probability among the old and the new elements (Experiments 1 and 2) or twice as often among the old elements than among the new elements (Experiment 3). The results show that new elements were prioritized for selection over old ones even though the observers had no incentive to do so. The results suggest that prioritized selection of new over old elements is not mediated by a top-down inhibition process, as was proposed by Watson and Humphreys (1997). Instead, prioritization of new elements appears to be a bottom-up process. The implications of these results are discussed in terms of models of attentional control.

Saccadic target selection as a function of time

Recent evidence indicates that stimulus-driven and goal-directed control of visual selection operate independently and in different time windows (van Zoest et al., 2004). The present study further investigates how eye movements are affected by stimulus-driven and goal-directed control. Observers were presented with search displays consisting of one target, multiple non-targets and one distractor element. The task of observers was to make a fast eye movement to a target immediately following the offset of a central fixation point, an event that either co-occurred with or soon followed the presentation of the search display. Distractor saliency and target-distractor similarity were independently manipulated. The results demonstrated that the effect of distractor saliency was transient and only present for the fastest eye movements, whereas the effect of target-distractor similarity was sustained and present in all but the fastest eye movements. The results support an independent timing account of visual selection.

The effects of salience on saccadic target selection.

Two experiments were conducted to investigate the effects of saliency on saccadic target selection as a function of time. Participants were required to make a speeded saccade towards a target defined by a unique orientation presented concurrently with multiple nontargets and one distractor. Target and distractor were equally salient within the orientation dimension but varied in saliency in the colour dimension. Within the colour dimension, the target presented could be more, equally, or less salient than the distractor. The results showed that saliency played a large role early during processing while no effects of saliency were found in later processing. Results are discussed in terms of models on visual selection.

Bottom-up and Top-down Control in Visual Search

Previous research suggests that the allocation of attention is largely controlled either in a stimulus-driven or in a goal-driven manner. To date, few studies have systematically manipulated variables affecting stimulus-driven and goal-driven selection independently in order to investigate how both manners of control interrelate and affect performance in visual search. In the present study observers were presented with search displays consisting of an array of line segments rotated at various orientations. The task of observers was to indicate the presence or absence of a vertical line segment (the target) presented amongst a series of nontargets and possibly one distractor. By varying the absolute differences in orientation between the target, nontargets, and distractors, relative target–distractor salience and target–distractor similarity were independently manipulated to investigate the contribution of stimulus-driven and goal-driven control. The major result was that relative target–distractor salience and target–distractor similarity affected search performance independently. Performance was better in cases where the irrelevant distractor was not a salient item in the search display and did not look similar to the target. The results are discussed in terms of models of attentional control.

Salience is only briefly represented: evidence from probe-detection performance.

Salient objects in the visual field tend to capture attention. The present study aimed to examine the time-course of salience effects using a probe-detection task. Eight experiments investigated how the salience of different orientation singletons affected probe reaction time as a function of stimulus onset asynchrony (SOA) between the presentation of a singleton display and a probe display. The results demonstrate that salience consistently affected probe reaction time at the shortest SOA. The effect of salience disappeared as SOA increased. These results suggest that contrary to the assumption of major theories on visual selection, salience is transiently represented in our visual system allowing the effects of salience on attentional selection to be only short-lived.

Goal-driven modulation as a function of time in saccadic target selection.

Four experiments were performed to investigate the contribution of goal-driven modulation in saccadic target selection as a function of time. Observers were required to make an eye movement to a prespecified target that was concurrently presented with multiple nontargets and possibly one distractor. Target and distractor were defined in different dimensions (orientation dimension and colour dimension in Experiment 1), or were both defined in the same dimension (i.e., both defined in the orientation dimension in Experiment 2, or both defined in the colour dimension in Experiments 3 and 4). The identities of target and distractor were switched over conditions. Speed–accuracy functions were computed to examine the full time course of selection in each condition. There were three major results. First, the ability to exert goal-driven control increased as a function of response latency. Second, this ability depended on the specific target–distractor combination, yet was not a function of whether target and distractor were defined within or across dimensions. Third, goal-driven control was available earlier when target and distractor were dissimilar than when they were similar. It was concluded that the influence of goal-driven control in visual selection is not all or none, but is of a continuous nature.

Prioritizing new elements with a brief preview period: Evidence against visual marking

Watson and Humphreys (1997) have proposed that the ability to prioritize new elements over old elements involves a time-consuming process (of at least 400 msec) of active inhibition of the locations of the old elements, which they referred to asvisual marking. Recently, Donk and Theeuwes (2001) have suggested that prioritized selection of new over old elements is an instantaneous process related to the luminance change accompanying the appearance of the new elements. The aim of the present study was to test these two alternatives by investigating whether prioritized selection of new over old elements could be achieved with a very short preview of the old elements (50 msec). The results indicated that participants were able to prioritize selection of new over old elements when the new elements were presented with luminance onset whereas the old elements were not. New elements could not be prioritized if both the old and the new elements appeared with luminance onset. The results indicated that prioritization of new elements is based on an instantaneous process, rather than on a time-consuming process.