Iain D. Gilchrist

Visual correlates of fixation selection: effects of scale and time

What distinguishes the locations that we fixate from those that we do not? To answer this question we recorded eye movements while observers viewed natural scenes, and recorded image characteristics centred at the locations that observers fixated. To investigate potential differences in the visual characteristics of fixated versus non-fixated locations, these images were transformed to make intensity, contrast, colour, and edge content explicit. Signal detection and information theoretic techniques were then used to compare fixated regions to those that were not. The presence of contrast and edge information was more strongly discriminatory than luminance or chromaticity. Fixated locations tended to be more distinctive in the high spatial frequencies. Extremes of low frequency luminance information were avoided. With prolonged viewing, consistency in fixation locations between observers decreased. In contrast to [Parkhurst, D. J., Law, K., & Niebur, E. (2002). Modeling the role of salience in the allocation of overt visual attention. Vision Research, 42 (1), 107-123] we found no change in the involvement of image features over time. We attribute this difference in our results to a systematic bias in their metric. We propose that saccade target selection involves an unchanging intermediate level representation of the scene but that the high-level interpretation of this representation changes over time.

Acute stress, memory, attention and cortisol

An investigation was conducted to explore the relationship between acute changes in cortisol and memory and attention in the context of an acute naturalistic stressor, namely, examination stress. Sixty students (36 male, 24 female) participated in an assessment of self-reported levels of stress, salivary cortisol, short term memory, selective and divided attention and auditory verbal working memory. Assessments were conducted during a non-exam and exam period. The results revealed that the exam period was associated with an increase in perceived levels of stress, but also a significant reduction in levels of salivary cortisol, compared with the non-exam period. This reduction in cortisol was associated with enhanced short-term memory (as measured by the total number of words recalled in a free recall task), impaired attention and an impairment in the primacy effect (a hippocampal-specific index of short term memory), but no significant effects on auditory verbal working memory. It was concluded that the results support the view that cortisol can modulate cognitive processes and that the effects of corticosteroids on cognitive function are selective.

Refixation frequency and memory mechanisms in visual search

Visual search-looking for a target object in the presence of a number of distractor items-is an everyday activity for humans (for example, finding the car in a busy car park) and animals (for example, foraging for food). Our understanding of visual search has been enriched by an interdisciplinary effort using a wide range of research techniques including behavioural studies in humans [1], single-cell electrophysiology [2], transcranial magnetic stimulation [3], event-related potentials [4] and studies of patients with focal brain injury [5]. A central question is what kind of information controls the search process. Visual search is typically accompanied by a series of eye movements, and investigating the nature and location of fixations helps to identify the kind of information that might control the search process. It has already been demonstrated that objects are fixated if they are visually similar to the target [6]. Also, if an item has been fixated, it is less likely to be returned to on the subsequent saccade. This automatic process is referred to as inhibition of return (IOR [7,8]). Here, we investigated the role of memory for which items had been fixated previously. We found that, during search, subjects often refixated items that had been previously fixated. Although there were fewer return saccades than would be expected by chance, the number of refixations indicated limited functional memory, indeed the memory effects that were present may primarily be a result of IOR.

Grouping and Extinction: Evidence for Low-level Modulation of Visual Selection

The effects of collinear edge- and brightness-based grouping on extinction were investigated in a bilateral parietally damaged patient. If either edge or brightness information supported the grouping of two simultaneously presented items, extinction was reduced. Grouping reduced extinction when the items fell across the midline (Experiment 2) and when they were presented in either visual field (Experiment 3). However, even with edge- and brightness-based grouping cues present, a small increase in item-separation dramatically increased the extent of extinction, though single item detection remained constant. These results support a model of visual processing in which locally acting grouping processes (e.g. edge- and brightness-based grouping) provide input for a selection mechanism that processes the resulting structural units (cf. Duncan & Humphreys, 1989). Extinction reflects spatially biased competition for selection, which is reduced when elements form a single structural unit.

Effort during visual search and counting: Insights from pupillometry

We investigated the processing effort during visual search and counting tasks using a pupil dilation measure. Search difficulty was manipulated by varying the number of distractors as well as the heterogeneity of the distractors. More difficult visual search resulted in more pupil dilation than did less difficult search. These results confirm a link between effort and increased pupil dilation. The pupil dilated more during the counting task than during target-absent search, even though the displays were identical, and the two tasks were matched for reaction time. The moment-to-moment dilation pattern during search suggests little effort in the early stages, but increasingly more effort towards response, whereas the counting task involved an increased initial effort, which was sustained throughout the trial. These patterns can be interpreted in terms of the differential memory load for item locations in each task. In an additional experiment, increasing the spatial memory requirements of the search evoked a corresponding increase in pupil dilation. These results support the view that search tasks involve some, but limited, memory for item locations, and the effort associated with this memory load increases during the trials. In contrast, counting involves a heavy locational memory component from the start.

Stimulus-Driven and Goal-Driven Control Over Visual Selection

This article explored the extent to which stimulus-driven control over visual selection is modulated by goal-driven factors. Observers searched for a no-onset color target among 3 distractors and signaled its location either manually or with a saccade. Additional distractors appeared either with or without an abrupt onset and were either similar or dissimilar to the target. Abrupt onsets disrupted saccades to the target, especially when they shared the target color. Irrelevant onsets also interfered with the manual responses, but this interference was dependent on the particular type of manual response. Stimulus-driven and contingent capture can occur within a single paradigm, but the extent and nature of these effects depend on the specific response required.

Saccade target selection in visual search: the effect of information from the previous fixation

This paper reports an analysis of saccades made during a task of visual search for a colour shape conjunction. The analysis concentrates on the saccade following the first saccade, thus complementing an earlier paper where the first saccades were analysed. The further analysis addresses the issue of what information might be held in trans-saccadic memory. As with the first saccade, incorrect second saccades tend to fall on distractors sharing one feature with the target. The proximity of the target to the fixation location immediately prior to the saccade is a very significant determinant of whether the saccade will reach the target. The results lead to the conclusion that in the majority of cases, choice of saccade destination is made afresh during each fixation with no carry-over from the previous fixation. However, in a small number of cases, second saccades are made after extremely brief fixation intervals. Although these saccades show a similar probability of reaching the target as those following longer fixations, it is argued that this sub-set of saccades are pre-programmed at the time of the preceding saccade.

Working Memory and the Suppression of Reflexive Saccades

Conscious behavioral intentions can frequently fail under conditions of attentional depletion. In attempting to trace the cognitive origin of this effect, we hypothesized that failures of action controlspecifically, oculomotor movementcan result from the imposition of fronto-executive load. To evaluate this prediction, participants performed an antisaccade task while simultaneously completing a working-memory task that is known to make variable demands on prefrontal processes (n-back task, see Jonides et al., 1997). The results of two experiments are reported. As expected, antisaccade error rates were increased in accordance with the fronto-executive demands of the n-back task (Experiment 1). In addition, the debilitating effects of working-memory load were restricted to the inhibitory component of the antisaccade task (Experiment 2). These findings corroborate the view that working memory operations play a critical role in the suppression of prepotent behavioral responses.

ScanMatch: A novel method for comparing fixation sequences

We present a novel approach to comparing saccadic eye movement sequences based on the Needleman-Wunsch algorithm used in bioinformatics to compare DNA sequences. In the proposed method, the saccade sequence is spatially and temporally binned and then recoded to create a sequence of letters that retains fixation location, time, and order information. The comparison of two letter sequences is made by maximizing the similarity score computed from a substitution matrix that provides the score for all letter pair substitutions and a penalty gap. The substitution matrix provides a meaningful link between each location coded by the individual letters. This link could be distance but could also encode any useful dimension, including perceptual or semantic space. We show, by using synthetic and behavioral data, the benefits of this method over existing methods. The ScanMatch toolbox for MATLAB is freely available online (www.scanmatch.co.uk).

Eye guidance and visual search

In our chapter for the first edition of this compendium (Findlay and Gilchrist 1998), we argued that active eye scanning is ubiquitous in visual search and so understanding eye scanning must be integral to any theory of search. We proposed an account, based around the concept of a salience map, of how the eyes might be guided during this process. We contrasted that active account with a more passive one in which covert attention ‘scanned’ some mental image and eye movements were incidental. The passive tradition was, at the time, the dominant one in studies of visual search and so we felt our proposal was quite radical. Since then there has been increasing support for an active model of visual search, in part reflecting an increasing realisation of the limitations of accounts based solely on covert attention. There has indeed been widening interest more generally in eye scanning and we have even been prepared to suggest that a fundamental theoretical shift is in the process of occurring (Findlay and Gilchrist 2003). We commence the present chapter with a brief recapitulation of our earlier arguments. This is followed by sections describing more recent experimental work that supports and elaborates the basic account.