James R. Brockmole

VISUAL SALIENCY DOES NOT ACCOUNT FOR EYE MOVEMENTS DURING VISUAL SEARCH IN REAL-WORLD SCENES

Publisher Summary This chapter presents testing of the hypothesis that fixation locations during scene viewing are primarily determined by visual salience. Eye movements were collected from participants who viewed photographs of real-world scenes during an active search task. Visual salience as determined by a popular computational model did not predict region-to-region saccades or saccade sequences any better than did a random model. Consistent with other reports in the literature, intensity, contrast, and edge density differed at fixated scene regions compared to regions that were not fixated, but these fixated regions also differ in rated semantic informativeness. Therefore, any observed correlations between fixation locations and image statistics cannot be unambiguously attributed to these image statistics. The chapter concludes that visual saliency does not account for eye movements during active search. The existing evidence is consistent with the hypothesis that cognitive factors play the dominant role in active gaze control.

Using real-world scenes as contextual cues for search

Research on contextual cueing has demonstrated that with simple arrays of letters and shapes, search for a target increases in efficiency as associations between a search target and its surrounding visual context are learned. We investigated whether the visual context afforded by repeated exposure to real-world scenes can also guide attention when the relationship between the scene and a target position is arbitrary. Observers searched for and identified a target letter embedded in photographs of real-world scenes. Although search time within novel scenes was consistent across trials, search time within repeated scenes decreased across repetitions. Unlike previous demonstrations of contextual cueing, however, memory for scene-target covariation was explicit. In subsequent memory tests, observers recognized repeated contexts more often than those that were presented once and displayed superior recall of target position within the repeated scenes. In addition, repetition of inverted scenes, which made the scene more difficult to identify, produced a markedly reduced rate of learning, suggesting semantic information concerning object and scene identity are used to guide attention.

Contextual cueing in naturalistic scenes : Global and local contexts

In contextual cueing, the position of a target within a group of distractors is learned over repeated exposure to a display with reference to a few nearby items rather than to the global pattern created by the elements. The authors contrasted the role of global and local contexts for contextual cueing in naturalistic scenes. Experiment 1 showed that learned target positions transfer when local information is altered but not when global information is changed. Experiment 2 showed that scene-target covariation is learned more slowly when local, but not global, information is repeated across trials than when global but not local information is repeated. Thus, in naturalistic scenes, observers are biased to associate target locations with global contexts.

Recognition and attention guidance during contextual cueing in real-world scenes: Evidence from eye movements

When confronted with a previously encountered scene, what information is used to guide search to a known target? We contrasted the role of a scenes basic-level category membership with its specific arrangement of visual properties. Observers were repeatedly shown photographs of scenes that contained consistently but arbitrarily located targets, allowing target positions to be associated with scene content. Learned scenes were then unexpectedly mirror reversed, spatially translating visual features as well as the target across the display while preserving the scenes identity and concept. Mirror reversals produced a cost as the eyes initially moved toward the position in the display in which the target had previously appeared. The cost was not complete, however; when initial search failed, the eyes were quickly directed to the targets new position. These results suggest that in real-world scenes, shifts of attention are initially based on scene identity, and subsequent shifts are guided by more detailed information regarding scene and object layout.

Feature bindings endure without attention: Evidence from an explicit recall task

Are integrated objects the unit of capacity of visual working memory, or is continued attention needed to maintain bindings between independently stored features? In a delayed recall task, participants reported the color and shape of a probed item from a memory array. During the delay, attention was manipulated with an exogenous cue. Recall was elevated at validly cued positions, indicating that the cue affected item memory. On invalid trials, participants most frequently recalled either both features (perfect object memory) or neither of the two features (no object memory); the frequency with which only one feature was recalled was significantly lower than predicted by feature independence as determined in a single-feature recall task. These data do not support the view that features are remembered independently when attention is withdrawn. Instead, integrated objects are stored in visual working memory without need for continued attention.

Temporal integration between visual images and visual percepts.

Using a temporal integration task, subjects in 5 experiments were expected to combine information from temporally separated visual presentations. Evidence from these experiments indicated that perceptual information can be integrated with previously generated and currently maintained visual images to form a representation that contains information from each source. Properties and limitations of this integration process were also explored, including the time required to generated the image, the speed at which percepts were integrated with images, and the capacity of the representation. Implications for theories of visual processing and memory are discussed.

Human navigation in nested environments.

Navigation in humans and many other animals relies on spatial representations of their environments. Three experiments examined how humans maintain sense of orientation between nested environments. Subjects can acquire new spatial representations easily without integrating them into their existing spatial knowledge system. While navigating between nested environments, subjects seemed to constantly switch between the currently processed environment by reorienting to approaching environments and losing track of old environments at given spatial regions. These results suggest that spatial updating in naturalistic, nested environments does not occur for all environments at the same time. Implications for the hierarchical theory of spatial representations and the path integration theory of navigation are discussed.

Do binding deficits account for age-related decline in visual working memory?

Remembering visual material, such as objects, faces, and spatial locations, over a short period of time (seconds) becomes more difficult as we age. We investigated whether these deficits could be explained by a simple reduction in visual working memory capacity or by an impairment in one’s ability to form or maintain appropriate associations among pieces of related information. In three experiments, we used recognition and recall tests to address the efficacy with which older adults can create bound object representations by varying the number of features of each object that had to be remembered for a subsequent memory test. Results demonstrated that whereas older adults exhibited reduced memory capacity as compared with that of younger adults, both groups stored integrated object representations in visual working memory. These results are contrasted with other work that suggests that age-related memory decline is due, at least in part, to associative deficits.

The World Within Reach: Effects of Hand Posture and Tool Use on Visual Cognition

Our mental processing of the visual world is not independent of our physical actions within it. Placing objects near one’s hands and interacting with objects using tools can enhance visual perception, bias and prolong the allocation of attention, and distort memory in systematic ways. This suggests that the world within our reach is cognitively different from the world beyond reach. In this review, we examine the evidence supporting this conclusion, focusing on the cognitive and neural mechanisms that underlie these effects, the parameters that may control their emergence, and their potential practical applications.

The role of attention in binding visual features in working memory: Evidence from cognitive ageing

Two experiments were conducted to assess the costs of attentional load during a feature (colour–shape) binding task in younger and older adults. Experiment 1 showed that a demanding backwards counting task, which draws upon central executive/general attentional resources, reduced binding to a greater extent than individual feature memory, but the effect was no greater in older than in younger adults. Experiment 2 showed that presenting memory items sequentially rather than simultaneously, such that items are required to be maintained while new representations are created, selectively affects binding performance in both age groups. Although this experiment exhibited an age-related binding deficit overall, both age groups were affected by the attention manipulation to an equal extent. While a role for attentional processes in colour–shape binding was apparent across both experiments, manipulations of attention exerted equal effects in both age groups. We therefore conclude that age-related binding deficits neither emerge nor are exacerbated under conditions of high attentional load. Implications for theories of visual working memory and cognitive ageing are discussed.