Preeti Verghese

The psychophysics of visual search.

Most theories of visual search emphasize issues of limited versus unlimited capacity and serial versus parallel processing. In the present article, we suggest a broader framework based on two principles, one empirical and one theoretical. The empirical principle is to focus on conditions at the intersection of visual search and the simple detection and discrimination paradigms of spatial vision. Such simple search conditions avoid artifacts and phenomena specific to more complex stimuli and tasks. The theoretical principle is to focus on the distinction between high and low threshold theory. While high threshold theory is largely discredited for simple detection and discrimination, it persists in the search literature. Furthermore, a low threshold theory such as signal detection theory can account for some of the phenomena attributed to limited capacity or serial processing. In the body of this article, we compare the predictions of high threshold theory and three versions of signal detection theory to the observed effects of manipulating set size, discriminability, number of targets, response bias, external noise, and distractor heterogeneity. For almost all cases, the results are inconsistent with high threshold theory and are consistent with all three versions of signal detection theory. In the Discussion, these simple theories are generalized to a larger domain that includes search asymmetry, multidimensional judgements including conjunction search, response time, search with multiple eye fixations and more general stimulus conditions. We conclude that low threshold theories can account for simple visual search without invoking mechanisms such as limited capacity or serial processing.

Visual Search and Attention: A Signal Detection Theory Approach

Abstract A framework based on signal detection theory shows how visual attention influences tasks that require searching for a target among distractors. Data from physiology and psychophysics show that performance in a search task is largely determined by the discriminability of the target from the distractors. Attention acts by enhancing the response to the attended stimulus and by restricting the range and number of units responding to the distractors. Both processes improve performance by increasing the discriminability of the attended signal.

Collinear facilitation is largely uncertainty reduction

When flanked by collinear Gabor patches, detection thresholds for a target Gabor patch improve by up to a factor of 2. This result has been interpreted as evidence for collinear facilitation. However, facilitation has been observed only for targets near detection threshold, where observers seem uncertain about the location and other properties of the stimulus. So the effect of the flankers may be to reduce this uncertainty. If this is true, then other cues to target location should produce a similar improvement in thresholds. To test this hypothesis, we measured contrast detection thresholds for a Gabor target alone, and in the presence of either a faint circle surrounding the target location, or two high-energy flanking Gabor patches. We also used an adaptive procedure to measure the slope of the psychometric function to determine whether the slopes were considerably lower in the presence of location cues or flanking Gabors, as predicted by signal detection theory when uncertainty is reduced. As observed previously, the presence of collinear flankers improved detection thresholds by a factor of two. Yet, on average, the circle alone accounted for the most of the facilitation; for three of our five observers, it improved thresholds as much as the collinear flankers. Other cues that specified target location produced similar improvements in detection thresholds. The slopes of the psychometric functions were much shallower in the presence of these location cues or the collinear flankers compared to the target-alone condition. This change in the slopes indicates that the threshold improvement is largely due to a significant reduction in uncertainty.

Local motion detectors cannot account for the detectability of an extended trajectory in noise

Previous work has shown that a single dot moving in a consistent direction is easily detected among noise dots in Brownian motion (Watamaniuk et al., Vis Res 1995;35:65-77). In this study we calculated the predictions of a commonly-used psychophysical motion model for a motion trajectory in noise. This model assumes local motion energy detectors optimally tuned to the signal, followed by a decision stage that implements the maximum rule. We first show that local motion detectors do indeed explain the detectability of brief trajectories (100 ms) that fall within a single unit, but that they severely underestimate the detectability of extended trajectories that span multiple units. For instance, a 200 ms trajectory is approximately three times more detectable than two isolated 100 ms trajectories presented together within an equivalent temporal interval. This result suggests a nonlinear interaction among local motion units. This interaction is not restricted to linear trajectories because circular trajectories with curvatures larger than 1 degree are almost as detectable as linear trajectories. Our data are consistent with a flexible network that feeds forward excitation among units tuned to similar directions of motion.

Comparing integration rules in visual search

Search performance for a target tilted in a known direction among vertical distractors is well explained by signal detection theory models. Typically these models use a maximum-of-outputs rule (Max rule) to predict search performance. The Max rule bases its decision on the largest response from a set of independent noisy detectors. When the target is tilted in either direction from the reference orientation and the task is to identify the sign of tilt, the loss of performance with set size is much greater than predicted by the Max rule. Here we varied the target tilt and measured psychometric functions for identifying the direction of tilt from vertical. Measurements were made at different set sizes in the presence of various levels of orientation jitter. The orientation jitter was set at multiples of the estimated internal noise, which was invariant across set sizes and measurement techniques. We then compared the data to the predictions of two models: a Summation model that integrates both signal and noise from local detectors and a Signed-Max model that first picks the maxima on both sides of vertical and then chooses the value with the highest absolute deviation from the reference. Although the function relating thresholds to set size had a slope consistent with both the Signed-Max and the Summation models, the shape of individual psychometric functions was in the most crucial conditions better predicted by the Signed-Max model, which chooses the largest tilt while keeping track of the direction of tilt.

Predicting future motion

Predicting the future course of a moving target is invaluable for planning actions. We used trajectory detection in noise to investigate this predictive capability. Using a contrast probe technique, we showed that in noise, contrast increments are more easily seen at the end of the trajectory than at the beginning. Analyses of the contrast data revealed that the improvement at the end of the trajectory was due to a substantial reduction in the number of detectors monitored, as well as to an increase in the gain of detectors responding to the increment. It appears that the first segment of the trajectory acts as an automatic cue that draws attention to subsequent segments of the trajectory, leading to enhanced detectability for predictable motion trajectories.

Attention to locations and features: different top-down modulation of detector weights.

It is well known that attention improves the visibility of a target. In this study, we examined the effect of attention on the selectivity profile for a target. We used a masking technique to measure the tuning function for detecting a target while cueing either its orientation or its location. In the presence of an orientation mask, uncued thresholds were maximally elevated with a parallel mask and decreased with increasing mask orientation from the target. The presence of a cue reduced the masking effect but the shape of the function was cue-specific: The orientation cue consistently improved thresholds at the target orientation, whereas the location cue typically improved thresholds at all orientations relative to the function measured in the absence of attention. The selective versus overall increase of sensitivity observed in our study may be due to differences in the weighting of individual detectors that determine the behavioral tuning function in the two cueing conditions.

Stimulus configuration determines the detectability of motion signals in noise

We measured the detectability of moving signal dots in dynamic noise to determine whether local motion signals are preferentially combined along an axis parallel to the direction of motion. Observers were asked to detect a signal composed of three dots moving in a linear trajectory among dynamic noise dots. The signal dots were collinear and equally spaced in a configuration that was either parallel to or perpendicular to their trajectory. The probability of detecting the signal was measured as a function of noise density, over a range of signal dot spacings from 0.5 degrees to 5.0 degrees. At any given noise density, the signal in the parallel configuration was more detectable than that in the perpendicular configuration. Our four observers could tolerate 1.5-2.5 times more noise in the parallel configuration. This improvement is not due merely to temporal summation between consecutive dots in the parallel trajectory. Temporal summation functions measured on our observers indicate that the benefit from spatial coincidence of the dots lasts for no more than 50 ms, whereas the increased detectability of the parallel configuration is observed up to the largest temporal separations tested (210 ms). These results demonstrate that dots arranged parallel to the signal trajectory are more easily detected than those arranged perpendicularly. Moreover, this enhancement points to the existence of visual mechanisms that preferentially organize motion information parallel to the direction of motion.

What is the depth of a sinusoidal grating

Stereo matching of a textured surface is, in principle, ambiguous because of the quasi-repetitive nature of texture. Here, we used a perfectly repetitive texture, namely a sinusoidal grating, to examine human stereo matching for repetitive patterns. Observers matched the depth of a vertical grating segment, 6-deg wide and presented in a rectangular envelope at or near the disparity of the segment edges. The interocular phase of the carrier also influenced stereo matching, producing shifts in depth arrayed around the plane specified by the edges. The limiting disparity for the edge matches was 40-60 arcmin, independent of the spatial frequency of the carrier. One explanation for these results is that first-order disparity energy mechanisms, tuned to lower spatial frequencies, respond to the edge disparities, while showing little response to the interocular phase of the carrier. In principle, these first-order low frequency mechanisms could account for edge-based stereo matching at high contrasts. But, edge matching is also observed at carrier contrasts as low as 5%, where these low frequency mechanisms are unlikely to detect the grating stimulus. This result suggests that edge matching for gratings depends on coarse-scale second-order stereo mechanisms, similar to the second-order mechanisms that have been proposed for encoding two-dimensional texture. We conclude that stereo matching of gratings (or any other texture) depends on a combination of responses in both coarse-scale second-order and fine-scale first-order disparity mechanisms.

Predictability and the Dynamics of Position Processing in the Flash-Lag Effect

Several models have been proposed to account for the flash-lag effect. One criterion for evaluating alternative models is to consider the separate effects of motion predictability and flash predictability. We first established that flash predictability has an impact on the size of the perceived spatial offset in the flash-lag illusion. We then examined motion predictability by varying the consistency of the motion trajectory. Both manipulations affected the magnitude of the flash-lag illusion. These outcomes suggest that the perception of position is a dynamic process that can be modulated by explicit cues in advance of the flash and by the temporal integration of position information over a consistent motion trajectory. A complete explanation of the flash-lag effect must specify how flash predictability and motion predictability modulate position-processing mechanisms.