Kyle C. McDermott

Adaptation and visual salience

We examined how the salience of color is affected by adaptation to different color distributions. Observers searched for a color target on a dense background of distractors varying along different directions in color space. Prior adaptation to the backgrounds enhanced search on the same background while adaptation to orthogonal background directions slowed detection. Advantages of adaptation were seen for both contrast adaptation (to different color axes) and chromatic adaptation (to different mean chromaticities). Control experiments, including analyses of eye movements during the search, suggest that these aftereffects are unlikely to reflect simple learning or changes in search strategies on familiar backgrounds, and instead result from how adaptation alters the relative salience of the target and background colors. Comparable effects were observed along different axes in the chromatic plane or for axes defined by different combinations of luminance and chromatic contrast, consistent with visual search and adaptation mediated by multiple color mechanisms. Similar effects also occurred for color distributions characteristic of natural environments with strongly selective color gamuts. Our results are consistent with the hypothesis that adaptation may play an important functional role in highlighting the salience of novel stimuli by discounting ambient properties of the visual environment.

Uniform color spaces and natural image statistics

Many aspects of visual coding have been successfully predicted by starting from the statistics of natural scenes and then asking how the stimulus could be efficiently represented. We started from the representation of color characterized by uniform color spaces, and then asked what type of color environment they implied. These spaces are designed to represent equal perceptual differences in color discrimination or appearance by equal distances in the space. The relative sensitivity to different axes within the space might therefore reflect the gamut of colors in natural scenes. To examine this, we projected perceptually uniform distributions within the Munsell, CIE L(*)u(*)v(*) or CIE L(*)a(*)b(*) spaces into cone-opponent space. All were elongated along a bluish-yellowish axis reflecting covarying signals along the L-M and S-(L+M) cardinal axes, a pattern typical (though not identical) to many natural environments. In turn, color distributions from environments were more uniform when projected into the CIE L(*)a(*)b(*) perceptual space than when represented in a normalized cone-opponent space. These analyses suggest the bluish-yellowish bias in environmental colors might be an important factor shaping chromatic sensitivity, and also suggest that perceptually uniform color metrics could be derived from natural scene statistics and potentially tailored to specific environments.

Simulations of adaptation and color appearance in observers with varying spectral sensitivity

A model of adaptation and visual coding was used to simulate how color appearance might vary among individuals that differ only in their sensitivity to wavelength. Color responses to images were calculated for cone receptors with spectral sensitivities specific to the individual, and in postreceptoral mechanisms tuned to different combinations of the cones. Adaptation was assumed to normalize sensitivity within each cone and postreceptoral channel so that the average response to an ensemble of scenes equaled the mean response in channels defined for the reference observer. Image colors were then rendered from the adapted channels’ outputs. The transformed images provide an illustration of the variations in color appearance that could be attributed to differences in spectral sensitivity in otherwise identical observers adapted to identical worlds, and examples of these predictions are shown for both normal variation (e.g. in lens and macular pigment) and color deficiencies (anomalous trichromacy). The simulations highlight the role that known processes of adaptation may play in compensating color appearance for variations in sensitivity both within and across observers, and provide a novel tool for visualizing the perceptual consequences of any variation in visual sensitivity including changes associated with development or disease.

Adapting images to observers

Adaptation exerts a continuous influence on visual coding, altering both sensitivity and appearance whenever there is a change in the patterns of stimulation the observer is exposed to. These adaptive changes are thought to improve visual performance by optimizing both discrimination and recognition, but may take substantial time to fully adjust the observer to a new stimulus context. Here we explore the advantages of instead adapting the image to the observer, obviating the need for sensitivity changes within the observer. Adaptation in color vision adjusts to both the average color and luminance and to the variations in color and luminance within the scene. We modeled these adjustments as gain changes in the cones and in multiple post-receptoral mechanisms tuned to stimulus contrasts along different color-luminance directions. Responses within these mechanisms were computed for a range of different environments, based on images sampled from a range of natural outdoor settings. Images were then adapted for different environments by scaling the responses so that for each mechanism the average response equaled the response to a reference environment. Transforming images in this way can increase the discriminability of different colors and the salience of novel colors. It also provides a way to simulate how the world might look to an observer in different environments or to different observers in the same environment. Such images thus provide a novel tool for exploring color appearance and the perceptual and functional consequences of adaptation.

Visual search and eye movements in novel and familiar contexts

Adapting to the visual characteristics of a specific environment may facilitate detecting novel stimuli within that environment. We monitored eye movements while subjects searched for a color target on familiar or unfamiliar color backgrounds, in order to test for these performance changes and to explore whether they reflect changes in salience from adaptation vs. changes in search strategies or perceptual learning. The target was an ellipse of variable color presented at a random location on a dense background of ellipses. In one condition, the colors of the background varied along either the LvsM or SvsLM cardinal axes. Observers adapted by viewing a rapid succession of backgrounds drawn from one color axis, and then searched for a target on a background from the same or different color axis. Searches were monitored with a Cambridge Research Systems Video Eyetracker. Targets were located more quickly on the background axis that observers were pre-exposed to, confirming that this exposure can improve search efficiency for stimuli that differ from the background. However, eye movement patterns (e.g. fixation durations and saccade magnitudes) did not clearly differ across the two backgrounds, suggesting that how the novel and familiar backgrounds were sampled remained similar. In a second condition, we compared search on a nonselective color background drawn from a circle of hues at fixed contrast. Prior exposure to this background did not facilitate search compared to an achromatic adapting field, suggesting that subjects were not simply learning the specific colors defining the background distributions. Instead, results for both conditions are consistent with a selective adaptation effect that enhances the salience of novel stimuli by partially discounting the background.

The perceptual balance of color

The cone contrasts carrying different dimensions of color vision vary greatly in magnitude, yet the perceived contrast of color and luminance in the world appears similar. We examined how this perceptual balance is adjusted by adaptation to the contrast in images. Observers set the level of L vs. M and S vs. LM contrast in 1/f noise images to match the perceived strength of a fixed level of luminance contrast. The perceptual balance of color in the images was roughly consistent with the range of contrast characteristic of natural images. Relative perceived contrast could be strongly biased by brief prior exposure to images with lower or higher levels of chromatic contrast. Similar adaptation effects were found for luminance contrast in images of natural scenes. For both, observers reliably chose the contrast balance that appeared correct, and these choices were rapidly recalibrated by adaptation. This recalibration of the norm for contrast could reflect both changes in sensitivity and shifts in criterion. Our results are consistent with the possibility that color mechanisms adjust the range of their responses to match the range of signals in the environment, and that contrast adaptation plays an important role in these adjustments.

Tests of a functional account of the Abney effect

The Abney effect refers to changes in the hue of lights as they are desaturated. Normally the purity is varied by desaturating with a fixed spectrum. Mizokami et al. [J. Vis.6, 996 (2006)] instead varied purity by using Gaussian spectra and increasing their bandwidth. Under these conditions the hues of lights at short and medium wavelengths tended to remain constant and thus were tied to a fixed property of the stimulus such as the spectral peak, possibly reflecting a compensation for the spectral filtering effects of the eye. Here we test this account more completely by comparing constant hue loci across a wide range of wavelengths and between the fovea and periphery. Purity was varied by adding either a fixed spectrum or by varying the spectral bandwidth, using an Agile Light Source capable of generating arbitrary spectra. For both types of spectra, hue loci were approximated by the Gaussian model at short and medium wavelengths, though the model failed to predict the precise form of the hue changes or the differences between the fovea and periphery. Our results suggest that a Gaussian model provides a useful heuristic for predicting constant hue loci and the form of the Abney effect at short and medium wavelengths and may approximate the inferences underlying the representation of hue in the visual system.

Contrast adaptation reveals increased organizational complexity of chromatic processing in the visual evoked potential

Results from psychophysics and single-unit recordings suggest that color vision comprises multiple stages of processing. Postreceptoral channels appear to consist of both a stage of broadly tuned opponent channels that compare cone signals and a subsequent stage, which includes cells tuned to many different directions in color space. The chromatic visual evoked potential (crVEP) has demonstrated chromatic processing selective for cardinal axes of color space. However, crVEP evidence for higher-order color mechanisms is lacking. The present study aimed to assess the contribution of lower- and higher-order color mechanisms to the crVEP by using chromatic contrast adaptation. The results reveal the presence of mechanisms tuned to intermediate directions in color space in addition to those tuned to the fundamental cardinal axes.