Karl R. Gegenfurtner

Grasping Visual Illusions: No Evidence for a Dissociation Between Perception and Action

Neuropsychological studies prompted the theory that the primate visual system might be organized into two parallel pathways, one for conscious perception and one for guiding action. Supporting evidence in healthy subjects seemed to come from a dissociation in visual illusions: In previous studies, the Ebbinghaus (or Titchener) illusion deceived perceptual judgments of size, but only marginally influenced the size estimates used in grasping. Contrary to those results, the findings from the present study show that there is no difference in the sizes of the perceptual and grasp illusions if the perceptual and grasping tasks are appropriately matched. We show that the differences found previously can be accounted for by a hitherto unknown, nonadditive effect in the illusion. We conclude that the illusion does not provide evidence for the existence of two distinct pathways for perception and action in the visual system.

Sensory and cognitive contributions of color to the recognition of natural scenes

Although color plays a prominent part in our subjective experience of the visual world, the evolutionary advantage of color vision is still unclear [1] [2], with most current answers pointing towards specialized uses, for example to detect ripe fruit amongst foliage [3] [4] [5] [6]. We investigated whether color has a more general role in visual recognition by looking at the contribution of color to the encoding and retrieval processes involved in pattern recognition [7] [8] [9]. Recognition accuracy was higher for color images of natural scenes than for luminance-matched black and white images, and color information contributed to both components of the recognition process. Initially, color leads to an image-coding advantage at the very early stages of sensory processing, most probably by easing the image-segmentation task. Later, color leads to an advantage in retrieval, presumably as the result of an enhanced image representation in memory due to the additional attribute. Our results ascribe color vision a general role in the processing of visual form, starting at the very earliest stages of analysis: color helps us to recognize things faster and to remember them better.

Processing of color, form, and motion in macaque area V2

We investigated the representation of color in cortical area V2 of macaque monkeys, and the association of color with other stimulus attributes. We measured the selectivity of individual V2 neurons for color, motion, and form. Most neurons in V2 were orientation selective, about half of them were selective for color, and a minority of cells (about 20%) were selective for size or direction. We correlated these physiological measurements with the anatomical location of the cells with respect to the cytochrome oxidase (CO) compartments of area V2. There was a tendency for color-selective cells to be found more frequently in the thin stripes, but color-selective cells also occurred frequently in thick stripes and inter-stripes. We found no difference in the degree of color selectivity between the different CO compartments. Furthermore, there was no negative correlation between color selectivity and selectivity for other stimulus attributes. We found many cells capable of encoding information along more than one stimulus dimension, regardless of their location with respect to the CO compartments. We suggest that area V2 plays an important role in integrating information about color, motion, and form. By this integration of stimulus attributes a cue invariant representation of the visual world might be achieved.

Color discrimination and adaptation

We have measured color discrimination in the isoluminant plane under rigorously controlled adaptation conditions. Two regimes were studied. Under the first regime the observer was adapted to the region of color space in which the discriminations were made. Thresholds for detecting changes along the S-(L + M) axis are a linearly increasing function of the excitation of the S cones. Thresholds for detecting changes along the L-M axis are independent of the locus of adaptation along this axis. The straightness of these functions is inconsistent with the theory that second stage mechanisms are more sensitive in the middle of their operating ranges. No convincing evidence of interactions in the effects of adaptation locus or test stimuli was observed. Under the second regime the observer was adapted to one point in color space and the stimuli to be discriminated were located in other places in color space. Discrimination seems to be limited primarily by mechanisms maximally sensitive to modulation along the isoluminant cardinal axes but evidence suggestive of the operation of higher order mechanisms was also found.

Eye movements and perception: A selective review

Eye movements are an integral and essential part of our human foveated vision system. Here, we review recent work on voluntary eye movements, with an emphasis on the last decade. More selectively, we address two of the most important questions about saccadic and smooth pursuit eye movements in natural vision. First, why do we saccade to where we do? We argue that, like for many other aspects of vision, several different circuits related to salience, object recognition, actions, and value ultimately interact to determine gaze behavior. Second, how are pursuit eye movements and perceptual experience of visual motion related? We show that motion perception and pursuit have a lot in common, but they also have separate noise sources that can lead to dissociations between them. We emphasize the point that pursuit actively modulates visual perception and that it can provide valuable information for motion perception.

Effects of visual illusions on grasping.

In 2 experiments, the Muller-Lyer illusion (F. C. Muller-Lyer, 1889; N = 16) and the parallel-lines illusion (W. Wundt, 1898; N = 26) clearly affected maximum preshape aperture in grasping (both ps < .001). The grasping effects were similar but not perfectly equal to the perceptual effects. Control experiments show that these differences can be attributed to problems in matching the perceptual task and the grasping task. A model is described stating the assumptions that are needed to compare the grasping effects and the perceptual effects of visual illusions. Further studies on the relationship between perception and grasping are reviewed. These studies provide no clear evidence for a dissociation between perception and grasping and therefore do not support the action versus perception hypothesis (A. D. Milner & M. A. Goodale, 1995).

Interaction of motion and color in the visual pathways

In recent years the idea of parallel and independent processing streams for different visual attributes has become a guiding principle for linking the organization, architecture and function of the visual system. Findings concerning the segregation of motion and color information have been at the forefront of the evidence in favor of the parallel processing scheme. A number of studies have shown that motion perception is impaired for isoluminant stimuli, which are thought to isolate the color system. However, there are now many studies, the results of which are incompatible with the simple idea of segregated pathways. We propose two processing streams for motion that differ mostly in their temporal characteristics. Although neither of the two motion streams is color-blind, as was originally suggested, they differ radically in the way they process color information. The view that we propose provides a framework that reconciles a number of seemingly contradictory results. Evidence to support the new framework comes from psychophysical, physiological and lesion studies.

The Contributions of Color to Recognition Memory for Natural Scenes

The authors used a recognition memory paradigm to assess the influence of color information on visual memory for images of natural scenes. Subjects performed 5%-10% better for colored than for black-and-white images independent of exposure duration. Experiment 2 indicated little influence of contrast once the images were suprathreshold, and Experiment 3 revealed that performance worsened when images were presented in color and tested in black and white, or vice versa, leading to the conclusion that the surface property color is part of the memory representation. Experiments 4 and 5 exclude the possibility that the superior recognition memory for colored images results solely from attentional factors or saliency. Finally, the recognition memory advantage disappears for falsely colored images of natural scenes: The improvement in recognition memory depends on the color congruence of presented images with learned knowledge about the color gamut found within natural scenes. The results can be accounted for within a multiple memory systems framework.

Contrast detection in luminance and chromatic noise

We measured detection thresholds for a vertically oriented 1.2-cycle-per-degree sine-wave grating embedded in spatiotemporal broadband noise. Noise and signal were modulated in different directions in color space around an equal-energy white point. When signal and noise were modulated in the same direction, we observed a linear relationship between noise spectral density and signal energy at threshold. The slope of this function was the same whether the modulation was along a luminance axis or a red-green axis. If the signal was on one axis and the noise was on the other, no masking was observed. These results support the notion of two independent and equally efficient mechanisms tuned to these directions. We then measured threshold elevations for masks with both chromatic and luminance components. When signal and noise were modulated along the same line (for example, bright red and dark green), thresholds were elevated. When we inverted the phase of the chromatic component of the noise relative to the luminance component (bright green and dark red), the masking effect disappeared, even though the amount of noise in the putative luminance and chromatic mechanisms was exactly the same as before. This implies that detection performance is limited by mechanisms sensitive to both luminance and chromatic contrast signals. We characterized these mechanisms by their spectral tuning curves.

Cortical mechanisms of colour vision

The perception of colour is a central component of primate vision. Colour facilitates object perception and recognition, and has an important role in scene segmentation and visual memory. Moreover, it provides an aesthetic component to visual experiences that is fundamental to our perception of the world. Despite the long history of colour vision studies, much has still to be learned about the physiological basis of colour perception. Recent advances in our understanding of the early processing in the retina and thalamus have enabled us to take a fresh look at cortical processing of colour. These studies are beginning to indicate that colour is processed not in isolation, but together with information about luminance and visual form, by the same neural circuits, to achieve a unitary and robust representation of the visual world.