Robert Ennis

Neural locus of color afterimages.

After fixating on a colored pattern, observers see a similar pattern in complementary colors when the stimulus is removed [1-6]. Afterimages were important in disproving the theory that visual rays emanate from the eye, in demonstrating interocular interactions, and in revealing the independence of binocular vision from eye movements. Afterimages also prove invaluable in exploring selective attention, filling in, and consciousness. Proposed physiological mechanisms for color afterimages range from bleaching of cone photopigments to cortical adaptation [4-9], but direct neural measurements have not been reported. We introduce a time-varying method for evoking afterimages, which provides precise measurements of adaptation and a direct link between visual percepts and neural responses [10]. We then use in vivo electrophysiological recordings to show that all three classes of primate retinal ganglion cells exhibit subtractive adaptation to prolonged stimuli, with much slower time constants than those expected of photoreceptors. At the cessation of the stimulus, ganglion cells generate rebound responses that can provide afterimage signals for later neurons. Our results indicate that afterimage signals are generated in the retina but may be modified like other retinal signals by cortical processes, so that evidence presented for cortical generation of color afterimages is explainable by spatiotemporal factors that modify all signals.

Transitions between Central and Peripheral Vision Create Spatial/Temporal Distortions: A Hypothesis Concerning the Perceived Break of the Curveball

Background The human visual system does not treat all parts of an image equally: the central segments of an image, which fall on the fovea, are processed with a higher resolution than the segments that fall in the visual periphery. Even though the differences between foveal and peripheral resolution are large, these differences do not usually disrupt our perception of seamless visual space. Here we examine a motion stimulus in which the shift from foveal to peripheral viewing creates a dramatic spatial/temporal discontinuity. Methodology/Principal Findings The stimulus consists of a descending disk (global motion) with an internal moving grating (local motion). When observers view the disk centrally, they perceive both global and local motion (i.e., observers see the disks vertical descent and the internal spinning). When observers view the disk peripherally, the internal portion appears stationary, and the disk appears to descend at an angle. The angle of perceived descent increases as the observer views the stimulus from further in the periphery. We examine the first- and second-order information content in the display with the use of a three-dimensional Fourier analysis and show how our results can be used to describe perceived spatial/temporal discontinuities in real-world situations. Conclusions/Significance The perceived shift of the disks direction in the periphery is consistent with a model in which foveal processing separates first- and second-order motion information while peripheral processing integrates first- and second-order motion information. We argue that the perceived distortion may influence real-world visual observations. To this end, we present a hypothesis and analysis of the perception of the curveball and rising fastball in the sport of baseball. The curveball is a physically measurable phenomenon: the imbalance of forces created by the balls spin causes the ball to deviate from a straight line and to follow a smooth parabolic path. However, the curveball is also a perceptual puzzle because batters often report that the flight of the ball undergoes a dramatic and nearly discontinuous shift in position as the ball nears home plate. We suggest that the perception of a discontinuous shift in position results from differences between foveal and peripheral processing.

Eye Movements and the Neural Basis of Context Effects on Visual Sensitivity

The effects of context on visual sensitivity are well established (e.g., sensitivity to luminance flicker is substantially higher on mean-gray surrounds than on white or black surrounds). The neural mechanisms generating context effects, however, remain unresolved. In the absence of direct tests, some theories invoke enhancement of edges by lateral inhibition, whereas others rely on transients caused by miniature eye movements that maintain fixation. We first replicated the luminance results on human observers and found unexpectedly that sensitivity to red-green flicker is also affected by surround color, being substantially higher on mean-gray surrounds than on red or green surrounds. To identify the neural bases of both context effects, we used in vivo electrophysiological recordings of primate magnocellular and parvocellular ganglion cell responses to luminance and red-green modulations, respectively. To test neuronal sensitivity to stationary edge contrast, neuronal responses were measured at various distances from the modulation edge against various surrounds. We found no evidence of enhanced responses to stationary edges on any surrounds, ruling out lateral inhibition-type explanations. To simulate the effects of eye movements, target patches were abruptly displaced while measuring responses. Abruptly displaced edges evoked vigorous transient responses that were selective for modulation-phase on mean-gray surrounds, but were phase-invariant on other surrounds. Eye movements could thus enhance detection of flicker on mean-gray surrounds, and neurometric analyses supported a primary role for eye movements in enhancing sensitivity. In addition, the transformation of spatial edges to transient neuronal responses by eye movements provides the signals for detecting luminance and color edges in natural scenes.

Retinal adaptation abnormalities in primary open-angle glaucoma.

PURPOSE Dynamic color and brightness adaptation are crucial for visual functioning. The effects of glaucoma on retinal ganglion cells (RGCs) could compromise these functions. We have previously used slow dynamic changes of light at moderate intensities to measure the speed and magnitude of subtractive adaptation in RGCs. We used the same procedure to test if RGC abnormalities cause slower and weaker adaptation for patients with glaucoma when compared to age-similar controls. We assessed adaptation deficits in specific classes of RGCs by testing along the three cardinal color axes that isolate konio, parvo, and magno RGCs. METHODS For one eye each of 10 primary open-angle glaucoma patients and their age-similar controls, we measured the speed and magnitude of adapting to 1/32 Hz color modulations along the three cardinal axes, at central fixation and 8° superior, inferior, nasal, and temporal to fixation. RESULTS In all 15 comparisons (5 locations × 3 color axes), average adaptation was slower and weaker for glaucoma patients than for controls. Adaptation developed slower at central targets than at 8° eccentricities for controls, but not for patients. Adaptation speed and magnitude differed between affected and control eyes even at retinal locations showing no visual field loss with clinical perimetry. CONCLUSIONS Neural adaptation is weaker in glaucoma patients for all three classes of RGCs. Since adaptation abnormalities are manifested even at retinal locations not exhibiting a visual field loss, this novel form of assessment may offer a functional insight into glaucoma and an early diagnosis tool.

Geometrical structure of perceptual color space: mental representations and adaptation invariance

A central issue in neuroscience is to understand how the brain builds structured representations of percepts that facilitate useful inferences about the world. Similarity between percepts is used to accomplish many everyday tasks, e.g. object identification, so is widely used to construct geometrical spaces that represent stimulus qualities, but the intrinsic validity of the geometry is not tested critically. We introduce an experimental approach to equating relative similarities by setting perceived midpoints between pairs of stimuli. Midpoint settings are used with Varignon’s Theorem to test the intrinsic geometry of a representation space, and its mapping to a physical space of stimuli. For perceptual color space, we demonstrate that geometrical structure depends on the mental representation used in judging similarity: an affine geometry is valid only when observers use an opponent-color mental representation. An affine geometry implies that similarity can be judged within straight lines and across parallel lines, and its neural coding could involve ratios of responses. We show that this perceptual space is invariant to changes in illumination color, providing a formal justification to generalize to all of color space, color constancy results measured for color categories. Our midpoint measurements deviate significantly from midpoints in the “uniform” color spaces CIELAB and CIELUV, used extensively in industry and research, so these spaces do not provide adequate metric representation of perceived colors. Our paradigm can thus test for intrinsic geometrical assumptions underlying the representation space for many perceptual modalities, and for the extrinsic perceptual geometry of the space of physical stimuli. Significance Mathematical spaces based on similarity judgments are widely used to represent stimulus qualities in perception, cognition and neuroscience. We introduce a perceptual approach to equate relative similarities, and use them to test the geometry of a perceptual space and its mapping to a physical space of stimuli. For color perception, our results show that perceptual geometry depends on the mental representation used in judging similarity, and it has an affine structure when observers use an opponent-color representation. An affine geometry implies that neural coding of similarity could involve simple ratios of responses. Our measurements also reveal that the uniform color spaces CIELAB and CIELUV, used extensively in industrial applications, do not provide adequate representation of similarity between moderately spaced colors.