Mark F. Bradshaw

Vertical disparities, differential perspective and binocular stereopsis

TO calculate the depth difference between a pair of points on a three-dimensional surface from binocular disparities, it is necessary to know the absolute distance to the surface1,2. Traditionally, it has been assumed that this information is derived from non-visual sources such as the vergence angle of the eyes3,4. It has been shown5,6 that the horizontal gradient of vertical disparity between the images in the two eyes also contains information about the fixation distance7–9. Recent results10,11, however, indicated that manipulations of the vertical disparity gradient have no effect on either the perceived shape or the perceived depth of surfaces defined by horizontal disparities. Following the reasoning of Longuet-Higgins12 and Tyler13, we suggest that vertical disparities are best understood as a consequence of perspective viewing from two different vantage points and the results we report here show that the human visual system is able to exploit vertical disparities and use them to scale the perceived depth and size of stereoscopic surfaces, if the field of view is sufficiently large.

The Perception of Emotion from Body Movement in Point-Light Displays of Interpersonal Dialogue

We examined whether it is possible to identify the emotional content of behaviour from point-light displays where pairs of actors are engaged in interpersonal communication. These actors displayed a series of emotions, which included sadness, anger, joy, disgust, fear, and romantic love. In experiment 1, subjects viewed brief clips of these point-light displays presented the right way up and upside down. In experiment 2, the importance of the interaction between the two figures in the recognition of emotion was examined. Subjects were shown upright versions of (i) the original pairs (dyads), (ii) a single actor (monad), and (iii) a dyad comprising a single actor and his/her mirror image (reflected dyad). In each experiment, the subjects rated the emotional content of the displays by moving a slider along a horizontal scale. All of the emotions received a rating for every clip. In experiment 1, when the displays were upright, the correct emotions were identified in each case except disgust; but, when the displays were inverted, performance was significantly diminished for some emotions. In experiment 2, the recognition of love and joy was impaired by the absence of the acting partner, and the recognition of sadness, joy, and fear was impaired in the non-veridical (mirror image) displays. These findings both support and extend previous research by showing that biological motion is sufficient for the perception of emotion, although inversion affects performance. Moreover, emotion perception from biological motion can be affected by the veridical or non-veridical social context within the displays.

Disparity Scaling and the Perception of Frontoparallel Surfaces

Binocular disparity can be defined in a variety of ways and its measurement depends upon the particular coordinate framework chosen. As a result of the inverse square law, binocular disparities need to be scaled by some estimate of absolute distance if they are to be interpreted correctly. The experiments described in this paper investigated the extent to which (i) the vergence angle and (ii) the horizontal gradient of vertical disparities or ‘differential perspective’ provide the necessary information for judging that a stereoscopic surface is flat and frontoparallel. For small displays (<20 deg) vergence is more effective than differential perspective in scaling frontoparallel surfaces but for larger displays (>30 deg), differential perspective plays the major role. When both cues together specify the viewing distance, the constancy of frontoparallel-surface scaling is close to perfect for all sizes of display up to 80 deg. Analysis of the geometry of stereoscopic images shows that when a surface patch lies in a frontal plane, the binocular horizontal size ratio of any surface feature is equal to the square of its binocular vertical size ratio, whatever its distance from the observer.

The Effect of Display Size on Disparity Scaling from Differential Perspective and Vergence Cues

The present study compared the relative effectiveness of differential perspective and vergence angle manipulations in scaling depth from horizontal disparities. When differential perspective and vergence angle were manipulated together (to simulate a range of different viewing distances from 28 cm to infinity), approximately 35% of the scaling required for complete depth constancy was obtained. When manipulated separately the relative influence of each cue depended crucially on the size of the visual display. Differential perspective was only effective when the display size was sufficiently large (i.e., greater than 20 deg) whereas the influence of vergence angle, although evident at each display size, was greatest in the smaller displays. For each display size the independent effects of the two cues were approximately additive. Perceived size (and two-dimensional spacing of elements) was also affected by manipulations of differential perspective and vergence. These results confirm that both differential perspective and vergence are effective in scaling the perceived two-dimensional size of elements and the perceived depth from horizontal disparities. They also show that the effect of the two cues in combination is approximately equal to the sum of their individual effects.

The interaction of binocular disparity and motion parallax in the computation of depth.

Depth from binocular disparity and motion parallax has traditionally been assumed to be the product of separate and independent processes. We report two experiments which used classical psychophysical paradigms to test this assumption. The first tested whether there was an elevation in the thresholds for detecting the 3D structure of corrugated surfaces defined by either binocular disparity or motion parallax following prolonged viewing (adaptation) of supra-threshold surfaces defined by either the same or different cue (threshold elevation). The second experiment tested whether the depth detection thresholds for a compound stimulus, containing both binocular disparity and motion parallax, were lower than the thresholds determined for each of the components separately (sub-threshold summation). Experiment 1 showed a substantial amount of within- and between-cue threshold elevation and experiment 2 revealed the presence of sub-threshold summation. Together, these results support the view that the combination of binocular disparity and motion parallax information is not limited to a linear, weighted addition of their individual depth estimates but that the cues can interact non-linearly in the computation of depth.

Visual Processing and Dyslexia

Magnocellular-pathway deficits have been hypothesised to be responsible for the problems experienced by dyslexic individuals in reading. However, research has yet to provide a detailed account of the consequences of these deficits or to identify the behavioural link between them and reading disabilities. The aim of the present study was to determine the potential consequences of the magnocellular-pathway deficits for dyslexics in a comprehensive range of visual tasks. Dyslexics and nondyslexics were compared on their ability to (i) perform vernier-acuity and orientation-acuity tasks; (ii) perceive motion by using a range of measures common in the psychophysical literature (Dmin, Dmax, and global coherence); and (iii) perceive shapes presented in random-dot stereograms at a range of disparity pedestals, thereby dissociating stereopsis from vergence control. The results indicated no significant differences in performance between the dyslexic and nondyslexic subjects in terms of the visual-acuity measures. In general, dyslexics performed relatively poorly on measures of motion perception and stereopsis, although when considered individually some of the dyslexics performed better than some of the controls. The poor performance of the dyslexics in the stereogram tasks was attributable to a subgroup of dyslexics who also appeared to have severe difficulty with the motion-coherence task. These data are consistent with previous evidence that some dyslexics may have deficits within the magnocellular visual pathway.

The task-dependent use of binocular disparity and motion parallax information.

Binocular disparity and motion parallax are powerful cues to the relative depth between objects. However to recover absolute depth, either additional scaling parameters are required to calibrate the information provided by each cue, or it can be recovered through the combination of information from both cues (Richards, W. (1985). Structure from stereo and motion. Journal of the Optical Society of America, 2, 343-349). However, not all tasks necessarily require a full specification of the absolute depth structure of a scene and so psychophysical performance may vary depending on the amount of information available, and the degree to which absolute depth structure is required. The experiments reported here used three different tasks that varied in the type of geometric information required in order for them to be completed successfully. These included a depth nulling task, a depth-matching task, and an absolute depth judgement (shape) task. Real world stimuli were viewed (i) monocularly with head movements, (ii) binocularly and static, or (iii) binocularly with head movements. No effect of viewing condition was found whereas there was a large effect of task. Performance was accurate on the matching and nulling tasks and much less accurate on the shape task. The fact that the same perceptual distortions were not evident in all tasks suggests that the visual system can switch strategy according to the demands of the particular task. No evidence was found to suggest that the visual system could exploit the simultaneous presence of disparity and motion parallax.

The visual control of reaching and grasping: binocular disparity and motion parallax.

The primary visual sources of depth and size information are binocular cues and motion parallax. Here, the authors determine the efficacy of these cues to control prehension by presenting them in isolation from other visual cues. When only binocular cues were available, reaches showed normal scaling of the transport and grasp components with object distance and size. However, when only motion parallax was available, only the transport component scaled reliably. No additional increase in scaling was found when both cues were available simultaneously. Therefore, although equivalent information is available from binocular and motion parallax information, the latter may be of relatively limited use for the control of the grasp. Binocular disparity appears selectively important for the control of the grasp.

Sensitivity to horizontal and vertical corrugations defined by binocular disparity

Sensitivity to corrugations defined by binocular disparity differs as a function of the modulation frequency. Such functions have proved to be useful descriptive and analytical tools in the study of the mechanisms involved in disparity processing. Indeed, given certain assumptions, these sensitivity functions can be used to predict certain perceptual outcomes. Given their importance, it is surprising that there is no comprehensive data set of disparity sensitivity functions (DSF) for a range of observers over a broad range of spatial frequencies and orientations. Here we report DSFs for six observers over an eight octave range of sinusoidal corrugations in disparity (0.0125-3.2 cpd). Multi-cycle, low frequency surfaces were used to assess the degree to which the fall-off in sensitivity at low corrugation frequencies is attributable to the decreasing number of cycles displayed. The data was found to form a continuous function despite the different number of cycles displayed. We conclude that the fall off in sensitivity is due to the spatial interactions in disparity processing. We also determined DSFs for the same observers to both vertically and horizontally oriented sinusoidal disparity corrugations in order to characterise the extent of the stereoscopic anisotropy. In general, the best thresholds for detecting vertically oriented disparity corrugations were higher (approximately 4 arc sec) than for horizontally oriented corrugations (approximately 2 arc sec). Moreover, the functions were shifted toward the high spatial frequency end of the spectrum.

A dissociation of perception and action in normal human observers: the effect of temporal-delay.

Neuropsychological results support the proposal that the human visual system is organised into distinct processing pathways, one for conscious perception and one for the control of action. Here, we compare perceptual and action responses following a pre-response-delay. Experiment 1 required participants to reproduce remembered locations and found that although perceptual matches were unaffected by delays of up to 4 s, pointing responses were significantly biased after only 2 s. Experiment 2 examined whether both the transport and grasp components of a natural prehensile movement were similarly affected by delay. Both peak wrist velocities and peak grip-apertures were affected equivalently by delay, suggesting that the two components of a prehensile movement have similar temporal constraints. The results from both experiments are consistent with the general perception-action dichotomy as originally proposed by Milner and Goodale [The visual brain in action, Oxford: Oxford University Press, 1995].