Stephen Palmisano

Global-Perspective Jitter Improves Vection in Central Vision

Previous vection research has tended to minimise visual – vestibular conflict by using optic-flow patterns which simulate self-motions of constant velocity. Here, experiments are reported on the effect of adding ‘global-perspective jitter’ to these displays—simulating forward motion of the observer on a platform oscillating in horizontal and/or vertical dimensions. Unlike non-jittering displays, jittering displays produced a situation of sustained visual–vestibular conflict. Contrary to the prevailing notion that visual – vestibular conflict impairs vection, jittering optic flow was found to produce shorter vection onsets and longer vection durations than non-jittering optic flow for all of jitter magnitudes and temporal frequencies examined. On the basis of these findings, it would appear that purely radial patterns of optic flow are not the optimal inducing stimuli for vection. Rather, flow patterns which contain both regular and random-oscillating components appear to produce the most compelling subjective experiences of self-motion.

Perceiving self-motion in depth: the role of stereoscopic motion and changing-size cues

During self-motions, different patterns of optic flow are presented to the left and right eyes. Previous research has, however, focused mainly on the self-motion information contained in a single pattern of optic flow. The present experiments investigated the role that binocular disparity plays in the visual perception of self-motion, showing that the addition of stereoscopic cues to optic flow significantly improves forward linear vection in central vision. Improvements were also achieved by adding changingsize cues to sparse (but not dense) flow patterns. These findings showed that assumptions in the heading literature that stereoscopic cues facilitate self-motion only when the optic flow has ambiguous depth ordering do not apply to vection. Rather, it was concluded that both stereoscopic and changingsize cues provide additional motion-in-depth information that is used in perceiving self-motion.

Jitter and size effects on vection are immune to experimental instructions and demands.

Both coherent perspective jitter and explicit changing-size cues have been shown to improve the vection induced by radially expanding optic flow. We examined whether these stimulus-based vection advantages could be modified by altering cognitions and/or expectations about both the likelihood of self-motion perception and the purpose of the experiment. In the main experiment, participants were randomly assigned into two groups—one where the cognitive conditions biased participants towards self-motion perception and another where the cognitive conditions biased them towards object-motion perception. Contrary to earlier findings by Lepecq et al (1995 Perception 24 435–449), we found that identical visual displays were less likely to induce vection in ‘object-motion-bias’ conditions than in ‘self-motion bias’ conditions. However, significant jitter and size advantages for vection were still found in both cognitive conditions (cognitive bias effects were greatest for non-jittering same-size control displays). The current results suggest that if a sufficiently large vection advantage can be produced when participants are expecting to experience self-motion, it is likely to persist in object-motion-bias conditions.

Consistent stereoscopic information increases the perceived speed of vection in depth

Previous research found that adding stereoscopic information to radially expanding optic flow decreased vection onsets and increased vection durations (Palmisano, 1996 Perception & Psychophysics 58 1168–1176). In the current experiments, stereoscopic cues were also found to increase perceptions of vection speed and self-displacement during vection in depth—but only when these cues were consistent with monocularly available information about self-motion. Stereoscopic information did not appear to be improving vection by increasing the perceived maximum extent of displays or by making displays appear more three-dimensional. Rather, it appeared that consistent patterns of stereoscopic optic flow provided extra, purely binocular information about vection speed, which resulted in faster/more compelling illusions of self-motion in depth.

Simulated viewpoint jitter shakes sensory conflict accounts of vection.

Sensory conflict has been used to explain the way we perceive and control our self-motion, as well as the aetiology of motion sickness. However, recent research on simulated viewpoint jitter provides a strong challenge to one core prediction of these theories -- that increasing sensory conflict should always impair visually induced illusions of self-motion (known as vection). These studies show that jittering self-motion displays (thought to generate significant and sustained visual-vestibular conflict) actually induce superior vection to comparable non-jittering displays (thought to generate only minimal/transient sensory conflict). Here we review viewpoint jitter effects on vection, postural sway, eye-movements and motion sickness, and relate them to recent behavioural and neurophysiological findings. It is shown that jitter research provides important insights into the role that sensory interaction plays in self-motion perception.

Coherent Perspective Jitter Induces Visual Illusions of Self-Motion:

Palmisano et al (2000 Perception 29 57–67) found that adding coherent perspective jitter to constant-velocity radial flow improved visually induced illusions of self-motion (vection). This was a surprising finding, because unlike pure radial flow, this jittering radial flow should have generated sustained visual–vestibular conflicts—previously thought to always reduce/impair vection. We attempted to ascertain the essential stimulus features for this jitter advantage for vection by examining three novel types of jitter display. While adding incoherent jitter to radial flow was found to impair vection, adding coherent non-perspective jitter had little effect on this subjective experience (contrary to the notion that jitter improves vection by reducing adaptation to radial flow). Importantly, we found that coherent perspective jitter not only improves the vection induced by radial flow, but it also appears to induce modest vection by itself (demonstrating that vection can still occur when there is an extreme mismatch between actual and expected vestibular activity). These results suggest that the previously demonstrated advantage for coherent perspective jitter was due (in part at least) to jittering vection combining with forwards vection in depth to produce a more compelling overall vection experience.

Stereoscopic perception of real depths at large distances

There has been no direct examination of stereoscopic depth perception at very large observation distances and depths. We measured perceptions of depth magnitude at distances where it is frequently reported without evidence that stereopsis is non-functional. We adapted methods pioneered at distances up to 9 m by R. S. Allison, B. J. Gillam, and E. Vecellio (2009) for use in a 381-m-long railway tunnel. Pairs of Light Emitting Diode (LED) targets were presented either in complete darkness or with the environment lit as far as the nearest LED (the observation distance). We found that binocular, but not monocular, estimates of the depth between pairs of LEDs increased with their physical depths up to the maximum depth separation tested (248 m). Binocular estimates of depth were much larger with a lit foreground than in darkness and increased as the observation distance increased from 20 to 40 m, indicating that binocular disparity can be scaled for much larger distances than previously realized. Since these observation distances were well beyond the range of vertical disparity and oculomotor cues, this scaling must rely on perspective cues. We also ran control experiments at smaller distances, which showed that estimates of depth and distance correlate poorly and that our metric estimation method gives similar results to a comparison method under the same conditions.

Accelerating self-motion displays produce more compelling vection in depth.

We examined the vection in depth induced when simulated random self-accelerations (jitter) and periodic self-accelerations (oscillation) were added to radial expanding optic flow (simulating constant-velocity forward self-motion). Contrary to the predictions of sensory-conflict theory frontal-plane jitter and oscillation were both found to significantly decrease the onsets and increase the speeds of vection in depth. Depth jitter and oscillation had lesser, but still significant, effects on the speed of vection in depth. A control experiment demonstrated that adding global perspective motion which simulated a constant-velocity frontal-plane self-motion had no significant effect on vection in depth induced by the radial component of the optic flow. These results are incompatible with the notion that constant-velocity displays produce optimal vection. Rather, they indicate that displays simulating self-acceleration can often produce more compelling experiences of self-motion in depth.

Stimulus eccentricity and spatial frequency interact to determine circular vection

While early research suggested that peripheral vision dominates the perception of self-motion, subsequent studies found little or no effect of stimulus eccentricity. In contradiction to these broad notions of ‘peripheral dominance’ and ‘eccentricity independence’, the present experiments showed that the spatial frequency of optic flow interacts with its eccentricity to determine circular vection magnitude—central stimulation producing the most compelling vection for high-spatial-frequency stimuli and peripheral stimulation producing the most compelling vection for lower-spatial-frequency stimuli. This interaction appeared to be due, in part at least, to the effect that the higher-spatial-frequency moving pattern had on subjects’ ability to organise optic flow into related motion about a single axis. For example, far-peripheral exposure to this high-spatial-frequency pattern caused many subjects to organise the optic flow into independent local regions of motion (a situation which clearly favoured the perception of object motion not self-motion). It is concluded that both high-spatial-frequency and low-spatial-frequency mechanisms are involved in the visual perception of self-motion—with their activities depending on the nature and eccentricity of the motion stimulation.

Future challenges for vection research: definitions, functional significance, measures, and neural bases.

This paper discusses four major challenges facing modern vection research. Challenge 1 (Defining Vection) outlines the different ways that vection has been defined in the literature and discusses their theoretical and experimental ramifications. The term vection is most often used to refer to visual illusions of self-motion induced in stationary observers (by moving, or simulating the motion of, the surrounding environment). However, vection is increasingly being used to also refer to non-visual illusions of self-motion, visually mediated self-motion perceptions, and even general subjective experiences (i.e., “feelings”) of self-motion. The common thread in all of these definitions is the conscious subjective experience of self-motion. Thus, Challenge 2 (Significance of Vection) tackles the crucial issue of whether such conscious experiences actually serve functional roles during self-motion (e.g., in terms of controlling or guiding the self-motion). After more than 100 years of vection research there has been surprisingly little investigation into its functional significance. Challenge 3 (Vection Measures) discusses the difficulties with existing subjective self-report measures of vection (particularly in the context of contemporary research), and proposes several more objective measures of vection based on recent empirical findings. Finally, Challenge 4 (Neural Basis) reviews the recent neuroimaging literature examining the neural basis of vection and discusses the hurdles still facing these investigations.