Georgios K. Kountouriotis

Using vision to control locomotion: looking where you want to go.

Looking at the inside edge of the road when steering a bend seems to be a well-established strategy linked to using a feature called the tangent point. An alternative proposal suggests that the gaze patterns observed when steering result from looking at the points in the world through which one wishes to pass. In this explanation fixation on or near the tangent point results from trying to take a trajectory that cuts the corner. To test these accounts, we recorded gaze and steering when taking different paths along curved roadways. Participants could gauge and maintain their lateral distance, but crucially, gaze was predominantly directed to the region proximal to the desired path rather than toward the tangent point per se. These results show that successful control of high-speed locomotion requires fixations in the direction you want to steer rather than using a single road feature like the tangent point.

The role of gaze and road edge information during high-speed locomotion.

Robust control of skilled actions requires the flexible combination of multiple sources of information. Here we examined the role of gaze during high-speed locomotor steering and in particular the role of feedback from the visible road edges. Participants were required to maintain one of three lateral positions on the road when one or both edges were degraded (either by fading or removing them). Steering became increasingly impaired as road edge information was degraded, with gaze being predominantly directed toward the required road position. When either of the road edges were removed, we observed systematic shifts in steering and gaze direction dependent upon both the required road position and the visible edge. A second experiment required fixation on the road center or beyond the road edges. The results showed that the direction of gaze led to predictable steering biases, which increased as road edge information became degraded. A new steering model demonstrates that the direction of gaze and both road edges influence steering in a manner consistent with the flexible weighted combination of near road feedback information and prospective gaze information.

Optic flow asymmetries bias high-speed steering along roads.

How do animals and insects use visual information to move through the world successfully? Optic flow, the pattern of motion at the eye, is a powerful source of information about self-motion. Insects and humans are sensitive to the global pattern of optic flow and try to maintain flow symmetry when flying or walking. The environments humans encounter, however, often contain demarcated paths that constrain future trajectories (e.g., roads), and steering has been successfully modeled using only road edge information. Here we examine whether flow asymmetries from a textured ground plane influences humans steering along demarcated paths. Using a virtual reality simulator we observed that different textures on either side of the path caused predictable biases to steering trajectories, consistent with participants reducing flow asymmetries. We also generated conditions where one textured region had no flow (either the texture was removed or the textured region was static). Despite the presence of visible path information, participants were biased toward the no-flow region consistent with reducing flow asymmetries. We conclude that optic flow asymmetries can lead to biased locomotor steering even when traveling along demarcated paths.

Leading to distraction: Driver distraction, lead car, and road environment.

Driver distraction is strongly associated with crashes and near-misses, and despite the attention this topic has received in recent years, the effect of different types of distracting task on driving performance remains unclear. In the case of non-visual distractions, such as talking on the phone or other engaging verbal tasks that do not require a visual input, a common finding is reduced lateral variability in steering and gaze patterns where participants concentrate their gaze towards the centre of the road and their steering control is less variable. In the experiments presented here, we examined whether this finding is more pronounced in the presence of a lead car (which may provide a focus point for gaze) and whether the behaviour of the lead car has any influence on the drivers steering control. In addition, both visual and non-visual distraction tasks were used, and their effect on different road environments (straight and curved roadways) was assessed. Visual distraction was found to increase variability in both gaze patterns and steering control, non-visual distraction reduced gaze and steering variability in conditions without a lead car; in the conditions where a lead car was present there was no significant difference from baseline. The lateral behaviour of the lead car did not have an effect on steering performance, a finding which indicates that a lead car may not necessarily be used as an information point. Finally, the effects of driver distraction were different for straight and curved roadways, indicating a stronger influence of the road environment in steering than previously thought.

The need for speed: global optic flow speed influences steering

How do animals follow demarcated paths? Different species are sensitive to optic flow and one control solution is to maintain the balance of flow symmetry across visual fields; however, it is unclear whether animals are sensitive to changes in asymmetries when steering along curved paths. Flow asymmetries can alter the global properties of flow (i.e. flow speed) which may also influence steering control. We tested humans steering curved paths in a virtual environment. The scene was manipulated so that the ground plane to either side of the demarcated path produced larger or smaller asymmetries in optic flow. Independent of asymmetries and the locomotor speed, the scene properties were altered to produce either faster or slower globally averaged flow speeds. Results showed that rather than being influenced by changes in flow asymmetry, steering responded to global flow speed. We conclude that the human brain performs global averaging of flow speed from across the scene and uses this signal as an input for steering control. This finding is surprising since the demarcated path provided sufficient information to steer, whereas global flow speed (by itself) did not. To explain these findings, existing models of steering must be modified to include a new perceptual variable: namely global optic flow speed.

Driving with homonymous visual field loss: Does visual search performance predict hazard detection?

Introduction Stroke often causes homonymous visual field loss, which can lead to exclusion from driving. Retention of a driving licence is sometimes possible by completing an on-road assessment, but this is not practical for all. It is important to find simple tests that can inform the assessment and rehabilitation of driving-related visual-motor function. Method We developed novel computerised assessments: visual search; simple reaction and decision reaction to appearing pedestrians; and pedestrian detection during simulated driving. We tested 12 patients with stroke (seven left, five right field loss) and 12 controls. Results The homonymous visual field defect group was split into adequately compensated or inadequately compensated groups based on visual search performance. The inadequately compensated group had problems with stimuli in their affected field: they tended to react more slowly than controls and in the driving task they failed to detect a number of pedestrians. In contrast, the adequately compensated group were better at detecting pedestrians, though reaction times were slightly slower than controls. Conclusion We suggest that our search task can predict, to a limited extent, whether a person with stroke compensates for visual field loss, and may potentially identify suitability for specific rehabilitation to promote return to driving.

Affine operations plus symmetry yield perception of metric shape with large perspective changes (≥ 45°): data and model.

G. P. Bingham and M. Lind (2008, Large continuous perspective transformations are necessary and sufficient for accurate perception of metric shape, Perception & Psychophysics, Vol. 70, pp. 524-540) showed that observers could perceive metric shape, given perspective changes ≥ 45° relative to a principal axis of elliptical cylinders. In this article, we tested (a) arbitrary perspective changes of 45°, (b) whether perception gradually improves with more perspective change, (c) speed of rotation, (d) whether this works with other shapes (asymmetric polyhedrons), (e) different slants, and (f) perspective changes >45°. Experiment 1 compared 45° perspective change away from, versus centered on, a principal axis. Observers adjusted an ellipse to match the cross-section of an elliptical cylinder viewed in a stereo-motion display. Experiment 2 tested whether performance would improve gradually with increases in perspective change, or suddenly with a 45° change. We also tested speed of rotation. Experiment 3 tested (a) asymmetric polyhedrons, (b) perspective change beyond 45°, and (c) the effect of slant. The results showed (a) a particular perspective was not required, (b) judgments only improved with ≥ 45° change, (c) speed was not relevant, (d) it worked with asymmetric polyhedrons, (e) slant was not relevant, and (f) judgments remained accurate beyond 45° of change. A model shows how affine operations, together with a symmetry yielded by 45° perspective change, bootstrap perception of metric shape.

Displaying optic flow to simulate locomotion: Comparing heading and steering

Optic flow can be used by humans to determine their direction of heading as well as controlling steering. Dot-flow displays have been widely used to investigate these abilities but it is unclear whether photorealistic textures would provide better information for controlling high-speed steering. Here, we examine the accuracy of heading judgements from dot-flow displays of different densities and luminance and then compare to a scene containing a textured ground. We then examine steering behaviour using these same displays to determine whether accurate heading conditions necessarily equate to successful steering. Our findings suggest that the bright dense dot-flow displays led to equivalent performance as the ground texture when judging heading, and this was also true when steering. The intermediate dot-flow conditions (with fewer and faded dots) revealed that some conditions that led to accurate heading judgements were insufficient for accurate steering. It seems, therefore, that heading perception should not be considered synonymous with successful steering control, and displays that support one ability will not necessarily support the other.

Metacognitive judgements of perceptual-motor steering performance

Control of skilled actions requires rapid information sampling and processing, which may largely be carried out subconsciously. However, individuals often need to make conscious strategic decisions that ideally would be based upon accurate knowledge of performance. Here, we determined the extent to which individuals have explicit awareness of their steering performance (conceptualised as “metacognition”). Participants steered in a virtual environment along a bending road while attempting to keep within a central demarcated target zone. Task demands were altered by manipulating locomotor speed (fast/slow) and the target zone (narrow/wide). All participants received continuous visual feedback about position in zone, and one sub-group was given additional auditory warnings when exiting/entering the zone. At the end of each trial, participants made a metacognitive evaluation: the proportion of the trial they believed was spent in the zone. Overall, although evaluations broadly shifted in line with task demands, participants showed limited calibration to performance. Regression analysis showed that evaluations were influenced by two components: (a) direct monitoring of performance and (b) indirect task heuristics estimating performance based on salient cues (e.g., speed). Evaluations often weighted indirect task heuristics inappropriately, but the additional auditory feedback improved evaluations seemingly by reducing this weighting. These results have important implications for all motor tasks where conscious cognitive control can be used to influence action selection.

Binocular Perception of 2D Lateral Motion and Guidance of Coordinated Motor Behavior.

Zannoli, Cass, Alais, and Mamassian (2012) found greater audiovisual lag between a tone and disparity-defined stimuli moving laterally (90–170 ms) than for disparity-defined stimuli moving in depth or luminance-defined stimuli moving laterally or in depth (50–60 ms). We tested if this increased lag presents an impediment to visually guided coordination with laterally moving objects. Participants used a joystick to move a virtual object in several constant relative phases with a laterally oscillating stimulus. Both the participant-controlled object and the target object were presented using a disparity-defined display that yielded information through changes in disparity over time (CDOT) or using a luminance-defined display that additionally provided information through monocular motion and interocular velocity differences (IOVD). Performance was comparable for both disparity-defined and luminance-defined displays in all relative phases. This suggests that, despite lag, perception of lateral motion through CDOT is generally sufficient to guide coordinated motor behavior.