Jacques Droulez

Bayesian processing of vestibular information

Complex self-motion stimulations in the dark can be powerfully disorienting and can create illusory motion percepts. In the absence of visual cues, the brain has to use angular and linear acceleration information provided by the vestibular canals and the otoliths, respectively. However, these sensors are inaccurate and ambiguous. We propose that the brain processes these signals in a statistically optimal fashion, reproducing the rules of Bayesian inference. We also suggest that this processing is related to the statistics of natural head movements. This would create a perceptual bias in favour of low velocity and acceleration. We have constructed a Bayesian model of self-motion perception based on these assumptions. Using this model, we have simulated perceptual responses to centrifugation and off-vertical axis rotation and obtained close agreement with experimental findings. This demonstrates how Bayesian inference allows to make a quantitative link between sensor noise and ambiguities, statistics of head movement, and the perception of self-motion.

Does the brain use sliding variables for the control of movements

Abstract. Delays in the transmission of sensory and motor information prevent errors from being instantaneously available to the central nervous system (CNS) and can reduce the stability of a closed-loop control strategy. On the other hand, the use of a pure feedforward control (inverse dynamics) requires a perfect knowledge of the dynamic behavior of the body and of manipulated objects. Sensory feedback is essential both to accommodate unexpected errors and events and to compensate for uncertainties about the dynamics of the body. Experimental observations concerning the control of posture, gaze and limbs have shown that the CNS certainly uses a combination of closed-loop and open-loop control. Feedforward components of movement, such as eye saccades, occur intermittently and present a stereotyped kinematic profile. In visuo-manual tracking tasks, hand movements exhibit velocity peaks that occur intermittently. When a delay or a slow dynamics are inserted in the visuo-manual control loop, intermittent step-and-hold movements appear clearly in the hand trajectory. In this study, we investigated strategies used by human subjects involved in the control of a particular dynamic system. We found strong evidence for substantial nonlinearities in the commands produced. The presence of step-and-hold movements seemed to be the major source of nonlinearities in the control loop. Furthermore, the stereotyped ballistic-like kinematics of these rapid and corrective movements suggests that they were produced in an open-loop way by the CNS. We analyzed the generation of ballistic movements in the light of sliding control theory assuming that they occurred when a sliding variable exceeded a constant threshold. In this framework, a sliding variable is defined as a composite variable (a combination of the instantaneous tracking error and its temporal derivatives) that fulfills a specific stability criterion. Based on this hypothesis and on the assumption of a constant reaction time, the tracking error and its derivatives should be correlated at a particular time lag before movement onset. A peak of correlation was found for a physiologically plausible reaction time, corresponding to a stable composite variable. The direction and amplitude of the ongoing stereotyped movements seemed also be adjusted in order to minimize this variable. These findings suggest that, during visually guided movements, human subjects attempt to minimize such a composite variable and not the instantaneous error. This minimization seems to be obtained by the execution of stereotyped corrective movements.

Visuovestibular perception of self-motion modeled as a dynamic optimization process

Abstract. This article describes a computational model for the sensory perception of self-motion, considered as a compromise between sensory information and physical coherence constraints. This compromise is realized by a dynamic optimization process minimizing a set of cost functions. Measure constraints are expressed as quadratic errors between motion estimates and corresponding sensory signals, using internal models of sensor transfer functions. Coherence constraints are expressed as quadratic errors between motion estimates, and their prediction is based on internal models of the physical laws governing the corresponding physical stimuli. This general scheme leads to a straightforward representation of fundamental sensory interactions (fusion of visual and canal rotational inputs, identification of the gravity component from the otolithic input, otolithic contribution to the perception of rotations, and influence of vection on the subjective vertical). The model is tuned and assessed using a range of well-known psychophysical results, including off-vertical axis rotations and centrifuge experiments. The ability of the model to predict and help analyze new situations is illustrated by a study of the vestibular contributions to self-motion perception during automobile driving and during acceleration cueing in driving simulators. The extendable structure of the model allows for further developments and applications, by using other cost functions representing additional sensory interactions.

The influence of long-term practice on mental rotation of 3-D objects

We evaluated the influence of long-term practice on the performance of a mental rotation task in which subjects judged whether two 3-D objects presented in different orientations were identical. Stimuli and experimental conditions were analogous to those used by Shepard and Metzler. Sixteen subjects were selected, to test the influence of aptitude for mental imagery on this learning process. Subjects participated in 12 to 15 sessions over 6 weeks. Two catalogues of different stimuli were alternatively used during three (or six) consecutive sessions to determine the influence of complexity and familiarity of figures. For all subjects, the inverse of the velocity of mental rotation along the sessions was adequately fitted by a decreasing exponential curve. However, evidence for mental rotation did not disappear, even after 15 sessions. Asymptotic variations can be attributed to differences in stimuli as well as imaging skills of subjects. Our results lead to a new interpretation of the mental rotation process.

The stationarity hypothesis: an allocentric criterion in visual perception.

Having long considered that extraretinal information plays little or no role in spatial vision, the study of structure from motion (SfM) has confounded a moving observer perceiving a stationary object with a non-moving observer perceiving a rigid object undergoing equal and opposite motion. However, recently it has been shown that extraretinal information does play an important role in the extraction of structure from motion by enhancing motion cues for objects that are stationary in an allocentric, world-fixed reference frame (Nature 409 (2001) 85). Here, we test whether stationarity per se is a criterion in SfM by pitting it against rigidity. We have created stimuli that, for a moving observer, offer two interpretations: one that is rigid but non-stationary, another that is more stationary or less rigid. In two experiments, with subjects reporting either structure or motion, we show that stationary, non-rigid solutions are preferred over rigid, non-stationary solutions; and that when no perfectly stationary solutions is available, the visual system prefers the solution that is most stationary. These results demonstrate that allocentric criteria, derived from extra-retinal information, participate in reconstructing the visual scene.

The visual perception of three-dimensional shape from self-motion and object-motion

To evaluate the influence of egomotion on the three-dimensional visual processing of structure-from-motion (SFM), we compared the visual discrimination between planar and spherical surfaces during subject-translation, object-translation, or rotation of the object in depth. Performance was the best for object-rotation, intermediate for subject-translation, and the poorest for object-translation--and thus increased with the quality of retinal image stabilization achieved in the different conditions. This suggests that the major role of self-motion information was to stabilize retinal images. In view of previous results, we propose that the interactions between self-motion information and SFM are reduced to functional complementarity, in the sense that self-motion can lift visual ambiguities but does not improve the sensitivity of SFM processes.

Postural stability in primary open angle glaucoma.

Background:  This study evaluated the visual contribution to postural steadiness in primary open angle glaucoma (POAG), in correlation with the mean deviation (MD) measured through conventional perimetry, and with the Advanced Glaucoma Intervention Study (AGIS) score, which quantifies the extent of losses in the visual field.

Perception of plane orientation from self-generated and passively observed optic flow

We investigated the perception of three-dimensional plane orientation--focusing on the perception of tilt--from optic flow generated by the observers active movement around a simulated stationary object, and compared the performance to that of an immobile observer receiving a replay of the same optic flow. We found that perception of plane orientation is more precise in the active than in the immobile case. In particular, in the case of the immobile observer, the presence of shear in optic flow drastically diminishes the precision of tilt perception, whereas in the active observer, this decrease in performance is greatly reduced. The difference between active and immobile observers appears to be due to random rather than systematic errors. Furthermore, perceived slant is better correlated with simulated slant in the active observer. We conclude with a discussion of various theoretical explanations for our results.

Contribution of extraretinal signals to the scaling of object distance during self-motion.

We investigated the role of extraretinal information in the perception of absolute distance. In a computersimulated environment, monocular observers judged the distance of objects positioned at different locations in depth while performing frontoparallel movements of the head. The objects were spheres covered with random dots subtending three different visual angles. Observers viewed the objects at eye level, either in isolation or superimposed on a ground floor. The distance and size of the spheres were covaried to suppress relative size information. Hence, the main cues to distance were the motion parallax and the extraretinal signals. In three experiments, we found evidence that (1) perceived distance is correlated with simulated distance in terms of precision and accuracy, (2) the accuracy in the distance estimate is slightly improved by the presence of a ground-floor surface, (3) the perceived distance is not altered significantly when the visual field size increases, and (4) the absolute distance is estimated correctly during self-motion. Conversely, stationary subjects failed to report absolute distance when they passively observed a moving object producing the same retinal stimulation, unless they could rely on knowledge of the three-dimensional movements.

How does horizontal and vertical navigation influence spatial memory of multifloored environments

Although a number of studies have been devoted to 2-D navigation, relatively little is known about how the brain encodes and recalls navigation in complex multifloored environments. Previous studies have proposed that humans preferentially memorize buildings by a set of horizontal 2-D representations. Yet this might stem from the fact that environments were also explored by floors. Here, we have investigated the effect of spatial learning on memory of a virtual multifloored building. Two groups of 28 participants watched a computer movie that showed either a route along floors one at a time or travel between floors by simulated lifts, consisting in both cases of a 2-D trajectory in the vertical plane. To test recognition, the participants viewed a camera movement that either replicated a segment of the learning route (familiar segment) or did not (novel segment—i.e., shortcuts). Overall, floor recognition was not reliably superior to column recognition, but learning along a floor route produced a better spatial memory performance than did learning along a column route. Moreover, the participants processed familiar segments more accurately than novel ones, not only after floor learning, but crucially, also after column learning, suggesting a key role of the observation mode on the exploitation of spatial memory.