Roland Kern

Neural encoding of behaviourally relevant visual-motion information in the fly

Information processing in visual systems is constrained by the spatial and temporal characteristics of the sensory input and by the biophysical properties of the neuronal circuits. Hence, to understand how visual systems encode behaviourally relevant information, we need to know about both the computational capabilities of the nervous system and the natural conditions under which animals normally operate. By combining behavioural, neurophysiological and computational approaches, it is now possible in the fly to assess adaptations that process visual-motion information under the constraints of its natural input. It is concluded that neuronal operating ranges and coding strategies appear to be closely matched to the inputs the animal encounters under behaviourally relevant conditions.

Function of a fly motion-sensitive neuron matches eye movements during free flight.

Sensing is often implicitly assumed to be the passive acquisition of information. However, part of the sensory information is generated actively when animals move. For instance, humans shift their gaze actively in a sequence of saccades towards interesting locations in a scene. Likewise, many insects shift their gaze by saccadic turns of body and head, keeping their gaze fixed between saccades. Here we employ a novel panoramic virtual reality stimulator and show that motion computation in a blowfly visual interneuron is tuned to make efficient use of the characteristic dynamics of retinal image flow. The neuron is able to extract information about the spatial layout of the environment by utilizing intervals of stable vision resulting from the saccadic viewing strategy. The extraction is possible because the retinal image flow evoked by translation, containing information about object distances, is confined to low frequencies. This flow component can be derived from the total optic flow between saccades because the residual intersaccadic head rotations are small and encoded at higher frequencies. Information about the spatial layout of the environment can thus be extracted by the neuron in a computationally parsimonious way. These results on neuronal function based on naturalistic, behaviourally generated optic flow are in stark contrast to conclusions based on conventional visual stimuli that the neuron primarily represents a detector for yaw rotations of the animal.

Vision in flying insects.

Vision guides flight behaviour in numerous insects. Despite their small brain, insects easily outperform current man-made autonomous vehicles in many respects. Examples are the virtuosic chasing manoeuvres male flies perform as part of their mating behaviour and the ability of bees to assess, on the basis of visual motion cues, the distance travelled in a novel environment. Analyses at both the behavioural and neuronal levels are beginning to unveil reasons for such extraordinary capabilities of insects. One recipe for their success is the adaptation of visual information processing to the specific requirements of the behavioural tasks and to the specific spatiotemporal properties of the natural input.

On the Computations Analyzing Natural Optic Flow: Quantitative Model Analysis of the Blowfly Motion Vision Pathway

For many animals, including humans, the optic flow generated on the eyes during locomotion is an important source of information about self-motion and the structure of the environment. The blowfly has been used frequently as a model system for experimental analysis of optic flow processing at the microcircuit level. Here, we describe a model of the computational mechanisms implemented by these circuits in the blowfly motion vision pathway. Although this model was originally proposed based on simple experimenter-designed stimuli, we show that it is also capable to quantitatively predict the responses to the complex dynamic stimuli a blowfly encounters in free flight. In particular, the model visual system exploits the active saccadic gaze and flight strategy of blowflies in a similar way, as does its neuronal counterpart. The model circuit extracts information about translation velocity in the intersaccadic intervals and thus, indirectly, about the three-dimensional layout of the environment. By stepwise dissection of the model circuit, we determine which of its components are essential for these remarkable features. When accounting for the responses to complex natural stimuli, the model is much more robust against parameter changes than when explaining the neuronal responses to simple experimenter-defined stimuli. In contrast to conclusions drawn from experiments with simple stimuli, optimization of the parameter set for different segments of natural optic flow stimuli do not indicate pronounced adaptational changes of these parameters during long-lasting stimulation.

Chasing a dummy target: smooth pursuit and velocity control in male blowflies

Male blowflies chase and catch other flies in fast acrobatic flights. To unravel the underlying control system, we presented a black moving sphere instead of a real fly as a pursuit target. By varying the size and speed of the target, we were able to systematically analyse the decisive visual determinants that guide chasing behaviour. Flies pursue targets of a wide range of sizes and velocities. The percentage of pursuits resulting in target capture decreases with increasing target size and speed. Chasing male flies adjust their forward velocity depending on the retinal size of the target, indicating that retinal size is a relevant input variable of the control system. The chasing fly focuses the target with great accuracy in the frontal part of its visual field by means of a smooth pursuit control system using the retinal position of the target to determine the flight direction. We conclude that for a comprehensive understanding of chasing control different time lags in the control systems of angular and forward velocity together with the impact of inertia on fly movements need to be taken into account.

Function and Coding in the Blowfly H1 Neuron during Naturalistic Optic Flow

Naturalistic stimuli, reconstructed from measured eye movements of flying blowflies, were replayed on a panoramic stimulus device. The directional movement-sensitive H1 neuron was recorded from blowflies watching these stimuli. The response of the H1 neuron is dominated by the response to fast saccadic turns into one direction. The response between saccades is mostly inhibited by the front-to-back optic flow caused by the forward translation during flight. To unravel the functional significance of the H1 neuron, we replayed, in addition to the original behaviorally generated stimulus, two targeted stimulus modifications: (1) a stimulus in which flow resulting from translation was removed (this stimulus produced strong intersaccadic responses); and (2) a stimulus in which the saccades were removed by assuming that the head follows the smooth flight trajectory (this stimulus produced alternating zero or nearly saturating spike rates). The responses to the two modified stimuli are strongly different from the response to the original stimulus, showing the importance of translation and saccades for the H1 response to natural optic flow. The response to the original stimulus thus suggests a double function for the H1 neuron, assisting two major classes of movement-sensitive output neurons targeted by H1. First, its strong response to saccades may function as a saccadic suppressor (via one of its target neurons) for cells involved in figure-ground discrimination. Second, its intersaccadic response may increase the signal-to-noise ratio (SNR) of wide-field neurons involved in detecting translational optic flow between saccades, in particular when flying speeds are low or when object distances are large.

FliMax, a novel stimulus device for panoramic and highspeed presentation of behaviourally generated optic flow

A high-speed panoramic visual stimulation device is introduced which is suitable to analyse visual interneurons during stimulation with rapid image displacements as experienced by fast moving animals. The responses of an identified motion sensitive neuron in the visual system of the blowfly to behaviourally generated image sequences are very complex and hard to predict from the established input circuitry of the neuron. This finding suggests that the computational significance of visual interneurons can only be assessed if they are characterised not only by conventional stimuli as are often used for systems analysis, but also by behaviourally relevant input.

Spatial vision in insects is facilitated by shaping the dynamics of visual input through behavioral action

Insects such as flies or bees, with their miniature brains, are able to control highly aerobatic flight maneuvres and to solve spatial vision tasks, such as avoiding collisions with obstacles, landing on objects, or even localizing a previously learnt inconspicuous goal on the basis of environmental cues. With regard to solving such spatial tasks, these insects still outperform man-made autonomous flying systems. To accomplish their extraordinary performance, flies and bees have been shown by their characteristic behavioral actions to actively shape the dynamics of the image flow on their eyes (“optic flow”). The neural processing of information about the spatial layout of the environment is greatly facilitated by segregating the rotational from the translational optic flow component through a saccadic flight and gaze strategy. This active vision strategy thus enables the nervous system to solve apparently complex spatial vision tasks in a particularly efficient and parsimonious way. The key idea of this review is that biological agents, such as flies or bees, acquire at least part of their strength as autonomous systems through active interactions with their environment and not by simply processing passively gained information about the world. These agent-environment interactions lead to adaptive behavior in surroundings of a wide range of complexity. Animals with even tiny brains, such as insects, are capable of performing extraordinarily well in their behavioral contexts by making optimal use of the closed action–perception loop. Model simulations and robotic implementations show that the smart biological mechanisms of motion computation and visually-guided flight control might be helpful to find technical solutions, for example, when designing micro air vehicles carrying a miniaturized, low-weight on-board processor.

A syntax of hoverfly flight prototypes

SUMMARY Hoverflies such as Eristalis tenax Linnaeus are known for their distinctive flight style. They can hover on the same spot for several seconds and then burst into movement in apparently any possible direction. In order to determine a quantitative and structured description of complex flight manoeuvres, we searched for a set of repeatedly occurring prototypical movements (PMs) and a set of rules for their ordering. PMs were identified by applying clustering algorithms to the translational and rotational velocities of the body of Eristalis during free-flight sequences. This approach led to nine stable and reliable PMs, and thus provided a tremendous reduction in the complexity of behavioural description. This set of PMs together with the probabilities of transition between them constitute a syntactical description of flight behaviour. The PMs themselves can be roughly segregated into fast rotational turns (saccades) and a variety of distinct translational movements (intersaccadic intervals). We interpret this segregation as reflecting an active sensing strategy which facilitates the extraction of spatial information from retinal image displacements. Detailed analysis of saccades shows that they are performed around all rotational axes individually and in all possible combinations. We found the probability of occurrence of a given saccade type to depend on parameters such as the angle between the long body axis and the direction of flight.

Gaze Strategy in the Free Flying Zebra Finch ( Taeniopygia guttata )

Fast moving animals depend on cues derived from the optic flow on their retina. Optic flow from translational locomotion includes information about the three-dimensional composition of the environment, while optic flow experienced during a rotational self motion does not. Thus, a saccadic gaze strategy that segregates rotations from translational movements during locomotion will facilitate extraction of spatial information from the visual input. We analysed whether birds use such a strategy by highspeed video recording zebra finches from two directions during an obstacle avoidance task. Each frame of the recording was examined to derive position and orientation of the beak in three-dimensional space. The data show that in all flights the head orientation was shifted in a saccadic fashion and was kept straight between saccades. Therefore, birds use a gaze strategy that actively stabilizes their gaze during translation to simplify optic flow based navigation. This is the first evidence of birds actively optimizing optic flow during flight.