Noriyasu Ando

Active control of free flight manoeuvres in a hawkmoth, Agrius convolvuli.

SUMMARY By combining optical triangulation with the comb-fringe technique and dual-channel telemetry, wing kinematics and body attitudes accompanying muscle activities of free-flying male hawkmoths were recorded synchronously when they performed flight manoeuvres elicited by a female sex pheromone. The results indicate that the wing leading edge angular position at the ventral stroke reversal, which can be decomposed by two orthogonal angular parameters (a flapping angle and a deviation angle), is well controllable. Two specific flight muscles, the dorsal-ventral muscle (DVM, indirect muscle, a wing elevator) and the third axillary muscle (3AXM, direct muscle, a wing retractor), can modulate the flapping angle and the deviation angle, respectively, by means of regulating the firing timing of muscle activities. The firing timing can be expressed by the firing latency absolutely, which is just before the timing of ventral stroke reversal. The results illustrate that lengthening the firing latency of the DVM and of the 3AXM can increase the flapping angle and the deviation angle, respectively, which both strengthen the downstroke at the ventral stroke reversal. The relationship of bilateral asymmetry shows that the bilateral differences in the firing latency of the DVM and of the 3AXM will cause bilateral differences in the wing position, which accompany the variations of yaw and roll angles in time course. This implies the contribution of the two muscles to active steering controls during turning or banking, though the DVM being an indirect muscle was generally treated as a power generator. Finally, the relationship between the pitch angle and the 3AXM latency, deduced from the relationships between the pitch angle and the deviation angle and between the deviation angle and the 3AXM latency, shows that lengthening the 3AXM latency can increase the pitch angle at the ventral stroke reversal by moving the wing tip far away from the centre of gravity of the body, which indicates a functional role of the 3AXM in active pitching control.

Dynamic use of optic flow during pheromone tracking by the male silkmoth, Bombyx mori

Several insects require both olfactory and visual cues during odour-source localisation to successfully locate an odour source. In the male silkmoth, Bombyx mori, detection of the female sex pheromone triggers a programmed walking pattern, starting from a surge (straight-line walking) followed by zigzag walking. Although pheromone-triggered behaviour in silkmoths is well understood, the role of visual cues remains obscure. To address this question, we performed behavioural experiments on tethered-walking moths by recording their locomotion during stimulation with a pheromone and a visual motion pattern (optic flow). The experiments were conducted under open- and closed-loop visual stimuli. We found that the use of optic flow input was determined by the behavioural state of surge and zigzagging. Silkmoths exhibited an optomotor response, which is a behavioural visual response, by turning towards the same direction as optic flow stimuli only during surge, but not during zigzagging. In addition, modulation of the zigzag walking pattern was observed when the moths were presented with biased closed-loop visual stimuli (visual feedback with biased constant optic flow); however, the directional preference mechanism was different from that of the optomotor response. Based on these findings, we suggest that the optomotor response is utilised for course control during straight-line walking, whereas the absence of optomotor response during zigzagging is used to effectively perform the programmed walking pattern. Considering the neural basis of programmed behaviour, we speculate that at least two visual pathways are involved in the state-dependent use of optic flow during odour tracking behaviour in silkmoths.

Understanding and Reconstruction of the Mobiligence of Insects Employing Multiscale Biological Approaches and Robotics

Adaptability, i.e., the ability to behave in accordance with a ceaselessly changing environment, is a defining feature of animals, including insects, and is a necessary attribute in robotics. Insects display a range of sophisticated behaviors in response to their environments based on the processing of a simple nervous system. Insects are uniquely suited for multidisciplinary studies of the brain involving a combined approach at several levels, from molecules and single neurons to neural networks and behavior. Furthermore, insects can be adapted for use with a wide variety of methodological approaches, from molecular genetics, electrophysiology and imaging to computational tools and robotics. Thus, insects are an excellent model taxon for understanding adaptive control in biological systems. In this review, the general features of the insect brain and multiscale approaches for understanding the neural basis of their behavior are introduced. As an example of adaptive behavior in insects, odor–source orientation behavior in silkmoths and the feasibility of a behavioral strategy based on their neural system, with implementation in robots, is described. Finally, we present novel approaches using an insect–machine hybrid, which will enhance our ability to evaluate and understand adaptive behavior.

Insect–machine hybrid system for understanding and evaluating sensory-motor control by sex pheromone in Bombyx mori

To elucidate the dynamic information processing in a brain underlying adaptive behavior, it is necessary to understand the behavior and corresponding neural activities. This requires animals which have clear relationships between behavior and corresponding neural activities. Insects are precisely such animals and one of the adaptive behaviors of insects is high-accuracy odor source orientation. The most direct way to know the relationships between neural activity and behavior is by recording neural activities in a brain from freely behaving insects. There is also a method to give stimuli mimicking the natural environment to tethered insects allowing insects to walk or fly at the same position. In addition to these methods an ‘insect–machine hybrid system’ is proposed, which is another experimental system meeting the conditions necessary for approaching the dynamic processing in the brain of insects for generating adaptive behavior. This insect–machine hybrid system is an experimental system which has a mobile robot as its body. The robot is controlled by the insect through its behavior or the neural activities recorded from the brain. As we can arbitrarily control the motor output of the robot, we can intervene at the relationship between the insect and the environmental conditions.

Using insects to drive mobile robots — hybrid robots bridge the gap between biological and artificial systems

The use of mobile robots is an effective method of validating sensory-motor models of animals in a real environment. The well-identified insect sensory-motor systems have been the major targets for modeling. Furthermore, mobile robots implemented with such insect models attract engineers who aim to avail advantages from organisms. However, directly comparing the robots with real insects is still difficult, even if we successfully model the biological systems, because of the physical differences between them. We developed a hybrid robot to bridge the gap. This hybrid robot is an insect-controlled robot, in which a tethered male silkmoth (Bombyx mori) drives the robot in order to localize an odor source. This robot has the following three advantages: 1) from a biomimetic perspective, the robot enables us to evaluate the potential performance of future insect-mimetic robots; 2) from a biological perspective, the robot enables us to manipulate the closed-loop of an onboard insect for further understanding of its sensory-motor system; and 3) the robot enables comparison with insect models as a reference biological system. In this paper, we review the recent works regarding insect-controlled robots and discuss the significance for both engineering and biology.

A simple behaviour provides accuracy and flexibility in odour plume tracking – the robotic control of sensory-motor coupling in silkmoths

ABSTRACT Odour plume tracking is an essential behaviour for animal survival. A fundamental strategy for this is to move upstream and then across-stream. Male silkmoths, Bombyx mori, display this strategy as a pre-programmed sequential behaviour. They walk forward (surge) in response to the female sex pheromone and perform a zigzagging ‘mating dance’. Though pre-programmed, the surge direction is modulated by bilateral olfactory input and optic flow. However, the nature of the interaction between these two sensory modalities and contribution of the resultant motor command to localizing an odour source are still unknown. We evaluated the ability of the silkmoth to localize an odour source under conditions of disturbed sensory-motor coupling, using a silkmoth-driven mobile robot. The significance of the bilateral olfaction of the moth was confirmed by inverting the olfactory input to the antennae, or its motor output. Inversion of the motor output induced consecutive circling, which was inhibited by covering the visual field of the moth. This suggests that the corollary discharge from the motor command and the reafference of self-generated optic flow generate compensatory signals to guide the surge accurately. Additionally, after inverting the olfactory input, the robot successfully tracked the odour plume by using a combination of behaviours. These results indicate that accurate guidance of the reflexive surge by integrating bilateral olfactory and visual information with innate pre-programmed behaviours increases the flexibility to track an odour plume even under disturbed circumstances. Summary: The odour plume-tracking ability of silkmoths is enhanced by visually guided osmotropotaxis combined with pre-programmed behaviour.

Cluster-camera networking and geometric configuration for intelligent space

The intelligent space is a space where we can easily interact with computers and robots, and get useful service from them. To achieve such a space, a distributed intelligent networked device (DIND) has been proposed. Many DINDs are installed in a space and they cooperate with each other to make the space intelligent. In this paper, optimal DIND placement, self-calibration of DIND and handover protocol for cooperation among DINDs are described.

Improvement of response isotropy of haptic interface for tele-micromanipulation systems

In this paper, control schemes for the master haptic interface are mainly discussed. We proposed the tele-micromanipulation systems, which enables human operators to operate micro-tasks, such as assembly or manufacturing, without feeling the stress. The paper focuses on the haptic interface, which gives the operators the feeling of presence. The mechanism applied in the human interface device often has a reasonable immanent friction. This friction must be compensated in a way that the operator cannot feel this friction force, but only the force from the manipulated environment. The main contribution of this paper is a direct model based chattering free sliding mode friction estimator and a compensator for the human interface device. The experimental results obtained are presented.

What is needed by mobile robots to move-intelligent space for mobile robots

In this paper, we explain our design policy of localization algorithm for mobile robots in general environment. We propose intelligent space as a solution of that. We have introduced intelligent space as a solution for realizing useful robots in general environment. Intelligent space is a space that supports both human and robots. Some experimental results are shown to show the performance and the merits of proposed localization method.

Flexibility and control of thorax deformation during hawkmoth flight

The interaction between neuromuscular systems and body mechanics plays an important role in the production of coordinated movements in animals. Lepidopteran insects move their wings by distortion of the thorax structure via the indirect flight muscles (IFMs), which are activated by neural signals at every stroke. However, how the action of these muscles affects thorax deformation and wing kinematics is poorly understood. We measured the deformation of the dorsal thorax (mesonotum) of tethered flying hawkmoths, Agrius convolvuli, using a high-speed laser profilometer combined with simultaneous recordings of electromyograms and wing kinematics. We observed that locally amplified mesonotum deformation near the wing hinges ensures sufficient wing movement. Furthermore, phase asymmetry in IFM activity leads to phase asymmetry in mesonotum oscillations and wingbeats. Our results revealed the flexibility and controllability of the single structure of the mesonotum by neurogenic action of the IFMs.