Phil Husbands

Explorations in evolutionary robotics

We discuss the methodological foundations for our work on the development of cognitive architectures, or control systems, for situated autonomous agents. Our focus is the problems of developing sensorimotor control systems for mobile robots, but we also discuss the applicability of our approach to the study of biological systems. We argue that, for agents required to exhibit sophisticated interactions with their environments, complex sensorimotor processing is necessary, and the design, by hand, of control systems capable of such processing is likely to become prohibitively difficult as complexity increases. We propose an automatic design process involving artificial evolution, wherein the basic building blocks used for evolving cognitive architectures are noise-tolerant dynamical neural networks. These networks may be recurrent and should operate in real time. The evolution should be incremental, using an extended and modified version of a genetic algorithm. Practical constraints suggest that initial architecture evaluations should be done largely in simulation. To support our claims and proposals, we summarize results from some preliminary simulation experiments in which visually guided robots are evolved to operate in simple environments. Significantly, our results demonstrate that robust visually guided control systems evolve from evaluation functions that do not explicitly require monitoring visual input. We outline the difficulties involved in continuing with simulations and conclude by describing specialized visuorobotic equipment, designed to eliminate the need for simulated sensors and actuators.

Noise and the Reality Gap: The Use of Simulation in Evolutionary Robotics

The pitfalls of naive robot simulations have been recognised for areas such as evolutionary robotics. It has been suggested that carefully validated simulations with a proper treatment of noise may overcome these problems. This paper reports the results of experiments intended to test some of these claims. A simulation was constructed of a two-wheeled Khepera robot with IR and ambient light sensors. This included detailed mathematical models of the robot-environment interaction dynamics with empirically determined parameters. Artificial evolution was used to develop recurrent dynamical network controllers for the simulated robot, for obstacle-avoidance and light-seeking tasks, using different levels of noise in the simulation. The evolved controllers were down-loaded onto the real robot and the correspondence between behaviour in simulation and in reality was tested. The level of correspondence varied according to how much noise was used in the simulation, with very good results achieved when realistic quantities were applied. It has been demonstrated that it is possible to develop successful robot controllers in simulation that generate almost identical behaviours in reality, at least for a particular class of robot-environment interaction dynamics.

Evolutionary Robotics: the Sussex Approach

We give an overview of evolutionary robotics research at Sussex over the last five years. We explain and justify our distinctive approaches to (artificial) evolution, and to the nature of robot control systems that are evolved. Results are presented from research with evolved controllers for autonomous mobile robots, simulated robots, co-evolved animats, real robots with software controllers, and a real robot with a controller directly evolved in hardware.

Evolution of central pattern generators for bipedal walking in a real-time physics environment

We describe an evolutionary approach to the control problem of bipedal walking. Using a full rigid-body simulation of a biped, it was possible to evolve recurrent neural networks that controlled stable straight-line walking on a planar surface. No proprioceptive information was necessary in order to achieve this task. Furthermore, simple sensory input to locate a sound source was integrated to achieve directional walking. To our knowledge, this is the first work that demonstrates the application of evolutionary optimization to 3D physically simulated biped locomotion.

Fitness landscapes and evolvability

In this paper, we develop techniques based on evolvability statistics of the fitness land-scape surrounding sampled solutions. Averaging the measures over a sample of equal fitness solutions allows us to build up fitness evolvability portraits of the fitness land-scape, which we show can be used to compare both the ruggedness and neutrality in a set of tunably rugged and tunably neutral landscapes. We further show that the tech-niques can be used with solution samples collected through both random sampling of the landscapes and online sampling during optimization. Finally, we apply the techniques to two real evolutionary electronics search spaces and highlight differences between the two search spaces, comparing with the time taken to find good solutions through search.

Better Living Through Chemistry: Evolving GasNets for Robot Control

This paper introduces a new type of artificial neural network (GasNets) and shows that it is possible to use evolutionary computing techniques to find robot controllers based on them. The controllers are built from networks inspired by the modulatory effects of freely diffusing gases, especially nitric oxide, in real neuronal networks. Evolutionary robotics techniques were used to develop control networks and visual morphologies to enable a robot to achieve a target discrimination task under very noisy lighting conditions. A series of evolutionary runs with and without the gas modulation active demonstrated that networks incorporating modulation by diffusing gases evolved to produce successful controllers considerably faster than networks without this mechanism. GasNets also consistently achieved evolutionary success in far fewer evaluations than were needed when using more conventional connectionist style networks.

Evolving controllers for a homogeneous system of physical robots: structured cooperation with minimal sensors

We report on recent work in which we employed artificial evolution to design neural network controllers for small, homogeneous teams of mobile autonomous robots. The robots were evolved to perform a formation–movement task from random starting positions, equipped only with infrared sensors. The dual constraints of homogeneity and minimal sensors make this a non–trivial task. We describe the behaviour of a successful system in which robots adopt and maintain functionally distinct roles in order to achieve the task. We believe this to be the first example of the use of artificial evolution to design coordinated, cooperative behaviour for real robots.

Evolutionary Robotics: A Survey of Applications and Problems

This paper reviews evolutionary approaches to the automatic design of real robots exhibiting a given behavior in a given environment. Such a methodology has been successfully applied to various wheeled and legged robots, and to numerous behaviors including wall-following, obstacle-avoidance, light-seeking, arena cleaning and target seeking. Its potentialities and limitations are discussed in the text and directions for future work are outlined.

Distributed Coevolutionary Genetic Algorithms for Multi-Criteria and Multi-Constraint Optimisation

This paper explores the use of coevolutionary genetic algorithms to attack hard optimisation problems. It outlines classes of practical problems which are difficult to tackle with conventional techniques, and indeed with standard ‘single species’ genetic algorithms, but which may be amenable to ‘multi-species’ coevolutionary genetic algorithms. It is argued that such algorithms are most coherent and effective when implemented as distributed genetic algorithms with local selection operating. Examples of the successful use of such techniques are described, with particular emphasis given to new work on a highly generalised version of the job shop scheduling problem.

Artificial evolution: a new path for Artificial Intelligence?

Recently there have been a number of proposals for the use of artificial evolution as a radically new approach to the development of control systems for autonomous robots. This paper explains the artificial evolution approach, using work at Sussex to illustrate it. The paper revolves around a case study on the concurrent evolution of control networks and visual sensor morphologies for a mobile robot. Wider intellectual issues surrounding the work are discussed, as is the use of more abstract evolutionary simulations as a new potentially useful tool in theoretical biology.