Mathew H. Evans

Naive Bayes texture classification applied to whisker data from a moving robot

Many rodents use their whiskers to distinguish objects by surface texture. To examine possible mechanisms for this discrimination, data from an artificial whisker attached to a moving robot was used to test texture classification algorithms. This data was examined previously using a template-based classifier of the whisker vibration power spectrum [1]. Motivated by a proposal about the neural computations underlying sensory decision making [2], we classified the raw whisker signal using the related ‘naive Bayes’ method. The integration time window is important, with roughly 100ms of data required for good decisions and 500ms for the best decisions. For stereotyped motion, the classifier achieved hit rates of about 80% using a single (horizontal or vertical) stream of vibration data and 90% using both streams. Similar hit rates were achieved on natural data, apart from a single case in which the performance was only about 55%. Therefore this application of naive Bayes represents a biologically motivated algorithm that can perform well in a real-world robot task.

Optimal decision-making in mammals: insights from a robot study of rodent texture discrimination

Texture perception is studied here in a physical model of the rat whisker system consisting of a robot equipped with a biomimetic vibrissal sensor. Investigations of whisker motion in rodents have led to several explanations for texture discrimination, such as resonance or stick-slips. Meanwhile, electrophysiological studies of decision-making in monkeys have suggested a neural mechanism of evidence accumulation to threshold for competing percepts, described by a probabilistic model of Bayesian sequential analysis. For our robot whisker data, we find that variable reaction-time decision-making with sequential analysis performs better than the fixed response-time maximum-likelihood estimation. These probabilistic classifiers also use whatever available features of the whisker signals aid the discrimination, giving improved performance over a single-feature strategy, such as matching the peak power spectra of whisker vibrations. These results cast new light on how the various proposals for texture discrimination in rodents depend on the whisker contact mechanics and suggest the possibility of a common account of decision-making across mammalian species.

Tactile Superresolution and Biomimetic Hyperacuity

Motivated by the impact of superresolution methods for imaging, we undertake a detailed and systematic analysis of localization acuity for a biomimetic fingertip and a flat region of tactile skin. We identify three key factors underlying superresolution that enable the perceptual acuity to surpass the sensor resolution: 1) the sensor is constructed with multiple overlapping, broad but sensitive receptive fields; 2) the tactile perception method interpolates between receptors (taxels) to attain subtaxel acuity; and 3) active perception ensures robustness to unknown initial contact location. All factors follow from active Bayesian perception applied to biomimetic tactile sensors with an elastomeric covering that spreads the contact over multiple taxels. In consequence, we attain extreme superresolution with a 35-fold improvement of localization acuity (0.12 mm) over sensor resolution (4 mm). We envisage that these principles will enable cheap high-acuity tactile sensors that are highly customizable to suit their robotic use. Practical applications encompass any scenario where an end-effector must be placed accurately via the sense of touch.

Tactile SLAM with a biomimetic whiskered robot

Future robots may need to navigate where visual sensors fail. Touch sensors provide an alternative modality, largely unexplored in the context of robotic map building. We present the first results in grid based simultaneous localisation and mapping (SLAM) with biomimetic whisker sensors, and show how multi-whisker features coupled with priors about straight edges in the world can boost its performance. Our results are from a simple, small environment but are intended as a first baseline to measure future algorithms against.

Prediction of primary somatosensory neuron activity during active tactile exploration

Primary sensory neurons form the interface between world and brain. Their function is well-understood during passive stimulation but, under natural behaving conditions, sense organs are under active, motor control. In an attempt to predict primary neuron firing under natural conditions of sensorimotor integration, we recorded from primary mechanosensory neurons of awake, head-fixed mice as they explored a pole with their whiskers, and simultaneously measured both whisker motion and forces with high-speed videography. Using Generalised Linear Models, we found that primary neuron responses were poorly predicted by whisker angle, but well-predicted by rotational forces acting on the whisker: both during touch and free-air whisker motion. These results are in apparent contrast to previous studies of passive stimulation, but could be reconciled by differences in the kinematics-force relationship between active and passive conditions. Thus, simple statistical models can predict rich neural activity elicited by natural, exploratory behaviour involving active movement of sense organs. DOI: http://dx.doi.org/10.7554/eLife.10696.001

Embodied hyperacuity from Bayesian perception: Shape and position discrimination with an iCub fingertip sensor

Recent advances in modeling animal perception has motivated an approach of Bayesian perception applied to biomimetic robots. This study presents an initial application of Bayesian perception on an iCub fingertip sensor mounted on a dedicated positioning robot. We systematically probed the test system with five cylindrical stimuli offset by a range of positions relative to the fingertip. Testing the real-time speed and accuracy of shape and position discrimination, we achieved sub-millimeter accuracy with just a few taps. This result is apparently the first explicit demonstration of perceptual hyperacuity in robot touch, in that object positions are perceived more accurately than the taxel spacing. We also found substantial performance gains when the fingertip can reposition itself to avoid poor perceptual locations, which indicates that improved robot perception could mimic active perception in animals.

Whisker-object contact speed affects radial distance estimation

Whiskered mammals such as rats are experts in tactile perception. By actively palpating surfaces with their whiskers, rats and mice are capable of acute texture discrimination and shape perception. We present a novel system for investigating whisker-object contacts repeatably and reliably. Using an XY positioning robot and a biomimetic artificial whisker we can generate signals for different whisker-object contacts under a wide range of conditions. Our system is also capable of dynamically altering the velocity and direction of the contact based on sensory signals. This provides a means for investigating sensory motor interaction in the tactile domain. Here we implement active contact control, and investigate the effect that speed has on radial distance estimation when using different features for classification. In the case of a moving object contacting a whisker, magnitude of deflection can be ambiguous in distinguishing a nearby object moving slowly from a more distant object moving rapidly. This ambiguity can be resolved by finding robust features for contact speed, which then informs classification of radial distance. Our results are verified on a dataset from SCRATCHbot, a whiskered mobile robot. Building whiskered robots and modelling these tactile perception capabilities would allow exploration and navigation in environments where other sensory modalities are impaired, for example in dark, dusty or loud environments such as disaster areas.

Naive Bayes novelty detection for a moving robot with whiskers

Novelty detection would be a useful ability for any autonomous robot that seeks to categorize a new environment or notice unexpected changes in its present one. A biomimetic robot (SCRATCHbot) inspired by the rat whisker system was here used to examine the performance of a novelty detection algorithm based on a “naive” implementation of Bayes rule. Naive Bayes algorithms are known to be both efficient and effective, and also have links with proposed neural mechanisms for decision making. To examine novelty detection, the robot first used its whiskers to sense an empty floor, after which it was tested with a textured strip placed in its path. Given only its experience of the familiar situation, the robot was able to distinguish the novel event and localize it in time. Performance increased with the number of whiskers, indicating benefits from integrating over multiple streams of information. Considering the generality of the algorithm, we suggest that such novelty detection could have widespread applicability as a trigger to react to important features in the robots environment.

Tactile discrimination using template classifiers: towards a model of feature extraction in mammalian vibrissal systems

Rats and other whiskered mammals are capable of making sophisticated sensory discriminations using tactile signals from their facial whiskers (vibrissae). As part of a programme of work to develop biomimetic technologies for vibrissal sensing, including whiskered robots, we are devising algorithms for the fast extraction of object parameters from whisker deflection data. Previous work has demonstrated that radial distance to contact can be estimated from forces measured at the base of the whisker shaft. We show that in the case of a moving object contacting a whisker, the measured force can be ambiguous in distinguishing a nearby object moving slowly from a more distant object moving rapidly. This ambiguity can be resolved by simultaneously extracting object position and speed from the whisker deflection time series - that is by attending to the dynamics of the whiskers interaction with the object. We compare a simple classifier with an adaptive EM (Expectation Maximisation) classifier. Both systems are effective at simultaneously extracting the two parameters, the EM-classifier showing similar performance to a handpicked template classifier. We propose that adaptive classification algorithms can provide insights into the types of computations performed in the rat vibrissal system when the animal is faced with a discrimination task.

The effect of whisker movement on radial distance estimation: a case study in comparative robotics.

Whisker movement has been shown to be under active control in certain specialist animals such as rats and mice. Though this whisker movement is well characterized, the role and effect of this movement on subsequent sensing is poorly understood. One method for investigating this phenomena is to generate artificial whisker deflections with robotic hardware under different movement conditions. A limitation of this approach is that assumptions must be made in the design of any artificial whisker actuators, which will impose certain restrictions on the whisker-object interaction. In this paper we present three robotic whisker platforms, each with different mechanical whisker properties and actuation mechanisms. A feature-based classifier is used to simultaneously discriminate radial distance to contact and contact speed for the first time. We show that whisker-object contact speed predictably affects deflection magnitudes, invariant of whisker material or whisker movement trajectory. We propose that rodent whisker control allows the animal to improve sensing accuracy by regulating contact speed induced touch-to-touch variability.