Ruben Martinez-Cantin

Robocentric map joining: Improving the consistency of EKF-SLAM

In this paper 1 we study the Extended Kalman Filter approach to simultaneous localization and mapping (EKF-SLAM), describing its known properties and limitations, and concentrate on the filter consistency issue. We show that linearization of the inherent nonlinearities of both the vehicle motion and the sensor models frequently drives the solution of the EKF-SLAM out of consistency, specially in those situations where uncertainty surpasses a certain threshold. We propose a mapping algorithm, Robocentric Map Joining, which improves consistency of the EKFSLAM algorithm by limiting the level of uncertainty in the continuous evolution of the stochastic map: (1) by building a sequence of independent local maps, and (2) by using a robot centered representation of each local map. Simulations and a large-scale indoor/outdoor experiment validate the proposed approach. c 2006 Elsevier B.V. All rights reserved.

A Bayesian exploration-exploitation approach for optimal online sensing and planning with a visually guided mobile robot

We address the problem of online path planning for optimal sensing with a mobile robot. The objective of the robot is to learn the most about its pose and the environment given time constraints. We use a POMDP with a utility function that depends on the belief state to model the finite horizon planning problem. We replan as the robot progresses throughout the environment. The POMDP is high-dimensional, continuous, non-differentiable, nonlinear, non-Gaussian and must be solved in real-time. Most existing techniques for stochastic planning and reinforcement learning are therefore inapplicable. To solve this extremely complex problem, we propose a Bayesian optimization method that dynamically trades off exploration (minimizing uncertainty in unknown parts of the policy space) and exploitation (capitalizing on the current best solution). We demonstrate our approach with a visually-guide mobile robot. The solution proposed here is also applicable to other closely-related domains, including active vision, sequential experimental design, dynamic sensing and calibration with mobile sensors.

Unscented SLAM for large-scale outdoor environments

This paper presents an experimentally validated alternative to the classical extended Kalman filter approach to the solution of the probabilistic state-space simultaneous localization and mapping (SLAM) problem. Several authors have reported the divergence of this classical approach due to the linearization of the inherent nonlinear nature of the SLAM problem. Hence, the approach described in this work aims to avoid the analytical linearization based on Taylor-series expansion of both the model and measurement equations by using the unscented filter. An innovation-based consistency checking validates the feasibility and applicability of the unscented SLAM approach to a real large-scale outdoor exploration mission.

Active Policy Learning for Robot Planning and Exploration under Uncertainty

This paper proposes a simulation-based active policy learning algorithm for finite-horizon, partially-observed sequential decision processes. The algorithm is tested in the domain of robot navigation and exploration under uncertainty. In such a setting, the expected cost, that must be minimized, is a function of the belief state (filtering distribution). This filtering distribution is in turn nonlinear and subject to discontinuities, which arise because constraints in the robot motion and control models. As a result, the expected cost is non-differentiable and very expensive to simulate. The new algorithm overcomes the first difficulty and reduces the number of required simulations as follows. First, it assumes that we have carried out previous simulations which returned values of the expected cost for different corresponding policy parameters. Second, it fits a Gaussian process (GP) regression model to these values, so as to approximate the expected cost as a function of the policy parameters. Third, it uses the GP predicted mean and variance to construct a statistical measure that determines which policy parameters should be used in the next simulation. The process is then repeated using the new parameters and the newly gathered expected cost observation. Since the objective is to find the policy parameters that minimize the expected cost, this iterative active learning approach effectively trades-off between exploration (in regions where the GP variance is large) and exploitation (where the GP mean is low). In our experiments, a robot uses the proposed algorithm to plan an optimal path for accomplishing a series of tasks, while maximizing the information about its pose and map estimates. These estimates are obtained with a standard filter for simultaneous localization and mapping. Upon gathering new observations, the robot updates the state estimates and is able to replan a new path in the spirit of open-loop feedback control.

Analysis of Particle Methods for Simultaneous Robot Localization and Mapping and a New Algorithm: Marginal-SLAM

This paper presents a new particle method, with stochastic parameter estimation, to solve the SLAM problem. The underlying algorithm is rooted on a solid probabilistic foundation and is guaranteed to converge asymptotically, unlike many existing popular approaches. Moreover, it is efficient in storage and computation. The new algorithm carries out filtering only in the marginal filtering space, thereby allowing for the recursive computation of low variance estimates of the map. The paper provides mathematical arguments and empirical evidence to substantiate the fact that the new method represents an improvement over the existing particle filtering approaches for SLAM, which work on the joint path state space.

Body schema acquisition through active learning

We present an active learning algorithm for the problem of body schema learning, i.e. estimating a kinematic model of a serial robot. The learning process is done online using Recursive Least Squares (RLS) estimation, which outperforms gradient methods usually applied in the literature. In addiction, the method provides the required information to apply an active learning algorithm to find the optimal set of robot configurations and observations to improve the learning process. By selecting the most informative observations, the proposed method minimizes the required amount of data. We have developed an efficient version of the active learning algorithm to select the points in real-time. The algorithms have been tested and compared using both simulated environments and a real humanoid robot.

Bounding uncertainty in EKF-SLAM: the robocentric local approach

This paper addresses the consistency issue of the extended Kalman filter approach to the simultaneous localization and mapping (EKF-SLAM) problem. Linearization of the inherent nonlinearities of both the motion and the sensor models frequently drives the solution of the EKF-SLAM out of consistency specially in those situations where location uncertainty surpasses a certain threshold. This paper proposes a robocentric local map sequencing algorithm which: (a) bounds location uncertainty within each local map, (b) reduces the computational cost up to constant time in the majority of updates and (c) improves linearization accuracy by updating the map with sensor uncertainty level constraints. Simulation and large-scale outdoor experiments validate the proposed approach

Adaptive Scale Robust Segmentation for 2D Laser Scanner

This paper presents a robust algorithm for segmentation and line detection in 2D range scans. The described method exploits the multimodal probability density function of the residual error. It is capable of segmenting the range data in clusters, estimate the straight segments parameters, and estimate the scale of inliers error noise successfully, despite of high level of spurious data. No prior knowledge about the sensor and object properties is given to the algorithm. The mode seeking is based on mean shift algorithm, which has been widely used and tested in 3D laser scan segmentation, machine learning and pattern recognition applications. We show the reliability of the technique with experimental indoor and outdoor manmade environment. Compared with classical methods, a good compromise between false positive, false negative, wrong segment split and wrong segment merge is achieved, with improved accuracy in the estimated parameters

Unscented Bayesian optimization for safe robot grasping

Safe and robust grasping of unknown objects is a major challenge in robotics, which has no general solution yet. A promising approach relies on haptic exploration, where active optimization strategies can be employed to reduce the number of exploration trials. One critical problem is that certain optimal grasps discoverd by the optimization procedure may be very sensitive to small deviations of the parameters from their nominal values: we call these unsafe grasps because small errors during motor execution may turn optimal grasps into bad grasps. To reduce the risk of grasp failure, safe grasps should be favoured. Therefore, we propose a new algorithm, unscented Bayesian optimization, that performs efficient optimization while considering uncertainty in the input space, leading to the discovery of safe optima. The results highlight how our method outperforms the classical Bayesian optimization both in synthetic problems and in realistic robot grasp simulations, finding robust and safe grasps after a few exploration trials.

Gaussian mixture models for affordance learning using Bayesian Networks

Affordances are fundamental descriptors of relationships between actions, objects and effects. They provide the means whereby a robot can predict effects, recognize actions, select objects and plan its behavior according to desired goals. This paper approaches the problem of an embodied agent exploring the world and learning these affordances autonomously from its sensory experiences. Models exist for learning the structure and the parameters of a Bayesian Network encoding this knowledge. Although Bayesian Networks are capable of dealing with uncertainty and redundancy, previous work considered complete observability of the discrete sensory data, which may lead to hard errors in the presence of noise. In this paper we consider a probabilistic representation of the sensors by Gaussian Mixture Models (GMMs) and explicitly taking into account the probability distribution contained in each discrete affordance concept, which can lead to a more correct learning.