Luis Riazuelo

C2TAM: A Cloud framework for cooperative tracking and mapping

The Simultaneous Localization And Mapping by an autonomous mobile robot-known by its acronym SLAM-is a computationally demanding process for medium and large-scale scenarios, in spite of the progress both in the algorithmic and hardware sides. As a consequence, a robot with SLAM capabilities has to be equipped with the latest computers whose weight and power consumption might limit its autonomy. This paper describes a visual SLAM system based on a distributed framework where the expensive map optimization and storage is allocated as a service in the Cloud, while a light camera tracking client runs on a local computer. The robot onboard computers are freed from most of the computation, the only extra requirement being an internet connection. The data flow from and to the Cloud is low enough to be supported by a standard wireless connection. The experimental section is focused on showing real-time performance for single-robot and cooperative SLAM using an RGBD camera. The system provides the interface to a map database where: (1) a map can be built and stored, (2) stored maps can be reused by other robots, (3) a robot can fuse its map online with a map already in the database, and (4) several robots can estimate individual maps and fuse them together if an overlap is detected.

Enforcing Network Connectivity in Robot Team Missions

The growing interest in robot teams for surveillance or rescue missions entails new technological challenges. Robots have to move to complete their tasks while maintaining communication among themselves and with their human operators, in many cases without the aid of a communication infrastructure. Guaranteeing connectivity enables robots to explicitly exchange information needed in collaborative task execution, and allows operators to monitor or manually control any robot at all times. Network paths should be multi-hop, so as not to unnecessarily restrict the team’s range. In this work we contribute a complete system which integrates three research aspects, usually studied separately, to achieve these characteristics: a multi-robot cooperative motion control technique based on a virtual spring—damper model which prevents communication network splits, a task allocation algorithm that takes advantage of network link information in order to ensure autonomous mission completion, and a network layer which works over wireless 802.11 devices, capable of sustaining hard real-time traffic and changing topologies. Link quality among peers is the key metric used to cooperatively move the robots and maintain uninterrupted connectivity, and the basis for novel ideas presented in each subsystem. Simulations and experimental results with real robots are presented and discussed.

Towards semantic SLAM using a monocular camera

Monocular SLAM systems have been mainly focused on producing geometric maps just composed of points or edges; but without any associated meaning or semantic content. In this paper, we propose a semantic SLAM algorithm that merges in the estimated map traditional meaningless points with known objects. The non-annotated map is built using only the information extracted from a monocular image sequence. The known object models are automatically computed from a sparse set of images gathered by cameras that may be different from the SLAM camera. The models include both visual appearance and tridimensional information. The semantic or annotated part of the map -the objects- are estimated using the information in the image sequence and the precomputed object models.

RoboEarth Semantic Mapping: A Cloud Enabled Knowledge-Based Approach

The vision of the RoboEarth project is to design a knowledge-based system to provide web and cloud services that can transform a simple robot into an intelligent one. In this work, we describe the RoboEarth semantic mapping system. The semantic map is composed of: 1) an ontology to code the concepts and relations in maps and objects and 2) a SLAM map providing the scene geometry and the object locations with respect to the robot. We propose to ground the terminological knowledge in the robot perceptions by means of the SLAM map of objects. RoboEarth boosts mapping by providing: 1) a subdatabase of object models relevant for the task at hand, obtained by semantic reasoning, which improves recognition by reducing computation and the false positive rate; 2) the sharing of semantic maps between robots; and 3) software as a service to externalize in the cloud the more intensive mapping computations, while meeting the mandatory hard real time constraints of the robot. To demonstrate the RoboEarth cloud mapping system, we investigate two action recipes that embody semantic map building in a simple mobile robot. The first recipe enables semantic map building for a novel environment while exploiting available prior information about the environment. The second recipe searches for a novel object, with the efficiency boosted thanks to the reasoning on a semantically annotated map. Our experimental results demonstrate that, by using RoboEarth cloud services, a simple robot can reliably and efficiently build the semantic maps needed to perform its quotidian tasks. In addition, we show the synergetic relation of the SLAM map of objects that grounds the terminological knowledge coded in the ontology.

Cooperative navigation using environment compliant robot formations

This paper reports an autonomous cooperative navigation system for robot formations in realistic scenarios. The formation movement control is based on a virtual structure composed by spring-dampers elements, which allows the formation to comply with the environment shape. A different navigation strategy is applied to the leader of the formation and to the rest of robots of the team. The leader plans the trajectories by using a two-level path planner with obstacle avoidance capabilities. The motion of the follower robots is controlled by the virtual structure, which adapts to the environment while the leader is tracked, taking into account the kinodynamic constraints of the vehicles. The system is evaluated in experiments carried out in simulations, some of them made in a realistic and complex urban scenario, and with real robots.

Signal-based deployment planning for robot teams in tunnel-like fading environments

Deploying a multi-robot team in confined environments poses multiple challenges that involve task and motion planning, localization and mapping, safe navigation, coordination of robots and also communications among all of them. In recent years, increasing attention has been paid to these challenges by the robotics community, but many problems remain unresolved. In this paper we address a technique for planning the deployment of a robot team in so-called fading environments, such as tunnels or galleries, where signal propagation presents specific characteristics. In order to maintain constant connectivity and high signal quality in the communication network formed by the robots and the base station, the robot deployment is driven by real-time signal measurements. First, an analysis of the signal propagation to obtain the general characteristic parameters of the signals in this kind of environment is carried out. Second, a technique which uses these parameters to drive the deployment is developed. A general strategy for this kind of environment in which the signals exhibit similar behavior is implemented. A complete system involving all of the above-mentioned robotics tasks has been developed. Finally, the system has been evaluated by means of simulation and in a real scenario.

Robot Teams for Intervention in Confined and Structured Environments

Safety, security, and rescue robotics can be extremely useful in emergency scenarios such as mining accidents or tunnel collapses where robot teams can be used to carry out cooperative exploration, intervention, or logistic missions. Deploying a multirobot team in such confined environments poses multiple challenges that involve task planning, motion planning, localization and mapping, safe navigation, coordination, and communications among all the robots. To complete their mission, robots have to be able to move in the environment with full autonomy while at the same time maintaining communication among themselves and with their human operators to accomplish team collaboration. Guaranteeing connectivity enables robots to explicitly exchange information needed in the execution of collaborative tasks and allows operators to monitor and teleoperate the robots and receive information about the environment. In this work, we present a system that integrates several research aspects to achieve a real exploration exercise in a tunnel using a robot team. These aspects are as follows: deployment planning, semantic feature recognition, multirobot navigation, localization, map building, and real-time communications. Two experimental scenarios have been used for the assessment of the system. The first is the Spanish Santa Marta mine, a large mazelike environment selected for its complexity for all the tasks involved. The second is the Spanish-French Somport tunnel, an old railway between Spain and France through the Central Pyrenees, used to carry out the real-world experiments. The latter is a simpler scenario, but it serves to highlight the real communication issues.

Creating and using RoboEarth object models

This paper presented an approach to create 3D object models for robotic and vision applications in a fast and inexpensive way compared to established approaches. By using the RoboEarth system for storing the created object models users have world-wide access to the data and can immediately reuse a model as soon as it was created and uploaded. The approach shows general applicability for different kinds of cameras. In this work this was shown by two example implementations for the recognition process of objects. The quality of the recognition can be verified in the video. Combined with the knowledge saved in the RoboEarth database the objects can also be properly classified.

Guaranteeing Communication for Robotic Intervention in Long Tunnel Scenarios

In tunnel-like environments such as road tunnels or mines, a team of networked mobile robots can provide surveillance, search and rescue, or monitoring services. However, these scenarios pose multiple challenges from the robotics and from the communication points of view. Structurally, tunnels are much more longer than they are wide, and in the communication context, the multipath propagation causes strong fading phenomena. While the former can be addressed implementing routing techniques that allow multi-hop communication, fadings are unavoidable and represent a serious issue. However, under certain transmitter-receiver configurations, these fadings are predictable and periodic. On this basis, in this work we present a set of solutions to improve the communications between a base station and a robot taking advantage of spatial diversity and link-quality-aware navigation. These proposals are tested by means of simulations and real-world experiments carried out in a long railway tunnel, involving mobile and fixed nodes towards an application for monitoring purposes.

A Robotized Dumper for Debris Removal in Tunnels Under Construction

Tunnels in construction exhibit many challenges for automation. In this work we address the robotization of a conventional dumper for debris removal during the construction of tunnels, in the framework of a technological transfer project. The goal is to convert a dumper into an autonomous vehicle capable of planning, navigate and localize itself. Planning and navigation techniques have been adapted to the special kinodynamic characteristics of the vehicle. The difficulties for having a precise continuous localization in this kind of scenarios, due to the irregularities of the terrain, the changing illumination and the own scenario, have driven to develop hybrid localization techniques to integrate continuous and discrete information, coming from the navigation sensors, some semantic geometric features, and the signal strength propagation in tunnel scenarios. Simulation and real-world experiments are described, and some preliminary results are discussed.