Pawel Musialik

RISE mobile robot operator training design

In the paper the framework for RISE (risky intervention and environmental surveillance) mobile robot operator training design is presented. The basic idea of the framework is to provide advanced software tools to improve the performance of the mobile robot simulation design that are applicable for operator training. The simulator is the end product of the framework. To achieve realistic rigid body simulation and realistic rendering the NVIDIA PhysX engine and the OGRE engine are used. It has to be noticed that the compatibility between the framework software and CAD modeling tools such as Solid Works was essential, therefore virtual models are exchangeable via COLLADA files. The simulator can be integrated with control panel of the mobile robot. It is possible to simulate the behavior of several types of robots such as caterpillar or wheeled. It is important to emphasize that presented result is a new approach related to mobile robots applications and potentially can improve the process of advance mobile robot application design and professional training of the operators.

A game for robot operation training in search and rescue missions

Search and rescue (SAR) teams often face several complex and dangerous tasks, which could be aided by unmanned robotic vehicles (UV). UV agents can potentially be used to decrease the risk in the loss of lives both of the rescuers and victims and aid in the search and transportation of survivors and in the removal of debris in a catastrophe scenario. Depending on the nature of a catastrophe and its geographical location, there are potentially three types of UVs that can be deployed: aerial, surface and ground. Due to the control and manipulation particularities each type of UV contemplates, their operators need prior training and certification. To train and certify the operators a tool (serious game) is under development. In this paper we will make an overview about our approach in its development. This game uses a typical client-server architecture where all client agents (virtual UVs and operator client interfaces) share the same immersive virtual environment which is generated through the merging of GIS data and a semantic model extracted from 3D laser data. There will be several types of scenarios suitable to several types of catastrophe situations. Each of these scenarios has its own mission plan for the trainees to follow. The game will also provide an interface for mission planning so that each mission plan will be carefully designed to accurately correspond to a matrix of skills. This matrix lists a set of common skills in various different UV operational case studies which will allow the certification of operators.

Training and Support system in the Cloud for improving the situational awareness in Search and Rescue (SAR) operations

In this paper, a Training and Support system for Search and Rescue operations is described. The system is a component of the ICARUS project (http://www.fp7-icarus.eu) which has a goal to develop sensor, robotic and communication technologies for Human Search And Rescue teams. The support system for planning and managing complex SAR operations is implemented as a command and control component that integrates different sources of spatial information, such as maps of the affected area, satellite images and sensor data coming from the unmanned robots, in order to provide a situation snapshot to the rescue team who will make the necessary decisions. Support issues will include planning of frequency resources needed for given areas, prediction of coverage conditions, location of fixed communication relays, etc. The training system is developed for the ICARUS operators controlling UGVs (Unmanned Ground Vehicles), UAVs (Unmanned Aerial Vehicles) and USVs (Unmanned Surface Vehicles) from a unified Remote Control Station (RC2). The Training and Support system is implemented in SaaS model (Software as a Service). Therefore, its functionality is available over the Ethernet. SAR ICARUS teams from different countries can be trained simultaneously on a shared virtual stage. In this paper we will show the multi-robot 3D mapping component (aerial vehicle and ground vehicles). We will demonstrate that these 3D maps can be used for Training purpose. Finally we demonstrate current approach for ICARUS Urban SAR (USAR) and Marine SAR (MSAR) operation training.

Lesson Learned from Eurathlon 2013 Land Robot Competition

This paper shows evaluation result of the mobile robotic system for Urban Search and Rescue performed during Eurathlon 2013 robotic competition by IAIR-IMM team. Our team was competing in two scenarios: a) Reconnaissance and surveillance in urban structures (USAR), b) Search and rescue in a smoke-filled underground structure. The main task for this system from our team point of view was to build 3D metric map of the environment and to find OPIs (Objects of Potential Interest). Therefore in this paper we described the vision system for objects recognition and 3D map building. The system is composed of mobile robot equipped with camera, 3D laser measurement system and base station composed of computer equipped with NVIDIA GPU for parallel processing of derived clouds of points. The main focus of the work was to improve the performance of the operator controlling the robot in harsh environment. We achieved satisfactory results that could be still improved in many aspects. In experimental part we demonstrated validation of vision recognition system and 3D maps built during preparation trials and during final competition. The best quantitative result of this work was 3rd place in USAR scenario. Unfortunately, we could not build the map in a smoke-filled underground structure, but the result is also very interesting for future developments.

Use of multi-domain robots in search and rescue operations — Contributions of the ICARUS team to the euRathlon 2015 challenge

Today, in our landscape perception exists a gap that needs to be fulfilled. Its important to increase the coverage, temporal and spatial resolution in order to cover this gap, as well as reduce costs with human resources that usually take this kind of tasks. Unmanned Autonomous vehicles with their inherent autonomy and reduced needs of human and communication resources, can provide additional capabilities and a new innovative solution to this problem This paper presents and describes the participation of ICARUS Team at euRathlon 2015 and the importance of this type of events performed with multiple unnamed systems.

Intelligent Mobile System for Improving Spatial Design Support and Security Inside Buildings

This paper concerns the an intelligent mobile application for spatial design support and security domain. Mobility has two aspects in our research: The first one is the usage of mobile robots for 3D mapping of urban areas and for performing some specific tasks. The second mobility aspect is related with a novel Software as a Service system that allows access to robotic functionalities and data over the Ethernet, thus we demonstrate the use of the novel NVIDIA GRID technology allowing to virtualize the graphic processing unit. We introduce Complex Shape Histogram, a core component of our artificial intelligence engine, used for classifying 3D point clouds with a Support Vector Machine. We use Complex Shape Histograms also for loop closing detection in the simultaneous localization and mapping algorithm. Our intelligent mobile system is built on top of the Qualitative Spatio-Temporal Representation and Reasoning framework. This framework defines an ontology and a semantic model, which are used for building the intelligent mobile user interfaces. We show experiments demonstrating advantages of our approach. In addition, we test our prototypes in the field after the end-user case studies demonstrating a relevant contribution for future intelligent mobile systems that merge mobile robots with novel data centers.

Accurate 3D mapping and immersive visualization for Search and Rescue

This paper concentrates on the topic of gathering, processing and presenting 3D data for use in Search and Rescue operations. The data are gathered by unmanned ground platforms, in form of 3D point clouds. The clouds are matched and transformed into a consistent, highly accurate 3D model. The paper describes the pipeline for such matching based on Iterative Closest Point algorithm supported by loop closing done with LUM method. The pipeline was implemented for parallel computation with Nvidia CUDA, which leads to higher matching accuracy and lower computation time. An analysis of performance for multiple GPUs is presented. The second problem discussed in the paper is immersive visualization of 3d data for search and rescue personnel. Five strategies are discussed: plain 3D point cloud, hypsometry, normal vectors, space descriptors and an approach based on light simulation through the use of NVIDIA OptiX Ray Tracing Engine. The results from each strategy were shown to end users for validation. The paper discusses the feedback given. The results of the research are used in the development of a support module for ICARUS project.