Paulo Sousa Dias

Mission planning and specification in the Neptus framework

The C3I (command, control, communication and information) Neptus framework which is being developed at the Underwater Systems and Technology Laboratory (USTL/LSTS) is presented. Neptus is a modular mixed initiative framework (human operators in the control loop) for the operation of heterogeneous teams of vehicles such as autonomous and remotely operated underwater, surface, land, and air vehicles. Neptus is composed of mission and vehicle planning, supervision, and post-mission analysis modules which are provided as services across a network. This paper focus mainly on the mission definition module with the presentation of MDL - a XML based language for mission definition

IMC: A communication protocol for networked vehicles and sensors

This paper presents the Inter-Module Communication (IMC) protocol, a message-oriented protocol designed and implemented in the Underwater Systems and Technology Laboratory (LSTS) to build interconnected systems of vehicles, sensors and human operators that are able to pursue common goals cooperatively by exchanging real-time information about the environment and updated objectives. IMC abstracts hardware and communication heterogeniety by providing a shared set of messages that can be serialized and transferred over different means.

Neptus - a framework to support multiple vehicle operation

This paper describes the development of a C3I (communications, command, control and intelligence/information) infrastructure, taking place at the Underwater Systems and Technology Laboratory (LSTS) of FEUP. This infrastructure, the Neptus framework, goal is to support the coordinated operation of heterogeneous teams, which include autonomous and remotely operated underwater, surface, land, and air vehicles and people. People perform a fundamental role, not only in the case of remotely operated vehicles, but also with autonomous vehicles where mix-initiative operation is a requirement. The operational scenarios for these teams are mainly environmental monitoring missions but could also include environmental disaster scenarios, rescue missions, etc. The Neptus distributed architecture is service oriented, which enables high degrees of interoperability between applications, of scalability (number of nodes), and of reconfiguration (number and type of nodes).

AUV Control and Communication using Underwater Acoustic Networks

Underwater acoustic networks can be quite effective to establish communication links between autonomous underwater vehicles (AUVs) and other vehicles or control units, enabling complex vehicle applications and control scenarios. A communications and control framework to support the use of underwater acoustic networks and sample application scenarios are described for single and multi-AUV operation.

Implementation of a Control Architecture for Networked Vehicle Systems

Abstract This paper describes the layered control architecture and its software implementation developed and used at the Underwater Systems and Technology Laboratory. The architecture is implemented as a toolchain which consists on three main entities: DUNE onboard software, Neptus command and control software and a common IMC message-based communication protocol. The LSTS software toolchain has been tested throughout various field deployments where it was used to control heterogeneous autonomous vehicles like AUVs, ASVs, UAVs and ROVs in both single and multi-vehicle operations.

Integrated Monitoring of Mola mola Behaviour in Space and Time.

Over the last decade, ocean sunfish movements have been monitored worldwide using various satellite tracking methods. This study reports the near-real time monitoring of fine-scale (< 10 m) behaviour of sunfish. The study was conducted in southern Portugal in May 2014 and involved satellite tags and underwater and surface robotic vehicles to measure both the movements and the contextual environment of the fish. A total of four individuals were tracked using custom-made GPS satellite tags providing geolocation estimates of fine-scale resolution. These accurate positions further informed sunfish areas of restricted search (ARS), which were directly correlated to steep thermal frontal zones. Simultaneously, and for two different occasions, an Autonomous Underwater Vehicle (AUV) video-recorded the path of the tracked fish and detected buoyant particles in the water column. Importantly, the densities of these particles were also directly correlated to steep thermal gradients. Thus, both sunfish foraging behaviour (ARS) and possibly prey densities, were found to be influenced by analogous environmental conditions. In addition, the dynamic structure of the water transited by the tracked individuals was described by a Lagrangian modelling approach. The model informed the distribution of zooplankton in the region, both horizontally and in the water column, and the resultant simulated densities positively correlated with sunfish ARS behaviour estimator (rs = 0.184, p<0.001). The model also revealed that tracked fish opportunistically displace with respect to subsurface current flow. Thus, we show how physical forcing and current structure provide a rationale for a predator’s fine-scale behaviour observed over a two weeks in May 2014.

LAUV: The Man-Portable Autonomous Underwater Vehicle

Abstract The global market offers an extensive catalog of commercial Autonomous Underwater Vehicles with different shapes, sizes and capabilities. This paper addresses the innovative concept which led to the development of a new commercial AUV product to compete in such a dynamic market. The LAUV was planned to be a lightweight vehicle that can be easily launched, operated and recovered with a minimal operational setup by end-users having heterogeneous backgrounds and without any complex prior training or know-how. Details of the design, installed components, sensors, sonars and operational field results, are discussed herein. The system has been deployed and operated in different environments for different objectives accumulating hundreds of successful real-world missions.

Mission Review and Analysis

This paper presents the mission review and analysis module of a C3I (command, control, communication and information) infrastructure-the Neptus framework. This is a mix-initiative environment that its being developed in the Underwater Systems and Technology Laboratory (USTL/LSTS) with the goal to support the coordinated operation of heterogeneous teams of vehicles. This includes autonomous and remotely operated underwater, surface, land, and air vehicles and people. People perform a fundamental role, not only in the case of remotely operated vehicles, but also with autonomous vehicles where mix-initiative operation is a requirement. The Neptus is very modular and will be heavily based on services with a distributed architecture. This paper focus mainly on the mission review and analysis where the data collected in a mission is prepared for analysis

Large scale data collection using networks of heterogeneous vehicles and sensors

This paper presents recent developments from the Underwater Systems and Technology Laboratory in order to integrate data received simultaneously from static and free-moving wireless sensors as well as unmanned vehicles, allowing real-time access of data using ubiquitous technologies. Live data is communicated using pre-established XML data formats and using the HTTP protocol for communication. Compatible systems may both send or receive this data following a publish/subscribe design pattern. Here, we describe the architecture as well as the various systems that make part of it: operational consoles, unmanned vehicles, wireless sensor networks and drifting sensors. The entire system is evaluated by presenting results from a real-world experiment.

Network of heterogeneous autonomous vehicles for marine research and management

In April 2016, NTNU, FFI, Kongsberg Seatex, LSTS and Maritime Robotics set up an experiment to explore their capability to combine the research vessel Gunnerus, the AUV Hugin, the UAV X8 and the USV Mariner in a network of heterogeneous unmanned vehicles. Communication, manoeuvring, onboard processing and operational complexity are essential components in such networks. To provide communication the MBR broadband radio system was implemented. To show the capabilities of the system proposed, a scenario with seabed mapping and target recognition was defined. The experiment made it apparent that these networks has the potential of significantly saving cost for data collection in marine research and management by reducing ship time. To fully unlock the potential of networks of heterogeneous unmanned vehicles, the missions of each vehicle need to be more integrated.