Tristan Perez

DeepFruits: A Fruit Detection System Using Deep Neural Networks

This paper presents a novel approach to fruit detection using deep convolutional neural networks. The aim is to build an accurate, fast and reliable fruit detection system, which is a vital element of an autonomous agricultural robotic platform; it is a key element for fruit yield estimation and automated harvesting. Recent work in deep neural networks has led to the development of a state-of-the-art object detector termed Faster Region-based CNN (Faster R-CNN). We adapt this model, through transfer learning, for the task of fruit detection using imagery obtained from two modalities: colour (RGB) and Near-Infrared (NIR). Early and late fusion methods are explored for combining the multi-modal (RGB and NIR) information. This leads to a novel multi-modal Faster R-CNN model, which achieves state-of-the-art results compared to prior work with the F1 score, which takes into account both precision and recall performances improving from 0.807 to 0.838 for the detection of sweet pepper. In addition to improved accuracy, this approach is also much quicker to deploy for new fruits, as it requires bounding box annotation rather than pixel-level annotation (annotating bounding boxes is approximately an order of magnitude quicker to perform). The model is retrained to perform the detection of seven fruits, with the entire process taking four hours to annotate and train the new model per fruit.

Brief paper: Dynamic positioning of marine craft using a port-Hamiltonian framework

Dynamic positioning of marine craft refers to the use of the propulsion system to regulate the vessel position and heading. This type of motion control is commonly used in the offshore industry for surface vessels, and it is also used for some underwater vehicles. In this paper, we use a port-Hamiltonian framework to design a novel nonlinear set-point-regulation controller with integral action. The controller handles input saturation and guarantees internal stability, rejection of unknown constant disturbances, and (integral-)input-to-state stability.

Model Predictive Rudder Roll Stabilization Control for Ships

Abstract In this paper, the problem of rudder roll stabilization for ships is addressed using model predictive control. The problem of rudder roll stabilization arises from using the rudder produced rolling motion of the ship to reject the undesirable wave produced roll. The main limiting factor of this problem is the highly non linear behaviour of the mechanical devices that command the rudder. The rudder mechanisms impose constraints on the maximum slew rate and magnitude attainable for the rudder movement, which directly affect the roll stabilization performance. The application of model predictive control is motivated by its essential ability to handle these kinds of constraints.

MARINE VESSEL MODELS IN CHANGING OPERATIONAL CONDITIONS—A TUTORIAL

Abstract This tutorial paper provides an overview, from a systems perspective, of the topic of motion dynamics of surface marine vessels and models. It presents a classification of parametric models currently used to describe marine vessel dynamics. The models presented have validity only for particular vessel operational conditions (VOCs), and a large number of work has already been dedicated to system identification of these models. Due to the increase of complexity of vessels and the operations they perform, however, more applications of system identification are needed to obtain to models valid across different VOCs. The main aim of the paper is therefore to highlight the essential characteristics of marine system dynamics to provide a background for researchers and engineers attempting future applications of system identification to marine systems.

A Survey of Control Allocation Methods for Underwater Vehicles

A control allocation system implements a function that maps the desired control forces generated by the vehicle motion controller into the commands of the different actuators. In this article, a survey of control allocation methods for over-actuated underwater vehicles is presented. The methods are applicable for both surface vessels and underwater vehicles. The paper presents a survey of control allocation methods with focus on mathematical representation and solvability of thruster allocation problems. The paper is useful for university students and engineers who want to get an overview of state-of-the art control allocation methods as well as advance methods to solve more complex problems.

Performance degradation in feedback control due to constraints

In this note, we present a method to characterize the degrada- tion in performance that arises in linear systems due to constraints imposed on the magnitude of the control signal to avoid saturation effects. We do this in the context of cheap control for tracking step signals.

Analysis of Ship Roll Gyrostabiliser Control

The use of dedicated spinning wheels that generate gyroscopic forces for reducing the roll motion of ships was considered and tested over 100 years ago. These devices, known as gyrostabilisers, presented a remarkable performance, but they fell into disuse due to their relatively large size and, primarily, due to the inability of the control systems to maintain performance over an extended envelope of sea states and sailing conditions (speed and heading relative to the waves). To date, advances in materials, mechanical design, electrical drives, and computer control systems have resulted in a revitalized interest in gyro-stabilisers for ships. This paper revisits the modelling of the coupled vessel-gyrostabiliser and delves into the associated gyrostabiliser control design problem. It also describes design trade-offs and potential performance limitations. A simulation study based on a navy patrol vessel is presented.

Autonomous Sweet Pepper Harvesting for Protected Cropping Systems

In this letter, we present a new robotic harvester (Harvey) that can autonomously harvest sweet pepper in protected cropping environments. Our approach combines effective vision algorithms with a novel end-effector design to enable successful harvesting of sweet peppers. Initial field trials in protected cropping environments, with two cultivar, demonstrate the efficacy of this approach achieving a 46% success rate for unmodified crop, and 58% for modified crop. Furthermore, for the more favourable cultivar we were also able to detach 90% of sweet peppers, indicating that improvements in the grasping success rate would result in greatly improved harvesting performance.

Ship Collision Avoidance and COLREGS Compliance Using Simulation-Based Control Behavior Selection With Predictive Hazard Assessment

This paper describes a concept for a collision avoidance system for ships, which is based on model predictive control. A finite set of alternative control behaviors are generated by varying two parameters: offsets to the guidance course angle commanded to the autopilot and changes to the propulsion command ranging from nominal speed to full reverse. Using simulated predictions of the trajectories of the obstacles and ship, compliance with the Convention on the International Regulations for Preventing Collisions at Sea and collision hazards associated with each of the alternative control behaviors are evaluated on a finite prediction horizon, and the optimal control behavior is selected. Robustness to sensing error, predicted obstacle behavior, and environmental conditions can be ensured by evaluating multiple scenarios for each control behavior. The method is conceptually and computationally simple and yet quite versatile as it can account for the dynamics of the ship, the dynamics of the steering and propulsion system, forces due to wind and ocean current, and any number of obstacles. Simulations show that the method is effective and can manage complex scenarios with multiple dynamic obstacles and uncertainty associated with sensors and predictions.

Antispin Thrust Allocation for Marine Vessels

In extreme weather conditions, thrusters on ships and rigs may be subject to severe thrust losses caused by ventilation and in-and-out-of-water events. When a thruster ventilates, air is sucked down from the surface and into the propeller. In more severe cases, parts of or even the whole propeller can be out of the water. These losses vary rapidly with time and cause increased wear and tear in addition to reduced thruster performance. In this paper, a thrust allocation strategy is proposed to reduce the effects of thrust losses and to reduce the possibility of multiple ventilation events. This thrust allocation strategy is named antispin thrust allocation, based on the analogous behavior of antispin wheel control of cars. The proposed thrust allocation strategy is important for improving the life span of the propulsion system and the accuracy of positioning for vessels conducting station keeping in terms of dynamic positioning or thruster-assisted position mooring. Application of this strategy can result in an increase of operational time and, thus, increased profitability. The performance of the proposed allocation strategy is demonstrated with experiments on a model ship.