Fernando Auat Cheein

Human-machine interfaces based on EMG and EEG applied to robotic systems

BackgroundTwo different Human-Machine Interfaces (HMIs) were developed, both based on electro-biological signals. One is based on the EMG signal and the other is based on the EEG signal. Two major features of such interfaces are their relatively simple data acquisition and processing systems, which need just a few hardware and software resources, so that they are, computationally and financially speaking, low cost solutions. Both interfaces were applied to robotic systems, and their performances are analyzed here. The EMG-based HMI was tested in a mobile robot, while the EEG-based HMI was tested in a mobile robot and a robotic manipulator as well.ResultsExperiments using the EMG-based HMI were carried out by eight individuals, who were asked to accomplish ten eye blinks with each eye, in order to test the eye blink detection algorithm. An average rightness rate of about 95% reached by individuals with the ability to blink both eyes allowed to conclude that the system could be used to command devices. Experiments with EEG consisted of inviting 25 people (some of them had suffered cases of meningitis and epilepsy) to test the system. All of them managed to deal with the HMI in only one training session. Most of them learnt how to use such HMI in less than 15 minutes. The minimum and maximum training times observed were 3 and 50 minutes, respectively.ConclusionSuch works are the initial parts of a system to help people with neuromotor diseases, including those with severe dysfunctions. The next steps are to convert a commercial wheelchair in an autonomous mobile vehicle; to implement the HMI onboard the autonomous wheelchair thus obtained to assist people with motor diseases, and to explore the potentiality of EEG signals, making the EEG-based HMI more robust and faster, aiming at using it to help individuals with severe motor dysfunctions.

Agricultural Robotics: Unmanned Robotic Service Units in Agricultural Tasks

The application of agricultural machinery in precision agriculture has experienced an increase in investment and research due to the use of robotics applications in the machinery design and task executions. Precision autonomous farming is the operation, guidance, and control of autonomous machines to carry out agricultural tasks. It motivates agricultural robotics. It is expected that, in the near future, autonomous vehicles will be at the heart of all precision agriculture applications [1]. The goal of agricultural robotics is more than just the application of robotics technologies to agriculture. Currently, most of the automatic agricultural vehicles used for weed detection, agrochemical dispersal, terrain leveling, irrigation, etc. are manned. An autonomous performance of such vehicles will allow for the continuous supervision of the field, since information regarding the environment can be autonomously acquired, and the vehicle can then perform its task accordingly.

Trajectory Tracking Controller Design for Unmanned Vehicles: A New Methodology

A major issue in the automatic guidance of vehicles is the design of control laws dedicated to the specific mobile platform used. Thus, if the model associated with the mobile platform or its constraints change, a new control law must be designed. In this paper, the problem of designing trajectory tracking controllers for unmanned vehicles is addressed. The methodology proposed here is an algebraic approach for obtaining optimum and stable trajectory tracking controllers for nonholonomic vehicles. Such an algebraic formulation makes the proposal suitable for embedded applications. The stability and optimality of the proposed controllers design method is theoretically proven for both bicycle-type and unicycle-type mobile robots, although the methodology can be extended to other types of unmanned vehicles. Four tests were carried out in this work in order to show the advantages of the proposal: the step discontinuity test, the curvature test, the real world test, and navigation under disturbances in the control actions. The results obtained were compared with four trajectory tracking controllers previously published in the literature. Additionally, an agricultural application is included in order to show the performance of the proposed controller when applied to a service unit within an agricultural environment. Field experiments demonstrating the capabilities of our proposal are also reported and discussed.

Towards a New Modality-Independent Interface for a Robotic Wheelchair

This work presents the development of a robotic wheelchair that can be commanded by users in a supervised way or by a fully automatic unsupervised navigation system. It provides flexibility to choose different modalities to command the wheelchair, in addition to be suitable for people with different levels of disabilities. Users can command the wheelchair based on their eye blinks, eye movements, head movements, by sip-and-puff and through brain signals. The wheelchair can also operate like an auto-guided vehicle, following metallic tapes, or in an autonomous way. The system is provided with an easy to use and flexible graphical user interface onboard a personal digital assistant, which is used to allow users to choose commands to be sent to the robotic wheelchair. Several experiments were carried out with people with disabilities, and the results validate the developed system as an assistive tool for people with distinct levels of disability.

SLAM algorithm applied to robotics assistance for navigation in unknown environments.

BackgroundThe combination of robotic tools with assistance technology determines a slightly explored area of applications and advantages for disability or elder people in their daily tasks. Autonomous motorized wheelchair navigation inside an environment, behaviour based control of orthopaedic arms or users preference learning from a friendly interface are some examples of this new field. In this paper, a Simultaneous Localization and Mapping (SLAM) algorithm is implemented to allow the environmental learning by a mobile robot while its navigation is governed by electromyographic signals. The entire system is part autonomous and part user-decision dependent (semi-autonomous). The environmental learning executed by the SLAM algorithm and the low level behaviour-based reactions of the mobile robot are robotic autonomous tasks, whereas the mobile robot navigation inside an environment is commanded by a Muscle-Computer Interface (MCI).MethodsIn this paper, a sequential Extended Kalman Filter (EKF) feature-based SLAM algorithm is implemented. The features correspond to lines and corners -concave and convex- of the environment. From the SLAM architecture, a global metric map of the environment is derived. The electromyographic signals that command the robots movements can be adapted to the patients disabilities. For mobile robot navigation purposes, five commands were obtained from the MCI: turn to the left, turn to the right, stop, start and exit. A kinematic controller to control the mobile robot was implemented. A low level behavior strategy was also implemented to avoid robots collisions with the environment and moving agents.ResultsThe entire system was tested in a population of seven volunteers: three elder, two below-elbow amputees and two young normally limbed patients. The experiments were performed within a closed low dynamic environment. Subjects took an average time of 35 minutes to navigate the environment and to learn how to use the MCI. The SLAM results have shown a consistent reconstruction of the environment. The obtained map was stored inside the Muscle-Computer Interface.ConclusionsThe integration of a highly demanding processing algorithm (SLAM) with a MCI and the communication between both in real time have shown to be consistent and successful. The metric map generated by the mobile robot would allow possible future autonomous navigation without direct control of the user, whose function could be relegated to choose robot destinations. Also, the mobile robot shares the same kinematic model of a motorized wheelchair. This advantage can be exploited for wheelchair autonomous navigation.

Large-scale mapping in complex field scenarios using an autonomous car

We present a mapping system for large-scale environments with changing features.We describe in a high level of detail a mapping algorithm for 3D-LiDAR.G-ICP was used for loop closure displacement calculation in GraphSLAM.Experiments were made with an autonomous vehicle in 3 real world environments. In this paper, we present an end-to-end framework for precise large-scale mapping with applications in autonomous driving. In special, the problem of mapping complex environments, with features changing from tree-lined streets to urban areas with dense traffic, is studied. The robotic car is equipped with an odometry sensor, a 3D LiDAR Velodyne HDL-32E, a IMU, and a low cost GPS, and the data generated by these sensors are integrated in a pose-based GraphSLAM estimator. A new strategy for identification and correction of odometry data using evolutionary algorithms is presented. This new strategy makes odometry data significantly more consistent with GPS. Loop closures are detected using GPS data, and GICP, a 3D point cloud registration algorithm, is used to estimate the displacement between the different travels over the same region. After path estimation, 3D LiDAR data is used to build an occupancy grid mapping of the environment. A detailed mathematical description of how occupancy evidence can be calculated from the point clouds is given, and a submapping strategy to handle memory limitations is presented as well. The proposed framework is tested in three real world environments with different sizes, and features: a parking lot, a university beltway, and a city neighborhood. In all cases, satisfactory maps were built, with precise loop closures even when the vehicle traveled long distances between them.

Real-time approaches for characterization of fully and partially scanned canopies in groves

Characterization of orchards enhances agricultural processes and resource management.Four computational geometry methods to estimate tree canopy volumes were evaluated.The methodologies were validated using real agricultural scenarios 3D LiDAR data.The methodologies have shown to converge to steady state estimations of the volume.Resources can be saved when partially scanning canopies. Efficient information management in orchard characterization leads to more efficient agricultural processes. In this brief, a set of computational geometry methods are presented and evaluated for orchard characterization; in particular, for the estimation of canopy volume and shape in groves and orchards using a LiDAR (Light Detection And Ranging) sensor mounted on an agricultural service unit. The proposed approaches were evaluated and validated in the field, showing they are convergent in the estimation process and that they are able to estimate the crown volume for fully scanned canopies in real time; for partially observed tree crowns, accuracy decreases up to 30% (the worst case). The latter is the major contribution of this brief since it implies that the automated service unit does not need to cover all alley-ways for an accurate modeling of the orchard, thus saving valuable resources.

Solution to a door crossing problem for an autonomous wheelchair

This paper proposes a solution to a door crossing problem in unknown environments for an autonomous wheelchair. The problem is solved by a dynamic path planning algorithm implementation based on successive frontier points determination. An adaptive trajectory tracking control based on the dynamic model is implemented on the vehicle to direct the wheelchair motion along the path in a smooth movement. An EKF feature-based SLAM is also implemented on the vehicle which gives an estimate of the wheelchair pose inside the environment. The SLAM allows the map reconstruction of the environment for future safe navigation purposes. The entire system is evaluated in a real time simulator of a robotic wheelchair.

Analysis of different feature selection criteria based on a covariance convergence perspective for a SLAM algorithm.

This paper introduces several non-arbitrary feature selection techniques for a Simultaneous Localization and Mapping (SLAM) algorithm. The feature selection criteria are based on the determination of the most significant features from a SLAM convergence perspective. The SLAM algorithm implemented in this work is a sequential EKF (Extended Kalman filter) SLAM. The feature selection criteria are applied on the correction stage of the SLAM algorithm, restricting it to correct the SLAM algorithm with the most significant features. This restriction also causes a decrement in the processing time of the SLAM. Several experiments with a mobile robot are shown in this work. The experiments concern the map reconstruction and a comparison between the different proposed techniques performance. The experiments were carried out at an outdoor environment composed by trees, although the results shown herein are not restricted to a special type of features.

Teleoperation of an Industrial Manipulator Through a TCP/IP Channel Using EEG Signals

This paper presents an industrial manipulator teleoperated via TCP/IP using a brain computer interface (BCI). Through a BCI based on event related potentials (ERD and ERS), the operator is capable to select a position on the manipulators workspace, that should be reached by the manipulator. A pose controller is executed on a remote PC and when new references are received, the controller calculates the necessary control actions so that the manipulator reaches the desired position. A bio-feedback link is closed through the operator watching to a visual interface, allowing him/her to visualize the manipulators workspace and the movements being executed. Besides the application of the BCI, the paper also shows how versatile it is, stressing features like its easy integration with robotic devices, its low cost and the short training time it requires