Enrique Hortal

SVM-based Brain–Machine Interface for controlling a robot arm through four mental tasks

Abstract Human–Machine Interfaces can be very useful to improve the quality of life of physically impaired users. In this work, a non-invasive spontaneous Brain–Machine Interface (BMI) has been designed to control a robot arm through the mental activity of the users. This BMI uses the classification of four mental tasks in order to manage the movements of the robot. The high accuracy in the classification of these tasks (around 70%) allows a quick accomplishment of the experiment designed, even with the low signal-to-noise ratio of this kind of signals. The experiment consists of reaching four points in the workspace of an industrial robot in the established order. After a brief training, the volunteers are able to control the robot in a real time activity. The real time test shows that the system can be applied to do more complex activity such as pick and place tasks if a supplementary system is added. These interfaces are very adequate in the control of rehabilitation or assistance systems for people suffering from motor impairment.

Control of a 2 DoF robot using a Brain-Machine Interface

In this paper, a non-invasive spontaneous Brain-Machine Interface (BMI) is used to control the movement of a planar robot. To that end, two mental tasks are used to manage the visual interface that controls the robot. The robot used is a PupArm, a force-controlled planar robot designed by the nBio research group at the Miguel Hernández University of Elche (Spain). Two control strategies are compared: hierarchical and directional control. The experimental test (performed by four users) consists of reaching four targets. The errors and time used during the performance of the tests are compared in both control strategies (hierarchical and directional control). The advantages and disadvantages of each method are shown after the analysis of the results. The hierarchical control allows an accurate approaching to the goals but it is slower than using the directional control which, on the contrary, is less precise. The results show both strategies are useful to control this planar robot. In the future, by adding an extra device like a gripper, this BMI could be used in assistive applications such as grasping daily objects in a realistic environment. In order to compare the behavior of the system taking into account the opinion of the users, a NASA Tasks Load Index (TLX) questionnaire is filled out after two sessions are completed.

Using a brain-machine interface to control a hybrid upper limb exoskeleton during rehabilitation of patients with neurological conditions

BackgroundAs a consequence of the increase of cerebro-vascular accidents, the number of people suffering from motor disabilities is raising. Exoskeletons, Functional Electrical Stimulation (FES) devices and Brain-Machine Interfaces (BMIs) could be combined for rehabilitation purposes in order to improve therapy outcomes.MethodsIn this work, a system based on a hybrid upper limb exoskeleton is used for neurological rehabilitation. Reaching movements are supported by the passive exoskeleton ArmeoSpring and FES. The movement execution is triggered by an EEG-based BMI. The BMI uses two different methods to interact with the exoskeleton from the user’s brain activity. The first method relies on motor imagery tasks classification, whilst the second one is based on movement intention detection.ResultsThree healthy users and five patients with neurological conditions participated in the experiments to verify the usability of the system. Using the BMI based on motor imagery, healthy volunteers obtained an average accuracy of 82.9 ± 14.5 %, and patients obtained an accuracy of 65.3 ± 9.0 %, with a low False Positives rate (FP) (19.2 ± 10.4 % and 15.0 ± 8.4 %, respectively). On the other hand, by using the BMI based on detecting the arm movement intention, the average accuracy was 76.7 ± 13.2 % for healthy users and 71.6 ± 15.8 % for patients, with 28.7 ± 19.9 % and 21.2 ± 13.3 % of FP rate (healthy users and patients, respectively).ConclusionsThe accuracy of the results shows that the combined use of a hybrid upper limb exoskeleton and a BMI could be used for rehabilitation therapies. The advantage of this system is that the user is an active part of the rehabilitation procedure. The next step will be to verify what are the clinical benefits for the patients using this new rehabilitation procedure.

Evaluating Classifiers to Detect Arm Movement Intention from EEG Signals

This paper presents a methodology to detect the intention to make a reaching movement with the arm in healthy subjects before the movement actually starts. This is done by measuring brain activity through electroencephalographic (EEG) signals that are registered by electrodes placed over the scalp. The preparation and performance of an arm movement generate a phenomenon called event-related desynchronization (ERD) in the mu and beta frequency bands. A novel methodology to characterize this cognitive process based on three sums of power spectral frequencies involved in ERD is presented. The main objective of this paper is to set the benchmark for classifiers and to choose the most convenient. The best results are obtained using an SVM classifier with around 72% accuracy. This classifier will be used in further research to generate the control commands to move a robotic exoskeleton that helps people suffering from motor disabilities to perform the movement. The final aim is that this brain-controlled robotic exoskeleton improves the current rehabilitation processes of disabled people.

Combining a Brain-Machine Interface and an Electrooculography Interface to perform pick and place tasks with a robotic arm

This paper presents a multimodal Human-Machine Interface system that combines an Electrooculography Interface and a Brain-Machine Interface. This multimodal interface has been used to control a robotic arm to perform pick and place tasks in a three dimensional environment. Five volunteers were asked to pick two boxes and place them in different positions. The results prove the feasibility of the system in the performance of pick and place tasks. By using the multimodal interface, all the volunteers (even naive users) were able to successfully move two objects within a satisfactory period of time with the help of the robotic arm. A multimodal HMI to perform pick and place tasks with a robotic arm is presented.The EOG interface is applied to control planar movements and to operate the gripper.The BMI is used to control the height of the gripper through two mental tasks.The system had been tested by five healthy subjects.The results prove the feasibility of the system in the performance of these tasks.

Online classification of two mental tasks using a SVM-based BCI system

A Brain-Computer Interface (BCI) can be very useful to help people with several movement disabilities to improve their independence or to assist them in rehabilitation tasks. In this paper, the results of the online classification of two mental tasks from electroencephalographic signals (EEG) are shown. The objective of this paper is to determine whether the accuracy in the online differentiation of two mental tasks could be enough to command a robot arm using two mental tasks. The results demonstrate that the features obtained using periodogram (a Power Spectral Density estimation) and the classification of these using a SVM-based (Support Vector Machine) system can be used in a reliable control of a robot arm. For all the users, the accuracy is around 87±2%. This accuracy is enough to be used to this end in real time.

Analyzing EEG signals to detect unexpected obstacles during walking

BackgroundWhen an unexpected perturbation in the environment occurs, the subsequent alertness state may cause a brain activation responding to that perturbation which can be detected and employed by a Brain-Computer Interface (BCI). In this work, the possibility of detecting a sudden obstacle appearance analyzing electroencephalographic (EEG) signals is assessed. For this purpose, different features of EEG signals are evaluated during the appearance of sudden obstacles while a subject is walking on a treadmill. The future goal is to use this procedure to detect any obstacle appearance during walking when the user is wearing a lower limb exoskeleton in order to generate an emergency stop command for the exoskeleton. This would enhance the user-exoskeleton interaction, improving the safety mechanisms of current exoskeletons.MethodsIn order to detect the change in the brain activity when an obstacle suddenly appears, different features of EEG signals are evaluated using the recordings of five healthy subjects. Since the change in the brain activity occurs in the time domain, the features evaluated are: common spatial patterns, average power, slope, and the coefficients of a polynomial fit. A Linear Discriminant Analysis-based classifier is used to differentiate between two conditions: the appearance or not of an obstacle. The evaluation of the performance to detect the obstacles is made in terms of accuracy, true positive (TP) and false positive (FP) rates.ResultsFrom the offline analysis, the best performance is achieved when the slope or the polynomial coefficients are used as features, with average detection accuracy rates of 74.0 and 79.5 %, respectively. These results are consistent with the pseudo-online results, where a complete EEG recording is segmented into windows of 500 ms and overlapped 400 ms, and a decision about the obstacle appearance is made for each window. The results of the best subject were 11 out of 14 obstacles detected with a rate of 9.09 FPs/min, and 10 out of 14 obstacles detected with a rate of 6.34 FPs/min using slope and polynomial coefficients features, respectively.ConclusionsAn EEG-based BCI can be developed to detect the appearance of unexpected obstacles. The average accuracy achieved is 79.5 % of success rate with a low number of false detections. Thus, the online performance of the BCI would be suitable for commanding in a safely way a lower limb exoskeleton during walking.

Mental tasks selection method for a SVM-based BCI system

In this work, a study that analyzes the best combinations of mental tasks in a Brain-Computer Interface (BCI) using a classifier based on Support Vector Machine (SVM) is presented. To that end, twelve mental tasks of different nature are analyzed and the results of the classification for the combinations of two, three and four tasks are obtained. Four volunteers performed registers of the twelve tasks. The main goal is to find the combination of more than three mental tasks that obtains the higher reliability to apply it in future complex applications that require the use of more than three mental control commands. After a selection procedure, the results obtained show higher success percentages and important differences according to the nature of the mental tasks, which suggest that it is possible to differentiate with enough reliability between more than three mental tasks using the methodology proposed.

Assessing Movement Factors in Upper Limb Kinematics Decoding from EEG Signals

The past decades have seen the rapid development of upper limb kinematics decoding techniques by performing intracortical recordings of brain signals. However, the use of non-invasive approaches to perform similar decoding procedures is still in its early stages. Recent studies show that there is a correlation between electroencephalographic (EEG) signals and hand-reaching kinematic parameters. From these studies, it could be concluded that the accuracy of upper limb kinematics decoding depends, at least partially, on the characteristics of the performed movement. In this paper, we have studied upper limb movements with different speeds and trajectories in a controlled environment to analyze the influence of movement variability in the decoding performance. To that end, low frequency components of the EEG signals have been decoded with linear models to obtain the position of the volunteer’s hand during performed trajectories grasping the end effector of a planar manipulandum. The results confirm that it is possible to obtain kinematic information from low frequency EEG signals and show that decoding performance is significantly influenced by movement variability and tracking accuracy as continuous and slower movements improve the accuracy of the decoder. This is a key factor that should be taken into account in future experimental designs.

Decoding the Attentional Demands of Gait through EEG Gamma Band Features

Rehabilitation techniques are evolving focused on improving their performance in terms of duration and level of recovery. Current studies encourage the patient’s involvement in their rehabilitation. Brain-Computer Interfaces are capable of decoding the cognitive state of users to provide feedback to an external device. On this paper, cortical information obtained from the scalp is acquired with the goal of studying the cognitive mechanisms related to the users’ attention to the gait. Data from 10 healthy users and 3 incomplete Spinal Cord Injury patients are acquired during treadmill walking. During gait, users are asked to perform 4 attentional tasks. Data obtained are treated to reduce movement artifacts. Features from δ(1 − 4Hz), θ(4 − 8Hz), α(8 − 12Hz), β(12 − 30Hz), γlow(30 − 50Hz), γhigh(50 − 90Hz) frequency bands are extracted and analyzed to find which ones provide more information related to attention. The selected bands are tested with 5 classifiers to distinguish between tasks. Classification results are also compared with chance levels to evaluate performance. Results show success rates of ∼67% for healthy users and ∼59% for patients. These values are obtained using features from γ band suggesting that the attention mechanisms are related to selective attention mechanisms, meaning that, while the attention on gait decreases the level of attention on the environment and external visual information increases. Linear Discriminant Analysis, K-Nearest Neighbors and Support Vector Machine classifiers provide the best results for all users. Results from patients are slightly lower, but significantly different, than those obtained from healthy users supporting the idea that the patients pay more attention to gait during non-attentional tasks due to the inherent difficulties they have during normal gait. This study provides evidence of the existence of classifiable cortical information related to the attention level on the gait. This fact could allow the development of a real-time system that obtains the attention level during lower limb rehabilitation. This information could be used as feedback to adapt the rehabilitation strategy.