Gerolf Vanacker

A Brain-Actuated Wheelchair: Asynchronous and Non-Invasive Brain-Computer Interfaces for Continuous Control of Robots

OBJECTIVE To assess the feasibility and robustness of an asynchronous and non-invasive EEG-based Brain-Computer Interface (BCI) for continuous mental control of a wheelchair. METHODS In experiment 1 two subjects were asked to mentally drive both a real and a simulated wheelchair from a starting point to a goal along a pre-specified path. Here we only report experiments with the simulated wheelchair for which we have extensive data in a complex environment that allows a sound analysis. Each subject participated in five experimental sessions, each consisting of 10 trials. The time elapsed between two consecutive experimental sessions was variable (from 1h to 2months) to assess the system robustness over time. The pre-specified path was divided into seven stretches to assess the system robustness in different contexts. To further assess the performance of the brain-actuated wheelchair, subject 1 participated in a second experiment consisting of 10 trials where he was asked to drive the simulated wheelchair following 10 different complex and random paths never tried before. RESULTS In experiment 1 the two subjects were able to reach 100% (subject 1) and 80% (subject 2) of the final goals along the pre-specified trajectory in their best sessions. Different performances were obtained over time and path stretches, what indicates that performance is time and context dependent. In experiment 2, subject 1 was able to reach the final goal in 80% of the trials. CONCLUSIONS The results show that subjects can rapidly master our asynchronous EEG-based BCI to control a wheelchair. Also, they can autonomously operate the BCI over long periods of time without the need for adaptive algorithms externally tuned by a human operator to minimize the impact of EEG non-stationarities. This is possible because of two key components: first, the inclusion of a shared control system between the BCI system and the intelligent simulated wheelchair; second, the selection of stable user-specific EEG features that maximize the separability between the mental tasks. SIGNIFICANCE These results show the feasibility of continuously controlling complex robotics devices using an asynchronous and non-invasive BCI.

Adaptive Shared Control of a Brain-Actuated Simulated Wheelchair

The use of shared control techniques has a profound impact on the performance of a robotic assistant controlled by human brain signals. However, this shared control usually provides assistance to the user in a constant and identical manner each time. Creating an adaptive level of assistance, thereby complementing the users capabilities at any moment, would be more appropriate. The better the user can do by himself, the less assistance he receives from the shared control system; and vice versa. In order to do this, we need to be able to detect when and in what way the user needs assistance. An appropriate assisting behaviour would then be activated for the time the user requires help, thereby adapting the level of assistance to the specific situation. This paper presents such a system, helping a brain-computer interface (BCI) subject perform goal-directed navigation of a simulated wheelchair in an adaptive manner. Whenever the subject has more difficulties in driving the wheelchair, more assistance will be given. Experimental results of two subjects show that this adaptive shared control increases the task performance. Also, it shows that a subject with a lower BCI performance has more need for extra assistance in difficult situations, such as manoeuvring in a narrow corridor.

Context-based filtering for assisted brain-actuated wheelchair driving

Controlling a robotic device by using human brain signals is an interesting and challenging task. The device may be complicated to control and the nonstationary nature of the brain signals provides for a rather unstable input. With the use of intelligent processing algorithms adapted to the task at hand, however, the performance can be increased. This paper introduces a shared control system that helps the subject in driving an intelligent wheelchair with a noninvasive brain interface. The subjects steering intentions are estimated from electroencephalogram (EEG) signals and passed through to the shared control system before being sent to the wheelchair motors. Experimental results show a possibility for significant improvement in the overall driving performance when using the shared control system compared to driving without it. These results have been obtained with 2 healthy subjects during their first day of training with the brain-actuated wheelchair.

User-adapted plan recognition and user-adapted shared control: A Bayesian approach to semi-autonomous wheelchair driving

Abstract Many elderly and physically impaired people experience difficulties when maneuvering a powered wheelchair. In order to ease maneuvering, powered wheelchairs have been equipped with sensors, additional computing power and intelligence by various research groups. This paper presents a Bayesian approach to maneuvering assistance for wheelchair driving, which can be adapted to a specific user. The proposed framework is able to model and estimate even complex user intents, i.e. wheelchair maneuvers that the driver has in mind. Furthermore, it explicitly takes the uncertainty on the user’s intent into account. Besides during intent estimation, user-specific properties and uncertainty on the user’s intent are incorporated when taking assistive actions, such that assistance is tailored to the user’s driving skills. This decision making is modeled as a greedy Partially Observable Markov Decision Process (POMDP). Benefits of this approach are shown using experimental results in simulation and on our wheelchair platform Sharioto.

Feature based omnidirectional sparse visual path following

Vision sensors are attractive for autonomous robots because they are a rich source of environment information. The main challenge in using images for mobile robots is managing this wealth of information. A relatively recent approach is the use of fast wide baseline local features, which we developed and used in the novel approach to sparse visual path following described in this paper. These local features have the great advantage that they can be recognized even if the viewpoint differs significantly. This opens the door to a memory efficient description of a path by descriptors of sparse images. We propose a method for re-execution of these paths by a series of visual homing operations which yield a navigation method with unique properties: it is accurate, robust, fast, and without odometry error build-up.

Bayesian Estimation of Wheelchair Driver Intents: Modeling Intents as Geometric Paths Tracked by the Driver

Many elderly and disabled people today experience difficulties when manoeuvring an electric wheelchair. In order to help these people, several robotic assistance platforms have been devised in the past. In most cases, these platforms consist of separate assistance modes, and heuristic rules are used to automatically decide which assistance mode should be selected in each time step. As these decision rules are often hard-coded and do not take uncertainty regarding the users intent into account, assistive actions may lead to confusion or even irritation if the users actual plans do not correspond to the assistive systems behavior. In contrast to previous approaches, this paper presents a more user-centered approach for recognizing the intent of wheelchair drivers, which explicitly estimates the uncertainty on the users intent. The paper shows the benefit of estimating this uncertainty using experimental results with our wheelchair platform Sharioto

Bayesian plan recognition and shared control under uncertainty: assisting wheelchair drivers by tracking fine motion paths

The last years have witnessed a significant increase in the percentage of old and disabled people. Members of this population group very often require extensive help for performing daily tasks like moving around or grasping objects. Unfortunately, assistive technology is not always available to people needing it. For instance, steering a wheelchair can represent an extremely fatiguing or simply impossible task to many elderly or disabled users. Most of the existing assistance platforms try to help users without considering their specific needs. However, driving performance may vary considerably across users due to different pathologies or just due to temporary effects like fatigue. Therefore, we propose in this paper a user adapted shared control approach aimed at helping users in driving a power wheelchair. Adaption to the user is achieved by estimating the users true intent out of potentially noisy steering signals before assisting him/her. The users driving performance is explicitly modeled in order to recognize the users intention or plan together with the uncertainty on it. Safe navigation is achieved by merging the potentially noisy input of the user with fine motion trajectories computed online by a 3D planner. Encouraging results on assisting a user who cannot steer to the left are reported on K.U.Leuvens intelligent wheelchair Sharioto.

Global dynamic window approach for holonomic and non-holonomic mobile robots with arbitrary cross-section

This paper presents an extension of current global dynamic window approaches to holonomic and nonholonomic mobile robots with an arbitrary cross-section. The algorithm proceeds in two stages. In order to account for an arbitrary robot footprint, the first stage takes the robots orientation explicitly into account by constructing a navigation function in the (x, y, /spl theta/) configuration space. In a second stage, an admissible velocity is chosen from a window around the robots current velocity, which contains all velocities that can be reached under the acceleration constraints. Fast computation over large areas is achieved by adopting multi-resolution (x, y) and (x, y, /spl theta/) planning. Several measures are taken to obtain safe and robust robot behaviour. Experimental results on our wheelchair test platform show the feasibility of the approach.

Adaptive filtering approach to improve wheelchair driving performance

This paper describes a novel adaptive filter approach to reduce the handicap a patient may experience when navigating an electric wheelchair. The filter automatically adapts to the specific handicap the patient has by training a connectionist structure that converts the joystick signal of the patient to the signal a reference user would give in the same context. Experimental results show that for various handicaps the filter improves the driving performance significantly