Robert Leeb

Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges

In recent years, new research has brought the field of electroencephalogram (EEG)-based brain–computer interfacing (BCI) out of its infancy and into a phase of relative maturity through many demonstrated prototypes such as brain-controlled wheelchairs, keyboards, and computer games. With this proof-of-concept phase in the past, the time is now ripe to focus on the development of practical BCI technologies that can be brought out of the lab and into real-world applications. In particular, we focus on the prospect of improving the lives of countless disabled individuals through a combination of BCI technology with existing assistive technologies (AT). In pursuit of more practical BCIs for use outside of the lab, in this paper, we identify four application areas where disabled individuals could greatly benefit from advancements in BCI technology, namely, “Communication and Control”, “Motor Substitution”, “Entertainment”, and “Motor Recovery”. We review the current state of the art and possible future developments, while discussing the main research issues in these four areas. In particular, we expect the most progress in the development of technologies such as hybrid BCI architectures, user–machine adaptation algorithms, the exploitation of users’ mental states for BCI reliability and confidence measures, the incorporation of principles in human–computer interaction (HCI) to improve BCI usability, and the development of novel BCI technology including better EEG devices.

A fully automated correction method of EOG artifacts in EEG recordings

OBJECTIVE A fully automated method for reducing EOG artifacts is presented and validated. METHODS The correction method is based on regression analysis and was applied to 18 recordings with 22 channels and approx. 6 min each. Two independent experts scored the original and corrected EEG in a blinded evaluation. RESULTS The expert scorers identified in 5.9% of the raw data some EOG artifacts; 4.7% were corrected. After applying the EOG correction, the expert scorers identified in another 1.9% of the data some EOG artifacts, which were not recognized in the uncorrected data. CONCLUSIONS The advantage of a fully automated reduction of EOG artifacts justifies the small additional effort of the proposed method and is a viable option for reducing EOG artifacts. The method has been implemented for offline and online analysis and is available through BioSig, an open source software library for biomedical signal processing. SIGNIFICANCE Visual identification and rejection of EOG-contaminated EEG segments can miss many EOG artifacts, and is therefore not sufficient for removing EOG artifacts. The proposed method was able to reduce EOG artifacts by 80%.

Self-paced (asynchronous) BCI control of a wheelchair in virtual environments: a case study with a tetraplegic

The aim of the present study was to demonstrate for the first time that brain waves can be used by a tetraplegic to control movements of his wheelchair in virtual reality (VR). In this case study, the spinal cord injured (SCI) subject was able to generate bursts of beta oscillations in the electroencephalogram (EEG) by imagination of movements of his paralyzed feet. These beta oscillations were used for a self-paced (asynchronous) brain-computer interface (BCI) control based on a single bipolar EEG recording. The subject was placed inside a virtual street populated with avatars. The task was to “go” from avatar to avatar towards the end of the street, but to stop at each avatar and talk to them. In average, the participant was able to successfully perform this asynchronous experiment with a performance of 90%, single runs up to 100%.

Brain–Computer Communication: Motivation, Aim, and Impact of Exploring a Virtual Apartment

The step away from a synchronized or cue-based brain-computer interface (BCI) and from laboratory conditions towards real world applications is very important and crucial in BCI research. This work shows that ten naive subjects can be trained in a synchronous paradigm within three sessions to navigate freely through a virtual apartment, whereby at every junction the subjects could decide by their own, how they wanted to explore the virtual environment (VE). This virtual apartment was designed similar to a real world application, with a goal-oriented task, a high mental workload, and a variable decision period for the subject. All subjects were able to perform long and stable motor imagery over a minimum time of 2 s. Using only three electroencephalogram (EEG) channels to analyze these imaginations, we were able to convert them into navigation commands. Additionally, it could be demonstrated that motivation is a very crucial factor in BCI research; motivated subjects perform much better than unmotivated ones.

Brain-Computer Interfaces, Virtual Reality, and Videogames

Major challenges must be tackled for brain-computer interfaces to mature into an established communications medium for VR applications, which will range from basic neuroscience studies to developing optimal peripherals and mental gamepads and more efficient brain-signal processing techniques.

Review of the BCI Competition IV

The BCI competition IV stands in the tradition of prior BCI competitions that aim to provide high quality neuroscientific data for open access to the scientific community. As experienced already in prior competitions not only scientists from the narrow field of BCI compete, but scholars with a broad variety of backgrounds and nationalities. They include high specialists as well as students. The goals of all BCI competitions have always been to challenge with respect to novel paradigms and complex data. We report on the following challenges: (1) asynchronous data, (2) synthetic, (3) multi-class continuous data, (4) session-to-session transfer, (5) directionally modulated MEG, (6) finger movements recorded by ECoG. As after past competitions, our hope is that winning entries may enhance the analysis methods of future BCIs.

Seperability of four-class motor imagery data using independent components analysis

This paper compares different ICA preprocessing algorithms on cross-validated training data as well as on unseen test data. The EEG data were recorded from 22 electrodes placed over the whole scalp during motor imagery tasks consisting of four different classes, namely the imagination of right hand, left hand, foot and tongue movements. Two sessions on different days were recorded for eight subjects. Three different independent components analysis (ICA) algorithms (Infomax, FastICA and SOBI) were studied and compared to common spatial patterns (CSP), Laplacian derivations and standard bipolar derivations, which are other well-known preprocessing methods. Among the ICA algorithms, the best performance was achieved by Infomax when using all 22 components as well as for the selected 6 components. However, the performance of Laplacian derivations was comparable with Infomax for both cross-validated and unseen data. The overall best four-class classification accuracies (between 33% and 84%) were obtained with CSP. For the cross-validated training data, CSP performed slightly better than Infomax, whereas for unseen test data, CSP yielded significantly better classification results than Infomax in one of the sessions.

Toward Self-Paced Brain–Computer Communication: Navigation Through Virtual Worlds

The self-paced control paradigm enables users to operate brain-computer interfaces (BCI) in a more natural way: no longer is the machine in control of the timing and speed of communication, but rather the user is. This is important to enhance the usability, flexibility, and response time of a BCI. In this work, we show how subjects, after performing cue-based feedback training (smiley paradigm), learned to navigate self-paced through the ¿freeSpace¿ virtual environment (VE). Similar to computer games, subjects had the task of picking up items by using the following navigation commands: rotate left, rotate right, and move forward ( three classes). Since the self-paced control paradigm allows subjects to make voluntary decisions on time, type, and duration of mental activity, no cues or routing directives were presented. The BCI was based only on three bipolar electroencephalogram channels and operated by motor imagery. Eye movements (electrooculogram) and electromyographic artifacts were reduced and detected online. The results of three able-bodied subjects are reported and problems emerging from self-paced control are discussed.

15 years of BCI research at graz university of technology: current projects

Over the last 15 years, the Graz Brain-Computer Interface (BCI) has been developed and all components such as feature extraction and classification, mode of operation, mental strategy, and type of feedback have been investigated. Recent projects deal with the development of asynchronous BCIs, the presentation of feedback and applications for communication and control.

A hybrid brain?computer interface based on the fusion of electroencephalographic and electromyographic activities

Hybrid brain-computer interfaces (BCIs) are representing a recent approach to develop practical BCIs. In such a system disabled users are able to use all their remaining functionalities as control possibilities in parallel with the BCI. Sometimes these people have residual activity of their muscles. Therefore, in the presented hybrid BCI framework we want to explore the parallel usage of electroencephalographic (EEG) and electromyographic (EMG) activity, whereby the control abilities of both channels are fused. Results showed that the participants could achieve a good control of their hybrid BCI independently of their level of muscular fatigue. Thereby the multimodal fusion approach of muscular and brain activity yielded better and more stable performance compared to the single conditions. Even in the case of an increasing muscular fatigue a good control (moderate and graceful degradation of the performance compared to the non-fatigued case) and a smooth handover could be achieved. Therefore, such systems allow the users a very reliable hybrid BCI control although they are getting more and more exhausted or fatigued during the day.