Gernot R. Müller-Putz

Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges

In recent years, new research has brought the field of electroencephalogram (EEG)-based brain–computer interfacing (BCI) out of its infancy and into a phase of relative maturity through many demonstrated prototypes such as brain-controlled wheelchairs, keyboards, and computer games. With this proof-of-concept phase in the past, the time is now ripe to focus on the development of practical BCI technologies that can be brought out of the lab and into real-world applications. In particular, we focus on the prospect of improving the lives of countless disabled individuals through a combination of BCI technology with existing assistive technologies (AT). In pursuit of more practical BCIs for use outside of the lab, in this paper, we identify four application areas where disabled individuals could greatly benefit from advancements in BCI technology, namely, “Communication and Control”, “Motor Substitution”, “Entertainment”, and “Motor Recovery”. We review the current state of the art and possible future developments, while discussing the main research issues in these four areas. In particular, we expect the most progress in the development of technologies such as hybrid BCI architectures, user–machine adaptation algorithms, the exploitation of users’ mental states for BCI reliability and confidence measures, the incorporation of principles in human–computer interaction (HCI) to improve BCI usability, and the development of novel BCI technology including better EEG devices.

EEG-based neuroprosthesis control: A step towards clinical practice

This case study demonstrates the coupling of an electroencephalogram (EEG)-based Brain-Computer Interface (BCI) with an implanted neuroprosthesis (Freehand system). Because the patient was available for only 3 days, the goal was to demonstrate the possibility of a patient gaining control over the motor imagery-based Graz BCI system within a very short training period. By applying himself to an organized and coordinated training procedure, the patient was able to generate distinctive EEG-patterns by the imagination of movements of his paralyzed left hand. These patterns consisted of power decreases in specific frequency bands that could be classified by the BCI. The output signal of the BCI emulated the shoulder joystick usually used, and by consecutive imaginations the patient was able to switch between different grasp phases of the lateral grasp that the Freehand system provided. By performing a part of the grasp-release test, the patient was able to move a simple object from one place to another. The results presented in this work give evidence that Brain-Computer Interfaces are an option for the control of neuroprostheses in patients with high spinal cord lesions. The fact that the user learned to control the BCI in a comparatively short time indicates that this method may also be an alternative approach for clinical purposes.

Steady-state visual evoked potential (SSVEP)-based communication: impact of harmonic frequency components

Brain-computer interfaces (BCIs) can be realized on the basis of steady-state evoked potentials (SSEPs). These types of brain signals resulting from repetitive stimulation have the same fundamental frequency as the stimulation but also include higher harmonics. This study investigated how the classification accuracy of a 4-class BCI system can be improved by incorporating visually evoked harmonic oscillations. The current study revealed that the use of three SSVEP harmonics yielded a significantly higher classification accuracy than was the case for one or two harmonics. During feedback experiments, the five subjects investigated reached a classification accuracy between 42.5% and 94.4%.

Control of an Electrical Prosthesis With an SSVEP-Based BCI

Brain-computer interfaces (BCIs) are systems that establish a direct connection between the human brain and a computer, thus providing an additional communication channel. They are used in a broad field of applications nowadays. One important issue is the control of neuroprosthetic devices for the restoration of the grasp function in spinal-cord-injured people. In this communication, an asynchronous (self-paced) four-class BCI based on steady-state visual evoked potentials (SSVEPs) was used to control a two-axes electrical hand prosthesis. During training, four healthy participants reached an online classification accuracy between 44% and 88%. Controlling the prosthetic hand asynchronously, the participants reached a performance of 75.5 to 217.5 s to copy a series of movements, whereas the fastest possible duration determined by the setup was 64 s. The number of false negative (FN) decisions varied from 0 to 10 (the maximal possible decisions were 34). It can be stated that the SSVEP-based BCI, operating in an asynchronous mode, is feasible for the control of neuroprosthetic devices with the flickering lights mounted on its surface.

Self-paced (asynchronous) BCI control of a wheelchair in virtual environments: a case study with a tetraplegic

The aim of the present study was to demonstrate for the first time that brain waves can be used by a tetraplegic to control movements of his wheelchair in virtual reality (VR). In this case study, the spinal cord injured (SCI) subject was able to generate bursts of beta oscillations in the electroencephalogram (EEG) by imagination of movements of his paralyzed feet. These beta oscillations were used for a self-paced (asynchronous) brain-computer interface (BCI) control based on a single bipolar EEG recording. The subject was placed inside a virtual street populated with avatars. The task was to “go” from avatar to avatar towards the end of the street, but to stop at each avatar and talk to them. In average, the participant was able to successfully perform this asynchronous experiment with a performance of 90%, single runs up to 100%.

Review of the BCI Competition IV

The BCI competition IV stands in the tradition of prior BCI competitions that aim to provide high quality neuroscientific data for open access to the scientific community. As experienced already in prior competitions not only scientists from the narrow field of BCI compete, but scholars with a broad variety of backgrounds and nationalities. They include high specialists as well as students. The goals of all BCI competitions have always been to challenge with respect to novel paradigms and complex data. We report on the following challenges: (1) asynchronous data, (2) synthetic, (3) multi-class continuous data, (4) session-to-session transfer, (5) directionally modulated MEG, (6) finger movements recorded by ECoG. As after past competitions, our hope is that winning entries may enhance the analysis methods of future BCIs.

Self-Paced Operation of an SSVEP-Based Orthosis With and Without an Imagery-Based “Brain Switch:” A Feasibility Study Towards a Hybrid BCI

This work introduces a hybrid brain-computer interface (BCI) composed of an imagery-based brain switch and a steady-state visual evoked potential (SSVEP)-based BCI. The brain switch (event related synchronization (ERS)-based BCI) was used to activate the four-step SSVEP-based orthosis (via gazing at a 8 Hz LED to open and gazing at a 13 Hz LED to close) only when needed for control, and to deactivate the LEDs during resting periods. Only two EEG channels were required, one over the motor cortex and one over the visual cortex. As a basis for comparison, the orthosis was also operated without using the brain switch. Six subjects participated in this study. This combination of two BCIs operated with different mental strategies is one example of a “hybrid” BCI and revealed a much lower rate of FPs per minute during resting periods or breaks compared to the SSVEP BCI alone ( FP = 1.46 ± 1.18 versus 5.40 ± 0.90). Four out of the six subjects succeeded in operating the self-paced hybrid BCI with a good performance (positive prediction value PPVb > 0.70).

15 years of BCI research at graz university of technology: current projects

Over the last 15 years, the Graz Brain-Computer Interface (BCI) has been developed and all components such as feature extraction and classification, mode of operation, mental strategy, and type of feedback have been investigated. Recent projects deal with the development of asynchronous BCIs, the presentation of feedback and applications for communication and control.

Event-related beta EEG-changes during passive and attempted foot movements in paraplegic patients

A number of electroencephalographic (EEG) studies report on motor event-related desynchronization and synchronization (ERD/ERS) in the beta band, i.e. a decrease and increase of spectral amplitudes of central beta rhythms in the range from 13 to 35 Hz. Following an ERD that occurs shortly before and during the movement, bursts of beta oscillations (beta ERS) appear within a 1-s interval after movement offset. Such a post-movement beta ERS has been reported after voluntary hand movements, passive movements, movement imagination, and also after movements induced by functional electrical stimulation. The present study compares ERD/ERS patterns in paraplegic patients (suffering from a complete spinal cord injury) and healthy subjects during attempted (active) and passive foot movements. The aim of this work is to address the question, whether patients do have the same focal beta ERD/ERS pattern during attempted foot movement as healthy subjects do. The results showed midcentral-focused beta ERD/ERS patterns during passive, active, and imagined foot movements in healthy subjects. This is in contrast to a diffuse and broad distributed ERD/ERS pattern during attempted foot movements in patients. Only one patient showed a similar ERD/ERS pattern. Furthermore, no significant ERD/ERS patterns during passive foot movement in the group of the paraplegics could be found.

Rehabilitation with Brain-Computer Interface Systems

BCI systems let users convert thoughts into actions that do not involve voluntary muscle movement. The systems offer a new means of communication for those with paralysis or severe neuromuscular disorders. BCI technology is a relatively new, fast-growing field of research and applications with the potential to improve the quality of life in severely disabled people. To date, several BCI prototypes exist, but most work only in a laboratory environment. Before a BCI can be used for communication and control at home, research must solve several problems. An important next step is to establish protocols for easily setting up and using BCI systems in a practical environment. Many features, such as electrode positions and frequency components, must be automatically selectable for particular motor imagery. The system must use the fewest number of recording electrodes possible, striving for the optimal single EEG channel. Finally, training time must decrease, perhaps through game-like feedback and automatic detection of artifacts, such as uncontrolled muscle activity. With these improvements, which are on the horizon, we expect to see practical BCI systems for a wide range of users and applications.