Martin Spüler

Coupling brain-machine interfaces with cortical stimulation for brain-state dependent stimulation: enhancing motor cortex excitability for neurorehabilitation.

Motor recovery after stroke is an unsolved challenge despite intensive rehabilitation training programs. Brain stimulation techniques have been explored in addition to traditional rehabilitation training to increase the excitability of the stimulated motor cortex. This modulation of cortical excitability augments the response to afferent input during motor exercises, thereby enhancing skilled motor learning by long-term potentiation-like plasticity. Recent approaches examined brain stimulation applied concurrently with voluntary movements to induce more specific use-dependent neural plasticity during motor training for neurorehabilitation. Unfortunately, such approaches are not applicable for the many severely affected stroke patients lacking residual hand function. These patients require novel activity-dependent stimulation paradigms based on intrinsic brain activity. Here, we report on such brain state-dependent stimulation (BSDS) combined with haptic feedback provided by a robotic hand orthosis. Transcranial magnetic stimulation (TMS) of the motor cortex and haptic feedback to the hand were controlled by sensorimotor desynchronization during motor-imagery and applied within a brain-machine interface (BMI) environment in one healthy subject and one patient with severe hand paresis in the chronic phase after stroke. BSDS significantly increased the excitability of the stimulated motor cortex in both healthy and post-stroke conditions, an effect not observed in non-BSDS protocols. This feasibility study suggests that closing the loop between intrinsic brain state, cortical stimulation and haptic feedback provides a novel neurorehabilitation strategy for stroke patients lacking residual hand function, a proposal that warrants further investigation in a larger cohort of stroke patients.

Online adaptation of a c-VEP Brain-computer Interface(BCI) based on error-related potentials and unsupervised learning.

The goal of a Brain-Computer Interface (BCI) is to control a computer by pure brain activity. Recently, BCIs based on code-modulated visual evoked potentials (c-VEPs) have shown great potential to establish high-performance communication. In this paper we present a c-VEP BCI that uses online adaptation of the classifier to reduce calibration time and increase performance. We compare two different approaches for online adaptation of the system: an unsupervised method and a method that uses the detection of error-related potentials. Both approaches were tested in an online study, in which an average accuracy of 96% was achieved with adaptation based on error-related potentials. This accuracy corresponds to an average information transfer rate of 144 bit/min, which is the highest bitrate reported so far for a non-invasive BCI. In a free-spelling mode, the subjects were able to write with an average of 21.3 error-free letters per minute, which shows the feasibility of the BCI system in a normal-use scenario. In addition we show that a calibration of the BCI system solely based on the detection of error-related potentials is possible, without knowing the true class labels.

Decoding of motor intentions from epidural ECoG recordings in severely paralyzed chronic stroke patients

OBJECTIVE Recently, there have been several approaches to utilize a brain-computer interface (BCI) for rehabilitation with stroke patients or as an assistive device for the paralyzed. In this study we investigated whether up to seven different hand movement intentions can be decoded from epidural electrocorticography (ECoG) in chronic stroke patients. APPROACH In a screening session we recorded epidural ECoG data over the ipsilesional motor cortex from four chronic stroke patients who had no residual hand movement. Data was analyzed offline using a support vector machine (SVM) to decode different movement intentions. MAIN RESULTS We showed that up to seven hand movement intentions can be decoded with an average accuracy of 61% (chance level 15.6%). When reducing the number of classes, average accuracies up to 88% can be achieved for decoding three different movement intentions. SIGNIFICANCE The findings suggest that ipsilesional epidural ECoG can be used as a viable control signal for BCI-driven neuroprosthesis. Although patients showed no sign of residual hand movement, brain activity at the ipsilesional motor cortex still shows enough intention-related activity to decode different movement intentions with sufficient accuracy.

Spatial Filtering Based on Canonical Correlation Analysis for Classification of Evoked or Event-Related Potentials in EEG Data

Classification of evoked or event-related potentials is an important prerequisite for many types of brain-computer interfaces (BCIs). To increase classification accuracy, spatial filters are used to improve the signal-to-noise ratio of the brain signals and thereby facilitate the detection and classification of evoked or event-related potentials. While canonical correlation analysis (CCA) has previously been used to construct spatial filters that increase classification accuracy for BCIs based on visual evoked potentials, we show in this paper, how CCA can also be used for spatial filtering of event-related potentials like P300. We also evaluate the use of CCA for spatial filtering on other data with evoked and event-related potentials and show that CCA performs consistently better than other standard spatial filtering methods.

Error-related potentials during continuous feedback: using EEG to detect errors of different type and severity.

When a person recognizes an error during a task, an error-related potential (ErrP) can be measured as response. It has been shown that ErrPs can be automatically detected in tasks with time-discrete feedback, which is widely applied in the field of Brain-Computer Interfaces (BCIs) for error correction or adaptation. However, there are only a few studies that concentrate on ErrPs during continuous feedback. With this study, we wanted to answer three different questions: (i) Can ErrPs be measured in electroencephalography (EEG) recordings during a task with continuous cursor control? (ii) Can ErrPs be classified using machine learning methods and is it possible to discriminate errors of different origins? (iii) Can we use EEG to detect the severity of an error? To answer these questions, we recorded EEG data from 10 subjects during a video game task and investigated two different types of error (execution error, due to inaccurate feedback; outcome error, due to not achieving the goal of an action). We analyzed the recorded data to show that during the same task, different kinds of error produce different ErrP waveforms and have a different spectral response. This allows us to detect and discriminate errors of different origin in an event-locked manner. By utilizing the error-related spectral response, we show that also a continuous, asynchronous detection of errors is possible. Although the detection of error severity based on EEG was one goal of this study, we did not find any significant influence of the severity on the EEG.

Learned self-regulation of the lesioned brain with epidural electrocorticography.

Introduction: Different techniques for neurofeedback of voluntary brain activations are currently being explored for clinical application in brain disorders. One of the most frequently used approaches is the self-regulation of oscillatory signals recorded with electroencephalography (EEG). Many patients are, however, unable to achieve sufficient voluntary control of brain activity. This could be due to the specific anatomical and physiological changes of the patient’s brain after the lesion, as well as to methodological issues related to the technique chosen for recording brain signals. Methods: A patient with an extended ischemic lesion of the cortex did not gain volitional control of sensorimotor oscillations when using a standard EEG-based approach. We provided him with neurofeedback of his brain activity from the epidural space by electrocorticography (ECoG). Results: Ipsilesional epidural recordings of field potentials facilitated self-regulation of brain oscillations in an online closed-loop paradigm and allowed reliable neurofeedback training for a period of 4 weeks. Conclusion: Epidural implants may decode and train brain activity even when the cortical physiology is distorted following severe brain injury. Such practice would allow for reinforcement learning of preserved neural networks and may well provide restorative tools for those patients who are severely afflicted.

Adaptive SVM-Based classification increases performance of a MEG-Based brain-computer interface (BCI)

One problem in current Brain-Computer Interfaces (BCIs) is non-stationarity of the underlying signals. This causes deteriorating performance throughout a session and difficulties to transfer a classifier from one session to another, which results in the need of collecting training data every session. Using an adaptive classifier is one solution to keep the performance stable and reduce the amount of training that is needed for a good BCI performance. In this paper we present an approach for an adaptive classifier based on a Support Vector Machine (SVM). We evaluate its advantage on offline BCI data and show its benefits and online feasibility in an online experiment using a MEG-based BCI with 10 subjects.

Principal component based covariate shift adaption to reduce non-stationarity in a MEG-based brain-computer interface

One of the biggest problems in today’s BCI research is the non-stationarity of the recorded signals. This non-stationarity can cause the BCI performance to deteriorate over time or drop significantly when transferring data from one session to another. To reduce the effect of non-stationaries, we propose a new method for covariate shift adaption that is based on Principal Component Analysis to extract non-stationaries and alleviate them. We show the proposed method to significantly increase BCI performance for an MEG-based BCI in an offline analysis as well as an online experiment with 10 subjects. We also show the method to be superior to other covariate shift adaption methods and present examples of identified non-stationaries to show the effect of the proposed method.

Hybrid Neuroprosthesis for the Upper Limb: Combining Brain-Controlled Neuromuscular Stimulation with a Multi-Joint Arm Exoskeleton

Brain-machine interface-controlled (BMI) neurofeedback training aims to modulate cortical physiology and is applied during neurorehabilitation to increase the responsiveness of the brain to subsequent physiotherapy. In a parallel line of research, robotic exoskeletons are used in goal-oriented rehabilitation exercises for patients with severe motor impairment to extend their range of motion (ROM) and the intensity of training. Furthermore, neuromuscular electrical stimulation (NMES) is applied in neurologically impaired patients to restore muscle strength by closing the sensorimotor loop. In this proof-of-principle study, we explored an integrated approach for providing assistance as needed to amplify the task-related ROM and the movement-related brain modulation during rehabilitation exercises of severely impaired patients. For this purpose, we combined these three approaches (BMI, NMES, and exoskeleton) in an integrated neuroprosthesis and studied the feasibility of this device in seven severely affected chronic stroke patients who performed wrist flexion and extension exercises while receiving feedback via a virtual environment. They were assisted by a gravity-compensating, seven degree-of-freedom exoskeleton which was attached to the paretic arm. NMES was applied to the wrist extensor and flexor muscles during the exercises and was controlled by a hybrid BMI based on both sensorimotor cortical desynchronization (ERD) and electromyography (EMG) activity. The stimulation intensity was individualized for each targeted muscle and remained subthreshold, i.e., induced no overt support. The hybrid BMI controlled the stimulation significantly better than the offline analyzed ERD (p = 0.028) or EMG (p = 0.021) modality alone. Neuromuscular stimulation could be well integrated into the exoskeleton-based training and amplified both the task-related ROM (p = 0.009) and the movement-related brain modulation (p = 0.019). Combining a hybrid BMI with neuromuscular stimulation and antigravity assistance augments upper limb function and brain activity during rehabilitation exercises and may thus provide a novel restorative framework for severely affected stroke patients.

A Brain-Computer Interface (BCI) system to use arbitrary Windows applications by directly controlling mouse and keyboard

A Brain-Computer Interface (BCI) allows to control a computer by brain activity only, without the need for muscle control. In this paper, we present an EEG-based BCI system based on code-modulated visual evoked potentials (c-VEPs) that enables the user to work with arbitrary Windows applications. Other BCI systems, like the P300 speller or BCI-based browsers, allow control of one dedicated application designed for use with a BCI. In contrast, the system presented in this paper does not consist of one dedicated application, but enables the user to control mouse cursor and keyboard input on the level of the operating system, thereby making it possible to use arbitrary applications. As the c-VEP BCI method was shown to enable very fast communication speeds (writing more than 20 error-free characters per minute), the presented system is the next step in replacing the traditional mouse and keyboard and enabling complete brain-based control of a computer.A Brain-Computer Interface (BCI) allows to control a computer by brain activity only, without the need for muscle control. In this paper, we present an EEG-based BCI system based on code-modulated visual evoked potentials (c-VEPs) that enables the user to work with arbitrary Windows applications. Other BCI systems, like the P300 speller or BCI-based browsers, allow control of one dedicated application designed for use with a BCI. In contrast, the system presented in this paper does not consist of one dedicated application, but enables the user to control mouse cursor and keyboard input on the level of the operating system, thereby making it possible to use arbitrary applications. As the c-VEP BCI method was shown to enable very fast communication speeds (writing more than 20 error-free characters per minute), the presented system is the next step in replacing the traditional mouse and keyboard and enabling complete brain-based control of a computer.