Carolin A. Ruf

An auditory multiclass brain-computer interface with natural stimuli: Usability evaluation with healthy participants and a motor impaired end user

Brain-computer interfaces (BCIs) can serve as muscle independent communication aids. Persons, who are unable to control their eye muscles (e.g., in the completely locked-in state) or have severe visual impairments for other reasons, need BCI systems that do not rely on the visual modality. For this reason, BCIs that employ auditory stimuli were suggested. In this study, a multiclass BCI spelling system was implemented that uses animal voices with directional cues to code rows and columns of a letter matrix. To reveal possible training effects with the system, 11 healthy participants performed spelling tasks on 2 consecutive days. In a second step, the system was tested by a participant with amyotrophic lateral sclerosis (ALS) in two sessions. In the first session, healthy participants spelled with an average accuracy of 76% (3.29 bits/min) that increased to 90% (4.23 bits/min) on the second day. Spelling accuracy by the participant with ALS was 20% in the first and 47% in the second session. The results indicate a strong training effect for both the healthy participants and the participant with ALS. While healthy participants reached high accuracies in the first session and second session, accuracies for the participant with ALS were not sufficient for satisfactory communication in both sessions. More training sessions might be needed to improve spelling accuracies. The study demonstrated the feasibility of the auditory BCI with healthy users and stresses the importance of training with auditory multiclass BCIs, especially for potential end-users of BCI with disease.

Design and Implementation of a P300-Based Brain-Computer Interface for Controlling an Internet Browser

An electroencephalographic (EEG) brain-computer interface (BCI) internet browser was designed and evaluated with 10 healthy volunteers and three individuals with advanced amyotrophic lateral sclerosis (ALS), all of whom were given tasks to execute on the internet using the browser. Participants with ALS achieved an average accuracy of 73% and a subsequent information transfer rate (ITR) of 8.6 bits/min and healthy participants with no prior BCI experience over 90% accuracy and an ITR of 14.4 bits/min. We define additional criteria for unrestricted internet access for evaluation of the presented and future internet browsers, and we provide a review of the existing browsers in the literature. The P300-based browser provides unrestricted access and enables free web surfing for individuals with paralysis.

Brain communication in a completely locked-in patient using bedside near-infrared spectroscopy

Amyotrophic lateral sclerosis (ALS) can result in the locked-in state (LIS), characterized by paralysis, and eventual respiratory failure, compensated by artificial ventilation,1 or the completely LIS (CLIS), with additional total paralysis of eye muscles. Brain–computer interfaces (BCIs) have been used to allow paralyzed people to regain basic communication,2 although current EEG-based BCIs have not succeeded with CLIS patients.3 We present Class IV case evidence to establish that communication in the CLIS is possible with a metabolic BCI based on near-infrared spectroscopy (NIRS).

A portable auditory P300 brain–computer interface with directional cues

OBJECTIVES The main objective of the current study was to implement and evaluate a P300 based brain-computer interface (BCI) speller that uses directional cues of auditory stimuli, which are presented over headphones. The interstimulus interval (ISI) was successively reduced to determine the optimal combination of speed and accuracy. The study further aimed at quantifying the differences in subjective workload between the auditory and the visual P300 spelling application. The influence of workload, mood and motivation on BCI performance and P300 amplitude was investigated. METHODS Twenty healthy participants performed auditory and visual spelling tasks in an EEG experiment with online feedback. RESULTS Sixteen of twenty participants performed at or above a level necessary for satisfactory communication (≥70% spelling accuracy) with the auditory BCI. Average bit rates of up to 2.76 bits/min (best subject 7.43 bits/min) were achieved. A significantly higher workload was reported for the auditory speller compared to the visual paradigm. Motivation significantly influenced P300 amplitude at Pz in the auditory condition. CONCLUSIONS The results of the online study suggest that the proposed paradigm offers a means of communication for most healthy users. SIGNIFICANCE The described auditory BCI can serve as a communication channel for completely paralyzed patients.

Effects of training and motivation on auditory P300 brain–computer interface performance

OBJECTIVES Brain-computer interface (BCI) technology aims at helping end-users with severe motor paralysis to communicate with their environment without using the natural output pathways of the brain. For end-users in complete paralysis, loss of gaze control may necessitate non-visual BCI systems. The present study investigated the effect of training on performance with an auditory P300 multi-class speller paradigm. For half of the participants, spatial cues were added to the auditory stimuli to see whether performance can be further optimized. The influence of motivation, mood and workload on performance and P300 component was also examined. METHODS In five sessions, 16 healthy participants were instructed to spell several words by attending to animal sounds representing the rows and columns of a 5 × 5 letter matrix. RESULTS 81% of the participants achieved an average online accuracy of ⩾ 70%. From the first to the fifth session information transfer rates increased from 3.72 bits/min to 5.63 bits/min. Motivation significantly influenced P300 amplitude and online ITR. No significant facilitative effect of spatial cues on performance was observed. CONCLUSIONS Training improves performance in an auditory BCI paradigm. Motivation influences performance and P300 amplitude. SIGNIFICANCE The described auditory BCI system may help end-users to communicate independently of gaze control with their environment.

Amyotrophic lateral sclerosis progression and stability of brain-computer interface communication

Abstract Our objective was to investigate the relationship between brain-computer interface (BCI) communication skill and disease progression in amyotrophic lateral sclerosis (ALS). We sought also to assess stability of BCI communication performance over time and whether it is related to the progression of neurological impairment before entering the locked-in state. A three years follow-up, BCI evaluation in a group of ALS patients (n = 24) was conducted. For a variety of reasons only three patients completed the three years follow-up. BCI communication skill and disability level, using the Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised, were assessed at admission and at each of the three follow-ups. Multiple non-parametric statistical methods were used to ensure reliability of the dependent variables: correlations, paired test and factor analysis of variance. Results demonstrated no significant relationship between BCI communication skill (BCI-CS) and disease evolution. The patients who performed the follow-up evaluations preserved their BCI-CS over time. Patients’ age at admission correlated positively with the ability to achieve control over a BCI. In conclusion, disease evolution in ALS does not affect the ability to control a BCI for communication. BCI performance can be maintained in the different stages of the illness.

Usability and Workload of Access Technology for People With Severe Motor Impairment: A Comparison of Brain-Computer Interfacing and Eye Tracking

Background. Eye trackers are widely used among people with amyotrophic lateral sclerosis, and their benefits to quality of life have been previously shown. On the contrary, Brain-computer interfaces (BCIs) are still quite a novel technology, which also serves as an access technology for people with severe motor impairment. Objective. To compare a visual P300-based BCI and an eye tracker in terms of information transfer rate (ITR), usability, and cognitive workload in users with motor impairments. Methods. Each participant performed 3 spelling tasks, over 4 total sessions, using an Internet browser, which was controlled by a spelling interface that was suitable for use with either the BCI or the eye tracker. At the end of each session, participants evaluated usability and cognitive workload of the system. Results. ITR and System Usability Scale (SUS) score were higher for the eye tracker (Wilcoxon signed-rank test: ITR T = 9, P = .016; SUS T = 12.50, P = .035). Cognitive workload was higher for the BCI (T = 4; P = .003). Conclusions. Although BCIs could be potentially useful for people with severe physical disabilities, we showed that the usability of BCIs based on the visual P300 remains inferior to eye tracking. We suggest that future research on visual BCIs should use eye tracking–based control as a comparison to evaluate performance or focus on nonvisual paradigms for persons who have lost gaze control.

Brain-computer interface and semantic classical conditioning of communication in paralysis.

We propose a classical semantic conditioning procedure to allow basic yes-no communication in the completely locked-in state as an alternative to instrumental-operant learning of brain responses, which is the common approach in brain-computer interface research. More precisely, it was intended to establish cortical responses to the trueness of a statement irrespective of the particular constituent words and letters or sounds of the words. As unconditioned stimulus short aversive stimuli consisting of 1-ms electrical pulses were used. True and false statements were presented acoustically and only the true statements were immediately followed by electrical stimuli. 15 healthy participants and one locked-in ALS patient underwent the experiment. Three different classifiers were employed in order to differentiate between the two cortical responses by means of electroencephalographic recordings. The offline analysis revealed that semantic classical conditioning can be applied successfully to enable basic communication using a non-muscular channel.

Prediction of P300 BCI Aptitude in Severe Motor Impairment

Brain-computer interfaces (BCIs) provide a non-muscular communication channel for persons with severe motor impairments. Previous studies have shown that the aptitude with which a BCI can be controlled varies from person to person. A reliable predictor of performance could facilitate selection of a suitable BCI paradigm. Eleven severely motor impaired participants performed three sessions of a P300 BCI web browsing task. Before each session auditory oddball data were collected to predict the BCI aptitude of the participants exhibited in the current session. We found a strong relationship of early positive and negative potentials around 200 ms (elicited with the auditory oddball task) with performance. The amplitude of the P2 (r  =  −0.77) and of the N2 (r  =  −0.86) had the strongest correlations. Aptitude prediction using an auditory oddball was successful. The finding that the N2 amplitude is a stronger predictor of performance than P3 amplitude was reproduced after initially showing this effect with a healthy sample of BCI users. This will reduce strain on the end-users by minimizing the time needed to find suitable paradigms and inspire new approaches to improve performance.

Semantic conditioning of salivary pH for communication

OBJECTIVES Semantic conditioning of salivary pH was investigated as a new paradigm for binary communication. METHODS AND MATERIALS In a sample of eleven healthy participants, affirmation or negation of presented statements were paired with milk and lemon to condition changes in salivary pH level. RESULTS Significant differences between the conditioned reactions were found at the group level. However, the analysis of pH changes on single-subject level revealed significant differences between affirmative and negative responses to the presented statements only for isolated samples in few participants. When classifying a change in pH value of more than .01 as correct response to a statement, only responses to affirmative statements reached mean accuracies of more than 60%. CONCLUSION Improvements in the paradigm are necessary before testing it with the critical target population of patients to prove its profit for basic yes/no communication in case no other reliable means of communication could be preserved.