Tobias Kaufmann

Flashing characters with famous faces improves ERP-based brain–computer interface performance

Currently, the event-related potential (ERP)-based spelling device, often referred to as P300-Speller, is the most commonly used brain-computer interface (BCI) for enhancing communication of patients with impaired speech or motor function. Among numerous improvements, a most central feature has received little attention, namely optimizing the stimulus used for eliciting ERPs. Therefore we compared P300-Speller performance with the standard stimulus (flashing characters) against performance with stimuli known for eliciting particularly strong ERPs due to their psychological salience, i.e. flashing familiar faces transparently superimposed on characters. Our results not only indicate remarkably increased ERPs in response to familiar faces but also improved P300-Speller performance due to a significant reduction of stimulus sequences needed for correct character classification. These findings demonstrate a promising new approach for improving the speed and thus fluency of BCI-enhanced communication with the widely used P300-Speller.

ARTiiFACT: a tool for heart rate artifact processing and heart rate variability analysis.

The importance of appropriate handling of artifacts in interbeat interval (IBI) data must not be underestimated. Even a single artifact may cause unreliable heart rate variability (HRV) results. Thus, a robust artifact detection algorithm and the option for manual intervention by the researcher form key components for confident HRV analysis. Here, we present ARTiiFACT, a software tool for processing electrocardiogram and IBI data. Both automated and manual artifact detection and correction are available in a graphical user interface. In addition, ARTiiFACT includes time- and frequency-based HRV analyses and descriptive statistics, thus offering the basic tools for HRV analysis. Notably, all program steps can be executed separately and allow for data export, thus offering high flexibility and interoperability with a whole range of applications.

Comparison of tactile, auditory, and visual modality for brain-computer interface use: a case study with a patient in the locked-in state

This paper describes a case study with a patient in the classic locked-in state, who currently has no means of independent communication. Following a user-centered approach, we investigated event-related potentials (ERP) elicited in different modalities for use in brain-computer interface (BCI) systems. Such systems could provide her with an alternative communication channel. To investigate the most viable modality for achieving BCI based communication, classic oddball paradigms (1 rare and 1 frequent stimulus, ratio 1:5) in the visual, auditory and tactile modality were conducted (2 runs per modality). Classifiers were built on one run and tested offline on another run (and vice versa). In these paradigms, the tactile modality was clearly superior to other modalities, displaying high offline accuracy even when classification was performed on single trials only. Consequently, we tested the tactile paradigm online and the patient successfully selected targets without any error. Furthermore, we investigated use of the visual or tactile modality for different BCI systems with more than two selection options. In the visual modality, several BCI paradigms were tested offline. Neither matrix-based nor so-called gaze-independent paradigms constituted a means of control. These results may thus question the gaze-independence of current gaze-independent approaches to BCI. A tactile four-choice BCI resulted in high offline classification accuracies. Yet, online use raised various issues. Although performance was clearly above chance, practical daily life use appeared unlikely when compared to other communication approaches (e.g., partner scanning). Our results emphasize the need for user-centered design in BCI development including identification of the best stimulus modality for a particular user. Finally, the paper discusses feasibility of EEG-based BCI systems for patients in classic locked-in state and compares BCI to other AT solutions that we also tested during the study.

Toward brain-computer interface based wheelchair control utilizing tactually-evoked event-related potentials

BackgroundPeople with severe disabilities, e.g. due to neurodegenerative disease, depend on technology that allows for accurate wheelchair control. For those who cannot operate a wheelchair with a joystick, brain-computer interfaces (BCI) may offer a valuable option. Technology depending on visual or auditory input may not be feasible as these modalities are dedicated to processing of environmental stimuli (e.g. recognition of obstacles, ambient noise). Herein we thus validated the feasibility of a BCI based on tactually-evoked event-related potentials (ERP) for wheelchair control. Furthermore, we investigated use of a dynamic stopping method to improve speed of the tactile BCI system.MethodsPositions of four tactile stimulators represented navigation directions (left thigh: move left; right thigh: move right; abdomen: move forward; lower neck: move backward) and N = 15 participants delivered navigation commands by focusing their attention on the desired tactile stimulus in an oddball-paradigm.ResultsParticipants navigated a virtual wheelchair through a building and eleven participants successfully completed the task of reaching 4 checkpoints in the building. The virtual wheelchair was equipped with simulated shared-control sensors (collision avoidance), yet these sensors were rarely needed.ConclusionWe conclude that most participants achieved tactile ERP-BCI control sufficient to reliably operate a wheelchair and dynamic stopping was of high value for tactile ERP classification. Finally, this paper discusses feasibility of tactile ERPs for BCI based wheelchair control.

Out of the frying pan into the fire--the P300-based BCI faces real-world challenges.

Brain-computer interfaces (BCIs) have been investigated for more than 20 years. Many BCIs use noninvasive electroencephalography as a measurement technique and the P300 event-related potential as an input signal (P300 BCI). Since the first experiment with a P300 BCI system in 1988 by Farwell and Donchin, not only data processing has improved but also stimuli presentation has been varied and a plethora of applications was developed and refined. Nowadays, these applications are facing the challenge of being transferred from the research laboratory into real-life situations to serve motor-impaired people in their homes as assistive technology.

The user-centered design as novel perspective for evaluating the usability of BCI-controlled applications.

Albeit research on brain-computer interfaces (BCI) for controlling applications has expanded tremendously, we still face a translational gap when bringing BCI to end-users. To bridge this gap, we adapted the user-centered design (UCD) to BCI research and development which implies a shift from focusing on single aspects, such as accuracy and information transfer rate (ITR), to a more holistic user experience. The UCD implements an iterative process between end-users and developers based on a valid evaluation procedure. Within the UCD framework usability of a device can be defined with regard to its effectiveness, efficiency, and satisfaction. We operationalized these aspects to evaluate BCI-controlled applications. Effectiveness was regarded equivalent to accuracy of selections and efficiency to the amount of information transferred per time unit and the effort invested (workload). Satisfaction was assessed with questionnaires and visual-analogue scales. These metrics have been successfully applied to several BCI-controlled applications for communication and entertainment, which were evaluated by end-users with severe motor impairment. Results of four studies, involving a total of N = 19 end-users revealed: effectiveness was moderate to high; efficiency in terms of ITR was low to high and workload low to medium; depending on the match between user and technology, and type of application satisfaction was moderate to high. The here suggested evaluation metrics within the framework of the UCD proved to be an applicable and informative approach to evaluate BCI controlled applications, and end-users with severe impairment and in the locked-in state were able to participate in this process.

Cortical effects of user training in a motor imagery based brain-computer interface measured by fNIRS and EEG.

The present study aims to gain insights into the effects of training with a motor imagery (MI)-based brain-computer interface (BCI) on activation patterns of the sensorimotor cortex. We used functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) to investigate long-term training effects across 10 sessions using a 2-class (right hand and feet) MI-based BCI in fifteen subjects. In the course of the training a significant enhancement of activation pattern emerges, represented by an [oxy-Hb] increase in fNIRS and a stronger event-related desynchronization in the upper β-frequency band in the EEG. These effects were only visible in participants with relatively low BCI performance (mean accuracy ≤ 70%). We found that training with an MI-based BCI affects cortical activation patterns especially in users with low BCI performance. Our results may serve as a valuable contribution to the field of BCI research and provide information about the effects that training with an MI-based BCI has on cortical activation patterns. This might be useful for clinical applications of BCI which aim at promoting and guiding neuroplasticity.

Spelling is just a click away - a user-centered brain-computer interface including auto-calibration and predictive text entry

Brain–computer interfaces (BCI) based on event-related potentials (ERP) allow for selection of characters from a visually presented character-matrix and thus provide a communication channel for users with neurodegenerative disease. Although they have been topic of research for more than 20 years and were multiply proven to be a reliable communication method, BCIs are almost exclusively used in experimental settings, handled by qualified experts. This study investigates if ERP–BCIs can be handled independently by laymen without expert support, which is inevitable for establishing BCIs in end-user’s daily life situations. Furthermore we compared the classic character-by-character text entry against a predictive text entry (PTE) that directly incorporates predictive text into the character-matrix. N = 19 BCI novices handled a user-centered ERP–BCI application on their own without expert support. The software individually adjusted classifier weights and control parameters in the background, invisible to the user (auto-calibration). All participants were able to operate the software on their own and to twice correctly spell a sentence with the auto-calibrated classifier (once with PTE, once without). Our PTE increased spelling speed and, importantly, did not reduce accuracy. In sum, this study demonstrates feasibility of auto-calibrating ERP–BCI use, independently by laymen and the strong benefit of integrating predictive text directly into the character-matrix.

Disintegration of Sensorimotor Brain Networks in Schizophrenia

BACKGROUND Schizophrenia is a severe mental disorder associated with derogated function across various domains, including perception, language, motor, emotional, and social behavior. Due to its complex symptomatology, schizophrenia is often regarded a disorder of cognitive processes. Yet due to the frequent involvement of sensory and perceptual symptoms, it has been hypothesized that functional disintegration between sensory and cognitive processes mediates the heterogeneous and comprehensive schizophrenia symptomatology. METHODS Here, using resting-state functional magnetic resonance imaging in 71 patients and 196 healthy controls, we characterized the standard deviation in BOLD (blood-oxygen-level-dependent) signal amplitude and the functional connectivity across a range of functional brain networks. We investigated connectivity on the edge and node level using network modeling based on independent component analysis and utilized the brain network features in cross-validated classification procedures. RESULTS Both amplitude and connectivity were significantly altered in patients, largely involving sensory networks. Reduced standard deviation in amplitude was observed in a range of visual, sensorimotor, and auditory nodes in patients. The strongest differences in connectivity implicated within-sensorimotor and sensorimotor-thalamic connections. Furthermore, sensory nodes displayed widespread alterations in the connectivity with higher-order nodes. We demonstrated robustness of effects across subjects by significantly classifying diagnostic group on the individual level based on cross-validated multivariate connectivity features. CONCLUSION Taken together, the findings support the hypothesis of disintegrated sensory and cognitive processes in schizophrenia, and the foci of effects emphasize that targeting the sensory and perceptual domains may be key to enhance our understanding of schizophrenia pathophysiology.

The brain functional connectome is robustly altered by lack of sleep.

Sleep is a universal phenomenon necessary for maintaining homeostasis and function across a range of organs. Lack of sleep has severe health-related consequences affecting whole-body functioning, yet no other organ is as severely affected as the brain. The neurophysiological mechanisms underlying these deficits are poorly understood. Here, we characterize the dynamic changes in brain connectivity profiles inflicted by sleep deprivation and how they deviate from regular daily variability. To this end, we obtained functional magnetic resonance imaging data from 60 young, adult male participants, scanned in the morning and evening of the same day and again the following morning. 41 participants underwent total sleep deprivation before the third scan, whereas the remainder had another night of regular sleep. Sleep deprivation strongly altered the connectivity of several resting-state networks, including dorsal attention, default mode, and hippocampal networks. Multivariate classification based on connectivity profiles predicted deprivation state with high accuracy, corroborating the robustness of the findings on an individual level. Finally, correlation analysis suggested that morning-to-evening connectivity changes were reverted by sleep (control group)-a pattern which did not occur after deprivation. We conclude that both, a day of waking and a night of sleep deprivation dynamically alter the brain functional connectome.