Erwei Yin

A novel hybrid BCI speller based on the incorporation of SSVEP into the P300 paradigm

OBJECTIVE Although extensive studies have shown improvement in spelling accuracy, the conventional P300 speller often exhibits errors, which occur in almost the same row or column relative to the target. To address this issue, we propose a novel hybrid brain-computer interface (BCI) approach by incorporating the steady-state visual evoked potential (SSVEP) into the conventional P300 paradigm. APPROACH We designed a periodic stimuli mechanism and superimposed it onto the P300 stimuli to increase the difference between the symbols in the same row or column. Furthermore, we integrated the random flashings and periodic flickers to simultaneously evoke the P300 and SSVEP, respectively. Finally, we developed a hybrid detection mechanism based on the P300 and SSVEP in which the target symbols are detected by the fusion of three-dimensional, time-frequency features. MAIN RESULTS The results obtained from 12 healthy subjects show that an online classification accuracy of 93.85% and information transfer rate of 56.44 bit/min were achieved using the proposed BCI speller in only a single trial. Specifically, 5 of the 12 subjects exhibited an information transfer rate of 63.56 bit/min with an accuracy of 100%. SIGNIFICANCE The pilot studies suggested that the proposed BCI speller could achieve a better and more stable system performance compared with the conventional P300 speller, and it is promising for achieving quick spelling in stimulus-driven BCI applications.

A Speedy Hybrid BCI Spelling Approach Combining P300 and SSVEP

This study proposes a novel hybrid brain-computer interface (BCI) approach for increasing the spelling speed. In this approach, the P300 and steady-state visually evoked potential (SSVEP) detection mechanisms are devised and integrated so that the two brain signals can be used for spelling simultaneously. Specifically, the target item is identified by 2-D coordinates that are realized by the two brain patterns. The subarea/location and row/column speedy spelling paradigms were designed based on this approach. The results obtained for 14 healthy subjects demonstrate that the average online practical information transfer rate, including the time of break between selections and error correcting, achieved using our approach was 53.06 bits/min. The pilot studies suggest that our BCI approach could achieve higher spelling speed compared with the conventional P300 and SSVEP spellers.

A Dynamically Optimized SSVEP Brain–Computer Interface (BCI) Speller

The aim of this study was to design a dynamically optimized steady-state visually evoked potential (SSVEP) brain-computer interface (BCI) system with enhanced performance relative to previous SSVEP BCIs in terms of the number of items selectable on the interface, accuracy, and speed. In this approach, the row/column (RC) paradigm was employed in a SSVEP speller to increase the number of items. The target is detected by subsequently determining the row and column coordinates. To improve spelling accuracy, we added a posterior processing after the canonical correlation analysis (CCA) approach to reduce the interfrequency variation between different subjects and named the new signal processing method CCA-RV, and designed a real-time biofeedback mechanism to increase attention on the visual stimuli. To achieve reasonable online spelling speed, both fixed and dynamic approaches for setting the optimal stimulus duration were implemented and compared. Experimental results for 11 subjects suggest that the CCA-RV method and the real-time biofeedback effectively increased accuracy compared with CCA and the absence of real-time feedback, respectively. In addition, both optimization approaches for setting stimulus duration achieved reasonable online spelling performance. However, the dynamic optimization approach yielded a higher practical information transfer rate (PITR) than the fixed optimization approach. The average online PITR achieved by the proposed adaptive SSVEP speller, including the time required for breaks between selections and error correction, was 41.08 bit/min. These results indicate that our BCI speller is promising for use in SSVEP-based BCI applications.

An Auditory-Tactile Visual Saccade-Independent P300 Brain–Computer Interface

Most P300 event-related potential (ERP)-based brain-computer interface (BCI) studies focus on gaze shift-dependent BCIs, which cannot be used by people who have lost voluntary eye movement. However, the performance of visual saccade-independent P300 BCIs is generally poor. To improve saccade-independent BCI performance, we propose a bimodal P300 BCI approach that simultaneously employs auditory and tactile stimuli. The proposed P300 BCI is a vision-independent system because no visual interaction is required of the user. Specifically, we designed a direction-congruent bimodal paradigm by randomly and simultaneously presenting auditory and tactile stimuli from the same direction. Furthermore, the channels and number of trials were tailored to each user to improve online performance. With 12 participants, the average online information transfer rate (ITR) of the bimodal approach improved by 45.43% and 51.05% over that attained, respectively, with the auditory and tactile approaches individually. Importantly, the average online ITR of the bimodal approach, including the break time between selections, reached 10.77 bits/min. These findings suggest that the proposed bimodal system holds promise as a practical visual saccade-independent P300 BCI.

A Hybrid Brain–Computer Interface Based on the Fusion of P300 and SSVEP Scores

The present study proposes a hybrid brain-computer interface (BCI) with 64 selectable items based on the fusion of P300 and steady-state visually evoked potential (SSVEP) brain signals. With this approach, row/column (RC) P300 and two-step SSVEP paradigms were integrated to create two hybrid paradigms, which we denote as the double RC (DRC) and 4-D spellers. In each hybrid paradigm, the target is simultaneously detected based on both P300 and SSVEP potentials as measured by the electroencephalogram. We further proposed a maximum-probability estimation (MPE) fusion approach to combine the P300 and SSVEP on a score level and compared this approach to other approaches based on linear discriminant analysis, a naïve Bayes classifier, and support vector machines. The experimental results obtained from thirteen participants indicated that the 4-D hybrid paradigm outperformed the DRC paradigm and that the MPE fusion achieved higher accuracy compared with the other approaches. Importantly, 12 of the 13 participants, using the 4-D paradigm achieved an accuracy of over 90% and the average accuracy was 95.18%. These promising results suggest that the proposed hybrid BCI system could be used in the design of a high-performance BCI-based keyboard.

A novel Morse code-inspired method for multiclass motor imagery brain-computer interface (BCI) design

Motor imagery (MI)-based brain-computer interfaces (BCIs) allow disabled individuals to control external devices voluntarily, helping us to restore lost motor functions. However, the number of control commands available in MI-based BCIs remains limited, limiting the usability of BCI systems in control applications involving multiple degrees of freedom (DOF), such as control of a robot arm. To address this problem, we developed a novel Morse code-inspired method for MI-based BCI design to increase the number of output commands. Using this method, brain activities are modulated by sequences of MI (sMI) tasks, which are constructed by alternately imagining movements of the left or right hand or no motion. The codes of the sMI task was detected from EEG signals and mapped to special commands. According to permutation theory, an sMI task with N-length allows 2 × (2(N)-1) possible commands with the left and right MI tasks under self-paced conditions. To verify its feasibility, the new method was used to construct a six-class BCI system to control the arm of a humanoid robot. Four subjects participated in our experiment and the averaged accuracy of the six-class sMI tasks was 89.4%. The Cohens kappa coefficient and the throughput of our BCI paradigm are 0.88 ± 0.060 and 23.5bits per minute (bpm), respectively. Furthermore, all of the subjects could operate an actual three-joint robot arm to grasp an object in around 49.1s using our approach. These promising results suggest that the Morse code-inspired method could be used in the design of BCIs for multi-DOF control.

Hybrid Brain-Computer Interface (BCI) based on the EEG and EOG signals

Recently, the integration of different electrophysiological signals into an electroencephalogram (EEG) has become an effective approach to improve the practicality of brain-computer interface (BCI) systems, referred to as hybrid BCIs. In this paper, a hybrid BCI was designed by combining an EEG with electrocardiograph (EOG) signals and tested using a target selection experiment. Gaze direction from the EOG and the event-related (de)synchronization (ERD/ERS) induced by motor imagery from the EEG were simultaneously detected as the output of the BCI system. The target selection mechanism was based on the synthesis of the gaze direction and ERD activity. When an ERD activity was detected, the target corresponding to the gaze direction was selected; without ERD activity, no target was selected, even when a subjects gaze was directed at the target. With this mechanism, the operation of the BCI system is more flexible and voluntary. The accuracy and completion time of the target selection tasks during the online testing were 89.3% and 2.4 seconds, respectively. These results show the feasibility and practicality of this hybrid BCI system, which can potentially be used in the rehabilitation of disabled individuals.

A novel task-oriented optimal design for P300-based brain–computer interfaces

Objective. The number of items of a P300-based brain-computer interface (BCI) should be adjustable in accordance with the requirements of the specific tasks. To address this issue, we propose a novel task-oriented optimal approach aimed at increasing the performance of general P300 BCIs with different numbers of items. Approach. First, we proposed a stimulus presentation with variable dimensions (VD) paradigm as a generalization of the conventional single-character (SC) and row-column (RC) stimulus paradigms. Furthermore, an embedding design approach was employed for any given number of items. Finally, based on the score-P model of each subject, the VD flash pattern was selected by a linear interpolation approach for a certain task. Main results. The results indicate that the optimal BCI design consistently outperforms the conventional approaches, i.e., the SC and RC paradigms. Specifically, there is significant improvement in the practical information transfer rate for a large number of items. Significance. The results suggest that the proposed optimal approach would provide useful guidance in the practical design of general P300-based BCIs.

Toward brain-actuated car applications

This study presented a paradigm for controlling a car using an asynchronous electroencephalogram (EEG)-based brain-computer interface (BCI) and presented the experimental results of a simulation performed in an experimental environment outside the laboratory. This paradigm uses two distinct MI tasks, imaginary left- and right-hand movements, to generate a multi-task car control strategy consisting of starting the engine, moving forward, turning left, turning right, moving backward, and stopping the engine. Five healthy subjects participated in the online car control experiment, and all successfully controlled the car by following a previously outlined route. Subject S1 exhibited the most satisfactory BCI-based performance, which was comparable to the manual control-based performance. We hypothesize that the proposed self-paced car control paradigm based on EEG signals could potentially be used in car control applications, and we provide a complementary or alternative way for individuals with locked-in disorders to achieve more mobility in the future, as well as providing a supplementary car-driving strategy to assist healthy people in driving a car.

Adding Real-Time Bayesian Ranks to Error-Related Potential Scores Improves Error Detection and Auto-Correction in a P300 Speller

Brain-computer interface (BCI) spellers could improve access to communication for people with profound physical disabilities; however, improved speed and accuracy of these spellers is required to make them practical for everyday use. Here we introduce the combination of P300-speller confidence with the error-related potential (ErrP) to improve online single-trial error detection and correction accuracies in a BCI speller. First, we present a mechanism for obtaining P300-confidence using a real-time Bayesian dynamic stopping framework that makes novel use of additional stimuli that occur due to epoch and filter delays. Second, we propose an ensemble of decision trees to combine ErrP and P300-confidence features. Third, we describe the unique attentional differences between error and correct feedback in our spelling interface and discuss how these differences affect ErrP physiology. We tested online error detection on 11 typically developed adults using a BCI system trained on a previous day and found an average sensitivity of 86.67% and specificity of 96.59%. Automatic correction increased selection accuracy by 13.67% and utility grew by a factor of 4.48. We found, however, that the improved performance was primarily attributable to the inclusion of P300 confidence in error detection, calling into question the significance of single-trial ErrP detection.