Febo Cincotti

Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges

In recent years, new research has brought the field of electroencephalogram (EEG)-based brain–computer interfacing (BCI) out of its infancy and into a phase of relative maturity through many demonstrated prototypes such as brain-controlled wheelchairs, keyboards, and computer games. With this proof-of-concept phase in the past, the time is now ripe to focus on the development of practical BCI technologies that can be brought out of the lab and into real-world applications. In particular, we focus on the prospect of improving the lives of countless disabled individuals through a combination of BCI technology with existing assistive technologies (AT). In pursuit of more practical BCIs for use outside of the lab, in this paper, we identify four application areas where disabled individuals could greatly benefit from advancements in BCI technology, namely, “Communication and Control”, “Motor Substitution”, “Entertainment”, and “Motor Recovery”. We review the current state of the art and possible future developments, while discussing the main research issues in these four areas. In particular, we expect the most progress in the development of technologies such as hybrid BCI architectures, user–machine adaptation algorithms, the exploitation of users’ mental states for BCI reliability and confidence measures, the incorporation of principles in human–computer interaction (HCI) to improve BCI usability, and the development of novel BCI technology including better EEG devices.

Estimation of the cortical functional connectivity with the multimodal integration of high-resolution EEG and fMRI data by directed transfer function

Nowadays, several types of brain imaging device are available to provide images of the functional activity of the cerebral cortex based on hemodynamic, metabolic, or electromagnetic measurements. However, static images of brain regions activated during particular tasks do not convey the information of how these regions communicate with each other. In this study, advanced methods for the estimation of cortical connectivity from combined high-resolution electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) data are presented. These methods include a subjects multicompartment head model (scalp, skull, dura mater, cortex) constructed from individual magnetic resonance images, multidipole source model, and regularized linear inverse source estimates of cortical current density. Determination of the priors in the resolution of the linear inverse problem was performed with the use of information from the hemodynamic responses of the cortical areas as revealed by block-designed (strength of activated voxels) fMRI. We estimate functional cortical connectivity by computing the directed transfer function (DTF) on the estimated cortical current density waveforms in regions of interest (ROIs) on the modeled cortical mantle. The proposed method was able to unveil the direction of the information flow between the cortical regions of interest, as it is directional in nature. Furthermore, this method allows to detect changes in the time course of information flow between cortical regions in different frequency bands. The reliability of these techniques was further demonstrated by elaboration of high-resolution EEG and fMRI signals collected during visually triggered finger movements in four healthy subjects. Connectivity patterns estimated for this task reveal an involvement of right parietal and bilateral premotor and prefrontal cortical areas. This cortical region involvement resembles that revealed in previous studies where visually triggered finger movements were analyzed with the use of separate EEG or fMRI measurements.

Human Movement-Related Potentials vs Desynchronization of EEG Alpha Rhythm: A High-Resolution EEG Study

Movement-related potentials (MRPs) and event-related desynchronization (ERD) of alpha rhythm were investigated with an advanced high-resolution electroencephalographic technology (128 channels, surface Laplacian estimate, realistic head modeling). The working hypothesis was that MRPs and alpha ERD reflect different aspects of sensorimotor cortical processes. Both MRPs and alpha ERD modeled the responses of primary sensorimotor (M1-S1), supplementary motor (SMA), and posterior parietal (PP, area 5) areas during the preparation and execution of unilateral finger movements. Maximum responses were modeled in the contralateral M1-S1 during both preparation and execution of the movement. The SMA and PP responses were modeled mainly from the MRPs and alpha ERD, respectively. The modeled ipsilateral M1-S1 responses were larger and stronger in the alpha ERD than MRPs. These results may suggest that alpha ERD reflects changes in the background oscillatory activity in wide cortical sensorimotor areas, whereas MRPs represent mainly increased, task-specific responses of SMA and contralateral M1-S1.

Comparison of different cortical connectivity estimators for high-resolution EEG recordings

The aim of this work is to characterize quantitatively the performance of a body of techniques in the frequency domain for the estimation of cortical connectivity from high‐resolution EEG recordings in different operative conditions commonly encountered in practice. Connectivity pattern estimators investigated are the Directed Transfer Function (DTF), its modification known as direct DTF (dDTF) and the Partial Directed Coherence (PDC). Predefined patterns of cortical connectivity were simulated and then retrieved by the application of the DTF, dDTF, and PDC methods. Signal‐to‐noise ratio (SNR) and length (LENGTH) of EEG epochs were studied as factors affecting the reconstruction of the imposed connectivity patterns. Reconstruction quality and error rate in estimated connectivity patterns were evaluated by means of some indexes of quality for the reconstructed connectivity pattern. The error functions were statistically analyzed with analysis of variance (ANOVA). The whole methodology was then applied to high‐resolution EEG data recorded during the well‐known Stroop paradigm. Simulations indicated that all three methods correctly estimated the simulated connectivity patterns under reasonable conditions. However, performance of the methods differed somewhat as a function of SNR and LENGTH factors. The methods were generally equivalent when applied to the Stroop data. In general, the amount of available EEG affected the accuracy of connectivity pattern estimations. Analysis of 27 s of nonconsecutive recordings with an SNR of 3 or more ensured that the connectivity pattern could be accurately recovered with an error below 7% for the PDC and 5% for the DTF. In conclusion, functional connectivity patterns of cortical activity can be effectively estimated under general conditions met in most EEG recordings by combining high‐resolution EEG techniques, linear inverse estimation of the cortical activity, and frequency domain multivariate methods such as PDC, DTF, and dDTF. Hum. Brain Mapp, 2007.

A local neural classifier for the recognition of EEG patterns associated to mental tasks

This paper proposes a novel and simple local neural classifier for the recognition of mental tasks from on-line spontaneous EEG signals. The proposed neural classifier recognizes three mental tasks from on-line spontaneous EEG signals. Correct recognition is around 70%. This modest rate is largely compensated by two properties, namely low percentage of wrong decisions (below 5%) and rapid responses (every 1/2 s). Interestingly, the neural classifier achieves this performance with a few units, normally just one per mental task. Also, since the subject and his/her personal interface learn simultaneously from each other, subjects master it rapidly (in a few days of moderate training). Finally, analysis of learned EEG patterns confirms that for a subject to operate satisfactorily a brain interface, the latter must fit the individual features of the former.

Linear classification of low-resolution EEG patterns produced by imagined hand movements

Electroencephalograph (EEG)-based brain-computer interfaces (BCIs) require on-line detection of mental states from spontaneous EEG signals. In this framework, surface Laplacian (SL) transformation of EEG signals has proved to improve the recognition scores of imagined motor activity. The results we obtained in the first year of an European project named adaptive brain interfaces (ABI) suggest that: 1) the detection of mental imagined activity can be obtained by using the signal space projection (SSP) method as a classifier and 2) a particular type of electrodes can be used in such a BCI device, reconciling the benefits of SL waveforms and the need for the use of few electrodes. Recognition of mental activity was attempted on both raw and SL-transformed EEG data from five healthy people performing two mental tasks, namely imagined right and left hand movements.

Tracking the Time-Varying Cortical Connectivity Patterns by Adaptive Multivariate Estimators

The directed transfer function (DTF) and the partial directed coherence (PDC) are frequency-domain estimators that are able to describe interactions between cortical areas in terms of the concept of Granger causality. However, the classical estimation of these methods is based on the multivariate autoregressive modelling (MVAR) of time series, which requires the stationarity of the signals. In this way, transient pathways of information transfer remains hidden. The objective of this study is to test a time-varying multivariate method for the estimation of rapidly changing connectivity relationships between cortical areas of the human brain, based on DTF/PDC and on the use of adaptive MVAR modelling (AMVAR) and to apply it to a set of real high resolution EEG data. This approach will allow the observation of rapidly changing influences between the cortical areas during the execution of a task. The simulation results indicated that time-varying DTF and PDC are able to estimate correctly the imposed connectivity patterns under reasonable operative conditions of signal-to-noise ratio (SNR) ad number of trials. An SNR of Ave and a number of trials of at least 20 provide a good accuracy in the estimation. After testing the method by the simulation study, we provide an application to the cortical estimations obtained from high resolution EEG data recorded from a group of healthy subject during a combined foot-lips movement and present the time-varying connectivity patterns resulting from the application of both DTF and PDC. Two different cortical networks were detected with the proposed methods, one constant across the task and the other evolving during the preparation of the joint movement.

Multimodal integration of high-resolution EEG and functional magnetic resonance imaging data: A simulation study

Previous simulation studies have stressed the importance of the use of fMRI priors in the estimation of cortical current density. However, no systematic variations of signal-to-noise ratio (SNR) and number of electrodes were explicitly taken into account in the estimation process. In this simulation study we considered the utility of including information as estimated from fMRI. This was done by using as the dependent variable both the correlation coefficient and the relative error between the imposed and the estimated waveforms at the level of cortical region of interests (ROI). A realistic head and cortical surface model was used. Factors used in the simulations were the different values of SNR of the scalp-generated data, the different inverse operators used to estimated the cortical source activity, the strengths of the fMRI priors in the fMRI-based inverse operators, and the number of scalp electrodes used in the analysis. Analysis of variance results suggested that all the considered factors significantly afflict the correlation and the relative error between the estimated and the simulated cortical activity. For the ROIs analyzed with simulated fMRI hot spots, it was observed that the best estimation of cortical source currents was performed with the inverse operators that used fMRI information. When the ROIs analyzed do not present fMRI hot spots, both standard (i.e., minimum norm) and fMRI-based inverse operators returned statistically equivalent correlation and relative error values.

Brain-computer interface boosts motor imagery practice during stroke recovery

Motor imagery (MI) is assumed to enhance poststroke motor recovery, yet its benefits are debatable. Brain–computer interfaces (BCIs) can provide instantaneous and quantitative measure of cerebral functions modulated by MI. The efficacy of BCI‐monitored MI practice as add‐on intervention to usual rehabilitation care was evaluated in a randomized controlled pilot study in subacute stroke patients.

Assessing cortical functional connectivity by partial directed coherence: simulations and application to real data

The aim of this paper is to test a technique called partial directed coherence (PDC) and its modification (squared PDC; sPDC) for the estimation of human cortical connectivity by means of simulation study, in which both PDC and sPDC were studied by analysis of variance. The statistical analysis performed returned that both PDC and sPDC are able to estimate correctly the imposed connectivity patterns when data exhibit a signal-to-noise ratio of at least 3 and a length of at least 27 s of nonconsecutive recordings at 250 Hz of sampling rate, equivalent, more generally, to 6750 data samples