Michele Tavella

Tools for Brain-Computer Interaction: A General Concept for a Hybrid BCI

The aim of this work is to present the development of a hybrid Brain-Computer Interface (hBCI) which combines existing input devices with a BCI. Thereby, the BCI should be available if the user wishes to extend the types of inputs available to an assistive technology system, but the user can also choose not to use the BCI at all; the BCI is active in the background. The hBCI might decide on the one hand which input channel(s) offer the most reliable signal(s) and switch between input channels to improve information transfer rate, usability, or other factors, or on the other hand fuse various input channels. One major goal therefore is to bring the BCI technology to a level where it can be used in a maximum number of scenarios in a simple way. To achieve this, it is of great importance that the hBCI is able to operate reliably for long periods, recognizing and adapting to changes as it does so. This goal is only possible if many different subsystems in the hBCI can work together. Since one research institute alone cannot provide such different functionality, collaboration between institutes is necessary. To allow for such a collaboration, a new concept and common software framework is introduced. It consists of four interfaces connecting the classical BCI modules: signal acquisition, preprocessing, feature extraction, classification, and the application. But it provides also the concept of fusion and shared control. In a proof of concept, the functionality of the proposed system was demonstrated.

The role of shared-control in BCI-based telepresence

This paper discusses and evaluates the role of shared control approach in a BCI-based telepresence framework. Driving a mobile device by using human brain signals might improve the quality of life of people suffering from severely physical disabilities. By means of a bidirectional audio/video connection to a robot, the BCI user is able to interact actively with relatives and friends located in different rooms. However, the control of robots through an uncertain channel as a BCI may be complicated and exhaustive. Shared control can facilitate the operation of brain-controlled telepresence robots, as demonstrated by the experimental results reported here. In fact, it allows all subjects to complete a rather complex task, driving the robot in a natural environment along a path with several targets and obstacles, in shorter times and with less number of mental commands.

Towards natural non-invasive hand neuroprostheses for daily living

In this paper we show how healthy subjects can operate a non-invasive asynchronous BCI for controlling a FES neuroprosthesis and manipulate objects to carry out daily tasks in ecological conditions. Both, experienced and novel subjects proved to be able to deliver mental commands with high accuracy and speed. Our neuroprosthetic approach relies on a natural interaction paradigm, where subjects delivers congruent MI commands (i.e., they imagining a movement of the same hand they control through FES). Furthermore, we have tested our approach in a common daily task such as handwriting, which requires the user to split his/her attention to multitask between BCI control, reaching, and the primary handwriting task itself. Interestingly, the very low number of erroneous trials illustrates how during the experiments subjects were able to deliver commands just when they intended to do so. Similarly, the subjects could perform actions while delivering, or preparing to deliver, mental commands.

Clinical evaluation of BrainTree, a motor imagery hybrid BCI speller

OBJECTIVE While brain-computer interfaces (BCIs) for communication have reached considerable technical maturity, there is still a great need for state-of-the-art evaluation by the end-users outside laboratory environments. To achieve this primary objective, it is necessary to augment a BCI with a series of components that allow end-users to type text effectively. APPROACH This work presents the clinical evaluation of a motor imagery (MI) BCI text-speller, called BrainTree, by six severely disabled end-users and ten able-bodied users. Additionally, we define a generic model of code-based BCI applications, which serves as an analytical tool for evaluation and design. MAIN RESULTS We show that all users achieved remarkable usability and efficiency outcomes in spelling. Furthermore, our model-based analysis highlights the added value of human-computer interaction techniques and hybrid BCI error-handling mechanisms, and reveals the effects of BCI performances on usability and efficiency in code-based applications. SIGNIFICANCE This study demonstrates the usability potential of code-based MI spellers, with BrainTree being the first to be evaluated by a substantial number of end-users, establishing them as a viable, competitive alternative to other popular BCI spellers. Another major outcome of our model-based analysis is the derivation of a 80% minimum command accuracy requirement for successful code-based application control, revising upwards previous estimates attempted in the literature.

Phase-based features for motor imagery brain-computer interfaces

Motor imagery (MI) brain-computer interfaces (BCIs) translate a subjects motor intention to a command signal. Most MI BCIs use power features in the mu or beta rhythms, while several results have been reported using a measure of phase synchrony, the phase-locking value (PLV). In this study, we investigated the performance of various phase-based features, including instantaneous phase difference (IPD) and PLV, for control of a MI BCI. Patterns of phase synchrony differentially appear over the motor cortices and between the primary motor cortex (M1) and supplementary motor area (SMA) during MI. Offline results, along with preliminary online sessions, indicate that IPD serves as a robust control signal for differentiating between MI classes, and that the phase relations between channels are relatively stable over several months. Offline and online trial-level classification accuracies based on IPD ranged from 84% to 99%, whereas the performance for the corresponding amplitude features ranged from 70% to 100%.

On the road to a neuroprosthetic hand: A novel hand grasp orthosis based on functional electrical stimulation

To patients who have lost the functionality of their hands as a result of a severe spinal cord injury or brain stroke, the development of new techniques for grasping is indispensable for reintegration and independency in daily life. Functional Electrical Stimulation (FES) of residual muscles can reproduce the most dominant grasping tasks and can be initialized by brain signals. However, due to the very complex hand anatomy and current limitations in FES-technology with surface electrodes, these grasp patterns cannot be smoothly executed. In this paper, we present an adaptable passive hand orthosis which is capable of producing natural and smooth movements when coupled with FES. It evenly synchronizes the grasping movements and applied forces on all fingers, allowing for naturalistic gestures and functional grasps of everyday objects. The orthosis is also equipped with a lock, which allows it to remain in the desired position without the need for long-term stimulation. Furthermore, we quantify improvements offered by the orthosis compare them with natural grasps on healthy subjects.