Heather L. Benz

Electrocorticographic amplitude predicts finger positions during slow grasping motions of the hand

Four human subjects undergoing subdural electrocorticography for epilepsy surgery engaged in a range of finger and hand movements. We observed that the amplitudes of the low-pass filtered electrocorticogram (ECoG), also known as the local motor potential (LMP), over specific peri-Rolandic electrodes were correlated (p < 0.001) with the position of individual fingers as the subjects engaged in slow and deliberate grasping motions. A generalized linear model (GLM) of the LMP amplitudes from those electrodes yielded predictions for positions of the fingers that had a strong congruence with the actual finger positions (correlation coefficient, r; median = 0.51, maximum = 0.91), during displacements of up to 10 cm at the fingertips. For all the subjects, decoding filters trained on data from any given session were remarkably robust in their prediction performance across multiple sessions and days, and were invariant with respect to changes in wrist angle, elbow flexion and hand placement across these sessions (median r = 0.52, maximum r = 0.86). Furthermore, a reasonable prediction accuracy for grasp aperture was achievable with as few as three electrodes in all subjects (median r = 0.49; maximum r = 0.90). These results provide further evidence for the feasibility of robust and practical ECoG-based control of finger movements in upper extremity prosthetics.

Toward Electrocorticographic Control of a Dexterous Upper Limb Prosthesis: Building Brain-Machine Interfaces

In this paper, an ECoG-based system for controlling the MPL where patients were implanted with ECoG electrode grids for clinical seizure mapping and asked to perform various recorded finger or grasp movements.

Connectivity Analysis as a Novel Approach to Motor Decoding for Prosthesis Control

The use of neural signals for prosthesis control is an emerging frontier of research to restore lost function to amputees and the paralyzed. Electrocorticography (ECoG) brain-machine interfaces (BMI) are an alternative to EEG and neural spiking and local field potential BMI approaches. Conventional ECoG BMIs rely on spectral analysis at specific electrode sites to extract signals for controlling prostheses. We compare traditional features with information about the connectivity of an ECoG electrode network. We use time-varying dynamic Bayesian networks (TV-DBN) to determine connectivity between ECoG channels in humans during a motor task. We show that, on average, TV-DBN connectivity decreases from baseline preceding movement and then becomes negative, indicating an alteration in the phase relationship between electrode pairs. In some subjects, this change occurs preceding and during movement, before changes in low or high frequency power. We tested TV-DBN output in a hand kinematic decoder and obtained an average correlation coefficient (r2) between actual and predicted joint angle of 0.40, and as high as 0.66 in one subject. This result compares favorably with spectral feature decoders, for which the average correlation coefficient was 0.13. This work introduces a new feature set based on connectivity and demonstrates its potential to improve ECoG BMI accuracy.

Coarse electrocorticographic decoding of ipsilateral reach in patients with brain lesions

In patients with unilateral upper limb paralysis from strokes and other brain lesions, strategies for functional recovery may eventually include brain-machine interfaces (BMIs) using control signals from residual sensorimotor systems in the damaged hemisphere. When voluntary movements of the contralateral limb are not possible due to brain pathology, initial training of such a BMI may require use of the unaffected ipsilateral limb. We conducted an offline investigation of the feasibility of decoding ipsilateral upper limb movements from electrocorticographic (ECoG) recordings in three patients with different lesions of sensorimotor systems associated with upper limb control. We found that the first principal component (PC) of unconstrained, naturalistic reaching movements of the upper limb could be decoded from ipsilateral ECoG using a linear model. ECoG signal features yielding the best decoding accuracy were different across subjects. Performance saturated with very few input features. Decoding performances of 0.77, 0.73, and 0.66 (median Pearsons r between the predicted and actual first PC of movement using nine signal features) were achieved in the three subjects. The performance achieved here with small numbers of electrodes and computationally simple decoding algorithms suggests that it may be possible to control a BMI using ECoG recorded from damaged sensorimotor brain systems.

Joint Spatial-Spectral Feature Space Clustering for Speech Activity Detection from ECoG Signals

Brain-machine interfaces for speech restoration have been extensively studied for more than two decades. The success of such a system will depend in part on selecting the best brain recording sites and signal features corresponding to speech production. The purpose of this study was to detect speech activity automatically from electrocorticographic signals based on joint spatial-frequency clustering of the ECoG feature space. For this study, the ECoG signals were recorded while a subject performed two different syllable repetition tasks. We found that the optimal frequency resolution to detect speech activity from ECoG signals was 8 Hz, achieving 98.8% accuracy by employing support vector machines as a classifier. We also defined the cortical areas that held the most information about the discrimination of speech and nonspeech time intervals. Additionally, the results shed light on the distinct cortical areas associated with the two syllables repetition tasks and may contribute to the development of portable ECoG-based communication.

Connectivity mapping of the human ECoG during a motor task with a time-varying dynamic Bayesian network

As a partially invasive and clinically obtained neural signal, the electrocorticogram (ECoG) provides a unique opportunity to study cortical processing in humans in vivo. Functional connectivity mapping based on the ECoG signal can provide insight into epileptogenic zones and putative cortical circuits. We describe the first application of time-varying dynamic Bayesian networks (TVDBN) to the ECoG signal for the identification and study of cortical circuits. Connectivity between motor areas as well as between sensory and motor areas preceding and during movement is described. We further apply the connectivity results of the TVDBN to a movement decoder, which achieves a correlation between actual and predicted hand movements of 0.68. This paper presents evidence that the connectivity information discovered with TVDBN is applicable to the design of an ECoG-based brain-machine interface.

Cortical subnetwork dynamics during human language tasks

Language tasks require the coordinated activation of multiple subnetworks-groups of related cortical interactions involved in specific components of task processing. Although electrocorticography (ECoG) has sufficient temporal and spatial resolution to capture the dynamics of event-related interactions between cortical sites, it is difficult to decompose these complex spatiotemporal patterns into functionally discrete subnetworks without explicit knowledge of each subnetworks timing. We hypothesized that subnetworks corresponding to distinct components of task-related processing could be identified as groups of interactions with co-varying strengths. In this study, five subjects implanted with ECoG grids over language areas performed word repetition and picture naming. We estimated the interaction strength between each pair of electrodes during each task using a time-varying dynamic Bayesian network (tvDBN) model constructed from the power of high gamma (70-110Hz) activity, a surrogate for population firing rates. We then reduced the dimensionality of this model using principal component analysis (PCA) to identify groups of interactions with co-varying strengths, which we term functional network components (FNCs). This data-driven technique estimates both the weight of each interactions contribution to a particular subnetwork, and the temporal profile of each subnetworks activation during the task. We found FNCs with temporal and anatomical features consistent with articulatory preparation in both tasks, and with auditory and visual processing in the word repetition and picture naming tasks, respectively. These FNCs were highly consistent between subjects with similar electrode placement, and were robust enough to be characterized in single trials. Furthermore, the interaction patterns uncovered by FNC analysis correlated well with recent literature suggesting important functional-anatomical distinctions between processing external and self-produced speech. Our results demonstrate that subnetwork decomposition of event-related cortical interactions is a powerful paradigm for interpreting the rich dynamics of large-scale, distributed cortical networks during human cognitive tasks.

Directed causality of the human electrocorticogram during dexterous movement

While significant strides have been made in designing brain-machine interfaces for use in humans, efforts to decode truly dexterous movements in real time have been hindered by difficulty extracting detailed movement-related information from the most practical human neural interface, the electrocorticogram (ECoG). We explore a potentially rich, largely untapped source of movement-related information in the form of cortical connectivity computed with time-varying dynamic Bayesian networks (TV-DBN). We discover that measures of connectivity between ECoG electrodes derived from the local motor potential vary with dexterous movement in 65% of movement-related electrode pairs tested, and measures of connectivity derived from spectral features vary with dexterous movement in 76%. Due to the large number of features generated with connectivity methods, the TV-DBN a promising tool for dexterous decoding.

Identifying and prioritizing concerns associated with prosthetic devices for use in a benefit-risk assessment: a mixed-methods approach

ABSTRACT Objective: We identified and prioritized concerns reported by stakeholders associated with novel upper-limb prostheses. Methods: An evidence review and key-informant engagement, identified 62 concerns with upper-limb prostheses with implantable components. We selected 16 concerns for inclusion in a best-worst scaling (BWS) prioritization survey. Focus groups and BWS were used to engage stakeholders at a public meeting on prostheses. In 16 BWS choice tasks, attendees selected the most and least influential concern when choosing an upper-limb prosthesis. Aggregate data were analyzed using choice frequencies and conditional logit analysis. Latent class analysis examined heterogeneity in priorities. Estimates were adjusted to importance ratios which indicate how influential each concern is in the decision making process. Results: Forty-seven (47) stakeholders from diverse backgrounds completed the BWS survey (response rate 51%). On aggregate, the most influential concern was reliability of the device (importance ratio: 13%), and least influential was the concern of an outdated device (importance ratio: 1%). Latent class analysis identified two classes with approximately 50% of participants each. The first class was most influenced by effectiveness of the device. The second class was most influenced by minimizing risks. Conclusion: In this pilot, we identified heterogeneity in how participants prioritize concerns for upper-limb prostheses.

Neuroprosthetics and the science of patient input.

Safe and effective neuroprosthetic systems are of great interest to both DARPA and CDRH, due to their innovative nature and their potential to aid severely disabled populations. By expanding what is possible in human-device interaction, these devices introduce new potential benefits and risks. Therefore patient input, which is increasingly important in weighing benefits and risks, is particularly relevant for this class of devices. FDA has been a significant contributor to an ongoing stakeholder conversation about the inclusion of the patient voice, working collaboratively to create a new framework for a patient-centered approach to medical device development. This framework is evolving through open dialogue with researcher and patient communities, investment in the science of patient input, and policymaking that is responsive to patient-centered data throughout the total product life cycle. In this commentary, we will discuss recent developments in patient-centered benefit-risk assessment and their relevance to the development of neural prosthetic systems.