John D. Simeral

Reach and grasp by people with tetraplegia using a neurally controlled robotic arm

Paralysis following spinal cord injury, brainstem stroke, amyotrophic lateral sclerosis and other disorders can disconnect the brain from the body, eliminating the ability to perform volitional movements. A neural interface system could restore mobility and independence for people with paralysis by translating neuronal activity directly into control signals for assistive devices. We have previously shown that people with long-standing tetraplegia can use a neural interface system to move and click a computer cursor and to control physical devices. Able-bodied monkeys have used a neural interface system to control a robotic arm, but it is unknown whether people with profound upper extremity paralysis or limb loss could use cortical neuronal ensemble signals to direct useful arm actions. Here we demonstrate the ability of two people with long-standing tetraplegia to use neural interface system-based control of a robotic arm to perform three-dimensional reach and grasp movements. Participants controlled the arm and hand over a broad space without explicit training, using signals decoded from a small, local population of motor cortex (MI) neurons recorded from a 96-channel microelectrode array. One of the study participants, implanted with the sensor 5 years earlier, also used a robotic arm to drink coffee from a bottle. Although robotic reach and grasp actions were not as fast or accurate as those of an able-bodied person, our results demonstrate the feasibility for people with tetraplegia, years after injury to the central nervous system, to recreate useful multidimensional control of complex devices directly from a small sample of neural signals.

Distribution of spatial and nonspatial information in dorsal hippocampus

The hippocampus in the mammalian brain is required for the encoding of current and the retention of past experience. Previous studies have shown that the hippocampus contains neurons that encode information required to perform spatial and nonspatial short-term memory tasks. A more detailed understanding of the functional anatomy of the hippocampus would provide important insight into how such encoding occurs. Here we show that hippocampal neurons in the rat are distributed anatomically in distinct segments along the length of the hippocampus. Each longitudinal segment contains clusters of neurons that become active when the animal performs a task with spatial attributes. Within these same segments are ordered arrangements of neurons that encode the nonspatial aspects of the task appropriate to those spatial features. Thus, anatomical segregation of spatial information, together with the interleaved representation of nonspatial information, represents a structural framework that may help to resolve conflicting views of hippocampal function.

Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array

The ongoing pilot clinical trial of the BrainGate neural interface system aims in part to assess the feasibility of using neural activity obtained from a small-scale, chronically implanted, intracortical microelectrode array to provide control signals for a neural prosthesis system. Critical questions include how long implanted microelectrodes will record useful neural signals, how reliably those signals can be acquired and decoded, and how effectively they can be used to control various assistive technologies such as computers and robotic assistive devices, or to enable functional electrical stimulation of paralyzed muscles. Here we examined these questions by assessing neural cursor control and BrainGate system characteristics on five consecutive days 1000 days after implant of a 4 × 4 mm array of 100 microelectrodes in the motor cortex of a human with longstanding tetraplegia subsequent to a brainstem stroke. On each of five prospectively-selected days we performed time-amplitude sorting of neuronal spiking activity, trained a population-based Kalman velocity decoding filter combined with a linear discriminant click state classifier, and then assessed closed-loop point-and-click cursor control. The participant performed both an eight-target center-out task and a random target Fitts metric task which was adapted from a human-computer interaction ISO standard used to quantify performance of computer input devices. The neural interface system was further characterized by daily measurement of electrode impedances, unit waveforms and local field potentials. Across the five days, spiking signals were obtained from 41 of 96 electrodes and were successfully decoded to provide neural cursor point-and-click control with a mean task performance of 91.3% ± 0.1% (mean ± s.d.) correct target acquisition. Results across five consecutive days demonstrate that a neural interface system based on an intracortical microelectrode array can provide repeatable, accurate point-and-click control of a computer interface to an individual with tetraplegia 1000 days after implantation of this sensor.

Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia

Computer-mediated connections between human motor cortical neurons and assistive devices promise to improve or restore lost function in people with paralysis. Recently, a pilot clinical study of an intracortical neural interface system demonstrated that a tetraplegic human was able to obtain continuous two-dimensional control of a computer cursor using neural activity recorded from his motor cortex. This control, however, was not sufficiently accurate for reliable use in many common computer control tasks. Here, we studied several central design choices for such a system including the kinematic representation for cursor movement, the decoding method that translates neuronal ensemble spiking activity into a control signal and the cursor control task used during training for optimizing the parameters of the decoding method. In two tetraplegic participants, we found that controlling a cursors velocity resulted in more accurate closed-loop control than controlling its position directly and that cursor velocity control was achieved more rapidly than position control. Control quality was further improved over conventional linear filters by using a probabilistic method, the Kalman filter, to decode human motor cortical activity. Performance assessment based on standard metrics used for the evaluation of a wide range of pointing devices demonstrated significantly improved cursor control with velocity rather than position decoding.

Point-and-Click Cursor Control With an Intracortical Neural Interface System by Humans With Tetraplegia

We present a point-and-click intracortical neural interface system (NIS) that enables humans with tetraplegia to volitionally move a 2-D computer cursor in any desired direction on a computer screen, hold it still, and click on the area of interest. This direct brain-computer interface extracts both discrete (click) and continuous (cursor velocity) signals from a single small population of neurons in human motor cortex. A key component of this system is a multi-state probabilistic decoding algorithm that simultaneously decodes neural spiking activity of a small population of neurons and outputs either a click signal or the velocity of the cursor. The algorithm combines a linear classifier, which determines whether the user is intending to click or move the cursor, with a Kalman filter that translates the neural population activity into cursor velocity. We present a paradigm for training the multi-state decoding algorithm using neural activity observed during imagined actions. Two human participants with tetraplegia (paralysis of the four limbs) performed a closed-loop radial target acquisition task using the point-and-click NIS over multiple sessions. We quantified point-and-click performance using various human-computer interaction measurements for pointing devices. We found that participants could control the cursor motion and click on specified targets with a small error rate (<; 3% in one participant). This study suggests that signals from a small ensemble of motor cortical neurons ( ~ 40) can be used for natural point-and-click 2-D cursor control of a personal computer.

Active Microelectronic Neurosensor Arrays for Implantable Brain Communication Interfaces

We have built a wireless implantable microelectronic device for transmitting cortical signals transcutaneously. The device is aimed at interfacing a cortical microelectrode array to an external computer for neural control applications. Our implantable microsystem enables 16-channel broadband neural recording in a nonhuman primate brain by converting these signals to a digital stream of infrared light pulses for transmission through the skin. The implantable unit employs a flexible polymer substrate onto which we have integrated ultra-low power amplification with analog multiplexing, an analog-to-digital converter, a low power digital controller chip, and infrared telemetry. The scalable 16-channel microsystem can employ any of several modalities of power supply, including radio frequency by induction, or infrared light via photovoltaic conversion. As of the time of this report, the implant has been tested as a subchronic unit in nonhuman primates (~ 1 month), yielding robust spike and broadband neural data on all available channels.

Clinical translation of a high-performance neural prosthesis

Neural prostheses have the potential to improve the quality of life of individuals with paralysis by directly mapping neural activity to limb- and computer-control signals. We translated a neural prosthetic system previously developed in animal model studies for use by two individuals with amyotrophic lateral sclerosis who had intracortical microelectrode arrays placed in motor cortex. Measured more than 1 year after implant, the neural cursor-control system showed the highest published performance achieved by a person to date, more than double that of previous pilot clinical trial participants.

Virtual typing by people with tetraplegia using a self-calibrating intracortical brain-computer interface

Individuals with tetraplegia are able to type self-paced for hours across multiple days using a self-calibrating point-and-click intracortical brain-computer interface. Prolonged typing with refined BCI The fact that the brain can be hooked up to a computer to allow paralyzed individuals to type is already a technological feat. But, these so-called brain-computer interface technologies can be tiring and burdensome for users, requiring frequent disruptions for recalibration when the decoded neural signals change. Jarosiewicz and colleagues therefore combined three calibration methods—retrospective target interference, velocity bias correction, and adaptive tracking of neural features—for seamless typing and stable neural control. This combination allowed two individuals with tetraplegia and with cortical microelectrode arrays to compose long texts at their own paces, with no need to interrupt typing for recalibration. Brain-computer interfaces (BCIs) promise to restore independence for people with severe motor disabilities by translating decoded neural activity directly into the control of a computer. However, recorded neural signals are not stationary (that is, can change over time), degrading the quality of decoding. Requiring users to pause what they are doing whenever signals change to perform decoder recalibration routines is time-consuming and impractical for everyday use of BCIs. We demonstrate that signal nonstationarity in an intracortical BCI can be mitigated automatically in software, enabling long periods (hours to days) of self-paced point-and-click typing by people with tetraplegia, without degradation in neural control. Three key innovations were included in our approach: tracking the statistics of the neural activity during self-timed pauses in neural control, velocity bias correction during neural control, and periodically recalibrating the decoder using data acquired during typing by mapping neural activity to movement intentions that are inferred retrospectively based on the user’s self-selected targets. These methods, which can be extended to a variety of neurally controlled applications, advance the potential for intracortical BCIs to help restore independent communication and assistive device control for people with paralysis.

Continuous neuronal ensemble control of simulated arm reaching by a human with tetraplegia

Functional electrical stimulation (FES), the coordinated electrical activation of multiple muscles, has been used to restore arm and hand function in people with paralysis. User interfaces for such systems typically derive commands from mechanically unrelated parts of the body with retained volitional control, and are unnatural and unable to simultaneously command the various joints of the arm. Neural interface systems, based on spiking intracortical signals recorded from the arm area of motor cortex, have shown the ability to control computer cursors, robotic arms and individual muscles in intact non-human primates. Such neural interface systems may thus offer a more natural source of commands for restoring dexterous movements via FES. However, the ability to use decoded neural signals to control the complex mechanical dynamics of a reanimated human limb, rather than the kinematics of a computer mouse, has not been demonstrated. This study demonstrates the ability of an individual with long-standing tetraplegia to use cortical neuron recordings to command the real-time movements of a simulated dynamic arm. This virtual arm replicates the dynamics associated with arm mass and muscle contractile properties, as well as those of an FES feedback controller that converts user commands into the required muscle activation patterns. An individual with long-standing tetraplegia was thus able to control a virtual, two-joint, dynamic arm in real time using commands derived from an existing human intracortical interface technology. These results show the feasibility of combining such an intracortical interface with existing FES systems to provide a high-performance, natural system for restoring arm and hand function in individuals with extensive paralysis.

Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: a proof-of-concept demonstration

SUMMARY Background People with chronic tetraplegia due to high cervical spinal cord injury (SCI) can regain limb movements through coordinated electrical stimulation of peripheral muscles and nerves, known as Functional Electrical Stimulation (FES). Users typically command FES systems through other preserved, but limited and unrelated, volitional movements (e.g. facial muscle activity, head movements). We demonstrate an individual with traumatic high cervical SCI performing coordinated reaching and grasping movements using his own paralyzed arm and hand, reanimated through FES, and commanded using his own cortical signals through an intracortical brain-computer-interface (iBCI). Methods The study participant (53 years old, C4, ASIA A) received two intracortical microelectrode arrays in the hand area of motor cortex, and 36 percutaneous electrodes for electrically stimulating hand, elbow, and shoulder muscles. The participant used a motorized mobile arm support for gravitational assistance and to provide humeral ab/adduction under cortical control. We assessed the participant’s ability to cortically command his paralyzed arm to perform simple single-joint arm/hand movements and functionally meaningful multi-joint movements. We compared iBCI control of his paralyzed arm to that of a virtual 3D arm. This study is registered with ClinicalTrials.gov, NCT00912041. Findings The participant successfully cortically commanded single-joint and coordinated multi-joint arm movements for point-to-point target acquisitions (80% – 100% accuracy) using first a virtual arm, and second his own arm animated by FES. Using his paralyzed arm, the participant volitionally performed self-paced reaches to drink a mug of coffee (successfully completing 11 of 12 attempts within a single session) and feed himself. Interpretation This is the first demonstration of a combined FES+iBCI neuroprosthesis for both reaching and grasping for people with SCI resulting in chronic tetraplegia, and represents a major advance, with a clear translational path, for clinically viable neuroprostheses for restoring reaching and grasping post-paralysis.BACKGROUND People with chronic tetraplegia, due to high-cervical spinal cord injury, can regain limb movements through coordinated electrical stimulation of peripheral muscles and nerves, known as functional electrical stimulation (FES). Users typically command FES systems through other preserved, but unrelated and limited in number, volitional movements (eg, facial muscle activity, head movements, shoulder shrugs). We report the findings of an individual with traumatic high-cervical spinal cord injury who coordinated reaching and grasping movements using his own paralysed arm and hand, reanimated through implanted FES, and commanded using his own cortical signals through an intracortical brain-computer interface (iBCI). METHODS We recruited a participant into the BrainGate2 clinical trial, an ongoing study that obtains safety information regarding an intracortical neural interface device, and investigates the feasibility of people with tetraplegia controlling assistive devices using their cortical signals. Surgical procedures were performed at University Hospitals Cleveland Medical Center (Cleveland, OH, USA). Study procedures and data analyses were performed at Case Western Reserve University (Cleveland, OH, USA) and the US Department of Veterans Affairs, Louis Stokes Cleveland Veterans Affairs Medical Center (Cleveland, OH, USA). The study participant was a 53-year-old man with a spinal cord injury (cervical level 4, American Spinal Injury Association Impairment Scale category A). He received two intracortical microelectrode arrays in the hand area of his motor cortex, and 4 months and 9 months later received a total of 36 implanted percutaneous electrodes in his right upper and lower arm to electrically stimulate his hand, elbow, and shoulder muscles. The participant used a motorised mobile arm support for gravitational assistance and to provide humeral abduction and adduction under cortical control. We assessed the participants ability to cortically command his paralysed arm to perform simple single-joint arm and hand movements and functionally meaningful multi-joint movements. We compared iBCI control of his paralysed arm with that of a virtual three-dimensional arm. This study is registered with ClinicalTrials.gov, number NCT00912041. FINDINGS The intracortical implant occurred on Dec 1, 2014, and we are continuing to study the participant. The last session included in this report was Nov 7, 2016. The point-to-point target acquisition sessions began on Oct 8, 2015 (311 days after implant). The participant successfully cortically commanded single-joint and coordinated multi-joint arm movements for point-to-point target acquisitions (80-100% accuracy), using first a virtual arm and second his own arm animated by FES. Using his paralysed arm, the participant volitionally performed self-paced reaches to drink a mug of coffee (successfully completing 11 of 12 attempts within a single session 463 days after implant) and feed himself (717 days after implant). INTERPRETATION To our knowledge, this is the first report of a combined implanted FES+iBCI neuroprosthesis for restoring both reaching and grasping movements to people with chronic tetraplegia due to spinal cord injury, and represents a major advance, with a clear translational path, for clinically viable neuroprostheses for restoration of reaching and grasping after paralysis. FUNDING National Institutes of Health, Department of Veterans Affairs.