Markus Hauschild

Cognitive signals for brain-machine interfaces in posterior parietal cortex include continuous 3D trajectory commands.

Cortical neural prosthetics extract command signals from the brain with the goal to restore function in paralyzed or amputated patients. Continuous control signals can be extracted from the motor cortical areas, whereas neural activity from posterior parietal cortex (PPC) can be used to decode cognitive variables related to the goals of movement. Because typical activities of daily living comprise both continuous control tasks such as reaching, and tasks benefiting from discrete control such as typing on a keyboard, availability of both signals simultaneously would promise significant increases in performance and versatility. Here, we show that PPC can provide 3D hand trajectory information under natural conditions that would be encountered for prosthetic applications, thus allowing simultaneous extraction of continuous and discrete signals without requiring multisite surgical implants. We found that limb movements can be decoded robustly and with high accuracy from a small population of neural units under free gaze in a complex 3D point-to-point reaching task. Both animals’ brain-control performance improved rapidly with practice, resulting in faster target acquisition and increasing accuracy. These findings disprove the notion that the motor cortical areas are the only candidate areas for continuous prosthetic command signals and, rather, suggests that PPC can provide equally useful trajectory signals in addition to discrete, cognitive variables. Hybrid use of continuous and discrete signals from PPC may enable a new generation of neural prostheses providing superior performance and additional flexibility in addressing individual patient needs.

Inactivation of the Parietal Reach Region Causes Optic Ataxia, Impairing Reaches but Not Saccades

Lesions in human posterior parietal cortex can cause optic ataxia (OA), in which reaches but not saccades to visual objects are impaired, suggesting separate visuomotor pathways for the two effectors. In monkeys, one potentially crucial area for reach control is the parietal reach region (PRR), in which neurons respond preferentially during reach planning as compared to saccade planning. However, direct causal evidence linking the monkey PRR to the deficits observed in OA is missing. We thus inactivated part of the macaque PRR, in the medial wall of the intraparietal sulcus, and produced the hallmarks of OA, misreaching for peripheral targets but unimpaired saccades. Furthermore, reach errors were larger for the targets preferred by the neural population local to the injection site. These results demonstrate that PRR is causally involved in reach-specific visuomotor pathways, and reach goal disruption in PRR can be a neural basis of OA.

A Virtual Reality Environment for Designing and Fitting Neural Prosthetic Limbs

Building and testing novel prosthetic limbs and control algorithms for functional electrical stimulation (FES) is expensive and risky. Here, we describe a virtual reality environment (VRE) to facilitate and accelerate the development of novel systems. In the VRE, subjects/patients can operate a simulated limb to interact with virtual objects. Realistic models of all relevant musculoskeletal and mechatronic components allow the development of entire prosthetic systems in VR before introducing them to the patient. The system is used both by engineers as a development tool and by clinicians to fit prosthetic devices to patients

Optic Ataxia: From Balint’s Syndrome to the Parietal Reach Region

Optic ataxia is a high-order deficit in reaching to visual goals that occurs with posterior parietal cortex (PPC) lesions. It is a component of Balints syndrome that also includes attentional and gaze disorders. Aspects of optic ataxia are misreaching in the contralesional visual field, difficulty preshaping the hand for grasping, and an inability to correct reaches online. Recent research in nonhuman primates (NHPs) suggests that many aspects of Balints syndrome and optic ataxia are a result of damage to specific functional modules for reaching, saccades, grasp, attention, and state estimation. The deficits from large lesions in humans are probably composite effects from damage to combinations of these functional modules. Interactions between these modules, either within posterior parietal cortex or downstream within frontal cortex, may account for more complex behaviors such as hand-eye coordination and reach-to-grasp.

Model-Based Development of Neural Prostheses for Movement

Neural prostheses for restoration of limb movement in paralyzed and amputee patients tend to be complex systems. Subjective intuition and trial-and-error approaches have been applied to the design and clinical fitting of simple systems with limited functionality. These approaches are time consuming, difficult to apply in larger scale, and not applicable to limbs under development with more anthropomorphic motion and actuation. The field of neural prosthetics is in need of more systematic methods, including tools that will allow users to develop accurate models of neural prostheses and simulate their behavior under various conditions before actual manufacturing or clinical application. Such virtual prototyping would provide an efficient and safe test-bed for narrowing the design choices and tuning the control parameters before actual clinical application. We describe a software environment that we have developed to facilitate the construction and modification of accurate mathematical models of paralyzed and prosthetic limbs and simulate their movement under various neural control strategies. These simulations can be run in real time with a stereoscopic display to enable design engineers and prospective users to evaluate a candidate neural prosthetic system and learn to operate it before actually receiving it.

Robust Control for Steer-by-Wire Vehicles

The design and analysis of steer-by-wire systems at the actuation and operational level is explored. At the actuation level, robust force feedback control using inverse disturbance observer structure and active observer algorithm is applied to enhance the robustness vs non-modelled dynamics and uncertain driver bio-impedance. At the operational level, the robustness aspects vs parameter uncertainties in vehicle dynamics and driver bio-impedance are issued and for a given target coupling dynamics between driver and vehicle the design task is converted to a model-matching problem. H∞ techniques and active observer algorithms are used to design the steer-by-wire controller. Robustness issues at both levels are covered by mapping stability bounds in the space of physical uncertain parameters.

A real-time virtual integration environment for the design and development of neural prosthetic systems

We have developed a virtual integration environment (VIE) for the development of neural prosthetic systems. The VIE is a software environment that modularizes the core functions of a neural prosthetic system — receiving signals, decoding signals and controlling a real or simulated device. Complete prosthetic systems can be quickly assembled by linking pre-existing modules together through standard interfaces. Systems can be simulated in real-time, and simulated components can be swapped out for real hardware. This paper is the first of two companion papers that describe the VIE and its use. In this paper, we first describe the architecture of the VIE and review implemented modules. We then describe the use of the VIE for the real-time validation of neural decode algorithms from pre-recorded data, the use of the VIE in closed loop primate experiments and the use of the VIE in the clinic.

Spatial and Temporal Eye–Hand Coordination Relies on the Parietal Reach Region

Coordinated eye movements are crucial for precision control of our hands. A commonly believed neural mechanism underlying eye–hand coordination is interaction between the neural networks controlling each effector, exchanging, and matching information, such as movement target location and onset time. Alternatively, eye–hand coordination may result simply from common inputs to independent eye and hand control pathways. Thus far, it remains unknown whether and where either of these two possible mechanisms exists. A candidate location for the former mechanism, interpathway communication, includes the posterior parietal cortex (PPC) where distinct effector-specific areas reside. If the PPC were within the network for eye–hand coordination, perturbing it would affect both eye and hand movements that are concurrently planned. In contrast, if eye–hand coordination arises solely from common inputs, perturbing one effector pathway, e.g., the parietal reach region (PRR), would not affect the other effector. To test these hypotheses, we inactivated part of PRR in the macaque, located in the medial bank of the intraparietal sulcus encompassing the medial intraparietal area and area 5V. When each effector moved alone, PRR inactivation shortened reach but not saccade amplitudes, compatible with the known reach-selective activity of PRR. However, when both effectors moved concurrently, PRR inactivation shortened both reach and saccade amplitudes, and decoupled their reaction times. Therefore, consistent with the interpathway communication hypothesis, we propose that the planning of concurrent eye and hand movements causes the spatial information in PRR to influence the otherwise independent eye control pathways, and that their temporal coupling requires an intact PRR.

Haptic control for steer-by-wire systems

A force-feedback actuation loop for a steer-by-wire vehicle is developed. It is shown that the performance of this loop can be essentially improved by the introduction of a torque sensor. Model reference based control algorithms based on disturbance observer (DOB) and active observers (AOB) are applied to enhance the robustness vs. non-modelled dynamics and uncertain driver impedance.

Biomimetic control of FES reaching

We are developing a biomimetic controller to restore BION-assisted reaching movements to quadriplegic patients. The controller has a hierarchical structure similar to that of the central nervous system (CNS), mimics the biological control circuits in the spinal cord and integrates with the patients residual voluntary movements. To demonstrate the feasibility of the proposed control strategy, we have examined one of its most critical components, i.e. the ability of subjects to produce adequate voluntary command signals to drive the functional electrical stimulation (FES) control of paralyzed joints. Normal subjects use their shoulder movements to drive a simulated lower arm in a virtual reality environment (VRE) to reach targets in 3D workspace of the arm. The preliminary results show that the type of the voluntary command signal and the type of FES control strategy have significant effect on the successful completion of the reaching tasks, the reachable workspace and the learning rate.