Rahman Davoodi

Computer simulation of FES standing up in paraplegia: a self-adaptive fuzzy controller with reinforcement learning

Using computer simulation, the theoretical feasibility of functional electrical stimulation (FES) assisted standing up is demonstrated using a closed-loop self-adaptive fuzzy logic controller based on reinforcement machine learning (FLC-RL). The control goal was to minimize upper limb forces and the terminal velocity of the knee joint. The reinforcement learning (RL) technique was extended to multicontroller problems in continuous state and action spaces. The validated algorithms were used to synthesize FES controllers for the knee and hip joints in simulated paraplegic standing up. The FLC-RL controller was able to achieve the maneuver with only 22% of the upper limb force required to stand-up without FES and to simultaneously reduce the terminal velocity of the knee joint close to zero. The FLC-RL controller demonstrated, as expected, the closed loop fuzzy logic control and on-line self-adaptation capability of the RL was able to accommodate for simulated disturbances due to voluntary arm forces, FES induced muscle fatigue and anthropometric differences between individuals. A method of incorporating a priori heuristic rule based knowledge is described that could reduce the number of the learning trials required to establish a usable control strategy. We also discuss how such heuristics may also be incorporated into the initial FLC-RL controller to ensure safe operation from the onset.

Development of an indoor rowing machine with manual FES controller for total body exercise in paraplegia

Concept 2 indoor rowing machine (Concept 2 Inc., USA) was modified for functional electrical stimulation (FES) rowing exercise in paraplegia. A new seating system provides trunk stability and constrains the leg motion to the sagittal plane. A 4-channel electrical stimulator activates the quadriceps and hamstrings in Drive and Recovery phases of the rowing cycle, respectively. Two force-sensing resistors (FSR) on the handle measure the thumb press as the command signal to the electrical stimulator. Optical encoders measure the positions of the seat and handle during rowing. To synchronize the voluntarily controlled upper body movement with the FES controlled leg movement, a novel manual control system was developed. It uses the voluntary thumb presses to control the timing of the stimulation to the paralyzed leg muscles. The manual control system was intuitive and easy to learn and resulted in well-coordinated rowing. Evaluation of the modified rower by paraplegic volunteers showed that it is effective, safe, and affordable exercise alternative for paraplegics.

A Virtual Reality Environment for Designing and Fitting Neural Prosthetic Limbs

Building and testing novel prosthetic limbs and control algorithms for functional electrical stimulation (FES) is expensive and risky. Here, we describe a virtual reality environment (VRE) to facilitate and accelerate the development of novel systems. In the VRE, subjects/patients can operate a simulated limb to interact with virtual objects. Realistic models of all relevant musculoskeletal and mechatronic components allow the development of entire prosthetic systems in VR before introducing them to the patient. The system is used both by engineers as a development tool and by clinicians to fit prosthetic devices to patients

Fuzzy logic control of FES rowing exercise in paraplegia

An indoor personal rowing machine (Concept 2 Inc., Morrisville, VT) has been modified for functional electrical stimulation assisted rowing exercise in paraplegia. To successfully perform the rowing maneuver, the voluntarily controlled upper body movements must be coordinated with the movements of the electrically stimulated paralyzed legs. To achieve such coordination, an automatic controller was developed that employs two levels of hierarchy. A high level finite state controller identifies the state or phase of the rowing motion and activates a low-level state-dedicated fuzzy logic controller (FLC) to deliver the electrical stimulation to the paralyzed leg muscles. A pilot study with participation of two paraplegic volunteers showed that FLC spent less muscle energy, and produced smoother rowing maneuvers than the existing On-Off constant-level stimulation controller.

The functional reanimation of paralyzed limbs

The functional reanimation of paralyzed limbs has been a longstanding goal of neural prosthetic research, but clinically successful applications have been elusive. Natural voluntary limb movement requires four major elements: actuators (i.e., motor units), sensors (i.e., somatosensory afferents), commands (i.e., cerebral cortical activity), and control (i.e., integration of the previous three elements at various levels of the neuraxis). Prosthetic equivalents of each of these elements are, as yet, primitive and often cumbersome to deploy, but new technologies promise substantial improvements for all. This article focuses on one such technology, bionic neuon (BION) modular microimplants, and its relationship to alternative and complementary technologies. The challenge remains to select and integrate them into systems that can be tailored efficiently to the widely disparate needs of patients with various patterns of weakness and paralysis.

Model-Based Development of Neural Prostheses for Movement

Neural prostheses for restoration of limb movement in paralyzed and amputee patients tend to be complex systems. Subjective intuition and trial-and-error approaches have been applied to the design and clinical fitting of simple systems with limited functionality. These approaches are time consuming, difficult to apply in larger scale, and not applicable to limbs under development with more anthropomorphic motion and actuation. The field of neural prosthetics is in need of more systematic methods, including tools that will allow users to develop accurate models of neural prostheses and simulate their behavior under various conditions before actual manufacturing or clinical application. Such virtual prototyping would provide an efficient and safe test-bed for narrowing the design choices and tuning the control parameters before actual clinical application. We describe a software environment that we have developed to facilitate the construction and modification of accurate mathematical models of paralyzed and prosthetic limbs and simulate their movement under various neural control strategies. These simulations can be run in real time with a stereoscopic display to enable design engineers and prospective users to evaluate a candidate neural prosthetic system and learn to operate it before actually receiving it.

Real-Time Animation Software for Customized Training to Use Motor Prosthetic Systems

Research on control of human movement and development of tools for restoration and rehabilitation of movement after spinal cord injury and amputation can benefit greatly from software tools for creating precisely timed animation sequences of human movement. Despite their ability to create sophisticated animation and high quality rendering, existing animation software are not adapted for application to neural prostheses and rehabilitation of human movement. We have developed a software tool known as MSMS (MusculoSkeletal Modeling Software) that can be used to develop models of human or prosthetic limbs and the objects with which they interact and to animate their movement using motion data from a variety of offline and online sources. The motion data can be read from a motion file containing synthesized motion data or recordings from a motion capture system. Alternatively, motion data can be streamed online from a real-time motion capture system, a physics-based simulation program, or any program that can produce real-time motion data. Further, animation sequences of daily life activities can be constructed using the intuitive user interface of Microsofts PowerPoint software. The latter allows expert and nonexpert users alike to assemble primitive movements into a complex motion sequence with precise timing by simply arranging the order of the slides and editing their properties in PowerPoint. The resulting motion sequence can be played back in an open-loop manner for demonstration and training or in closed-loop virtual reality environments where the timing and speed of animation depends on user inputs. These versatile animation utilities can be used in any application that requires precisely timed animations but they are particularly suited for research and rehabilitation of movement disorders. MSMSs modeling and animation tools are routinely used in a number of research laboratories around the country to study the control of movement and to develop and test neural prostheses for patients with paralysis or amputations.

Advanced modeling environment for developing and testing FES control systems

Realistic models of neuromusculoskeletal systems can provide a safe and convenient environment for the design and evaluation of controllers for functional electrical stimulation (FES) prior to clinical trials. We have developed a set of integrated musculoskeletal modeling tools to facilitate the model building process. Simulink models of musculoskeletal systems are created using two software packages developed in our laboratory, Musculoskeletal Modeling in Simulink (MMS) and virtual muscle, in addition to one software package available commercially, SIMM (Musculographics Inc., USA). MMS converts anatomically accurate musculoskeletal models generated by SIMM into Simulink(R) blocks. It also removes run-time constraints on kinetic simulations in SIMM, and allows the development of complex musculoskeletal models without writing a line of code. Virtual muscle builds realistic Simulink models of muscles responding to either natural recruitment or FES. Models of sensorimotor control systems can be developed using various Matlab (Mathworks Inc., USA) toolboxes and integrated easily with these musculoskeletal blocks in the graphical environment of Simulink.

Automatic Finite State Control of FES-Assisted Indoor Rowing Exercise after Spinal Cord Injury

We modified a commercial indoor rowing machine (Concept 2 Inc., Morrisville, NJ, USA) for a functional electrical stimulation (FES) assisted indoor rowing exercise in which the rowers must repeatedly press the two switches on the handle that stimulate their paralyzed leg muscles. The objective of this study was to automate the delivery of electrical stimulation to prevent potential repetitive strain injuries and to expand the user base to clients with impaired hand function. The modifications for development of the FES rowing machine and clinical trials were all performed in the University of Alberta. A new controller was developed to automatically control the electrical stimulation of the paralyzed leg muscles to perform the lower extremity part of the rowing maneuver while the subject voluntarily performed the upper body part of the maneuver. Two paraplegic users of the older manual control system tested the new automatic controller.

Development of clinician-friendly software for musculoskeletal modeling and control

Research and development in various fields dealing with human movement has been hampered by the lack of adequate software tools. We have formed a core development team to organize a collective effort by the research community to develop musculoskeletal modeling software that satisfies the requirements of both researchers and clinicians. We have identified initial requirements and have developed some of the basic components. We are developing common standards to facilitate sharing and reuse of musculoskeletal models and their component parts. Free distribution of the software and its source code will allow users to contribute to further development of the software as new models and data become available in the future.