Kevin B. Englehart

A robust, real-time control scheme for multifunction myoelectric control

This paper represents an ongoing investigation of dexterous and natural control of upper extremity prostheses using the myoelectric signal (MES). The scheme described within uses pattern recognition to process four channels of MES, with the task of discriminating multiple classes of limb movement. The method does not require segmentation of the MES data, allowing a continuous stream of class decisions to be delivered to a prosthetic device. It is shown in this paper that, by exploiting the processing power inherent in current computing systems, substantial gains in classifier accuracy and response time are possible. Other important characteristics for prosthetic control systems are met as well. Due to the fact that the classifier learns the muscle activation patterns for each desired class for each individual, a natural control actuation results. The continuous decision stream allows complex sequences of manipulation involving multiple joints to be performed without interruption. Finally, minimal storage capacity is required, which is an important factor in embedded control systems.

Classification of the myoelectric signal using time-frequency based representations

An accurate and computationally efficient means of classifying surface myoelectric signal patterns has been the subject of considerable research effort in recent years. Effective feature extraction is crucial to reliable classification and, in the quest to improve the accuracy of transient myoelectric signal pattern classification, an ensemble of time-frequency based representations are proposed. It is shown that feature sets based upon the short-time Fourier transform, the wavelet transform, and the wavelet packet transform provide an effective representation for classification, provided that they are subject to an appropriate form of dimensionality reduction.

A Gaussian mixture model based classification scheme for myoelectric control of powered upper limb prostheses

This paper introduces and evaluates the use of Gaussian mixture models (GMMs) for multiple limb motion classification using continuous myoelectric signals. The focus of this work is to optimize the configuration of this classification scheme. To that end, a complete experimental evaluation of this system is conducted on a 12 subject database. The experiments examine the GMMs algorithmic issues including the model order selection and variance limiting, the segmentation of the data, and various feature sets including time-domain features and autoregressive features. The benefits of postprocessing the results using a majority vote rule are demonstrated. The performance of the GMM is compared to three commonly used classifiers: a linear discriminant analysis, a linear perceptron network, and a multilayer perceptron neural network. The GMM-based limb motion classification system demonstrates exceptional classification accuracy and results in a robust method of motion classification with low computational load.

Electromyogram pattern recognition for control of powered upper-limb prostheses: State of the art and challenges for clinical use

Using electromyogram (EMG) signals to control upper-limb prostheses is an important clinical option, offering a person with amputation autonomy of control by contracting residual muscles. The dexterity with which one may control a prosthesis has progressed very little, especially when controlling multiple degrees of freedom. Using pattern recognition to discriminate multiple degrees of freedom has shown great promise in the research literature, but it has yet to transition to a clinically viable option. This article describes the pertinent issues and best practices in EMG pattern recognition, identifies the major challenges in deploying robust control, and advocates research directions that may have an effect in the near future.

A Comparison of Surface and Intramuscular Myoelectric Signal Classification

The surface myoelectric signal (MES) has been used as an input to controllers for powered prostheses for many years. As a result of recent technological advances it is reasonable to assume that there will soon be implantable myoelectric sensors which will enable the internal MES to be used as input to these controllers. An internal MES measurement should have less muscular crosstalk allowing for more independent control sites. However, it remains unclear if this benefit outweighs the loss of the more global information contained in the surface MES. This paper compares the classification accuracy of six pattern recognition-based myoelectric controllers which use multi-channel surface MES as inputs to the same controllers which use multi-channel intramuscular MES as inputs. An experiment was designed during which surface and intramuscular MES were collected simultaneously for 10 different classes of isometric contraction. There was no significant difference in classification accuracy as a result of using the intramuscular MES measurement technique when compared to the surface MES measurement technique. Impressive classification accuracy (97%) could be achieved by optimally selecting only three channels of surface MES

Continuous myoelectric control for powered prostheses using hidden Markov models

This paper represents an ongoing investigation of dexterous and natural control of upper extremity prostheses using the myoelectric signal. The scheme described within uses a hidden Markov model (HMM) to process four channels of myoelectric signal, with the task of discriminating six classes of limb movement. The HMM-based approach is shown to be capable of higher classification accuracy than previous methods based upon multilayer perceptrons. The method does not require segmentation of the myoelectric signal data, allowing a continuous stream of class decisions to be delivered to a prosthetic device. Due to the fact that the classifier learns the muscle activation patterns for each desired class for each individual, a natural control actuation results. The continuous decision stream allows complex sequences of manipulation involving multiple joints to be performed without interruption. The computational complexity of the HMM in its operational mode is low, making it suitable for a real-time implementation. The low computational overhead associated with training the HMM also enables the possibility of adaptive classifier training while in use.

Extracting Simultaneous and Proportional Neural Control Information for Multiple-DOF Prostheses From the Surface Electromyographic Signal

A novel signal processing algorithm for the surface electromyogram (EMG) is proposed to extract simultaneous and proportional control information for multiple DOFs. The algorithm is based on a generative model for the surface EMG. The model assumes that synergistic muscles share spinal neural drives, which correspond to the intended activations of different DOFs of natural movements and are embedded within the surface EMG. A DOF-wise nonnegative matrix factorization (NMF) is developed to estimate neural control information from the multichannel surface EMG. It is shown, both by simulation and experimental studies, that the proposed algorithm is able to extract the multidimensional control information simultaneously. A direct application of the proposed method would be providing simultaneous and proportional control of multifunction myoelectric prostheses.

Resolving the Limb Position Effect in Myoelectric Pattern Recognition

Reported studies on pattern recognition of electromyograms (EMG) for the control of prosthetic devices traditionally focus on classification accuracy of signals recorded in a laboratory. The difference between the constrained nature in which such data are often collected and the unpredictable nature of prosthetic use is an example of the semantic gap between research findings and a viable clinical implementation. In this paper, we demonstrate that the variations in limb position associated with normal use can have a substantial impact on the robustness of EMG pattern recognition, as illustrated by an in- crease in average classification error from 3.8% to 18%. We propose to solve this problem by: 1) collecting EMG data and training the classifier in multiple limb positions and by 2) measuring the limb position with accelerometers. Applying these two methods to data from ten normally limbed subjects, we reduce the average classification error from 18% to 5.7% and 5.0%, respectively. Our study shows how sensor fusion (using EMG and accelerometers) may be an efficient method to mitigate the effect of limb position and improve classification accuracy.

Continuous Locomotion-Mode Identification for Prosthetic Legs Based on Neuromuscular–Mechanical Fusion

In this study, we developed an algorithm based on neuromuscular-mechanical fusion to continuously recognize a variety of locomotion modes performed by patients with transfemoral (TF) amputations. Electromyographic (EMG) signals recorded from gluteal and residual thigh muscles and ground reaction forces/moments measured from the prosthetic pylon were used as inputs to a phase-dependent pattern classifier for continuous locomotion-mode identification. The algorithm was evaluated using data collected from five patients with TF amputations. The results showed that neuromuscular-mechanical fusion outperformed methods that used only EMG signals or mechanical information. For continuous performance of one walking mode (i.e., static state), the interface based on neuromuscular-mechanical fusion and a support vector machine (SVM) algorithm produced 99% or higher accuracy in the stance phase and 95% accuracy in the swing phase for locomotion-mode recognition. During mode transitions, the fusion-based SVM method correctly recognized all transitions with a sufficient predication time. These promising results demonstrate the potential of the continuous locomotion-mode classifier based on neuromuscular-mechanical fusion for neural control of prosthetic legs.

A training strategy to reduce classification degradation due to electrode displacements in pattern recognition based myoelectric control

Abstract Pattern recognition based myoelectric control systems rely on detecting repeatable patterns at given electrode locations. This work describes an experiment to determine the effect of electrode displacements on pattern classification accuracy, and a classifier training strategy to accommodate this degradation. The results show that electrode displacements adversely affect classification accuracy, but training the system to recognize plausible displacement locations mitigates the effect. Furthermore, a combination of time-domain and autoregressive features appears to yield the best classification accuracy and is least affected by electrode displacements.