Elaine A. Corbett

Comparison of electromyography and force as interfaces for prosthetic control

The ease with which persons with upper-limb amputations can control their powered prostheses is largely determined by the efficacy of the user command interface. One needs to understand the abilities of the human operator regarding the different available options. Electromyography (EMG) is widely used to control powered upper-limb prostheses. It is an indirect estimator of muscle force and may be expected to limit the control capabilities of the prosthesis user. This study compared EMG control with force control, an interface that is used in everyday interactions with the environment. We used both methods to perform a position-tracking task. Direct-position control of the wrist provided an upper bound for human-operator capabilities. The results demonstrated that an EMG control interface is as effective as force control for the position-tracking task. We also examined the effects of gain and tracking frequency on EMG control to explore the limits of this control interface. We found that information transmission rates for myoelectric control were best at higher tracking frequencies than at the frequencies previously reported for position control. The results may be useful for the design of prostheses and prosthetic controllers.

Decoding with limited neural data: a mixture of time-warped trajectory models for directional reaches.

Neuroprosthetic devices promise to allow paralyzed patients to perform the necessary functions of everyday life. However, to allow patients to use such tools it is necessary to decode their intent from neural signals such as electromyograms (EMGs). Because these signals are noisy, state of the art decoders integrate information over time. One systematic way of doing this is by taking into account the natural evolution of the state of the body--by using a so-called trajectory model. Here we use two insights about movements to enhance our trajectory model: (1) at any given time, there is a small set of likely movement targets, potentially identified by gaze; (2) reaches are produced at varying speeds. We decoded natural reaching movements using EMGs of muscles that might be available from an individual with spinal cord injury. Target estimates found from tracking eye movements were incorporated into the trajectory model, while a mixture model accounted for the inherent uncertainty in these estimates. Warping the trajectory model in time using a continuous estimate of the reach speed enabled accurate decoding of faster reaches. We found that the choice of richer trajectory models, such as those incorporating target or speed, improves decoding particularly when there is a small number of EMGs available.

Real-Time Evaluation of a Noninvasive Neuroprosthetic Interface for Control of Reach

Injuries of the cervical spinal cord can interrupt the neural pathways controlling the muscles of the arm, resulting in complete or partial paralysis. For individuals unable to reach due to high-level injuries, neuroprostheses can restore some of the lost function. Natural, multidimensional control of neuroprosthetic devices for reaching remains a challenge. Electromyograms (EMGs) from muscles that remain under voluntary control can be used to communicate intended reach trajectories, but when the number of available muscles is limited control can be difficult and unintuitive. We combined shoulder EMGs with target estimates obtained from gaze. Natural gaze data were integrated with EMG during closed-loop robotic control of the arm, using a probabilistic mixture model. We tested the approach with two different sets of EMGs, as might be available to subjects with C4and C5-level spinal cord injuries. Incorporating gaze greatly improved control of reaching, particularly when there were few EMG signals. We found that subjects naturally adapted their eye-movement precision as we varied the set of available EMGs, attaining accurate performance in both tested conditions. The system performs a near-optimal combination of both physiological signals, making control more intuitive and allowing a natural trajectory that reduces the burden on the user.

The attention-weighted sample-size model of visual short-term memory: Attention capture predicts resource allocation and memory load.

We investigated the capacity of visual short-term memory (VSTM) in a phase discrimination task that required judgments about the configural relations between pairs of black and white features. Sewell et al. (2014) previously showed that VSTM capacity in an orientation discrimination task was well described by a sample-size model, which views VSTM as a resource comprised of a finite number of noisy stimulus samples. The model predicts the invariance of [Formula: see text] , the sum of squared sensitivities across items, for displays of different sizes. For phase discrimination, the set-size effect significantly exceeded that predicted by the sample-size model for both simultaneously and sequentially presented stimuli. Instead, the set-size effect and the serial position curves with sequential presentation were predicted by an attention-weighted version of the sample-size model, which assumes that one of the items in the display captures attention and receives a disproportionate share of resources. The choice probabilities and response time distributions from the task were well described by a diffusion decision model in which the drift rates embodied the assumptions of the attention-weighted sample-size model.

Multimodal decoding and congruent sensory information enhance reaching performance in subjects with cervical spinal cord injury

Cervical spinal cord injury (SCI) paralyzes muscles of the hand and arm, making it difficult to perform activities of daily living. Restoring the ability to reach can dramatically improve quality of life for people with cervical SCI. Any reaching system requires a user interface to decode parameters of an intended reach, such as trajectory and target. A challenge in developing such decoders is that often few physiological signals related to the intended reach remain under voluntary control, especially in patients with high cervical injuries. Furthermore, the decoding problem changes when the user is controlling the motion of their limb, as opposed to an external device. The purpose of this study was to investigate the benefits of combining disparate signal sources to control reach in people with a range of impairments, and to consider the effect of two feedback approaches. Subjects with cervical SCI performed robot-assisted reaching, controlling trajectories with either shoulder electromyograms (EMGs) or EMGs combined with gaze. We then evaluated how reaching performance was influenced by task-related sensory feedback, testing the EMG-only decoder in two conditions. The first involved moving the arm with the robot, providing congruent sensory feedback through their remaining sense of proprioception. In the second, the subjects moved the robot without the arm attached, as in applications that control external devices. We found that the multimodal-decoding algorithm worked well for all subjects, enabling them to perform straight, accurate reaches. The inclusion of gaze information, used to estimate target location, was especially important for the most impaired subjects. In the absence of gaze information, congruent sensory feedback improved performance. These results highlight the importance of proprioceptive feedback, and suggest that multi-modal decoders are likely to be most beneficial for highly impaired subjects and in tasks where such feedback is unavailable.

Dealing with noisy gaze information for a target-dependent neural decoder

We tend to look at targets prior to moving our hand towards them. This means that our eye movements contain information about the movements we are planning to make. This information has been shown to be useful in the context of decoding of movement intent from neural signals. However, this is complicated by the fact that occasionally, subjects may want to move towards targets that have not been foveated, or may be distracted and temporarily look away from the intended target. We have previously accounted for this uncertainty using a probabilistic mixture over targets, where the gaze information is used to identify target candidates. Here we evaluate how the accuracy of prior target information influences decoding accuracy. We also consider a mixture model where we assume that the target may be foveated or, alternatively, that the target may not be foveated. We found that errors due to inaccurate target information were reduced by including a generic model representing movements to all targets into the mixture.

The magical number one-on-square-root-two: The double-target detection deficit in brief visual displays.

How limited representational capacity is divided when multiple items need to be processed simultaneously is a fundamental question in cognitive psychology. The double-target deficit is the finding that, when monitoring multiple locations or information streams for targets, identification of 2 simultaneous targets is substantially worse than is predicted from the cost of divided attention alone. This finding suggests that targets and nontargets are treated differently by the cognitive system. We investigated the double-target deficit in 4 different visual decision tasks using noisy, backwardly masked targets presented for a range of exposure durations to test the theory that the deficit reflects a capacity limitation of visual short-term memory (VSTM). We quantified the deficit using a sample-size model of VSTM and 2 different models of the decision process: a signal detection MAX model and an optimum likelihood ratio model. We found a double-target deficit in all 4 tasks which increased in magnitude for briefer displays, consistent with the capacity limits of VSTM. We explained the exposure dependency using a competitive interaction model in which nontargets compete for access to VSTM at a slower rate than targets. Our findings support 2-stage models of visual processing in which the most target-like stimuli gain priority access into VSTM before the decision process begins.

Dealing with target uncertainty in a reaching control interface

Prosthetic devices need to be controlled by their users, typically using physiological signals. People tend to look at objects before reaching for them and we have shown that combining eye movements with other continuous physiological signal sources enhances control. This approach suffers when subjects also look at non-targets, a problem we addressed with a probabilistic mixture over targets where subject gaze information is used to identify target candidates. However, this approach would be ineffective if a user wanted to move towards targets that have not been foveated. Here we evaluated how the accuracy of prior target information influenced decoding accuracy, as the availability of neural control signals was varied. We also considered a mixture model where we assumed that the target may be foveated or, alternatively, that the target may not be foveated. We tested the accuracy of the models at decoding natural reaching data, and also in a closed-loop robot-assisted reaching task. The mixture model worked well in the face of high target uncertainty. Furthermore, errors due to inaccurate target information were reduced by including a generic model that relied on neural signals only.

Speeded multielement decision-making as diffusion in a hypersphere: Theory and application to double-target detection

We generalize the circular 2D diffusion model of Smith (Psychological Review, 123, 425–451: 2016) to provide a new model of speeded decision-making in multielement visual displays. We model decision-making in tasks with multielement displays as evidence accumulation by a vector-valued diffusion process in a hypersphere, whose radius represents the decision criterion for the task. We show that the methods used to derive response time and accuracy predictions for the 2D model can be applied, with only minor changes, to predict performance in higher-dimensional spaces as well. We apply the model to the double-target deficit paradigm of Duncan (Psychological Review, 87, 272–300: 1980) in which participants judge whether briefly presented four-element displays contain one- or two-digit targets among letter distractors. A 4D version of the hyperspherical diffusion model correctly predicted distributions of response times and response accuracy as a function of task difficulty in single-target and double-target versions of the task. The estimated drift rate parameters from the model imply that the mental representation of the decision alternatives, which we term the “decision template” for the task, encodes configural stimulus properties that reflect the number of targets in the display. Along with its application to multielement decision-making, the model has the potential to characterize the speed and accuracy of multiattribute decisions in studies of cognitive categorization, visual attention, and other areas.

The power law of visual working memory characterizes attention engagement.

The quality or precision of stimulus representations in visual working memory can be characterized by a power law, which states that precision decreases as a power of the number of items in memory, with an exponent whose magnitude typically varies in the range 0.5 to 0.75. The authors show that the magnitude of the exponent is an index of the attentional demands of memory formation. They report 5 visual working memory experiments with tasks using noisy, backward-masked stimuli that varied in their attentional demands and show that the magnitude of the exponent increases systematically with the attentional demands of the task. Recall accuracy in the experiments was well described by an attention-weighted sample-size model that views visual working memory as a resource comprised of noisy evidence samples that are recruited during stimulus exposure and which can be allocated flexibly under attentional control. The magnitude of the exponent indexes the degree to which attention allocates resources to items in memory unequally rather than equally.