Assaf Pressman

Somatosensory evoked potentials during a rubber-hand illusion in schizophrenia

The rubber-hand illusion (RHI), an illusion in which tactile sensations are referred to a synthetic alien limb, is enhanced in schizophrenia patients. Somatosensory evoked responses of the illusion were compared between schizophrenia patients and normal control subjects. Schizophrenia patients had significant alterations in long latency evoked responses during the illusion. These findings support the hypothesis of alterations in associative higher-level neuronal activity in schizophrenia. The findings support previous results pointing to alterations in associative brain regions in schizophrenia.

Perception of Delayed Stiffness

Advanced technology has recently provided truly immersive virtual environments with teleoperated robotic devices. In order to control movements from a distance, the human sensorimotor system has to overcome the e fects of delay. Currently, little is known about the mechanisms that underlie haptic estimation in delayed environments. The aim of this research is to explore the e fect of a delay on perception of surfaces sti fness. A forced choice paradigm was used in which subjects were asked to identify the sti fer of two virtual spring-like surfaces based on manipulation without visual feedback. Virtual surfaces were obtained by generating an elastic force proportional to the penetration of the handle of a manipulandum inside a virtual boundary. The elastic force was either an instantaneous function of the displacement, delayed at 30 or 60 milliseconds after the displacement or led the displacement (by means of Kalman predictor) by 50 milliseconds. It was assumed that, to estimate sti fness, the brain relates the experienced interaction forces with the amount of penetration. The results of the experiment indicate a systematic dependence of the estimated sti fness upon the delay between position and force. When the force lagged the penetration, surfaces were perceived as sti fer. Conversely, when the force led the penetration, surfaces were perceived as softer. The perceptual findings were compared with different regression models. This allowed some candidate models to be discarded. To further refine the analysis, a second experiment was carried out in which the delay was introduced only during part of the hand/surface interaction, either while the hand was moving into the spring-like surface or when it was moving out of it. Findings are consistent with sti fness estimates based on dividing the maximum force by the perceived amount of penetration. Findings are not consistent with an estimate of compliance based on the maximum position or local sti fness on the way out nor with linear estimates of sti fness based on the entire force/motion history.

Functional reorganization of upper-body movement after spinal cord injury

Survivors of spinal cord injury need to reorganize their residual body movements for interacting with assistive devices and performing activities that used to be easy and natural. To investigate movement reorganization, we asked subjects with high-level spinal cord injury (SCI) and unimpaired subjects to control a cursor on a screen by performing upper-body motions. While this task would be normally accomplished by operating a computer mouse, here shoulder motions were mapped into the cursor position. Both the control and the SCI subjects were rapidly able to reorganize their movements and to successfully control the cursor. The majority of the subjects in both groups were successful in reducing the movements that were not effective at producing cursor motions. This is inconsistent with the hypothesis that the control system is merely concerned with the accurate acquisition of the targets and is unconcerned with motions that are not relevant to this goal. In contrast, our findings suggest that subjects can learn to reorganize coordination so as to increase the correspondence between the subspace of their upper-body motions with the plane in which the controlled cursor moves. This is effectively equivalent to constructing an inverse internal model of the map from body motions to cursor motions, established by the experiment. These results are relevant to the development of interfaces for assistive devices that optimize the use of residual voluntary control and enhance the learning process in disabled users, searching for an easily learnable map between their body motor space and control space of the device.

Perception and Action in Teleoperated Needle Insertion

We studied the effect of delay on perception and action in contact with a force field that emulates elastic soft tissue with a rigid nonlinear boundary. Such a field is similar to forces exerted on a needle during teleoperated needle insertion. We found that delay causes motor underestimation of the stiffness of this nonlinear soft tissue, without perceptual change. These experimental results are supported by simulation of a simplified mechanical model of the arm and neural controller, and a model for perception of stiffness, which is based on regression in the force-position space. In addition, we show that changing the gain of the teleoperation channel cancels the motor effect of delay without adding perceptual distortion. We conclude that it is possible to achieve perceptual and motor transparency in virtual one-dimensional remote needle insertion task.

Body machine interface: Remapping motor skills after spinal cord injury

The goal of a body-machine interface (BMI) is to map the residual motor skills of the users into efficient patterns of control. The interface is subject to two processes of learning: while users practice controlling the assistive device, the interface modifies itself based on the users residual abilities and preferences. In this study, we combined virtual reality and movement capture technologies to investigate the reorganization of movements that occurs when individuals with spinal cord injury (SCI) are allowed to use a broad spectrum of body motions to perform different tasks. Subjects, over multiple sessions, used their upper body movements to engage in exercises that required different operational functions such as controlling a keyboard for playing a videogame, driving a simulated wheelchair in a virtual reality (VR) environment, and piloting a cursor on a screen for reaching targets. In particular, we investigated the possibility of reducing the dimensionality of the control signals by finding repeatable and stable correlations of movement signals, established both by the presence of biomechanical constraints and by learned patterns of coordination. The outcomes of these investigations will provide guidance for further studies of efficient remapping of motor coordination for the control of assistive devices and are a basis for a new training paradigm in which the burden of learning is significantly removed from the impaired subjects and shifted to the devices.

Adaptation to Delayed Force Perturbations in Reaching Movements

Adaptation to deterministic force perturbations during reaching movements was extensively studied in the last few decades. Here, we use this methodology to explore the ability of the brain to adapt to a delayed velocity-dependent force field. Two groups of subjects preformed a standard reaching experiment under a velocity dependent force field. The force was either immediately proportional to the current velocity (Control) or lagged it by 50 ms (Test). The results demonstrate clear adaptation to the delayed force perturbations. Deviations from a straight line during catch trials were shifted in time compared to post-adaptation to a non-delayed velocity dependent field (Control), indicating expectation to the delayed force field. Adaptation to force fields is considered to be a process in which the motor system predicts the forces to be expected based on the state that a limb will assume in response to motor commands. This study demonstrates for the first time that the temporal window of this prediction needs not to be fixed. This is relevant to the ability of the adaptive mechanisms to compensate for variability in the transmission of information across the sensory-motor system.

Learning to push and learning to move: the adaptive control of contact forces

To be successful at manipulating objects one needs to apply simultaneously well controlled movements and contact forces. We present a computational theory of how the brain may successfully generate a vast spectrum of interactive behaviors by combining two independent processes. One process is competent to control movements in free space and the other is competent to control contact forces against rigid constraints. Free space and rigid constraints are singularities at the boundaries of a continuum of mechanical impedance. Within this continuum, forces and motions occur in “compatible pairs” connected by the equations of Newtonian dynamics. The force applied to an object determines its motion. Conversely, inverse dynamics determine a unique force trajectory from a movement trajectory. In this perspective, we describe motor learning as a process leading to the discovery of compatible force/motion pairs. The learned compatible pairs constitute a local representation of the environments mechanics. Experiments on force field adaptation have already provided us with evidence that the brain is able to predict and compensate the forces encountered when one is attempting to generate a motion. Here, we tested the theory in the dual case, i.e., when one attempts at applying a desired contact force against a simulated rigid surface. If the surface becomes unexpectedly compliant, the contact point moves as a function of the applied force and this causes the applied force to deviate from its desired value. We found that, through repeated attempts at generating the desired contact force, subjects discovered the unique compatible hand motion. When, after learning, the rigid contact was unexpectedly restored, subjects displayed after effects of learning, consistent with the concurrent operation of a motion control system and a force control system. Together, theory and experiment support a new and broader view of modularity in the coordinated control of forces and motions.

Perception and action in simulated telesurgery

We studied the effect of delay on perception and action in contact with a force field that emulates elastic soft tissue with a specific rigid nonlinear boundary. Such field is similar to forces exerted on a needle during teleoperated needle insertion tasks. We found that a nonlinear boundary region causes both psychometric and motor overestimation of stiffness, and that delay causes motor but not psychometric underestimation of the stiffness of this nonlinear soft tissue. In addition we show that changing the teleoperation channel gain reduces and can even cancel the motor effect of delay.

State-Based Delay Representation and Its Transfer from a Game of Pong to Reaching and Tracking

Abstract To accurately estimate the state of the body, the nervous system needs to account for delays between signals from different sensory modalities. To investigate how such delays may be represented in the sensorimotor system, we asked human participants to play a virtual pong game in which the movement of the virtual paddle was delayed with respect to their hand movement. We tested the representation of this new mapping between the hand and the delayed paddle by examining transfer of adaptation to blind reaching and blind tracking tasks. These blind tasks enabled to capture the representation in feedforward mechanisms of movement control. A Time Representation of the delay is an estimation of the actual time lag between hand and paddle movements. A State Representation is a representation of delay using current state variables: the distance between the paddle and the ball originating from the delay may be considered as a spatial shift; the low sensitivity in the response of the paddle may be interpreted as a minifying gain; and the lag may be attributed to a mechanical resistance that influences paddle’s movement. We found that the effects of prolonged exposure to the delayed feedback transferred to blind reaching and tracking tasks and caused participants to exhibit hypermetric movements. These results, together with simulations of our representation models, suggest that delay is not represented based on time, but rather as a spatial gain change in visuomotor mapping.

Simultaneity in Perception of Knocking

-“Knock, knock-whos there?” Here, we do not address this question but rather the underlying mechanism behind the perception of knocking impacts. When one knocks on a surface, her hand makes a forward-backward motion and, at the point of reversal, the knuckles collide with the rigid surface. How does one perceive the unity, or simultaneity, of the sensory events associated with this impact? Does this binding derive from a temporal estimate of simultaneity, or does the brain use some other mechanism? In this paper, we ask whether the tap and the reversal of the hand are perceived as happening together, since both took place at the same time or at a particular state of motion. The aim of this research is to find out whether a tactile event and the flow of proprioceptive information regarding the state of the arm are matched within the central nervous system according to time or state. We tested this experimentally with subjects who actively moved one arm, as well as subjects who were servoed by a robotic device. Our results suggest that time is the mechanism used for judging the unity of the modalities for both active and passive movements. Taken together, these results provide a useful cue for neuroscientists as to the structure and function of the perceptual and motor systems and essential engineering knowledge for the development of effective and realistic augmented reality systems with haptics for the telerobotics, telesurgery, and telepresence applications of the future.