John F. Dammann

Restoring the sense of touch with a prosthetic hand through a brain interface.

Significance Our ability to manipulate objects relies fundamentally on sensory signals originating from the hand. To restore motor function with upper-limb neuroprostheses requires that somatosensory feedback be provided to the tetraplegic patient or amputee. Accordingly, we have developed approaches to convey sensory information critical for object manipulation—information about contact location, pressure, and timing—through intracortical microstimulation of somatosensory cortex. In experiments with nonhuman primates, we show that we can elicit percepts that are projected to a localized patch of skin, that track the pressure exerted on the skin, and that signal the timing of contact events. We anticipate that the proposed biomimetic feedback will constitute an important step in restoring touch to individuals who have lost it. Our ability to manipulate objects dexterously relies fundamentally on sensory signals originating from the hand. To restore motor function with upper-limb neuroprostheses requires that somatosensory feedback be provided to the tetraplegic patient or amputee. Given the complexity of state-of-the-art prosthetic limbs and, thus, the huge state space they can traverse, it is desirable to minimize the need for the patient to learn associations between events impinging on the limb and arbitrary sensations. Accordingly, we have developed approaches to intuitively convey sensory information that is critical for object manipulation—information about contact location, pressure, and timing—through intracortical microstimulation of primary somatosensory cortex. In experiments with nonhuman primates, we show that we can elicit percepts that are projected to a localized patch of skin and that track the pressure exerted on the skin. In a real-time application, we demonstrate that animals can perform a tactile discrimination task equally well whether mechanical stimuli are delivered to their native fingers or to a prosthetic one. Finally, we propose that the timing of contact events can be signaled through phasic intracortical microstimulation at the onset and offset of object contact that mimics the ubiquitous on and off responses observed in primary somatosensory cortex to complement slowly varying pressure-related feedback. We anticipate that the proposed biomimetic feedback will considerably increase the dexterity and embodiment of upper-limb neuroprostheses and will constitute an important step in restoring touch to individuals who have lost it.

Spatial and temporal codes mediate the tactile perception of natural textures

text text text text text

Temporal frequency channels are linked across audition and touch

Temporal frequency is a fundamental sensory dimension in audition and touch. In audition, analysis of temporal frequency is necessary for speech and music perception; in touch, the spectral analysis of vibratory signals has been implicated in texture perception and in sensing the environment through tools. Environmental oscillations impinging upon the ear are generally thought to be processed independently of oscillations impinging upon the skin. Here, we show that frequency channels are perceptually linked across audition and touch. In a series of psychophysical experiments, we demonstrate that auditory stimuli interfere with tactile frequency perception in a systematic manner. Specifically, performance on a tactile-frequency-discrimination task is impaired when an auditory distractor is presented with the tactile stimuli, but only if the frequencies of the auditory and tactile stimuli are similar. The frequency-dependent interference effect is observed whether the distractors are pure tones or band-pass noise, so an auditory percept of pitch is not required for the effect to be produced. Importantly, distractors that strongly impair frequency discrimination do not interfere with judgments of tactile intensity. This surprisingly specific crosstalk between different modalities reflects the importance of supramodal representations of fundamental sensory dimensions.

Behavioral Demonstration of a Somatosensory Neuroprosthesis

Tactile sensation is critical for effective object manipulation, but current prosthetic upper limbs make no provision for delivering somesthetic feedback to the user. For individuals who require use of prosthetic limbs, this lack of feedback transforms a mundane task into one that requires extreme concentration and effort. Although vibrotactile motors and sensory substitution devices can be used to convey gross sensations, a direct neural interface is required to provide detailed and intuitive sensory feedback. In light of this, we describe the implementation of a somatosensory prosthesis with which we elicit, through intracortical microstimulation (ICMS), percepts whose magnitude is graded according to the force exerted on the prosthetic finger. Specifically, the prosthesis consists of a sensorized finger, the force output of which is converted into a regime of ICMS delivered to primary somatosensory cortex through chronically implanted multi-electrode arrays. We show that the performance of animals (Rhesus macaques) on a tactile task is equivalent whether stimuli are delivered to the native finger or to the prosthetic finger.

Multiplexing stimulus information through rate and temporal codes in primate somatosensory cortex.

In somatosensory cortex, stimulus amplitude is represented at a relatively coarse temporal resolution, while stimulus frequency is represented by precisely timed action potentials.

A dense array stimulator to generate arbitrary spatio-temporal tactile stimuli

The generation and presentation of tactile stimuli presents a unique challenge. Unlike vision and audition, in which standard equipment such as monitors and audio systems can be used for most experiments, tactile stimuli and/or stimulators often have to be tailor-made for a given study. Here, we present a novel tactile stimulator designed to present arbitrary spatio-temporal stimuli to the skin. The stimulator consists of 400 pins, arrayed over a 1cm(2) area, each under independent computer control. The dense array allows for an unprecedented number of stimuli to be presented within an experimental session (e.g., up to 1200 stimuli per minute) and for stimuli to be generated adaptively. The stimulator can be used in a variety of modes and can deliver indented and scanned patterns as well as stimuli defined by mathematical spatio-temporal functions (e.g., drifting sinusoids). We describe the hardware and software of the system, and discuss previous and prospective applications.

Natural scenes in tactile texture

Sensory systems are designed to extract behaviorally relevant information from the environment. In seeking to understand a sensory system, it is important to understand the environment within which it operates. In the present study, we seek to characterize the natural scenes of tactile texture perception. During tactile exploration complex high-frequency vibrations are elicited in the fingertip skin, and these vibrations are thought to carry information about the surface texture of manipulated objects. How these texture-elicited vibrations depend on surface microgeometry and on the biomechanical properties of the fingertip skin itself remains to be elucidated. Here we record skin vibrations, using a laser-Doppler vibrometer, as various textured surfaces are scanned across the finger. We find that the frequency composition of elicited vibrations is texture specific and highly repeatable. In fact, textures can be classified with high accuracy on the basis of the vibrations they elicit in the skin. As might be expected, some aspects of surface microgeometry are directly reflected in the skin vibrations. However, texture vibrations are also determined in part by fingerprint geometry. This mechanism enhances textural features that are too small to be resolved spatially, given the limited spatial resolution of the neural signal. We conclude that it is impossible to understand the neural basis of texture perception without first characterizing the skin vibrations that drive neural responses, given the complex dependence of skin vibrations on both surface microgeometry and fingertip biomechanics.

The Effect of Surface Wave Propagation on Neural Responses to Vibration in Primate Glabrous Skin

Because tactile perception relies on the response of large populations of receptors distributed across the skin, we seek to characterize how a mechanical deformation of the skin at one location affects the skin at another. To this end, we introduce a novel non-contact method to characterize the surface waves produced in the skin under a variety of stimulation conditions. Specifically, we deliver vibrations to the fingertip using a vibratory actuator and measure, using a laser Doppler vibrometer, the surface waves at different distances from the locus of stimulation. First, we show that a vibration applied to the fingertip travels at least the length of the finger and that the rate at which it decays is dependent on stimulus frequency. Furthermore, the resonant frequency of the skin matches the frequency at which a subpopulation of afferents, namely Pacinian afferents, is most sensitive. We show that this skin resonance can lead to a two-fold increase in the strength of the response of a simulated afferent population. Second, the rate at which vibrations propagate across the skin is dependent on the stimulus frequency and plateaus at 7 m/s. The resulting delay in neural activation across locations does not substantially blur the temporal patterning in simulated populations of afferents for frequencies less than 200 Hz, which has important implications about how vibratory frequency is encoded in the responses of somatosensory neurons. Third, we show that, despite the dependence of decay rate and propagation speed on frequency, the waveform of a complex vibration is well preserved as it travels across the skin. Our results suggest, then, that the propagation of surface waves promotes the encoding of spectrally complex vibrations as the entire neural population is exposed to essentially the same stimulus. We also discuss the implications of our results for biomechanical models of the skin.

The effect of chronic intracortical microstimulation on the electrode–tissue interface

OBJECTIVE Somatosensation is critical for effective object manipulation, but current upper limb prostheses do not provide such feedback to the user. For individuals who require use of prosthetic limbs, this lack of feedback transforms a mundane task into one that requires extreme concentration and effort. Although vibrotactile motors and sensory substitution devices can be used to convey gross sensations, a direct neural interface is required to provide detailed and intuitive sensory feedback. The viability of intracortical microstimulation (ICMS) as a method to deliver feedback depends in part on the long-term reliability of implanted electrodes used to deliver the stimulation. The objective of the present study is to investigate the effects of chronic ICMS on the electrode-tissue interface. APPROACH We stimulate the primary somatosensory cortex of three Rhesus macaques through chronically implanted electrodes for 4 h per day over a period of six months, with different electrodes subjected to different regimes of stimulation. We measure the impedance and voltage excursion as a function of time and of ICMS parameters. We also test the sensorimotor consequences of chronic ICMS by having animals grasp and manipulate small treats. MAIN RESULTS We show that impedance and voltage excursion both decay with time but stabilize after 10-12 weeks. The magnitude of this decay is dependent on the amplitude of the ICMS and, to a lesser degree, the duration of individual pulse trains. Furthermore, chronic ICMS does not produce any deficits in fine motor control. SIGNIFICANCE The results suggest that chronic ICMS has only a minor effect on the electrode-tissue interface and may thus be a viable means to convey sensory feedback in neuroprosthetics.

The effects of chronic intracortical microstimulation on neural tissue and fine motor behavior.

OBJECTIVE One approach to conveying sensory feedback in neuroprostheses is to electrically stimulate sensory neurons in the cortex. For this approach to be viable, it is critical that intracortical microstimulation (ICMS) causes minimal damage to the brain. Here, we investigate the effects of chronic ICMS on the neuronal tissue across a variety of stimulation regimes in non-human primates. We also examine each animals ability to use their hand--the cortical representation of which is targeted by the ICMS--as a further assay of possible neuronal damage. APPROACH We implanted electrode arrays in the primary somatosensory cortex of three Rhesus macaques and delivered ICMS four hours per day, five days per week, for six months. Multiple regimes of ICMS were delivered to investigate the effects of stimulation parameters on the tissue and behavior. Parameters included current amplitude (10-100 μA), pulse train duration (1, 5 s), and duty cycle (1/1, 1/3). We then performed a range of histopathological assays on tissue near the tips of both stimulated and unstimulated electrodes to assess the effects of chronic ICMS on the tissue and their dependence on stimulation parameters. MAIN RESULTS While the implantation and residence of the arrays in the cortical tissue did cause significant damage, chronic ICMS had no detectable additional effect; furthermore, the animals exhibited no impairments in fine motor control. SIGNIFICANCE Chronic ICMS may be a viable means to convey sensory feedback in neuroprostheses as it does not cause significant damage to the stimulated tissue.