Mitchell E. Tyler

Seeing with the Brain

We see with the brain, not the eyes (Bach-y-Rita, 1972); images that pass through our pupils go no further than the retina. From there image information travels to the rest of the brain by means of coded pulse trains, and the brain, being highly plastic, can learn to interpret them in visual terms. Perceptual levels of the brain interpret the spatially encoded neural activity, modified and augmented by nonsynaptic and other brain plasticity mechanisms (Bach-y-Rita, 1972, 1995, 1999, in press). However, the cognitive value of that information is not merely a process of image analysis. Perception of the image relies on memory, learning, contextual interpretation (e.g., we perceive intent of the driver in the slight lateral movements of a car in front of us on the highway), cultural, and other social factors that are probably exclusively human characteristics that provide “qualia” (Bach-y-Rita, 1996b). This is the basis for our tactile vision substitution system (TVSS) studies that, starting in 1963, have demonstrated that visual information and the subjective qualities of seeing can be obtained tactually using sensory substitution systems.1 The description of studies with this system have been taken INTERNATIONAL JOURNAL OF HUMAN–COMPUTER INTERACTION, 15(2), 285–295 Copyright

CLOSING AN OPEN-LOOP CONTROL SYSTEM: VESTIBULAR SUBSTITUTION THROUGH THE TONGUE

The human postural coordination mechanism is an example of a complex closed-loop control system based on multisensory integration [9,10,13,14]. In models of this process, sensory data from vestibular, visual, tactile and proprioceptive systems are integrated as linearly additive inputs that drive multiple sensory-motor loops to provide effective coordination of body movement, posture and alignment [5-8, 10, 11]. In the absence of normal vestibular (such as from a toxic drug reaction) and other inputs, unstable posture occurs. This instability may be the result of noise in a functionally open-loop control system [9]. Nonetheless, after sensory loss the brain can utilize tactile information from a sensory substitution system for functional compensation [1-4, 12]. Here we have demonstrated that head-body postural coordination can be restored by means of vestibular substitution using a head-mounted accelerometer and a brain-machine interface that employs a unique pattern of electrotactile stimulation on the tongue. Moreover, postural stability persists for a period of time after removing the vestibular substitution, after which the open-loop instability reappears.

Polarity Effect in Electrovibration for Tactile Display

Electrovibration is the tactile sensation of an alternating potential between the human body and a smooth conducting surface when the skin slides over the surface and where the current is too small to stimulate sensory nerves directly. It has been proposed as a high-density tactile display method, for example to display pictographic information to persons who are blind. Previous models for the electrovibration transduction mechanism are based on a parallel-plate capacitor in which the electrostatic force is insensitive to polarity. We present experimental data showing that electrovibratory perceptual sensitivity to positive pulses is less than that for negative or biphasic pulses and propose that this disparity may be due to the asymmetric electrical properties of human skin. We furthermore propose using negative pulses for insulated tactile displays based on electrovibration because their sensory thresholds were found to be more stable than for waveforms incorporating positive pulses

BRAINPORT: AN ALTERNATIVE INPUT TO THE BRAIN

Brain Computer Interface (BCI) technology is one of the most rapidly developing areas of modern science; it has created numerous significant crossroads between Neuroscience and Computer Science. The goal of BCI technology is to provide a direct link between the human brain and a computerized environment. The objective of recent BCI approaches and applications have been designed to provide the information flow from the brain to the computerized periphery. The opposite or alternative direction of the flow of information (computer to brain interface, or CBI) remains almost undeveloped. The BrainPort is a CBI that offers a complementary technology designed to support a direct link from a computerized environment to the human brain - and to do so non-invasively. Currently, BrainPort research is pursuing two primary goals. One is the delivery of missing sensory information critical for normal human behavior through an additional artificial sensory channel around the damaged or malfunctioning natural sensory system. The other is to decrease the risk of sensory overload in human-machine interactions by providing a parallel and supplemental channel for information flow to the brain. In contrast, conventional CBI strategies (e.g., Virtual Reality), are usually designed to provide additional or substitution information through pre-existing sensory channels, and unintentionally aggravate the brain overload problem.

Electrotactile haptic display on the fingertips: preliminary results

Electrical stimulation of the sense of touch may be used to display pictorial information to blind computer users via a fingertip-scanned (haptic) touch tablet containing embedded electrodes. This might be particularly useful to users of systems with graphical user interfaces, or with drawing and layout software. Electrotactile (electrocutaneous) stimulation on the fingertip, however, differs substantially from that on other body locations. We discuss the implications of designing a practical graphics haptic display by addressing the high-resistance and variable nature of the fingertip electrode-skin interface.<<ETX>>

Changes in functional brain organization and behavioral correlations after rehabilitative therapy using a brain-computer interface

This study aims to examine the changes in task-related brain activity induced by rehabilitative therapy using brain-computer interface (BCI) technologies and whether these changes are relevant to functional gains achieved through the use of these therapies. Stroke patients with persistent upper-extremity motor deficits received interventional rehabilitation therapy using a closed-loop neurofeedback BCI device (n = 8) or no therapy (n = 6). Behavioral assessments using the Stroke Impact Scale, the Action Research Arm Test (ARAT), and the Nine-Hole Peg Test (9-HPT) as well as task-based fMRI scans were conducted before, during, after, and 1 month after therapy administration or at analogous intervals in the absence of therapy. Laterality Index (LI) values during finger tapping of each hand were calculated for each time point and assessed for correlation with behavioral outcomes. Brain activity during finger tapping of each hand shifted over the course of BCI therapy, but not in the absence of therapy, to greater involvement of the non-lesioned hemisphere (and lesser involvement of the stroke-lesioned hemisphere) as measured by LI. Moreover, changes from baseline LI values during finger tapping of the impaired hand were correlated with gains in both objective and subjective behavioral measures. These findings suggest that the administration of interventional BCI therapy can induce differential changes in brain activity patterns between the lesioned and non-lesioned hemispheres and that these brain changes are associated with changes in specific motor functions.

Efficacy of electrotactile vestibular substitution in patients with bilateral vestibular and central balance loss

Patients with bilateral vestibular loss (BVL) of both central and peripheral origin experience multiple problems with balance and posture control, movement, and abnormal gait.Wicab, Inc. has developed the BrainPort balance device to transmit head position/orientation information normally provided by the vestibular system to the brain through a substitute sensory channel: electrotactile stimulation of the tongue. Head-orientation data (artificially sensed) serves as the input signal for the BrainPort balance device to control the movement of a small pattern of stimulation on the tongue that relates to head position in real-time. With training, the brain learns to appropriately interpret the information from the device and utilize it to function as it would with data from a normal-functioning natural sense. Ina total of 40 subjects trained with the BrainPort, 18 have been tested using standardized quantitative measurements of the treatment effects. A specialized set of exercises, testing, and training procedures has been developed that may serve as the course of intensive physical therapy with the BrainPort balance device. Our results demonstrate consistent positive and statistically significant balance rehabilitation effects independent of aging and etiology of balance deficit.

The afferent neural response to electrotactile stimuli: preliminary results

We recorded action potentials from three RA fibers innervating primate fingerpad, while applying electrotactile (electrocutaneous) stimulation. Negative pulses required 1.3-1.5 times more current than positive ones for entrainment. The strength-duration time constant was approximately 151 micros. Suprathreshold sinusoidal vibration synchronized to 30-Hz electrotactile pulses changed the electrotactile entrainment current slightly, indicating a possible electrical-mechanical transduction interaction.

Changes in functional connectivity correlate with behavioral gains in stroke patients after therapy using a brain-computer interface device

Brain-computer interface (BCI) technology is being incorporated into new stroke rehabilitation devices, but little is known about brain changes associated with its use. We collected anatomical and functional MRI of nine stroke patients with persistent upper extremity motor impairment before, during, and after therapy using a BCI system. Subjects were asked to perform finger tapping of the impaired hand during fMRI. Action Research Arm Test (ARAT), 9-Hole Peg Test (9-HPT), and Stroke Impact Scale (SIS) domains of Hand Function (HF) and Activities of Daily Living (ADL) were also assessed. Group-level analyses examined changes in whole-brain task-based functional connectivity (FC) to seed regions in the motor network observed during and after BCI therapy. Whole-brain FC analyses seeded in each thalamus showed FC increases from baseline at mid-therapy and post-therapy (p < 0.05). Changes in FC between seeds at both the network and the connection levels were examined for correlations with changes in behavioral measures. Average motor network FC was increased post-therapy, and changes in average network FC correlated (p < 0.05) with changes in performance on ARAT (R2 = 0.21), 9-HPT (R2 = 0.41), SIS HF (R2 = 0.27), and SIS ADL (R2 = 0.40). Multiple individual connections within the motor network were found to correlate in change from baseline with changes in behavioral measures. Many of these connections involved the thalamus, with change in each of four behavioral measures significantly correlating with change from baseline FC of at least one thalamic connection. These preliminary results show changes in FC that occur with the administration of rehabilitative therapy using a BCI system. The correlations noted between changes in FC measures and changes in behavioral outcomes indicate that both adaptive and maladaptive changes in FC may develop with this therapy and also suggest a brain-behavior relationship that may be stimulated by the neuromodulatory component of BCI therapy.

Characterizing relationships of DTI, fMRI, and motor recovery in stroke rehabilitation utilizing brain-computer interface technology

The relationship of the structural integrity of white matter tracts and cortical activity to motor functional outcomes in stroke patients is of particular interest in understanding mechanisms of brain structural and functional changes while recovering from stroke. This study aims to probe these underlying mechanisms using diffusion tensor imaging (DTI) and fMRI measures. We examined the structural integrity of the posterior limb of the internal capsule (PLIC) using DTI and corticomotor activity using motor-task fMRI in stroke patients who completed up to 15 sessions of rehabilitation therapy using Brain-Computer Interface (BCI) technology. We hypothesized that (1) the structural integrity of PLIC and corticomotor activity are affected by stroke; (2) changes in structural integrity and corticomotor activity following BCI intervention are related to motor recovery; (3) there is a potential relationship between structural integrity and corticomotor activity. We found that (1) the ipsilesional PLIC showed significantly decreased fractional anisotropy (FA) values when compared to the contralesional PLIC; (2) lower ipsilesional PLIC-FA values were significantly associated with worse motor outcomes (i.e., ipsilesional PLIC-FA and motor outcomes were positively correlated.); (3) lower ipsilesional PLIC-FA values were significantly associated with greater ipsilesional corticomotor activity during impaired-finger-tapping-task fMRI (i.e., ipsilesional PLIC-FA and ipsilesional corticomotor activity were negatively correlated), with an overall bilateral pattern of corticomotor activity observed; and (4) baseline FA values predicted motor recovery assessed after BCI intervention. These findings suggest that (1) greater vs. lesser microstructural integrity of the ipsilesional PLIC may contribute toward better vs. poor motor recovery respectively in the stroke-affected limb and demand lesser vs. greater cortical activity respectively from the ipsilesional motor cortex; and that (2) PLIC-FA is a promising biomarker in tracking and predicting motor functional recovery in stroke patients receiving BCI intervention.