Charlotte M. Reed

Information transmission with a multifinger tactual display

In this work, the tactual information transmission capabilities of a tactual display designed to provide stimulation along a continuum from kinesthetic movements to cutaneous vibrations are assessed. The display is capable of delivering arbitrary waveforms to three digits (thumb, index, and middle finger) within an amplitude range from absolute detection threshold to about 50 dB sensation level and a frequency range from dc to above 300 Hz. Stimulus sets were designed at each of three signal durations (125, 250, and 500 msec) by combining salient attributes, such as frequency (further divided into low, middle, and high regions), amplitude, direction of motion, and finger location. Estimated static information transfer (IT) was 6.5 bits at 500 mseC., 6.4 bits at 250 mseC., and 5.6 bits at 125 msec. Estimates of IT rate were derived from identification experiments in which the subject’s task was to identify the middle stimulus in a sequence of three stimuli randomly selected from a given stimulus set. On the basis of the extrapolations from these IT measurements to continuous streams, the IT rate was estimated to be about 12 bits/seC., which is roughly the same as that achieved by Tadoma users in tactual speech communication.

Research on the Tadoma method of speech communication

In Tadoma, speech is received by placing a hand on the talkers face and monitoring actions associated with speech production. Our initial research has documented the speech perception, speech production, and linguistic abilities of deaf-blind individuals highly trained in Tadoma. This research has demonstrated that good speech reception can be achieved through the tactile sense: Performance is roughly equivalent to that of normals listening in noise or babble with a signal-to-noise ratio in the range 0-6 dB. It appears that the principal cues employed are lip movement, jaw movement, oral airflow, and laryngeal vibration, and that the errors which occur are caused primarily by inadequate information on tongue position. Our current research includes (1) learning of Tadoma by normal subjects with simulated deafness and blindness, (2) augmenting Tadoma with a supplemental tactile display of tongue position, and (3) developing a synthetic Tadoma system in which signals recorded from a talkers face are used to drive an artificial face. This research is expected to increase our understanding of Tadoma and its relation to other tactile communication methods, show that performance obtained through Tadoma does not represent the ultimate limits of the tactile sense, and provide a research tool for studying transformations of Tadoma.

Speech reception by listeners with real and simulated hearing impairment: Effects of continuous and interrupted noise

The effects of audibility and age on masking for sentences in continuous and interrupted noise were examined in listeners with real and simulated hearing loss. The absolute thresholds of each of ten listeners with sensorineural hearing loss were simulated in normal-hearing listeners through a combination of spectrally-shaped threshold noise and multi-band expansion for octave bands with center frequencies from 0.25-8 kHz. Each individual hearing loss was simulated in two groups of three normal-hearing listeners (an age-matched and a non-age-matched group). The speech-to-noise ratio (S/N) for 50%-correct identification of hearing in noise test (HINT) sentences was measured in backgrounds of continuous and temporally-modulated (10 Hz square-wave) noise at two overall levels for unprocessed speech and for speech that was amplified with the NAL-RP prescription. The S/N in both continuous and interrupted noise of the hearing-impaired listeners was relatively well-simulated in both groups of normal-hearing listeners. Thus, release from masking (the difference in S/N obtained in continuous versus interrupted noise) appears to be determined primarily by audibility. Minimal age effects were observed in this small sample. Observed values of masking release were compared to predictions derived from intelligibility curves generated using the extended speech intelligibility index (ESII) [Rhebergen et al. (2006). J. Acoust. Soc. Am. 120, 3988-3997].

Optimum Information Transfer Rates for Communication through Haptic and Other Sensory Modalities

This paper is concerned with investigating the factors that contribute to optimizing information transfer (IT) rate in humans. With an increasing interest in designing complex haptic signals for a wide variety of applications, there is a need for a better understanding of how information can be displayed in an optimal way. Based on the results of several early studies from the 1950s, a general “rule of thumb” has arisen in the literature which suggests that IT rate is dependent primarily on the stimulus delivery rate and is optimized for presentation rates of 2-3 items/s. Thus, the key to maximizing IT rate is to maximize the information in the stimulus set. Recent data obtained with multidimensional tactual signals, however, appear to contradict these conclusions. In particular, these current results suggest that optimal delivery rate varies with stimulus information to yield a constant peak IT rate that depends on the degree of familiarity and training with a particular stimulus set. We discuss factors that may be responsible for the discrepancies in results across studies including procedural differences, training issues, and stimulus-response compatibility. These factors should be taken into account when designing haptic signals to yield optimal IT rates for communication devices.

Review Article: Review of the Literature on Temporal Resolution in Listeners With Cochlear Hearing Impairment: A Critical Assessment of the Role of Suprathreshold Deficits

A critical review of studies of temporal resolution in listeners with cochlear hearing impairment is presented with the aim of assessing evidence for suprathreshold deficits. Particular attention is paid to the roles of variables—such as stimulus audibility, overall stimulus level, and participants age—which may complicate the interpretation of experimental findings in comparing the performance of hearing-impaired (HI) and normal-hearing (NH) listeners. On certain temporal tasks (e.g., gap detection), the performance of HI listeners appears to be degraded relative to that of NH listeners when compared at equal SPL (sound pressure level). For other temporal tasks (e.g., forward masking), HI performance is degraded relative to that of NH listeners when compared at equal sensation level. A relatively small group of studies exists, however, in which the effects of stimulus audibility and level (and occasionally participants age) have been controlled through the use of noise-masked simulation of hearing loss in NH listeners. For some temporal tasks (including gap-detection, gap-duration discrimination, and detection of brief tones in modulated noise), the performance of HI listeners is well reproduced in the results of noise-masked NH listeners. For other tasks (i.e., temporal integration), noise-masked hearing-loss simulations do not reproduce the results of HI listeners. In three additional areas of temporal processing (duration discrimination, detection of temporal modulation in noise, and various temporal-masking paradigms), further studies employing control of stimulus audibility and level, as well as age, are necessary for a more complete understanding of the role of suprathreshold deficits in the temporal-processing abilities of HI listeners.

Reception of environmental sounds through cochlear implants.

Objective: The objective of this study was to measure the performance of persons with cochlear implants on a test of environmental-sound reception. Design: The reception of environmental sounds was studied using a test employing closed sets of 10 sounds in each of four different settings (General Home, Kitchen, Office, and Outside). The participants in the study were 11 subjects with cochlear implants. Identification testing was conducted under each of the four closed sets of stimuli using a one-interval, 10-alternative, forced-choice procedure. The data were summarized in terms of overall percent correct identification scores and information transfer (IT) in bits. Confusion patterns were described using a hierarchical-clustering analysis. In addition, individual performance on the environmental-sound task was related to the ability to recognize isolated words through the cochlear implant alone. Results: Levels of performance were similar across the four stimulus sets. Mean scores across subjects ranged from 45.3% correct (and IT of 1.5 bits) to 93.8% correct (and IT of 3.1 bits). Performance on the environmental-sound identification test was roughly related to NU-6 word recognition ability. Specifically, those subjects with word scores greater than 34% correct performed at levels of 80 to 94% on environmental-sound recognition, whereas subjects with word scores less than 34% had greater difficulty on the task. Results of the hierarchical clustering analysis, conducted on two groups of subjects (a high-performing [HP] group and a low-performing [LP] group), indicated that confusions were confined to three or four specific stimuli for the HP subjects and that larger clusters of confused stimuli were observed in the data of the LP group. Signals with distinct temporal-envelope characteristics were easily perceived by all subjects, and confused items tended to share similar overall durations and temporal envelopes. Conclusions: Temporal-envelope cues appear to play a large role in the identification of environmental sounds through cochlear implants. The finer distinctions made by the HP group compared with the LP group may be related to a better ability both to resolve temporal differences and to use gross spectral cues. These findings are qualitatively consistent with patterns of confusions observed in the reception of speech segments through cochlear implants.

Note on Information Transfer Rates in Human Communication

Information-transfer (IT) rates in bits/sec were estimated for a variety of methods of human communication and modalities of reception. Using previously published data, a range of communication rates for which transmission is highly accurate was established for each method and modality. These communication rates were converted into a normalized unit of transmission (words/sec). The normalized units were then converted into estimates of IT rate (bits/sec) using Shannons (1951) calculations of the information content of a single letter of the alphabet. Maximal estimates of IT rates of roughly 40 to 60 bits/sec are observed for speech (through audition) and for reading and sign language (through vision). Maximal rates roughly 50 percent lower are obtained for reading through the tactual sense. Estimates of IT rates for motor output tasks are also considered. A close correspondence is generally observed between IT rates for receiving a given display and IT rates for the motor output task required for producing the display. These results have implications for the design of synthetic-environment systems and the displays and controls to be used in these systems, by providing examples of communication rates that have been achieved by humans in the area of language communication.

Frequency and amplitude discrimination along the kinesthetic-cutaneous continuum in the presence of masking stimulia)

Frequency and amplitude discrimination thresholds along the kinesthetic to cutaneous continuum were evaluated on the left index fingerpad using a multifinger tactual display. Target stimuli were presented either in isolation (no-masker condition) or in the presence of masking stimuli (one- or two-masker conditions). Six reference target signals in the frequency range 2-300 Hz (two each from low-, medium-, and high-frequency regions) and at an amplitude of either 20 or 35 dB sensation levels (SL) were used. In the no-masker condition, the range of frequency Weber fraction was 0.13-0.38 and 0.14-0.28, and the range of amplitude discrimination threshold was 1.82-2.98 dB and 1.65-2.71 dB, at 20 and 35 dB SL, respectively. In the masking conditions, average frequency Weber fractions rose to 0.60 and 0.46, and average amplitude thresholds rose to 3.63 and 3.72 dB, at 20 and 35 dB SL, respectively. In general, thresholds were largest in the two-masker condition and lowest in the no-masker condition. Although the frequency and amplitude thresholds generally increased in the presence of masking stimuli, there was some indication of channel independence for low- and high-frequency target stimuli. The implications of the results for tactual communication of speech are discussed.

Discrimination and identification of finger joint-angle position using active motion

The authors report six experiments on the human ability to discriminate and identify finger joint-angle positions using active motion. The PIP (proximal interphalangeal) joint of the index finger was examined in Exps. 1--3 and the MCP (metacarpophalangeal) joint in Exps. 4--6. In Exp. 1, the just noticeable difference (JND) of PIP joint-angle position was measured when the MCP joint was either fully extended or halfway bent. In Exp. 2, the JND of PIP joint-angle position as a function of PIP joint-angle reference position was measured when the PIP joint was almost fully extended, halfway bent, or almost fully flexed. In Exp. 3, the information transfer of PIP joint-angle position was estimated with the MCP joint in a fully extended position. In Exps. 4--6, the JND and the information transfer of MCP joint-angle position were studied with a similar experimental design. The results show that the JNDs of the PIP joint-angle position were roughly constant (2.5°−2.7°) independent of the PIP joint-angle reference position or the MCP joint-angle position used (Exps. 1 and 2). The JNDs of the MCP joint-angle position, however, increased with the flexion of both the PIP and MCP joints and ranged from 1.7° to 2.7° (Exps. 4 and 5). The information transfer of the PIP and MCP joint-angle position were similar, indicating 3--4 perfectly identifiable joint-angle positions for both joints (Exps. 3 and 6). The results provide the basic data needed for estimating, for example, the resolution of fingertip position during active free motion. They are compared to the results from previous studies on joint position, length, and thickness perception.

Temporal masking of multidimensional tactual stimuli

Experiments were performed to examine the temporal masking properties of multidimensional tactual stimulation patterns delivered to the left index finger. The stimuli consisted of fixed-frequency sinusoidal motions in the kinesthetic (2 or 4 Hz), midfrequency (30 Hz), and cutaneous (300 Hz) frequency ranges. Seven stimuli composed of one, two, or three spectral components were constructed at each of two signal durations (125 or 250 ms). Subjects identified target signals under three different masking paradigms: forward masking, backward masking, and sandwiched masking (in which the target is presented between two maskers). Target identification was studied as a function of interstimulus interval (ISI) in the range 0 to 640 ms. For both signal durations, percent-correct scores increased with ISI for each of the three masking paradigms. Scores with forward and backward masking were similar and significantly higher than scores obtained with sandwiched masking. Analyses of error trials revealed that subjects showed a tendency to respond, more often than chance, with the masker, the composite of the masker and target, or the combination of the target and a component of the masker. The current results are compared to those obtained in previous studies of tactual recognition masking with brief cutaneous spatial patterns. The results are also discussed in terms of estimates of information transfer (IT) and IT rate, are compared to previous studies with multidimensional tactual signals, and are related to research on the development of tactual aids for the deaf.