Timothy L. White

Effects of Visual and Auditory Cues About Threat Location on Target Acquisition and Attention to Auditory communications

This laboratory study examined the effects of visual, spatial language, and 3-D audio cues about target location on target acquisition performance and the recall of information contained in concurrent radio communications. Two baseline conditions were also included in the analysis: no cues (baseline 1) and target presence cues only (baseline 2). In modes in which target location cues were provided, 100% of the targets presented were acquired compared to 94% in baseline 1 and 95% in baseline 2. On average, targets were acquired 1.4 seconds faster in the visual, spatial language, and 3-D audio modes than in the baseline conditions, with times in the visual and 3-D audio modes being 1 second faster than those in spatial language. Overall workload scores were lower in the 3-D audio mode than in all other conditions except the visual mode. Less information (23%) was recalled from auditory communications in baseline 1 than in the other four conditions where attention could be directed to communications between target presentations.

Effects of unimodal and multimodal cues about threat locations on target acquisition and workload.

Two studies were conducted to examine the effects of unimodal and multimodal cueing techniques for indicating the location of threats on target acquisition, the recall of information from concurrent communications, and perceived workload. One visual, two auditory (i.e., nonspatial speech and spatial tones [3-D]), and one tactile cue were assessed in Experiment 1. Experiment 2 examined the effects of combinations of the cues assessed in the first investigation: visual + nonspatial speech, visual + spatial tones, visual + tactile, and nonspatial speech + tactile. A unimodal, “visual only” condition was included as a baseline to determine the extent to which a supplementary cue might influence changes in performance and workload. The results of the studies indicated that time to first shot and the percentage of hits can be improved and workload reduced by providing cues about target location. The multimodal cues did not yield significant improvements in performance or workload beyond that achieved by the unimodal visual cue.

Effects of inter-stimulus interval and intensity on the perceived urgency of tactile patterns

This research examines the feasibility of coding urgency into tactile patterns. Four tactile patterns were presented at either, 12 or 23.5 dB above mean threshold, with an ISI of either 0 (no interval) or 500 msec. Measures included pattern identification and urgency rating on a scale of 1 (least urgent) to 10 (most urgent). Two studies were conducted, a laboratory study and a field study. In the laboratory study, participants received the tactile patterns while seated in front of a computer. For the field study, participants performed dismounted Soldier maneuvers while receiving the tactile patterns. Higher identification rates were found for the 23.5 dB intensity. Patterns presented at the 23.5 dB intensity and no ISI were rated most urgent. No differences in urgency ratings were found for 12 dB based on ISI. Findings support the notion of coding urgency into tactile patterns as a way of augmenting tactile communication.

Using the Tactile Modality as a Communication Medium for Dismounted Soldiers

This study examined the issues related to the detection and identification of tactile patterns as combat assault maneuvers were being performed. Three obstacles were used in this study: tires, windows, and high crawl. A baseline condition, in which participants received tactile patterns while standing, was also included in the analysis. In the baseline condition, participants detected and identified 100% of the tactile patterns. Analysis of the obstacle data showed that the obstacles had a significant effect on the detection and identification of the tactile signals. Participants detected 62.5% of the tactile patterns during the high crawl, which was significantly lower than for the tires and windows, with 92% and 88% of signals detected, respectively. With regard to the correct identification of tactile patterns, participants correctly identified 51% of the patterns during the high crawl, as compared to 88.5% for the tires and 77% for the windows.

Getting the Buzz: What's Next for Tactile Information Delivery?

As a result of continuous technological advances, information delivery is becoming multi-modal and complex. In many professions (e.g., air traffic control, combat operations) an abundance of information is delivered simultaneously over the visual and auditory sensory channels resulting in cognitive overload and leading to performance degradation over time. The Multiple-Resource theory suggests that offloading information from overtaxed sensory modalities to other modalities can reduce workload (Wickens, 2002). If properly implemented, tactile displays – i.e., devices used to present information to the user by stimulating the skin – may be a viable solution in reducing sensory and cognitive overload from the visual and audio channels. Shifting information to the tactile (touch) channel or judicious use of tactile information in conjunction with auditory and/or visual cues can lead to a reduction in cognitive and perceptual overload and an increase in positive performance outcomes. The primary objective of this panel is to discuss the most promising developments in tactile research and how the next steps can lead to new application areas or to specific products. The panelists – representing academia, the military, and industry, can collectively speak to diverse tactile information delivery methodologies, their respective applications, and challenges for the path forward. Some applications have already been realized in aviation, robotics, medicine, and commercial products and these will be described. Ultimately, this panel session is expected to inspire interest in tactile information delivery and to identify promising pathways for research leading to new application areas and specific application products.