Bridget A. Lewis

Perceived Urgency Mapping Across Modalities within a Driving Context

Hazard mapping is essential to effective driver-vehicle interface (DVI) design. Determining which modality to use for situations of different criticality requires an understanding of the relative impact of signal parameters within each modality on perceptions of urgency and annoyance. Towards this goal we obtained psychometric functions for visual, auditory and tactile interpulse interval (IPI), visual color, signal word, and auditory fundamental frequency on perceptions of urgency, annoyance, and acceptability. Results indicate that manipulation of IPI in the tactile modality, relative to visual and auditory, has greater utility (greater impact on urgency than annoyance). Manipulations of color were generally rated as less annoying and more acceptable than auditory and tactile stimuli; but they were also rated as lower in urgency relative to other modality manipulations. Manipulation of auditory fundamental frequency resulted in high ratings of both urgency and annoyance. Results of the current investigation can be used to guide DVI design and evaluation.

Multimodal urgency coding: auditory, visual, and tactile parameters and their impact on perceived urgency

Through a series of investigations involving different levels of contextual fidelity we developed scales of perceived urgency for several dimensions of the auditory, visual, and tactile modalities. Psychophysical ratings of perceived urgency, annoyance, and acceptability as well as behavioral responses to signals in each modality were obtained and analyzed using Stevens Power Law to allow comparison across modalities. Obtained results and their implications for use as in-vehicle alerts and warnings are discussed.

Perceived Urgency Scaling in Tactile Alerts

Tactile vibrations are potentially useful in a variety of environments to communicate information to visually and auditorily overloaded people. However, since vibrotactile signals must come into physical contact with the skin, they may also be perceived as highly urgent and annoying. The current study examined whether scalable levels of perceived urgency could be obtained with tactile signals by measuring the relationship between changes in vibrotactile pulse rate and ratings of urgency and annoyance. In two separate experiments, changes in pulse rate resulted in changes in ratings of perceived urgency with faster pulse rates being perceived as more urgent. Importantly, in both studies pulse rate had a greater impact on perceived urgency than it did on annoyance suggesting that scalable levels of urgency can be achieved without similarly annoying operators. Results are discussed in terms of their implications for multimodal display design.

Equating Perceived Urgency Across Auditory, Visual, and Tactile Signals

Determining the most effective modality to use to draw an operator’s attention to a specific situation has been a topic of recent interest. Making this determination requires ensuring that the signals being compared have been equated for saliency and perceived urgency. We conducted an experiment to examine how perceptions of urgency and annoyance change with changes in physical parameters across auditory, visual, and tactile modalities. While urgency ratings in the low, medium, and high range were found in each modality, parameters such as interpulse interval had a greater impact on perceived urgency than annoyance in the auditory and tactile modality, while having relatively little impact in the visual modality. Results can be used to facilitate the design of alerts and warnings with pre-specified urgency levels while minimizing annoyance and have implications for both research and interface design.

Perceived Urgency and Annoyance of Auditory Alerts in a Driving Context

Complex in-vehicle technology and safety systems are finding their way into many cars on the road today. These systems require alerts and warnings that appropriately convey multiple levels of urgency, but if these are deemed excessively annoying, then their implementation may be of little consequence. In this study we used a well-documented psychophysical approach to identify the relationship between specific auditory parameters, perceived urgency and perceived annoyance. In agreement with existing literature, increases in all parameters led to increases in both urgency and annoyance - although differentially. Of the parameters investigated, only pulse rate exhibited a stronger psychophysical relationship with urgency than annoyance. The tradeoff between urgency and annoyance is of practical concern and results from this study provide a potential guideline to determine the viability of future in vehicle alerts based on this relationship.

Effect of Tactile Location, Pulse Duration, and Interpulse Interval on Perceived Urgency

Tactile displays hold promise as an effective and efficient means of presenting a wide range of information to the driver. This study examined the subjective perceptions of urgency and annoyance for tactile signals of different pulse duration, interpulse interval (IPI), and pulse pattern from devices called tactors located on the wrist, on the waist belt, or in the seat pan. Results revealed significant utility (steep increases in urgency without similarly steep increases in annoyance) for signals presented in pulse durations from 10 to 150 ms with decreasing utility beyond this range (200 ms or greater). Perceived urgency showed a decreasing trend as the IPI increased. Strikingly similar magnitude estimation functions were obtained across the three tactor locations. Results are discussed in terms of their implications for tactile display design in vehicles.

Comparison of Traditional Psychophysical and Sorting Methods for In-Vehicle Display Design

Modern vehicles can present an ever-changing plethora of information, making it of the utmost importance that signals are evaluated efficiently in the early stages of design. The current study investigates the relationship between traditional methods of physchophysical scaling and newer methods of sorting or categorization. Participants sorted a sample of sounds into “Alarms”, “Status Notifications” and “Social Notifications”. Following the sorting task, participants were asked to rate each individual sound (using a 1-100 scale) on urgency, annoyance and acceptability. Results indicate extremely high correlations between alarm categorization and urgency level where sounds categorized as alarms by more participants were also rated as more urgent by all participants.

Designing Unambiguous Auditory Crash Warning Systems

A series of three studies examined the acoustic characteristics that contribute to a sound being unambiguously perceived as an urgent alarm within a vehicle context. In experiment 1, participants sorted a variety of sounds modeled after sounds currently in use in driver-vehicle interfaces (DVIs) into categories indicating highly critical warnings and alerts (or “alarms”), vehicle status sounds, or in vehicle social notifications. Results indicated that four criteria (peak-to-total time ratio, interburst interval, number of harmonics, and base frequency) explained 61% of the variance in categorization. From these criteria, cutoffs were determined and manipulated to create stimuli for an initial validation study. Experiment 2 results indicated that these criteria remained robust even when examined in a larger stimulus set and with different participants. Finally, Experiment 3 investigated rapid categorization under divided attention. Participants categorized alerts while driving in a desktop driving simulator and completing a secondary distracting task. Results indicate that previously defined parameter criteria and cutoffs are applicable in higher context and under load. Furthermore, sounds that met all criteria were responded to more quickly than those which met only some or no criteria, indicating that these criteria can be used to create sounds which are unambiguous and intuitive in an in-vehicle driving context.

Max Brake Force as a Measure of Perceived Urgency in a Driving Context

Participants drove a simulated vehicle while completing an n-back task of high or low cognitive demand. Concurrently, they responded via brake press to signals presented in either a single modality (auditory, visual or tactile) or a bimodal combination. Participants were asked to indicate the perceived urgency of each signal by adjusting the force applied in their brake response. Signals were designed to be of “high” or “low” urgency based on previous research for both unimodal and bimodal combinations. Participants were capable of subjectively judging perceived urgency independent of response time and responded to bimodal (relative to unimodal) and high (relative to low) urgency stimuli with significantly greater brake force. However, both factors interacted with cognitive demand indicating that the magnitude of these differential responses was reduced under high demand. Implications for warning evaluation in an in-vehicle driving context are discussed.

Validation of Essential Acoustic Parameters for Highly Urgent In-Vehicle Collision Warnings

Objective The aim of this study was to validate the importance of key acoustic criteria for use as in-vehicle forward collision warning (FCW) systems. Background Despite recent advances in vehicle safety, automobile crashes remain one of the leading causes of death. As automation allows for more control of noncritical functions by the vehicle, the potential for disengagement and distraction from the driving task also increases. It is, therefore, as important as ever that in-vehicle safety-critical interfaces are intuitive and unambiguous, promoting effective collision avoidance responses upon first exposure even under divided-attention conditions. Method The current study used a driving simulator to assess the effectiveness of two warnings, one that met all essential acoustic parameters, one that met only some essential parameters, and a no-warning control in the context of a lead vehicle–following task in conjunction with a cognitive distractor task and collision event. Results Participants receiving an FCW comprising five essential acoustic components had improved collision avoidance responses relative to a no-warning condition and an FCW missing essential elements on their first exposure. Responses to a consistently good warning (GMU Prime) improved with subsequent exposures, whereas continued exposure to the less optimal FCW (GMU Sub-Prime) resulted in poorer performance even relative to receiving no warning at all. Conclusions This study provides support for previous warning design studies and for the validity of five key acoustic parameters essential for the design of effective in-vehicle FCWs. Application Results from this study have implications for the design of auditory FCWs and in-vehicle display design.