Hyungil Kim

Look at Me: Augmented Reality Pedestrian Warning System Using an In-Vehicle Volumetric Head Up Display

Current pedestrian collision warning systems use either auditory alarms or visual symbols to inform drivers. These traditional approaches cannot tell the driver where the detected pedestrians are located, which is critical for the driver to respond appropriately. To address this problem, we introduce a new driver interface taking advantage of a volumetric head-up display (HUD). In our experimental user study, sixteen participants drove a test vehicle in a parking lot while braking for crossing pedestrians using different interface designs on the HUD. Our results showed that spatial information provided by conformal graphics on the HUD resulted in not only better driver performance but also smoother braking behavior as compared to the baseline.

Virtual Road Signs Augmented Reality Driving Aid for Novice Drivers

Studies have shown that experts are more sensitive to changes in the road scene than novice drivers, and use the driving patterns of other cars to infer important information. A tool that can help bridge the gap between experts and novices may be augmented reality (AR), which can be used to graphically overlay virtual information onto the real world that may not otherwise be easily inferred. In this paper, we propose an AR interface that aims to improve the sensation, attention, situation awareness and decision making of international drivers who are new to the United States (US). We present results of a preliminary study that identifies the needs of novice international drivers as well as an AR interface design created to support these needs. Contextual inquiry and analysis techniques were used to extract the needs of novice international drivers. Based on observations, iterative designs and a prototype were developed that merge AR and audio feedback. Lastly, the prototype was evaluated by two usability experts, who performed a heuristic walkthrough based on the principles of human information processing. The experts conclude that the interface has the potential of increasing the sensation, attention, situation awareness and decision making while reducing the mental workload of novice international drivers. Future work will include an empirical study to support the observations of the analytical evaluation presented herein.

Virtual Shadow Making Cross Traffic Dynamics Visible through Augmented Reality Head Up Display

Most obvious benefit of augmented reality (AR) displays is direct perception of information atop physical reality. In driving context, however, AR interfaces should be designed carefully to guide drivers’ attention while minimizing attentional narrowing. This work aims to design an interface for cross traffic alert using an AR head up display (HUD) that is compatible with both the driver’s cognitive process and physical reality of driving environment. Ecological interface design (EID) allowed us to complement current user centered design (UCD) approaches by considering human-environment interaction and leveraging the inherent benefit of AR interfaces: conformal graphics. We designed a novel interface that casts virtual shadows of approaching obstacles through an AR HUD and prototyped this idea for a specific use-case of pedestrian collision warning. Our initial usability evaluation demonstrated potential benefits of incorporating EID into AR interface design. The approaches and design idea from this study can be leveraged by future researchers and designers to create more reliable and safer AR interfaces for vehicle drivers.

Effect of Volumetric Displays on Depth Perception in Augmented Reality

Augmented reality (AR) head-up displays (HUD) have previously been explored as a potential information delivery system for drivers. In driving scenarios, correct perception of virtual object distance assists with effective use of AR HUDs in safety-critical applications (e.g., collision warnings). AR volumetric displays purportedly offer increased accuracy of distance perception through consistent presentation of oculomotor cues such as vergence and accommodation over traditional displays. For this paper, we investigated volumetric AR displays as a mean of enhancing perception of virtual objects registered to the real world, specifically in terms of distance perception as a result of binocular cues. We designed and ran an experiment where participants controlled and placed virtual objects next to real-world counterparts at ranges between 7-12 meters. We found that the volumetric AR display outperformed a traditional fixed focal plane AR HUD when considering distances 5 meters greater than the traditional displays focal depth.

Quantifying Distraction Potential of Augmented Reality Head-Up Displays for Vehicle Drivers

Background: A recent National Highway Traffic & Safety Administration (NHTSA) report states that 10% of fatal crashes and 18% of injury crashes were reported as distraction-affected crashes. In that same year, 3,179 people were killed and an estimated 431,000 injured in motor vehicle crashes involving distracted drivers, many of which involved secondary visual displays (NHTSA, 2016). Augmented reality (AR) head-up displays (HUD) promise to be less distractive than traditional in-vehicle displays since they do not take drivers’ eyes off the road (Gabbard, Fitch, & Kim, 2014). However, empirical studies have reported possible negative consequences of AR HUDs, in part, due to AR graphics’ salience (Sharfi & Shinar, 2014), frequent changes (Wolffsohn, McBrien, Edgar, & Stout, 1998), and visual clutter (Burnett & Donkor, 2012). Moreover, current in-vehicle display assessment methods which are based on eye-off-road time measures (NHTSA, 2012), cannot capture this unique challenge. Objective: This work aims to propose a new method for the assessment of AR HUDs by quantifying both positive (informing drivers) and negative (distracting drivers) consequences of AR HUDs which might not be captured by current in-vehicle display assessment methods. Method: We proposed a new way of quantifying the distraction potential of AR HUDs by measuring driver situation awareness with operational improvements on the situation awareness global assessment technique (Endsley, 2012) to suit AR usability evaluations. A human-subject experiment was conducted in a driving simulator to apply the proposed method and to evaluate two AR HUD interfaces for pedestrian collision warning. The AR warning interfaces were prototyped by the augmented video technique (Soro, Rakotonirainy, Schroeter, & Wollstdter, 2014). Twenty-four participants drove while interacting with different types of AR pedestrian collision warning interfaces (no warning, bounding box, and virtual shadow). Drivers’ situation awareness, confidence, and workload were measured and compared to the no warning condition. Results: Only one of the warning interface designs, the virtual shadow (Kim, Isleib, & Gabbard, 2016), improved driver situation awareness about pedestrians which were cued by the AR HUD, not affecting situation awareness about other environmental elements which were not augmented by the HUD. The experiment also showed drivers’ overconfidence bias while interacting with the bounding box which is another warning interface design. The empirical user study did not provide any evidence for reduced driver workload when AR warnings were given. Conclusion: Our initial human-subject study demonstrated a potential of the proposed method in quantifying both positive and negative consequences of AR HUDs on driver cognitive processes. More importantly, the experiment showed that AR interfaces can have both positive and negative consequences on driver situation awareness depending upon how we design perceptual forms of graphical elements. Application: The proposed assessment methods for AR HUDs can inform not only comparative evaluation among design alternatives but also assist in incrementally improving design iterations to better support drivers’ information needs, situation awareness, and in turn, performance, and safety.

Casting shadows: Ecological interface design for augmented reality pedestrian collision warning

Ecological interface design (EID) has the opportunity to complement current approaches for augmented reality (AR) interface design by considering human-environment interaction and leveraging the inherent benefit of AR interfaces: conformal graphics. This work applies EID to design a novel interface for pedestrian collision warning for an automotive AR head-up display (HUD). Our initial usability evaluation shows potential benefits of incorporating EID into AR interface design.