Dehua Cui

A prototype of landmark-based car navigation using a full-windshield head-up display system

In driving applications, a full windshield head-up display (FWD) system provides a flexible way for delivering driving related information. The projected information (text, image and graphics) is distorted on the car windshield because of its non-planar surface, the FWD projectors position and the viewing angle of the driver. In this paper, we present development of a prototype of landmark-based car navigation using an FWD system. We propose to use a computer vision method to automatically correct FWD projection distortion on the windshield. Our system consists of an FWD, a camera and an LCD video projector. In the calibration phase, the camera captures the patterns projected by the FWD projector and our method automatically models the windshield distortion. In the working phase, the LCD video projector projects a video sequence (that is captured on a moving vehicle in the real driving situation) onto a wall to simulate real driving and the camera simulates the drivers view. Our system aims to detect and highlight key landmarks such as road signs on the windshield by controlling the FWD projector to provide better navigation information. We demonstrate the proposed concept using our previously developed street landmark detection system.