Yelena Rodin

Fuzzy-logic-based sensor fusion of images

The fusion of visual and infrared sensor images of potential driving hazards in static infrared and visual scenes is computed using the Fuzzy Logic Approach (FLA). The FLA is presented as a new method for combining images from different sensors for achieving an image that displays more information than either image separately. Fuzzy logic is a modeling approach that encodes expert knowledge directly and easily using rules. With the help of membership functions designed for the data set under study, the FLA can model and interpolate to enhance the contrast of the imagery. The Mamdani model is used to combine the images. The fused sensor images are compared to metrics to measure the increased perception of a driving hazard in the sensor-fused image. The metrics are correlated to experimental ranking of the image quality. A data set containing IR and visual images of driving hazards under different types of atmospheric contrast conditions is fused using the Fuzzy Logic Approach (FLA). A holographic matched-filter method (HMFM) is used to scan some of the more difficult images for automated detection. The image rankings are obtained by presenting imagery in the TARDEC Visual Perception Lab (VPL) to subjects. Probability of detection of a driving hazard is computed using data obtained in observer tests. The matched-filter is implemented for driving hazard recognition with a spatial filter designed to emulate holographic methods. One of the possible automatic target recognition devices implements digital/optical cross-correlator that would process sensor-fused images of targets. Such a device may be useful for enhanced automotive vision or military signature recognition of camouflaged vehicles. A textured clutter metric is compared to experimental rankings.

Noise and contrast comparison of visual and infrared images of hazards as seen inside an automobile

The purpose of this experiment was to quantitatively measure driver performance for detecting potential road hazards in visual and infrared (IR) imagery of road scenes containing varying combinations of contrast and noise. This pilot test is a first step toward comparing various IR and visual sensors and displays for the purpose of an enhanced vision system to go inside the driver compartment. Visible and IR road imagery obtained was displayed on a large screen and on a PC monitor and subject response times were recorded. Based on the response time, detection probabilities were computed and compared to the known time of occurrence of a driving hazard. The goal was to see what combinations of sensor, contrast and noise enable subjects to have a higher detection probability of potential driving hazards.

Eyetracker analysis of fixation points using an IR HUD in an automobile

This paper describes the experimental apparatus and analysis techniques now in place at the US Army Tank-automotive and Armaments COMmand Visual Perception Lab in Warren, Michigan, and the results of some preliminary trials using these methods. The tools will be used to develop and analyse experiments to better understand how drivers use various displays and viewing systems intended to aid drivers in poor visibility conditions, particularly at night. Visible and infrared road scene imagery obtained from the field were displayed simultaneously and subject eye fixation and point of gaze measured using a magnetic head tracker and near infrared eyetracker. Results were analysed to determine if personal differences between the various subjects caused them to prefer one display to another. The goal was to see if people prefer to use the heads up display or the direct view for driving at night.

A video-based system and method for improving aircraft security

Commercial airplanes are now a weapon of mass destruction to be used in asymmetric warfare against the United States. There is a clear need for enhanced situational awareness within the passenger cabin of airplanes. If the crew suspected that the security of an aircraft had been compromised it would be critical for a crew member to be able to clearly and rapidly see what is occurring inside the passenger cabin without having to open the door to the cockpit. In case of emergency it would also be extremely valuable for ground personnel and aircraft responding to the emergency to be able to visually monitor what is happening inside the aircraft cabin.