Gregory H. Smith

Fuzzy-logic-based sensor fusion of images

The fusion of visual and infrared sensor images of potential driving hazards in static infrared and visual scenes is computed using the Fuzzy Logic Approach (FLA). The FLA is presented as a new method for combining images from different sensors for achieving an image that displays more information than either image separately. Fuzzy logic is a modeling approach that encodes expert knowledge directly and easily using rules. With the help of membership functions designed for the data set under study, the FLA can model and interpolate to enhance the contrast of the imagery. The Mamdani model is used to combine the images. The fused sensor images are compared to metrics to measure the increased perception of a driving hazard in the sensor-fused image. The metrics are correlated to experimental ranking of the image quality. A data set containing IR and visual images of driving hazards under different types of atmospheric contrast conditions is fused using the Fuzzy Logic Approach (FLA). A holographic matched-filter method (HMFM) is used to scan some of the more difficult images for automated detection. The image rankings are obtained by presenting imagery in the TARDEC Visual Perception Lab (VPL) to subjects. Probability of detection of a driving hazard is computed using data obtained in observer tests. The matched-filter is implemented for driving hazard recognition with a spatial filter designed to emulate holographic methods. One of the possible automatic target recognition devices implements digital/optical cross-correlator that would process sensor-fused images of targets. Such a device may be useful for enhanced automotive vision or military signature recognition of camouflaged vehicles. A textured clutter metric is compared to experimental rankings.

Development of a high speed system for temperature mapping of a rotating target

This paper covers the development and comparison of two systems to measure the temperature variation on rotating components. Measurement of hot spots on a rotating brake disk is used for demonstration purposes. The two systems utilized are a high-speed infrared camera and an array of fiber optics connected to multiple high-speed single-point two-color infrared detectors coupled to a high-speed data acquisition system. The advantages and disadvantages of the two systems are discussed relative to real time data and post processing analyses. Results from both systems are presented for comparison.

Noise and contrast comparison of visual and infrared images of hazards as seen inside an automobile

The purpose of this experiment was to quantitatively measure driver performance for detecting potential road hazards in visual and infrared (IR) imagery of road scenes containing varying combinations of contrast and noise. This pilot test is a first step toward comparing various IR and visual sensors and displays for the purpose of an enhanced vision system to go inside the driver compartment. Visible and IR road imagery obtained was displayed on a large screen and on a PC monitor and subject response times were recorded. Based on the response time, detection probabilities were computed and compared to the known time of occurrence of a driving hazard. The goal was to see what combinations of sensor, contrast and noise enable subjects to have a higher detection probability of potential driving hazards.

Inspection of functional free form geometry

Abstract Next Generation Shape Verification (NGSV) provides a means of comparing free form surfaces by evaluating the conformance of a physical part or die to its design intent. The design intent can be represented as a math/cad model or be obtained by scanning a “master” part using a high data density collection device such as a laser scanner.

A video-based system and method for improving aircraft security

Commercial airplanes are now a weapon of mass destruction to be used in asymmetric warfare against the United States. There is a clear need for enhanced situational awareness within the passenger cabin of airplanes. If the crew suspected that the security of an aircraft had been compromised it would be critical for a crew member to be able to clearly and rapidly see what is occurring inside the passenger cabin without having to open the door to the cockpit. In case of emergency it would also be extremely valuable for ground personnel and aircraft responding to the emergency to be able to visually monitor what is happening inside the aircraft cabin.