Tracy J. Barnidge

3D vision upgrade kit for TALON robot

In this paper, we report on the development of a 3D vision field upgrade kit for TALON robot consisting of a replacement flat panel stereoscopic display, and multiple stereo camera systems. An assessment of the systems use for robotic driving, manipulation, and surveillance operations was conducted. The 3D vision system was integrated onto a TALON IV Robot and Operator Control Unit (OCU) such that stock components could be electrically disconnected and removed, and upgrade components coupled directly to the mounting and electrical connections. A replacement display, replacement mast camera with zoom, auto-focus, and variable convergence, and a replacement gripper camera with fixed focus and zoom comprise the upgrade kit. The stereo mast camera allows for improved driving and situational awareness as well as scene survey. The stereo gripper camera allows for improved manipulation in typical TALON missions.

Characterization of a monochromatic 128x64 resolution PLED for military instrumentation applications

A characterization was performed on a monochrome, low-information content polymeric light emitting diode (PLED) display to determine the effects of ruggedization for military display applications. A summary of the environmental, mechanical, and optical characterization results show that a unique direct bonding method and night vision imaging system (NVIS) filter material can be used to ruggedize commercial-off-the-shelf (COTS) PLED displays to operate in demanding military environments. Significant enhancements to a COTS PLED device are discussed in terms of impact resistance, enhanced sunlight readability, and compatibility with night vision operations.

NVIS filters for defense enhancement of flexible and emissive display technologies: USDC program RFP04-110

A jointly funded development project was undertaken by the United States Display Consortium (USDC) and Rockwell Collins, Inc., to characterize internally developed flexible night-vision imaging system (NVIS) filters which enhance the performance of organic light-emitting displays (OLEDs) and other potential flexible display technology variants. We have developed an innovative dye-based NVIS filter material well suited for use as a front surface filter for OLED displays. In particular, this new NVIS filter material offers high transmittance in the visible spectrum along with a sharp spectral cut-off and excellent extinction in the near-IR (NIR). This report presents results from a recent investigation to assess the compatibility of this new dye-based NVIS filter material with rigid and flexible OLEDs.

3D display considerations for rugged airborne environments

The KC-46 is the next generation, multi-role, aerial refueling tanker aircraft being developed by Boeing for the United States Air Force. Rockwell Collins has developed the Remote Vision System (RVS) that supports aerial refueling operations under a variety of conditions. The system utilizes large-area, high-resolution 3D displays linked with remote sensors to enhance the operator’s visual acuity for precise aerial refueling control. This paper reviews the design considerations, trade-offs, and other factors related to the selection and ruggedization of the 3D display technology for this military application.

Review of the evolution of display technologies for next-generation aircraft

Advancements in electronic display technologies have provided many benefits for military avionics. The modernization of legacy tanker transport aircraft along with the development of next-generation platforms, such as the KC-46 aerial refueling tanker, offers a timeline of the evolution of avionics display approaches. The adaptation of advanced flight displays from the Boeing 787 for the KC-46 flight deck also provides examples of how avionics display solutions may be leveraged across commercial and military flight decks to realize greater situational awareness and improve overall mission effectiveness. This paper provides a review of the display technology advancements that have led to today’s advanced avionics displays for the next-generation KC-46 tanker aircraft. In particular, progress in display operating modes, backlighting, packaging, and ruggedization will be discussed along with display certification considerations across military and civilian platforms.

Current state of OLED technology relative to military avionics requirements

The paper will review optical and environmental performance thresholds required for OLED technology to be used on various military platforms. Life study results will be summarized to highlight trends while identifying remaining performance gaps to make this technology viable for future military avionics platforms.

Design Issues for Stereo Vision Systems Used on Tele-operated Robotic Platforms

The use of tele-operated Unmanned Ground Vehicles (UGVs) for military uses has grown significantly in recent years with operations in both Iraq and Afghanistan. In both cases the safety of the Soldier or technician performing the mission is improved by the large standoff distances afforded by the use of the UGV, but the full performance capability of the robotic system is not utilized due to insufficient depth perception provided by the standard two dimensional video system, causing the operator to slow the mission to ensure the safety of the UGV given the uncertainty of the perceived scene using 2D. To address this Polaris Sensor Technologies has developed, in a series of developments funded by the Leonard Wood Institute at Ft. Leonard Wood, MO, a prototype Stereo Vision Upgrade (SVU) Kit for the Foster-Miller TALON IV robot which provides the operator with improved depth perception and situational awareness, allowing for shorter mission times and higher success rates. Because there are multiple 2D cameras being replaced by stereo camera systems in the SVU Kit, and because the needs of the camera systems for each phase of a mission vary, there are a number of tradeoffs and design choices that must be made in developing such a system for robotic tele-operation. Additionally, human factors design criteria drive optical parameters of the camera systems which must be matched to the display system being used. The problem space for such an upgrade kit will be defined, and the choices made in the development of this particular SVU Kit will be discussed.

3D display for enhanced tele-operation and other applications

In this paper, we report on the use of a 3D vision field upgrade kit for TALON robot consisting of a replacement flat panel stereoscopic display, and multiple stereo camera systems. An assessment of the systems use for robotic driving, manipulation, and surveillance operations was conducted. A replacement display, replacement mast camera with zoom, auto-focus, and variable convergence, and a replacement gripper camera with fixed focus and zoom comprise the upgrade kit. The stereo mast camera allows for improved driving and situational awareness as well as scene survey. The stereo gripper camera allows for improved manipulation in typical TALON missions.

High-definition 3D display for training applications

In this paper, we report on the development of a high definition stereoscopic liquid crystal display for use in training applications. The display technology provides full spatial and temporal resolution on a liquid crystal display panel consisting of 1920×1200 pixels at 60 frames per second. Display content can include mixed 2D and 3D data. Source data can be 3D video from cameras, computer generated imagery, or fused data from a variety of sensor modalities. Discussion of the use of this display technology in military and medical industries will be included. Examples of use in simulation and training for robot tele-operation, helicopter landing, surgical procedures, and vehicle repair, as well as for DoD mission rehearsal will be presented.

High-definition 3D display for enhanced visualization

In this paper, we report on the development of a high definition stereoscopic liquid crystal display for use in a variety of applications. The display technology provides full spatial and temporal resolution on a liquid crystal display panel consisting of 1920×1200 pixels at 60 frames per second. Applications include training, mission rehearsal and planning, and enhanced visualization. Display content can include mixed 2D and 3D data. Source data can be 3D video from cameras, computer generated imagery, or fused data from a variety of sensor modalities. Recent work involving generation of 3D terrain from aerial imagery will be demonstrated. Discussion of the use of this display technology in military and medical industries will be included.