Kevin J. Shelton

Design and Testing of an Unlimited Field-of-regard Synthetic Vision Head-worn Display for Commercial Aircraft Surface Operations

Experiments and flight tests have shown that a Head-Up Display (HUD) and a head-down, electronic moving map (EMM) can be enhanced with Synthetic Vision for airport surface operations. While great success in ground operations was demonstrated with a HUD, the research noted that two major HUD limitations during ground operations were their monochrome form and limited, fixed field of regard. A potential solution to these limitations found with HUDs may be emerging Head Worn Displays (HWDs). HWDs are small, lightweight full color display devices that may be worn without significant encumbrance to the user. By coupling the HWD with a head tracker, unlimited field-of-regard may be realized for commercial aviation applications. In the proposed paper, the results of two ground simulation experiments conducted at NASA Langley are summarized. The experiments evaluated the efficacy of head-worn display applications of Synthetic Vision and Enhanced Vision technology to enhance transport aircraft surface operations. The two studies tested a combined six display concepts: (1) paper charts with existing cockpit displays, (2) baseline consisting of existing cockpit displays including a Class III electronic flight bag display of the airport surface; (3) an advanced baseline that also included displayed traffic and routing information, (4) a modified version of a HUD and EMM display demonstrated in previous research; (5) an unlimited field-of-regard, full color, head-tracked HWD with a conformal 3-D synthetic vision surface view; and (6) a fully integrated HWD concept. The fully integrated HWD concept is a head-tracked, color, unlimited field-of-regard concept that provides a 3-D conformal synthetic view of the airport surface integrated with advanced taxi route clearance, taxi precision guidance, and data-link capability. The results of the experiments showed that the fully integrated HWD provided greater path performance compared to using paper charts alone. Further, when comparing the HWD with the HUD concept, there were no differences in path performance. In addition, the HWD and HUD concepts were rated via paired-comparisons the same in terms of situational awareness and workload. However, there were over twice as many taxi incursion events with the HUD than the HWD.

Collision Avoidance for Airport Traffic simulation evaluation

A Collision Avoidance for Airport Traffic (CAAT) concept for the airport Terminal Maneuvering Area (TMA) was evaluated in a simulation study at the National Aeronautics and Space Administration (NASA) Langley Research Center. CAAT is being designed to enhance surface situation awareness and provide cockpit alerts of potential conflicts during runway, taxi, and low altitude air-to-air operations. The purpose of the study was to evaluate pilot reaction to conflict events in the TMA near the airport, different alert timings for various scenarios, alerting display concepts, and directive alerting concepts. This paper gives an overview of the conflict detection and resolution (CD&R) concept, simulation study, and test results.

Synthetic Vision Enhanced Surface Operations With Head-Worn Display for Commercial Aircraft

Efficiency and safety of airport surface operations can be enhanced by using synthetic vision and associated technologies, employed on a head-up display (HUD) combined with a head-down display electronic moving map. Past research has noted that 2 major limitations of HUDs during ground operations were its monochrome form and its limited, fixed field of regard. These limitations can be overcome with the use of a head-worn display (HWD). This article describes the results of a simulation experiment that showed that a fully integrated HWD concept provided significantly improved path performance compared to using paper charts alone. When comparing the HWD and HUD concepts, there were no differences found for path performance or subjective ratings of workload and marginally significant differences found for reported situation awareness and pilot comments of perceived system safety. Implications and directions for future research are described.

Synthetic vision for lunar and planetary landing vehicles

The Crew Vehicle Interface (CVI) group of the Integrated Intelligent Flight Deck Technologies (IIFDT) has done extensive research in the area of Synthetic Vision (SV), and has shown that SV technology can substantially enhance flight crew situation awareness, reduce pilot workload, promote flight path control precision and improve aviation safety. SV technology is being extended to evaluate its utility for lunar and planetary exploration vehicles. SV may hold significant potential for many lunar and planetary missions since the SV presentation provides a computer-generated view of the terrain and other significant environment characteristics independent of the outside visibility conditions, window locations, or vehicle attributes. SV allows unconstrained control of the computer-generated scene lighting, terrain coloring, and virtual camera angles which may provide invaluable visual cues to pilots/astronauts and in addition, important vehicle state information may be conformally displayed on the view such as forward and down velocities, altitude, and fuel remaining to enhance trajectory control and vehicle system status. This paper discusses preliminary SV concepts for tactical and strategic displays for a lunar landing vehicle. The technical challenges and potential solutions to SV applications for the lunar landing mission are explored, including the requirements for high resolution terrain lunar maps and an accurate position and orientation of the vehicle that is essential in providing lunar Synthetic Vision System (SVS) cockpit displays. The paper also discusses the technical challenge of creating an accurate synthetic terrain portrayal using an ellipsoid lunar digital elevation model which eliminates projection errors and can be efficiently rendered in real-time.

Visual advantage of enhanced flight vision system during NextGen flight test evaluation

Synthetic Vision Systems and Enhanced Flight Vision System (SVS/EFVS) technologies have the potential to provide additional margins of safety for aircrew performance and enable operational improvements for low visibility operations in the terminal area environment. Simulation and flight tests were jointly sponsored by NASA’s Aviation Safety Program, Vehicle Systems Safety Technology project and the Federal Aviation Administration (FAA) to evaluate potential safety and operational benefits of SVS/EFVS technologies in low visibility Next Generation Air Transportation System (NextGen) operations. The flight tests were conducted by a team of Honeywell, Gulfstream Aerospace Corporation and NASA personnel with the goal of obtaining pilot-in-the-loop test data for flight validation, verification, and demonstration of selected SVS/EFVS operational and system-level performance capabilities. Nine test flights were flown in Gulfstream’s G450 flight test aircraft outfitted with the SVS/EFVS technologies under low visibility instrument meteorological conditions. Evaluation pilots flew 108 approaches in low visibility weather conditions (600 feet to 3600 feet reported visibility) under different obscurants (mist, fog, drizzle fog, frozen fog) and sky cover (broken, overcast). Flight test videos were evaluated at three different altitudes (decision altitude, 100 feet radar altitude, and touchdown) to determine the visual advantage afforded to the pilot using the EFVS/Forward-Looking InfraRed (FLIR) imagery compared to natural vision. Results indicate the EFVS provided a visual advantage of two to three times over that of the out-the-window (OTW) view. The EFVS allowed pilots to view the runway environment, specifically runway lights, before they would be able to OTW with natural vision.

Synthetic and Enhanced Vision Systems (SEVS) for NextGen simulation and flight test performance evaluation

The Synthetic and Enhanced Vision Systems for NextGen (SEVS) simulation and flight tests are jointly sponsored by NASAs Aviation Safety Program, Vehicle Systems Safety Technology project and the Federal Aviation Administration (FAA). The flight tests were conducted by a team of Honeywell, Gulfstream Aerospace Corporation and NASA personnel with the goal of obtaining pilot-in-the-loop test data for flight validation, verification, and demonstration of selected SEVS operational and system-level performance capabilities. Nine test flights (38 flight hours) were conducted over the summer and fall of 2011. The evaluations were flown in Gulfstreams G450 flight test aircraft outfitted with the SEVS technology under very low visibility instrument meteorological conditions. Evaluation pilots flew 108 approaches in low visibility weather conditions (600 ft to 2400 ft visibility) into various airports from Louisiana to Maine. In-situ flight performance and subjective workload and acceptability data were collected in collaboration with ground simulation studies at LaRCs Research Flight Deck simulator.

Transition of Attention in Terminal Area NextGen Operations Using Synthetic Vision Systems

This experiment investigates the capability of Synthetic Vision Systems (SVS) to provide significant situation awareness in terminal area operations, specifically in low visibility conditions. The use of a Head-Up Display (HUD) and Head-Down Displays (HDD) with SVS is contrasted to baseline standard head down displays in terms of induced workload and pilot behavior in 1400 RVR visibility levels. Variances across performance and pilot behavior were reviewed for acceptability when using HUD or HDD with SVS under reduced minimums to acquire the necessary visual components to continue to land. The data suggest superior performance for HUD implementations. Improved attentional behavior is also suggested for HDD implementations of SVS for low-visibility approach and landing operations.

Flight deck interval management and delegated separation for equivalent visual operations

An emerging Next Generation Air Transportation System concept — Equivalent Visual Operations (EVO) — can be achieved using an electronic means to provide sufficient visibility of the external world and other required flight references on flight deck displays that enable the safety, operational tempos, and visual flight rules (VFR)-like procedures for all weather conditions. Synthetic and enhanced flight vision system technologies are critical enabling technologies to EVO. Current research evaluated concepts for flight deck-based interval management (FIM) operations, integrated with Synthetic Vision and Enhanced Vision flight-deck displays and technologies. One concept involves delegated flight deck-based separation, in which the flight crews were paired with another aircraft and responsible for spacing and maintaining separation from the paired aircraft, termed, “equivalent visual separation.” The operation required the flight crews to acquire and maintain an “equivalent visual contact” as well as to conduct manual landings in low-visibility conditions. The paper describes results that evaluated the concept of EVO delegated separation, including an off-nominal scenario in which the lead aircraft was not able to conform to the assigned spacing resulting in a loss of separation.

Surface map traffic intent displays and net-centric datalink communications for NextGen

By 2025, U.S. air traffic is predicted to increase three fold and may strain the current air traffic management system, which may not be able to accommodate this growth. In response to this challenge, a revolutionary new concept has been proposed for U.S. aviation operations, termed the Next Generation Air Transportation System or ¿NextGen¿. Many key capabilities are being identified to enable NextGen, including the use of data-link communications. Because NextGen represents a radically different approach to air traffic management and requires a dramatic shift in the tasks, roles, and responsibilities for the flight deck, there are numerous research issues and challenges that must be overcome to ensure a safe, sustainable air transportation system. Flight deck display and crew-vehicle interaction concepts are being developed that proactively investigate and overcome potential technology and safety barriers that might otherwise constrain the full realization of NextGen. The paper describes simulation research, conducted at National Aeronautics and Space Administration (NASA) Langley Research Center, examining datalink communications and traffic intent data during envisioned four-dimensional trajectory (4DT)-based and equivalent visual (EV) surface operations. Overall, the results suggest that controller pilot datalink communications (CPDLC) with the use of mandatory pilot read-back of all clearances significantly enhanced situation awareness for 4DT and EV surface operations. The depiction of graphical traffic state and intent information on the surface map display further enhanced off-nominal detection and pilot qualitative reports of safety and awareness.

Head-Worn Displays for NextGen

The operating concepts emerging under the Next Generation air transportation system (NextGen) require new technology and procedures - not only on the ground-side - but also on the flight deck. Flight deck display and decision support technologies are specifically targeted to overcome aircraft safety barriers that might otherwise constrain the full realization of NextGen. One such technology is the very lightweight, unobtrusive head-worn display (HWD). HWDs with an integrated head-tracking system are being researched as they offer significant potential benefit under emerging NextGen operational concepts. Two areas of benefit for NextGen are defined. First, the HWD may be designed to be equivalent to the Head-Up Display (HUD) using Virtual HUD concepts. As such, these operational credits may be provided to significantly more aircraft for which HUD installation is neither practical nor possible. Second, the HWD provides unique display capabilities, such as an unlimited field-of-regard. These capabilities may be integral to emerging NextGen operational concepts, eliminating safety issues which might otherwise constrain the full realization of NextGen. The paper details recent research results, current HWD technology limitations, and future technology development needed to realize HWDs as a enabling technology for NextGen.