James E. Melzer

Ecological approach to partial binocular overlap

A partial binocular-overlap helmet-mounted display (HMD) allows the presentation of wide-field-of-view imagery with no loss of resolution and a reduction in size and weight. One trade-off with these attributes is binocular rivalry created by the edge of the imagery seen by one eye overlaying continuous imagery seen by the other eye. Three distinct methods are considered that reduce this rivalry--and there are trade-offs with each approach. These three methods are the use of optical stops or filters that provide a luminance gradation that softens the overlapping binocular edges, left/right eye assignment for the flanking monocular regions, and contour lines superimposed on the imagery that correspond to the binocular/monocular borders. These approaches to improving the quality of partial binocular- overlap HMD imagery are considered within an ecological framework, where departures from ecological validity may impact visual perception and system performance.

Overcoming the Field of View: Resolution Invariant In Head Mounted Displays

The Integrated Maintenance and Logistics Soldier System advanced mobile information system for vehicle and weapon system integrated maintenance and logistics will expedite the successful completion of military mission objectives through enhanced situation awareness and reduced mean-time- to-repair for the Force XXI Army.

Partial Binocular-Overlap In Helmet-Mounted Displays

One approach to decreasing the size and weight of a helmet-mounted display while maintaining a wide-field-of-view and adequate image resolution is to use a partial binocular-overlap configuration. With a partial binocular-overlap helmet-mounted display the user would see a central binocular image flanked by two monocular images. Properly implemented, the user should not be aware of the partial-overlap condition, but would benefit from the reduced weight, decreased size, and extended field-of-view. However, the successful implementation of a partial-overlap design requires understanding of and solutions for several complex problems.

HMDs as enablers of situation awareness: the OODA loop and sense-making

Helmet-Mounted Displays have been shown to be powerful tools that can unlock the pilot from the interior of the cockpit or the forward line of sight of the Head-Up Display. Imagery that is presented in one of three reference frames can enable the pilots to do their job more effectively while simultaneously decreasing workload. This paper will review key attributes of Situation Awareness, the Observe/Orient/Decide/Act (OODA) Loop and Sensemaking and how HMDs can aid the pilot in achieving these ideal cognitive states.

The Cognitive Pilot Helmet: enabling pilot-aware smart avionics

We hypothesize that human-aware helmet display systems can drastically improve situation awareness (SA), reduce workload, and become the cognitive gateway to two-way human-systems information. We designed a ruggedized prototype helmet liner that was fitted with active electroencephalogram (EEG) electrodes and pulse oxymetry sensor. This liner was integrated into a helmet that was fitted with a binocular SR-100A helmet mounted display. We modified the SR-100A to include dual-eye tracking capability. The resulting system is able to pick up physiological signals from the wearer in real-time for cognitive state characterization by the Cognitive Avionics Tool Set (CATS). We conducted a preliminary test of the cognitive state estimation system in a simulated close-air-support task in the laboratory and found that workload throughout the mission could be gauged using physiological parameters. Cognitively-linked helmet systems can increase situation awareness by metering the amount of information based on available cognitive bandwidth and eventually, we feel that they will be able to provide anticipatory information to the user by means of cognitive intent recognition. Considerable design challenges lie ahead to create robust models of cognitive state characterization and intent recognition. However, the rewards of such efforts could be systems that allow a dramatic increase in human decision making ability and productivity in dynamical complex situations such as air combat or surface warfare.

Integrated headgear for the Future Force Warrior and beyond

The ground soldier of the future will benefit from current developments in electronics, lightweight ballistic materials, and importantly, displays and sensors. The Armys Future Force Warrior program is taking advantage of initiatives in both government and industry labs as well as human factors information to demonstrate the advantages they can provide. This paper will discuss the Integrated Headgear System, a synthesis of protection and information for the infantry soldier.

Design evolution of a wide-field-of-view head-mounted display for aircraft training and simulation

A full-color Head Mounted Display (HMD) with both wide field of view and high resolution is very useful for aircraft flight simulation and training. This paper will describe the design evolution of the SIM EYETM from its inception as a monochrome, flight-worthy helmet-mounted display, through its changes to the current a wide field of view, full color, high-resolution HMD.

Sensor-offset HMD perception and performance

The perceptual and performance effects of viewing HMD sensor-offset video were investigated in a series of small studies and demonstrations. A sensor-offset simulator was developed with three sensor positions relative to left-eye viewing: inline and forward, temporal and level, and high and centered. Several manual tasks were used to test the effect of sensor offset: card sorting, blind pointing and open-eye pointing. An obstacle course task was also used, followed by a more careful look at avoiding specific obstacles. Once the arm and hand were within the sensor field of view, the user demonstrated the ability to readily move to the target regardless of the sensor offset. A model of sensor offset was developed to account for these results.

Integrated headgear for the future force warrior: results of the first field evaluations

The development of an advanced ground soldiers integrated headgear system for the Armys Future Force Warrior Program passed a major milestone during 2006. Field testing of functional headgear systems by small combat units demonstrated that the headgear capabilities were mature enough to move beyond the advanced technology demonstration (ATD) phase. This paper will describe the final system with test results from the three field exercises and will address the strengths and weaknesses of the headgear system features, head mounted sensors, displays and sensor fusion.

Color helmet display for the tactical environment: the pilot's chromatic perspective

The applications of color symbology, graphics, and imagery in helmet-mounted displays have the potential to reduce workload and improve piloting performance. Unfortunately, there are three well-recognized paradigms that disallow the use of color in helmet-mounted displays in aviation environments. We provide evidence of three corresponding paradigm shfts that encourage the use of color in these displays. The rationales for these paradigm shifts are based on new methods of training and rehearsing, new lighting environments, and new display technologies.