Dietrich Grasshoff

How to measure monitoring performance of pilots and air traffic controllers

In prior research on the future of aviation it was established that operators will have to work with highly automated systems. Increasing automation will require operators monitoring appropriately (OMA). OMA are expected to demonstrate the use of distinctly different monitoring phases (orientation, anticipation, detection, and recheck). Within these phases, they must grasp in time the relevant information that would enable them to take control should automation fail. The presented study aims at finding appropriate measurements for the identification of OMA on the basis of eye tracking. In order to do this, a normative model of adequate monitoring behavior was designed including the definition of areas of interest. We tested 90 participants who had to monitor a dynamic automatic process, and then take control. In order to decide on suitable eye tracking parameters it was asked which parameters are significantly related to manual control performance. The results show that the suitability of parameters depends on the specific phase of the monitoring process. Gaze durations allow for differentiating between high and low performing subjects during orientation phases. In contrast, relative fixation counts are suitable for predicting monitoring performance during detection phases. In general, the results support the assumption that eye tracking parameters are appropriate for identifying OMA.

Future Ability Requirements for Human Operators in Aviation

The present study addresses the optimal fit between technical innovations in aviation and aircraft operators. Because of the increase in computerization, an accurate and efficient monitoring of the automation poses a key challenge to future operators. As the German Aerospace Centers Department of Aviation and Space Psychology is responsible for personnel selection of pilots and air traffic controllers, our objective for the selection of future personnel is to distinguish good monitoring operators from bad operators. In order to identify good monitoring behavior we developed a simulation tool that represents tasks of pilots and controllers within a dynamic air traffic flow. Participants have either to monitor the automatic process or to control the dynamic traffic manually. Monitoring behavior is measured by recording eye movement parameters. The identification of accurate monitoring behavior enables us to adapt selection profiles to future ability requirements.

On the Development of a Monitoring Test for the Selection of Aviation Operators

In future ATM systems aviation operators will have to work with highly automated systems. According to prior research operational monitoring will become a prominent aspect of task performance [1]. Thus, operators monitoring appropriately will be needed, being able to detect system errors in time and to take over control if automation fails. To monitor appropriately, different monitoring phases orientation, anticipation, detection, and recheck have to be performed by the subjects. Within these phases, the relevant information should be gathered to enable taking over full control, once automation should fail. Based on this model of appropriate monitoring behavior [2, 3], the present study focuses on the development of a monitoring test for the selection of future operators in the field of aviation.