Barbara G. Kanki

Using virtual reality technology for aircraft visual inspection training: presence and comparison studies

The aircraft maintenance industry is a complex system consisting of several interrelated human and machine components. Recognizing this, the Federal Aviation Administration (FAA) has pursued human factors related research. In the maintenance arena the research has focused on the aircraft inspection process and the aircraft inspector. Training has been identified as the primary intervention strategy to improve the quality and reliability of aircraft inspection. If training is to be successful, it is critical that we provide aircraft inspectors with appropriate training tools and environment. In response to this need, the paper outlines the development of a virtual reality (VR) system for aircraft inspection training. VR has generated much excitement but little formal proof that it is useful. However, since VR interfaces are difficult and expensive to build, the computer graphics community needs to be able to predict which applications will benefit from VR. To address this important issue, this research measured the degree of immersion and presence felt by subjects in a virtual environment simulator. Specifically, it conducted two controlled studies using the VR system developed for visual inspection task of an aft-cargo bay at the VR Lab of Clemson University. Beyond assembling the visual inspection virtual environment, a significant goal of this project was to explore subjective presence as it affects task performance. The results of this study indicated that the system scored high on the issues related to the degree of presence felt by the subjects. As a next logical step, this study, then, compared VR to an existing PC-based aircraft inspection simulator. The results showed that the VR system was better and preferred over the PC-based training tool.

Validation of a tool to measure and promote clinical teamwork.

Objective: Human factors and teamwork are major contributors to sentinel events. A major limitation to improving human factors and teamwork is the paucity of objective validated measurement tools. Our goal was to develop a brief tool that could be used to objectively evaluate teamwork in the field during short clinical team simulations and in everyday clinical care. Study Design: A pilot validation study. Standardized videos were created demonstrating poor, average, and excellent teamwork among an obstetric team in a common clinical scenario (shoulder dystocia). Three evaluators all trained in Crew Resource Management, and unaware of assigned teamwork level, independently reviewed videos and evaluated teamwork using the Clinical Teamwork Scale (CTS). Statistical analysis included calculation of the Kappa statistic and Kendall coefficient to evaluate agreement and score concordance among raters, and Interclass Correlation Coefficient (ICC) to evaluate interrater reliability. The reliability of the tool was further evaluated by estimating the variance of each component of the tool based on generalizability theory. Results: There was substantial agreement (Kappa 0.78) and score concordance (Kendall coefficient 0.95) among raters, and excellent interrater reliability (interclass correlation coefficient 0.98). The highest percentage of variance in scores among raters was because of rater/item interaction. Conclusion: The CTS was developed to efficiently measure key clinical teamwork skills during simulation exercises and in everyday clinical care. It contains 15 questions in 5 clinical teamwork domains (communication, situational awareness, decision-making, role responsibility, and patient friendliness). It is easy to use and has construct validity with median ratings consistently corresponding with the intended teamwork level. The CTS is a brief, straightforward, valid, reliable, and easy-to-use tool to measure key factors in teamwork in simulated and clinical settings.

COMMUNICATION AND CREW RESOURCE MANAGEMENT.

Abstract As in other complex, sociotechnical systems, communication plays an important role in accomplishing goals, and coordinating individuals and tasks. Thus, the effective communication for safe and efficient flight operations is a critical part of Crew Resource Management (CRM) training. Over the years, the basic concepts and history have not changed significantly, but the chapter has been updated to reflect how communication as a CRM skill has evolved and how it relates to changes in the operational environment, enhanced technology aircraft and airspace systems. In addition, the communication concept is considered beyond the flight deck including cross-functional teams and the organization as a whole.

Binocular eye tracking in virtual reality for inspection training

This paper describes the development of a binocular eye tracking Virtual Reality system for aircraft inspection training. The aesthetic appearance of the environment is driven by standard graphical techniques augmented by realistic texture maps of the physical environment. A “virtual flashlight” is provided to simulate a tool used by inspectors. The users gaze direction, as well as head position and orientation, are tracked to allow recording of the users gaze locations within the environment. These gaze locations, or scanpaths, are calculated as gaze/polygon intersections, enabling comparison of fixated points with stored locations of artificially generated defects located in the environment interior. Recorded scanpaths provide a means of comparison of the performance of experts to novices, thereby gauging the effects of training.

Mobile In Situ Obstetric Emergency Simulation and Teamwork Training to Improve Maternal-Fetal Safety in Hospitals

BACKGROUND Evidence from other high-risk industries has demonstrated that teamwork skills can be taught and effective teamwork may improve safety. Increasingly, health care providers, hospital administrators, and quality and safety professionals are considering simulation as a strategy to improve quality and patient safety. MOBILE OBSTETRIC SIMULATION AND TEAM TRAINING PROGRAM A mobile obstetric emergency simulation and team training program was created to bring simulation technology and teamwork training used routinely in other high reliability fields directly to health care institutions. A mobile unit constituted a practical approach, given the expense of simulation equipment, the time required for staff to develop educational materials and simulation scenarios, and the need to have a standardized program to promote consistent evaluation across sites. Between 2007 and 2009, in situ simulation of obstetric emergencies and teamwork training was tested with more than 150 health care professionals in labor and delivery units across four rural and two community hospitals in Oregon. HOW DO ORGANIZATIONS DETERMINE WHICH TYPE OF SIMULATION IS BEST FOR THEM? Because simulation technologies are relatively costly to start and maintain, it can be challenging for hospitals and health care professionals to determine which format (send staff to a simulation center, develop in-house simulation program, develop a consortium of hospitals that run a simulation program, or use a mobile simulation program) is best for them. CONCLUSIONS In situ simulation is an effective way to develop new skills, to maintain infrequently used clinical skills even among experienced clinical teams, and to uncover and address latent safety threats in the clinical setting.

AN EVALUATION OF THE TAXIWAY NAVIGATION AND SITUATION AWARENESS (T-NASA) SYSTEM IN HIGH-FIDELITY SIMULATION

The effects of an electronic moving map and a HUD on ground taxi performance in reduced visibility were examined in a high-fidelity simulation. Sixteen commercial flight crews completed 21 trials, each consisting of an autoland arrival to Chicago O’Hare and taxi to an apron area. Relative to a baseline (paper-chart only) condition, the EMM/HUD combination increased forward speed by 21%, and reduced navigation errors by nearly 100%. These results, together with workload ratings, situation awareness ratings, analyses of crew interactions, and pilot feedback, provide strong evidence that the combination of head-up symbology and an EMM can substantially improve both the efficiency and the safety of ground operations.

Best Practices in Shift Turnovers: Implications for Reducing Aviation Maintenance Turnover Errors as Revealed in ASRS Reports

Effective shift turnover is critical to safety in many work environments, including medicine, the oil industry, and aviation maintenance. To gain insight into aviation maintenance turnover procedures and possible improvements to them, we examined NASA Aviation Safety Reporting System (ASRS) maintenance incident reports involving shift turnover communication problems. We used the Boeing Maintenance Error Decision Aid (MEDA) coding system to code 1,182 ASRS maintenance incident reports. We compared the incidents involving shift turnover-related communication problems (n = 46) with incidents involving non-turnover-related communication problems (n = 37) and with other maintenance incidents (n = 1,099). Turnover-related incidents involved a significantly higher proportion of equipment that was classified by ASRS as “critical” than either of the other 2 samples, and had a significantly higher proportion of severe consequences. We suggest improvements to turnover work practices and include a generic checklist for effective turnovers to aid in turnover development.

Patterns of Error in Confidential Maintenance Incident Reports

Confidential reports of maintenance incidents are a valuable source of information on maintenance errors and the contexts within which they occur. NASAs Aviation Safety Reporting System has been receiving an increasing number of maintenance incident reports since a specialized maintenance reporting form was introduced in 1996. In a series of studies, the database of ASRS maintenance incidents was examined using correspondence analysis, a statistical technique that converts complex data tables into a visual form. The analyses revealed patterns within the ASRS data set that would have otherwise been difficult to detect. The results have implications for a range of purposes including human factors training, the design of procedures, and the identification of improvements in aircraft design.

Using Virtual Reality Technology to Improve Aircraft Inspection Performance: Presence and Performance Measurement Studies

Research in aircraft inspection and maintenance has revealed the criticality of human inspection performance in improving aviation safety. If we are to provide the general public with a safe and reliable air transportation system, inspection must be performed effectively, efficiently and consistently. Even though it is difficult to eliminate errors completely, continuing emphasis must be placed on identifying interventions to reduce errors and improve consistency in performance. Training has been identified as the primary intervention strategy in improving the quality and reliability of aircraft inspection performance. If training is to be successful, it is clear that we need to provide aircraft inspectors with tools to help enhance their inspection skills and improve performance. In response to this need a Virtual Reality (VR) based simulator was developed for visual inspection task of an aft cargo bay. Presence and performance validation studies were conducted to evaluate the simulator and are described as part of this paper.

Identifying Human Factors Issues in Aircraft Maintenance Operations

Maintenance operations incidents submitted to the Aviation Safety Reporting System (ASRS) between 1986-1992 were systematically analyzed in order to identify issues relevant to human factors and crew coordination. This exploratory analysis involved 95 ASRS reports which represented a wide range of maintenance incidents. The reports were coded and analyzed according to the type of error (e.g, wrong part, procedural error, non-procedural error), contributing factors (e.g., individual, within-team, cross-team, procedure, tools), result of the error (e.g., aircraft damage or not) as well as the operational impact (e.g., aircraft flown to destination, air return, delay at gate). The main findings indicate that procedural errors were most common (48.4%) and that individual and team actions contributed to the errors in more than 50% of the cases. As for operational results, most errors were either corrected after landing at the destination (51.6%) or required the flight crew to stop enroute (29.5%). Interactions among these variables are also discussed. This analysis is a first step toward developing a taxonomy of crew coordination problems in maintenance. By understanding what variables are important and how they are interrelated, we may develop intervention strategies that are better tailored to the human factor issues involved.