Mark W. Wiggins

Cognitive failure analysis for aircraft accident investigation

Abstract The present studies were undertaken to investigate the applicability of an information processing approach to human failure in the aircraft cockpit. Using data obtained from official aircraft accident investigation reports, a database of accidents and incidents involving New Zealand civil aircraft between 1982 and 1991 was compiled. In the first study, reports were coded into one of three error stages proposed by Nagel (1988) and for the presence of any of 61 specific errors noted by Gerbert and Kemmler (1986). The importance of decisional factors in fatal crashes was noted. Principal components analysis suggested the presence of five different varieties of human failure. In the second study, a more detailed error taxonomy derived from the work of Rasmussen (1982) was applied to the data. Goal selection errors emerged as the most frequent kind of cognitive error in fatal accidents. Aircraft accident reports can be a useful source of information about cognitive failures if probed with an appropria...

Cognitive task analyses for decision centred design and training

This paper presents three case studies of Cognitive Task Analysis (CTA) for defining systems design and training requirements. The approach taken involves a modification of the critical decision method of Klein et al. The authors utilized the revised CDM to obtain information from expert white-water rafting guides, general aviation pilots, and emergency ambulance dispatchers. The information obtained was used to develop multi-media tools for training rafting guides and general aviation pilots, and to redesign the VDU display requirements for the ambulance dispatchers. The examples demonstrate the utility of an approach to CTA that is closely based on relevant theory, and provides guidance to practitioners wishing to apply CTA techniques.

Weatherwise: evaluation of a cue-based training approach for the recognition of deteriorating weather conditions during flight.

Inappropriate and ineffective weather-related decision making continues to account for a significant proportion of general aviation fatalities in the United States and elsewhere. This study details the evaluation of a computer-based training system that was developed to provide visual pilots with the skills necessary to recognize and respond to the cues associated with deteriorating weather conditions during flight. A total of 66 pilots were assigned to one of two groups, and the evaluation process was undertaken at both a self-report and performance level. At the self-report level, the results suggested that pilots were more likely to use the cues following exposure to the training program. From a performance perspective, there is evidence to suggest that cue-based training can improve the timeliness of weather-related decision making during visual flight rules flight. Actual or potential applications of this research include the development of computer-based training systems for fault diagnosis in complex industrial environments.

Expert and novice pilot perceptions of static in-flight images of weather

Weather-related accidents continue to account for a significant proportion of fatal general aviation accidents. The aim of this study was to examine the nature of inflight weather-related decision making in a task involving assessments of inflight weather conditions. Pilots examined 10 photographic images of weather conditions taken during flight and were asked to judge whether it would be possible to continue the flight along the current track and altitude and remain in visual meteorological conditions (VMC). As part of their assessments, respondents were also asked to indicate the extent to which they used various cues. The results indicated that experts and novices appear to use inflight cues differently, although this did not appear to influence perceptions concerning the possibility of flight under VMC. The implications of these results are discussed in terms of the development of appropriate instructional systems.

Expert, intermediate and novice performance during simulated pre-flight decision-making

This study involved a comparison between the process of information acquisition employed by expert, intermediate and novice pilots during simulated pre-flight decision-making. Using a process-tracing approach, comparisons were made between the types of information accessed, the sequence in which this information was accessed, and the decisions formulated during three pre-flight scenarios. Time-constraints, ranging from seven minutes to two minutes, were manipulated to assess the impact on information acquisition. Consistent with the hypothesis, a qualitative difference emerged between the information acquisition strategies employed by novice and intermediate level pilots, and the strategies employed by expert pilots. The implications of these differences are discussed in terms of the initiatives necessary to facilitate the acquisition of expertise amongst less experienced pilots.

The Capability of Static and Dynamic Features to Distinguish Competent From Genuinely Expert Practitioners in Pediatric Diagnosis

Children’s Hospital at Westmead, Sydney, Australia Objective: The authors describe the development of a new, more objective method of distinguishing experienced competent nonexpert from expert practitioners within pediatric intensive care. Background: Expert performance involves the acquisition and use of refined feature-event associations (cues) in the operational environment. Competent nonexperts, although experienced, possess rudimentary cue associations in memory. Thus, they cannot respond as efficiently or as reliably as their expert counterparts, particularly when key diagnostic information is unavail- able, such as that provided by dynamic cues. Method: This study involved the application of four distinct tasks in which the use of relevant cues could be expected to increase both the accuracy and the efficiency of diagnostic performance. These tasks included both static and dynamic stimuli that were varied systematically. A total of 50 experienced pediatric intensive staff took part in the study. Results: The sample clustered into two levels across the tasks: Participants who performed at a consistently high level throughout the four tasks were labeled experts, and participants who performed at a lower level throughout the tasks were labeled competent nonexperts. The groups differed in their responses to the diagnostic scenarios presented in two of the tasks and their ability to maintain performance in the absence of dynamic features. Conclusion: Experienced pediatricians can be decomposed into two groups on the basis of their capacity to acquire and use cues; these groups differ in their diagnostic accuracy and in their ability to maintain performance in the absence of dynamic features. Application: The tasks may be used to identify practitioners who are failing to acquire expertise at a rate consistent with their experience, position, or training. This information may be used to guide targeted training efforts.

An objective approach to identifying diagnostic expertise among power system controllers

Objective: The present study investigated whether performance across a range of cue-based cognitive tasks differentiated the diagnostic performance of power control operators into three distinct groups, characteristic of novice, competence, and expertise. Background: Despite its increasing importance in the contemporary workplace, there is little understanding of the cognitive processes that distinguish novice, competent, and expert performance in the context of remote diagnosis. However, recent evidence suggests that cue acquisition and utilization may represent a mechanism by which the transition from novice to expertise occurs. Method: The study involved the application of four distinct cue-based tasks within the context of power system control. A total of 65 controllers, encompassing a range of industry experience, completed the tasks as part of an in-service training program. Results: Using a cluster analysis, it was possible to extract three distinct groups of operators on the basis of their performance in the cue-based tasks, and these groups corresponded to differences in diagnostic performance. Conclusion: The results indicate assessments of the capacity to extract and utilize cues were able to distinguish expert from competent practitioners in the context of power control. Application: Assessments of the capacity to extract and utilize cues may be used in the future to distinguish expert from nonexpert practitioners, particularly in the context of remote diagnosis.

Cough once for danger: icons versus abstract warnings as informative alerts in civil aviation

Objective: An experiment investigated the efficacy of auditory icons as warning signals in an aviation context. Background: Iconic signals, such as a cough to signal dangerous levels of carbon monoxide, convey information about the nature of an incident and alert the operator that there is a problem, whereas signals that are arbitrarily associated with a critical incident provide relatively less information. Warning recognition speed and accuracy are likely to be influenced by modality of presentation (visual, auditory, auditory + visual) and task demand (low, high). Methods: The 172 participants completed a computer-based training session and test task that involved responding to abstract or iconic auditory (1 s), visual, or auditory + visual warnings associated with seven critical incidents while performing low- and high-demand concurrent tasks. Results: Significantly fewer training trials were required to learn iconic warnings than abstract warnings. An advantage for iconic warnings persisted into the test phase, evident most consistently as greater warning recognition accuracy. The effect was observed in both high- and low-demand conditions. Auditory abstract warnings, in particular, elicited slow reaction times and poor accuracy. Conclusion: Associations between a small number of meaningful environmental sounds and critical incidents can be learned with ease relative to more abstract associations, although training is required and response times are relatively slow. Application: Sets of distinctive auditory iconic warnings can be designed to alert and inform pilots about non-time-pressured events. Potential applications of language-neutral icons as informative warnings include civil, commercial, and defense aircraft.

Remembrance of cases past: who remembers what, when confronting critical flight events?

Recent “naturalistic” theories of decision making emphasize the role of stored prior experiences or cases as a guide to current action. However, there is little empirical evidence on the role that case-based remindings play in real-life decision making. The present study utilized a Web-based survey to collect data about the role of prior cases in pilot decision making about critical flight events. Results showed that more than half of the 1081 pilots who responded could provide details about utilizing a previous case in responding to a critical flight event. These events were most likely to involve weather or equipment failure. The cases were found to be useful in situational assessment rather than option evaluation. The use of cases increased with age and experience. Data obtained from a concurrent conventional survey showed broadly similar results. The implications of these results are that case-based remindings play an important role in expert pilot decision making and that a training system that incorporates case-based learning would be a potentially useful means of improving pilot decision making. Actual or potential applications of this research include the development of case-based training systems to enhance flight training.

Measuring Relative Cue Strength as a Means of Validating an Inventory of Expert Offender Profiling Cues

Cues have been identified as important precursors to successful diagnoses among expert practitioners. However, current approaches to the identification of expert cues typically rely on subjective methods, making the validity of cues difficult to establish. The present research examined the utility of a Paired-Concept Association Task (P-CAT) as a basis for discriminating expert and novice cue activation in the context of offender profiling. Three studies are reported: 1A employed a cognitive interview for the acquisition of cue-based concepts used by experts and novices; 1B presented pairs of concepts as part of the P-CAT, which recorded response latency; and, 1C employed a survey to further gauge participants’ perceptions of the concepts. The results revealed differences between experts and novices in the cue-based associations activated, and in the response latencies associated with the P-CAT, across expertise. The P-CAT accurately discriminated expert from novice cue activation and consequently offers a new method for objectively validating expert cue use.