Peter Berggren

Swedish-Singapore studies of Bayesian modelling techniques for tactical intelligence analysis

In this paper we present the results of an experiment, which combined the Impactorium tool with the RAHS System. We describe the intelligence analysis process supported by the tools and give a brief introduction to the tools. Results from a Swedish study that influenced the version of Impactorium tested in Singapore are reported. We conclude with some suggestions for future studies of Bayesian belief modelling for intelligence analysis.

A user study of the Impact matrix, a fusion based decision support for enhanced situation awareness

Todaypsilas asymmetric threats put new challenges on military decision making. As new technology develops we have new possibilities to support decision making in such environments. However, it is important that the tools developed take into account userspsila (commanderspsila) decision needs. This paper presents some initial user studies of Swedish commanders testing a prototype application developed to answer these new challenges introduced by asymmetric threats. The application aids commanders by supporting situation awareness in terms of providing an overview of incoming intelligence reports and displaying probabilities of future events. The user study focuses on how the tool can support commanderspsila daily decision making activities. The results indicate that the general concept could be useful for Swedish commanders and analysts, but some suggestions for improvements are made. The issues found in this study will inform the continuing evaluation of this tool.

Reoccurring LISREL patterns describing Mental Workload, Situation Awareness and Performance

The main purpose of this paper is to present how LISREL models using subjective ratings is consistent over several studies. That is, the same pattern is repeated each time suggesting that the subjective ratings actually represent something stable and that the responses from the participants are true. The studies all include different subjects in different settings rating different subjective measures on different occasions, locations, and questionnaires. The ratings concern primarily the concepts “Mental Workload”, “Situation Awareness” and “Subjective Performance”.

The relationship between Workload, Teamwork, Situation Awareness, and Performance in Teams: A microworld study

In modern military organizations teamwork performance is central, yet the underlying factors contributing to such performance are debated. The purpose of this paper was to investigate how several known teamwork measures relate to a prior model of operator performance (Nählinder et al, 2004). This study expands this model to the team level and in the command and control domain. Specifically, this paper studies the relationship between individual and team workload measures, situation awareness measures, and performance measures in 18 two-person teams. The study has two major findings: Firstly, the various team cognition measures statistically cluster into four meaningful concepts (workload, teamwork, situation awareness and performance). Secondly, a Structural Equation Model indicates that the relationship between the various individual and team measures can be described in a model resembling the model found in previous studies (Nählinder et al, 2004). In particular, the results show that the general workload in the microworld study has a negative effect on both teamwork and situation awareness. Teamwork, in turn, also affects situation awareness, which has major impact on performance.

Increasing Training Efficiency Using Embedded Pedagogical Tools in a Combat Flight Simulator

Many flight simulators today are made to provide a realistic environment for training. However, they often lack the possibility of providing pedagogical feedback to the person in training as well as feedback to any instructor leading the training. The purpose of this paper was to evaluate the usefulness of several pedagogical tools embedded in a flight simulator and to examine their potential for increasing training efficiency. Twenty students and instructors from the Swedish Air Force Flying Training School volunteered in this study. Seven embedded pedagogical tools were assessed using questionnaires. There was a quite consistent opinion in favor of the pedagogical tools implying that the embedded pedagogical tools is the way forward in training simulator development. The results from the present study are believed to be equally valid in many other areas besides flight simulators.

Dynamic Measures for Performance Assessment in Complex Environments

The command and control environment is a dynamic and complex setting with complicated technical systems where teams of operators interact to reach shared goals. This paper presents a study where a quasi-dynamic evaluation technique was used to assess performance. Nine operators from the Swedish Air Force participated in a peace support operation scenario in an operational setting. Data was collected by a repeated measurement technique to measure performance, workload, situation awareness, complexity, team coordination and sharing of information. A causal model was derived from the data which shows the relations between mental workload, individual performance and team performance. An efficiency index was calculated showing that the operators performed better over time, even though complexity increased. The use of the repeated measurement technique proved to be successful for measuring complex and dynamic events.

The shared priorities measure as a way of assessing team strategic awareness: a bridge between self-assessment and the deep blue sea of field recordings

Objective, easy to use, easy to comprehend, high face-validity assessment methods for measuring shared awareness in teams are hard to find. This paper describes an experiment where a new measure called Shared Priorities, which is based on ranking of self-generated strategic items, is tested. Trained teams were compared to non-trained teams in a dynamic problem-solving task in terms of performance and shared awareness. The shared priorities measure was used alongside other, well-documented measures of team awareness based on self-rating. The results show that the Shared Priorities measure correlate with performance and could also distinguish between trained and non-trained teams. However, the Shared Priorities measure did not correlate with the other team measures, suggesting that it captures a different quality of team work than the self-rating measures. Further, the shared priorities measure was found to be easily administered and gained a high user acceptance.

Assessing the quality of Shared Priorities in teams using content analysis in a microworld experiment

ABSTRACT Objective, easy to use, and easy to comprehend assessment methods for measuring shared understanding in teams are hard to find. This paper describes an experiment where a measure called Shared Priorities, which is based on ranking of self-generated strategic items, is assessed. Trained teams were compared to non-trained teams in a dynamic problem-solving task. The maturity of the participating teams was also assessed using a content analysis measure. The Shared Priorities measure was used alongside other well-documented measures of team awareness based on self-rating. Results show that the Shared Priorities measure correlates with task performance and could also distinguish between trained and non-trained teams. However, the Shared Priorities measure did not correlate with the other team measures (cf. CARS – Crew Awareness Rating Scale – and DATMA – Distributed Assessment of Team Mutual Awareness), suggesting that it captures a different quality of teamwork than the self-rating measures. Further, the Shared Priorities measure was found to be easily administered.

Statistical modelling of team training in a microworld study

A command and control environment is a dynamic and complex setting with complicated technical systems where teams of operators interact to reach shared goals. This study presents an experiment in which we, by means of Structural Equation Modeling (SEM), explain the relations between basic concepts of command and control environments: mental workload, frustration, situational awareness, and performance. This paper reports a LISREL analysis of the Baroutsi, Berggren, Nählinder, & Johansson (2013) data. From that data, a new latent variable “Frustration” emerges, which now can be included in the model.

Dynamic Assessment of Pilot Mental Status

Modern flight and weapon platforms are becoming more and more sophisticated. New sensors and weapon systems are added, giving the operator more information to process before acting or deciding. Today, many pilots feel they reach their information processing limits during difficult missions and during difficult circumstances. The purpose of the present study has been to measure mental workload, situational awareness and performance during specific air-to-ground missions in both simulated and real flight in order to assess operator status. Specifically to compare simulated versus real flight regarding the concepts, to analyze the relationships between physiological reactions, situational awareness, and experienced mental workload and also develop and test causal models of operator function. A second purpose of the study was to develop practically useful methods for analyzing mental workload and performance during operative conditions.