Cindy Chamberland

A Cognitive and Affective Neuroergonomics Approach to Game Design

While the usefulness of games extends beyond their entertainment value, the act of playing a game remains essentially tied to its positive experience. Techniques to assess the player’s experience have greatly improved in the past decade, yet several challenges remain such as identifying objective and dynamic measures that reflect the player’s emotions during the game. In this paper, we describe an innovative approach to capture the player’s experience that relies on cognitive sciences and affective neuroscience. Our research endeavor is to contribute to the development of systems capable of predicting the player’s fun based on psychophysiology and in-game behaviors, and adapting the game to maximize that value. We present a use case of our techniques to elicit the player’s affective and cognitive states using an online strategic card game. Preliminary results revealed that electrodermal and respiratory activities were positively associated to the casual gamers’ affective and cognitive states. Such findings suggest that psychophysiological metrics combined with behavioural measures offer a promising avenue to assess the player’s experience in a comprehensive and objective manner.

Task switching and serial memory: looking into the nature of switches and tasks.

Task switching research has so far focused on the impact of switching task-sets between two-choice classification tasks that require little or no memory load. Empirical work is lacking however to determine whether the switching cost can be extended to other cognitive activities and to different types of switches. In the present study, switching between the content - verbal to spatial - of the tasks was contrasted with switching cognitive processes - categorization to serial memory. Our pattern of results revealed the absence of local and general switch costs on serial memory tasks, while substantial costs were observed with two-choice judgement tasks. Such a finding challenges the widely accepted assumption that task alternation comes with a considerable cost in performance regardless of the cognitive tasks undertaken. Our results are discussed in context of the predominant models of task switching.

Insights from Eye Movement into Dynamic Decision-Making Research and Usability Testing

This study shows how the use of various measures of eye movement can serve to portray dynamic decision-making (DDM) in a coherent fashion. We extracted eye movement metrics relative to 1) scanpath, 2) eye fixations, and 3) pupillary response, to characterize DDM during the process of risk assessment. Results from Experiment 1 revealed that incorrect classifications were associated with 1) less efficient information search, 2) difficulties in making sense of critical information, and 3) a low level of cognitive load. In Experiment 2, we used eye tracking to assess the impact on DDM of introducing a decision support system. The addition of a temporal-overview display seems to affect processing time in DDM as indexed by shorter scanpaths and fixations during classifications. These findings illustrate how event-based eye movement measures can reveal characteristics and limitations of the ongoing cognitive processing involved in DDM and also contribute to usability testing.

The Impact of Communication Training in High Fidelity Simulation of Emergency ICU Resuscitation

The intensive care unit (ICU) is a high-risk environment that requires cross-professional teams to provide life-saving patient care. There is ample evidence that poor communication creates situations where medical errors are likely to occur and affect patient safety. We tested whether communication-oriented debriefing following high-fidelity simulation improves quality of information exchange reflecting collaborative work in ICU teams. Ten teams of six cross-professional ICU workers participated in three simulation-based training sessions. After each training session, the experimental group was debriefed on communication-oriented skills (based on Crew Resource Management, CRM), while the control group was debriefed on technical skills. The analysis was double-blind; 30 videotaped sessions were coded for three types of communication measures by four observers showing adequate inter-rater reliability. Results suggest that high-fidelity simulation training can improve non-technical skills in cross-professional ICU teams. Further investigation is needed on the performance effects of communication-focused debriefing.

Priority or Parity? Scanning Strategies and Detection Performance of Novice Operators in Urban Surveillance

Closed-circuit television (CCTV) is increasingly used as a means to ensure the safety and security of critical infrastructure and public spaces. Operators in control rooms are responsible for monitoring multiple camera feeds that generally exceed the number of screens available. Using a realistic video surveillance simulation, the current study investigates strategies that untrained operators use to deal with this visual overload. The majority of participants adopted a priority strategy by fixating some scenes more than others, as opposed to a parity strategy of devoting roughly equal time across all screens—although participants were largely unaware of the strategy they had used. A parity approach led to better detection performance, perhaps because less time elapsed between viewing each available camera feed thus reducing the probability that an incident could pass unnoticed. The identification of successful scanning strategies can be used to inform operator training.

The Benefits and the Costs of Using Auditory Warning Messages in Dynamic Decision Making Settings

The failure to notice critical changes in both visual and auditory scenes may have important consequences for performance in complex dynamic environments, especially those related to security, such as aviation, surveillance during major events, and command and control of emergency response. Previous work has shown that a significant number of situation changes remain undetected by operators in such environments. In the current study, we examined the impact of using auditory warning messages to support the detection of critical situation changes and to a broader extent the decision making required by the environment. Twenty-two participants performed a radar operator task involving multiple subtasks while detecting critical task-related events that were cued by a specific type of audio message. Results showed that about 22% of the critical changes remained undetected by participants, a percentage similar to that found in previous work using visual cues to support change detection. However, we found that audio messages tended to bias threat evaluation toward perceiving objects as more threatening than they were in reality. Such findings revealed both benefits and costs associated with using audio messages to support change detection in complex dynamic environments.

Gaze-Aware Cognitive Assistant for Multiscreen Surveillance

Surveillance operators must scan multiple camera feeds to ensure timely detection of incidents; however, variability in scanning behavior can lead to untimely/failed detection of critical information in feeds that were neglected for a long period. Using an eye tracker to monitor screen fixations we can calculate (in real-time) the time elapsed since the last scan of each particular feed, allowing the setting-up of targeted countermeasures contingent on operator oculomotor behavior. One avenue is to provide operators with timely alerts to modulate the scan pattern to avoid attentional tunneling and inattentional blindness. We test such an adaptive solution within a major event surveillance simulation and preliminary results show that operator scan behavior can be modulated, although further investigation is required to determine warning frequency and modality to optimize the balance between saliency and workload increase. Future work will focus on adding a real-time vigilance detection and countermeasure capability.

Pip and Pop: When Auditory Alarms Facilitate Visual Change Detection in Dynamic Settings

Dynamic and complex command and control situations often require the timely recognition of changes in the environment in order to detect potentially malicious actions. Change detection can be challenging within a continually evolving scene, and particularly under multitasking conditions whereby attention is necessarily divided between several subtasks. On-screen tools can assist with detection (e.g., providing a visual record of changes, ensuring that none are overlooked), however, in a high workload environment, this may result in information overload to the detriment of the primary task. One alternative is to exploit the auditory modality as a means to support visual change detection. In the current study, we use a naval air-warfare simulation, and introduce an auditory alarm to coincide with critical visual changes (in aircraft speed/direction) on the radar. We found that participants detected a greater percentage of visual changes and were significantly quicker to detect these changes when they were accompanied by an auditory alarm than when they were not. Furthermore, participants reported that mental demand was lower in the auditory alarm condition, and this was reflected in reduced classification omissions on the primary task. Results are discussed in relation to Wickens’ multiple resource theory of attention and indicate the potential for using the auditory modality to facilitate visual change detection.