Matthew Johnston

Augmented Cognition: An Overview

Augmented cognition is a form of human-systems interaction in which a tight coupling between user and computer is achieved via physiological and neurophysiological sensing of a users cognitive state. This interactive paradigm seeks to revolutionize the manner in which humans engage with computers by leveraging this knowledge of cognitive state to precisely adapt user-system interaction in real time. This review provides an overview of contemporary works in the field of augmented cognition and details regarding the three main components of an augmented cognition system: cognitive state sensors, adaptation strategies, and control systems. The review provides a perspective on the field as well as insights into the many challenges that lie ahead for those who endeavor to realize the full potential of augmented cognition.

Results from Pilot Testing a System for Tactile Reception of Advanced Patterns (STRAP)

This paper presents pilot study results on the learnability and effectiveness of the System for Tactile Reception of Advanced Patterns (STRAP) that is capable of displaying complex information through tactile actuators on the users torso. Information requirements from dismounted soldier communications and tactile design guidelines resulted in 56 distinct tactile symbols. To facilitate cognitive demands for decoding, information presentation was formalized by developing construction rules for tactile symbols and a context-free grammar for compilation of tactile sentences. The pilot study outlined trained two participants on the tactile language. Results showed they were able to reach 90% criterion in less than 3.5 hours. Furthermore, once learned, participants were able to receive and comprehend complex commands comprised of multiple tactile symbols under varying levels of workload with some success.

The Physiological Assessment of VE Training System Fidelity

This paper describes the Training Effectiveness Evaluation with neurophysiological metrics: Fidelity Assessment of VE Training Systems (TEE-FAST) framework, which offers a comprehensive assessment of physical, functional and psychological fidelity of VE training systems. TEE-FAST evaluates at the cue level how information is presented to users and how users respond, both behaviorally and physiologically, in both a VE training environment and the related operational (or live training) environment. The differences in cue presentation and user responses across VE and live tasks are evaluated to determine how effective a VE training system is at targeting specified training goals. Evaluation outcomes provide targeted design guidance regarding training utility related to each specified training goal, as well as redesign recommendations to enhance VE system fidelity and training utility.

A Systems Approach to Diagnosing and Measuring Teamwork in Complex Sociotechnical Organizations

This paper presents a novel approach to diagnosing and measuring teamwork in complex sociotechnical systems. First, the underlying theoretical constructs that have inspired the development and use of a multi-level model to study team phenomena from a general systems perspective are presented. Next, in an attempt to theoretically ground the construct, “flow state” will be presented as an isomorphic variable in a multi-level model, meaning it is represented similarly at the system, team, and individual level. Approaching processes embedded in organizations from this perspective allows diagnosis of the systemic influences that contribute most to the variance in performance, identification of pervasive latent systemic failures, and the development of a tailored taxonomy of behavioral teamwork dimensions, which can then be translated into metrics to measure teamwork within any observable complex process.

Development of a system for communicating human factors readiness

While human factors has been recognized as a key component in research and development efforts, there is a lack of systematic guidance as to how to insert human factors evaluation outcomes into system development processes. The current effort proposes a systematic scale comparable to existing Technology Readiness Level scales to objectively quantify and track human factors readiness throughout the system development lifecycle. The resultant Human Factors Readiness Levels (HFRLs), iteratively developed with input from government and industry human factors practitioners across a variety of domains, prioritize each identified human factors issue based on its risk level and by the status of any resolution. The overall scoring method utilizes a scale of 1 to 10, with a higher score indicating a higher level of human factors readiness. The HFRL scale has been integrated into a software tool, the System for Human Factors Readiness Evaluation (SHARE), that supports tracking and calculation of system level HFRLs that can be quickly and easily shared to support acquisition decision making and product development in an effort to realize return on investment through early identification, prioritization and rectification of issues avoiding expensive, late design changes.

Test-retest reliability of CogGauge: a cognitive assessment tool for SpaceFlight

The purpose of this study was to assess at a preliminary level, the test/retest reliability of the math processing mini-game of CogGauge: a cognitive assessment tool for spaceflight. The focus of this assessment was on the stability of test scores and calculation of reliable change on test/retest scores obtained on a mathematical processing task. A sample of 18 neurotypical, nonconcussed individuals with a minimum of a graduate or professional school degree completed the task on two separate occasions separated by 7 days. Testretest coefficients, reliable change difference scores (including adjustments for practice effects) and descriptive statistics are provided along with a discussion of the CogGauge tool.

Results from Empirical Testing of the System for Tactile Reception of Advanced Patterns (STRAP)

The System for Tactile Reception of Advanced Patterns (STRAP) is capable of displaying complex information through tactile actuators on a users torso. Non-verbal communication requirements from a Military Operations in Urban Terrain (MOUT) task and tactile design guidelines resulted greater than 60 distinct tactile symbols for communication and a context free grammar. This empirical evaluation is the first step in validating the STRAP system as a complement to traditional communication methods such as military hand and arm signals and radio. Nine participants were trained on the entire tactile language to a 90% criterion and were asked to utilize a small subset of the vocabulary while completing room clearing tasks using a virtual desktop simulation. The results show no significant difference in room clearing performance when haptic versus verbal communications were provided, indicating that the STRAP system shows promise as a complementary communication device. Improvements to both the tactile display and symbols are discussed as a means to improve recognition of haptic commands and overall system utility.

Using a Game to Evaluate Passenger Screener Fatigue and Sleepiness at Airport Screening Checkpoints

The sensitivity of a game-based neurocognitive test to detect sleepiness and fatigue among workers at an airport passenger screening checkpoint (screeners) was examined. Screener fatigue and sleepiness was evaluated using both the game-based test and self-reports over the course of an eight-hour shift. Fatigue and sleepiness using the game-based test was evaluated utilizing differences in pre- and post—shift performance on four games targeting fatigue-mediated cognitive processes including simple reaction time, spatial processing, logical relations, and mathematical processing. Self-reports of fatigue and sleepiness were also collected pre-and post-shift using a previously validated tool. Results revealed that screeners at the checkpoint experienced a significant increase in fatigue and sleepiness from pre- to post-shift, indicated by both performance on the game and the self-report tool. The results suggest that the game-based tool could be used to evaluate the impact of countermeasures to reduce screener fatigue at screening checkpoints.