Joseph R. Keebler

Team Size, Team Role, Communication Modality, and Team Coordination in the Distributed Operation of Multiple Heterogeneous Unmanned Vehicles

The aim of this study was to investigate the effects of team size, communication modality, and team role on measures of team process over time. As the use of semiautonomous, unmanned vehicles increases, it is pertinent to investigate issues associated with the human teams that will control them, including consideration of team roles and the design of systems to support these roles. Using a 1:35 scale facility for military operations in urban terrain, distributed teams of two or three operators used a simulated, unmanned aerial vehicle and a scaled, unmanned ground vehicle to complete two distinct phases of a mission. The teams used either audio or instant messaging for communication, and the analysis of communication assessed their discussion of target identification, target classification, object localization, and vehicle navigation. Findings indicate that the addition of a third teammate resulted in greater role specificity, and the use of audio increased communication of task-relevant content. The proper assignment of team roles can improve the ability of a team to both acquire and synthesize information from remote environments. Furthermore, proper system design can improve the flow of information between teammates over time.

The influence of camouflage, obstruction, familiarity and spatial ability on target identification from an unmanned ground vehicle

The purpose of this study was to examine the effects of environmental and cognitive factors on the identification of targets from an unmanned ground vehicle (UGV). This was accomplished by manipulating obstruction, camouflage and familiarity of objects in the environment, while also measuring spatial ability. The effects of these variables on target identification were studied by measuring performance of participants that observed pre-recorded video from a 1:35 scaled military operations in urban terrain facility. Analyses indicated that a combination of camouflage and obstruction caused the most detrimental effects on performance, and that there were differences in the recognition of familiar and unfamiliar targets. Further analysis indicated that these detrimental effects could only be overcome with a combination of target familiarity and spatial ability. The findings highlight the degree to which environmental factors hinder performance and the need for a multidimensional approach for improving performance under these conditions. Areas in need of future research are also discussed. Practitioner Summary: Cognitive theory is applied to the problem of perception from UGVs. Results from an experimental study indicate that a combination of camouflage and obstruction caused the most detrimental effects on performance, with differences in the recognition of both familiar and unfamiliar targets. Familiarity and spatial ability interacted to predict the performance.

Beyond "spatial ability": examining the impact of multiple individual differences in a perception by proxy framework

Prior research has proposed the use of a Perception by Proxy framework that relies on human perception to support actions of autonomy. Given the importance of human perception, this framework highlights the need to understand how human cognitive abilities factor into the human-robot dynamic. The following paper uses a military reconnaissance task to examine how cognitive abilities interact with the gradual implementation of autonomy in a Perception by Proxy framework (i.e., autonomy to detect; autonomy to support rerouting) to predict three dimensions of sequential performance (i.e., speeded detection; target identification; rerouting). Results showed that, in addition to effects of autonomy and task setting, different individual abilities predicted unique aspects of performance. This highlights the need to broaden consideration of cognitive abilities in HRI.

Meta-analyses of the effects of standardized handoff protocols on patient, provider, and organizational outcomes

Objective: The overall purpose was to understand the effects of handoff protocols using meta-analytic approaches. Background: Standardized protocols have been required by the Joint Commission, but meta-analytic integration of handoff protocol research has not been conducted. Method: The primary outcomes investigated were handoff information passed during transitions of care, patient outcomes, provider outcomes, and organizational outcomes. Sources included Medline, SAGE, Embase, PsycINFO, and PubMed, searched from the earliest date available through March 30th, 2015. Initially 4,556 articles were identified, with 4,520 removed. This process left a final set of 36 articles, all which included pre-/postintervention designs implemented in live clinical/hospital settings. We also conducted a moderation analysis based on the number of items contained in each protocol to understand if the length of a protocol led to systematic changes in effect sizes of the outcome variables. Results: Meta-analyses were conducted on 34,527 pre- and 30,072 postintervention data points. Results indicate positive effects on all four outcomes: handoff information (g = .71, 95% confidence interval [CI] [.63, .79]), patient outcomes (g = .53, 95% CI [.41, .65]), provider outcomes (g = .51, 95% CI [.41, .60]), and organizational outcomes (g = .29, 95% CI [.23, .35]). We found protocols to be effective, but there is significant publication bias and heterogeneity in the literature. Due to publication bias, we further searched the gray literature through greylit.org and found another 347 articles, although none were relevant to this research. Our moderation analysis demonstrates that for handoff information, protocols using 12 or more items led to a significantly higher proportion of information passed compared with protocols using 11 or fewer items. Further, there were numerous negative outcomes found throughout this meta-analysis, with trends demonstrating that protocols can increase the time for handover and the rate of errors of omission. Conclusions: These results demonstrate that handoff protocols tend to improve results on multiple levels, including handoff information passed and patient, provider, and organizational outcomes. These findings come with the caveat that publication bias exists in the literature on handoffs. Instances where protocols can lead to negative outcomes are also discussed. Application: Significant effects were found for protocols across provider types, regardless of expertise or area of clinical focus. It also appears that more thorough protocols lead to more information being passed, especially when those protocols consist of 12 or more items. Given these findings, publication bias is an apparent feature of this literature base. Recommendations to reduce the apparent publication bias in the field include changing the way articles are screened and published.

Developing an effective combat identification training

Correctly identifying combat vehicles is a difficult task. As the military becomes more automated through unmanned vehicles (UVs), it will be important to make sure individuals are properly trained in the visual recognition and identification of combat targets. Due to the extensive amount of visual materials that can be used to study potential combat targets (in this case armored vehicles), it is pertinent to conduct empirical research to further evaluate the effectiveness of training media types. Through examining learning and performance outcomes, as well as individual experiences, it may be possible to better understand the effects of differing types of training media. This paper will strive to review some of the technologies that could be used for training combat identification, as well as review relevant cognitive and experiential factors that may affect training interactions, including learning, trainee enjoyment, technology acceptance and performance.

Some Good and Bad with Spatial Ability in Three Person Teams That Operate Multiple Unmanned Vehicles

This study reports findings regarding the influence of spatial ability of each operator on a three person team on workload and performance. Sixty six participants were randomly assigned to the role of unmanned aerial vehicle (UAV) operator, unmanned ground vehicle (UGV) operator, and intelligence officer (leader) to create a total of 22 teams, and spatial ability was assessed with Part 5 of the Guilford-Zimmerman Aptitude Survey. Findings indicated that spatial ability of the UAV operator and UGV operator improved reconnaissance, and while spatial ability of the UAV operator improved reacquisition of objectives after reconnaissance, spatial ability of the intelligence officer hindered team performance on this second task. A rationale for these results was developed with findings from the Multiple Resource Questionnaire (MRQ). Discussion focuses on the relationship between spatial ability and visual perception in complex teams.

Applying team heuristics to future human-robot systems

In this paper we briefly describe teaming heuristics as they are applied to human-human teams, and demonstrate their adaptability to human-robot (HR) teams. We discuss a framework developed from Salass models on teamwork and team training. As HRI technology moves from teleoperative control methods to teamwork with intelligent robots, it is pertinent to properly integrate knowledge about teams into the development of robotic systems. This should lead to highly effective team systems, and may provide insight into the design of robotic entities and system protocols.

Evaluation of COTS Simulations for Future HRI Teams

As robotic technologies become more autonomous, the way human-robot interaction is studied in the laboratory is going to need to change. Currently, the use of robots in the present day is almost entirely via tele-operation. As robots become more intelligent, they will need less human supervisory control. One approach is to liken near future human-robot teams to working human-animal teams However, in order to fully understand how humans will interact with near future robotic technologies that may not yet exist, we must use today’s simulation technologies as research tools. Some of these include Commercial off the Shelf (COTS) games. To overcome some of the problems inherent in trying to simulate technologies that may not yet exist, these games can represent a means by which near future human-robot interactions can be simulated This paper serves as a review the development of a framework for analyzing the utility of COTS games for HRI research, and will apply the framework to a few current COTS games.

Gaining Ground: Merging Cognitive Load Theory with Human Factors Principles

Although considered one of the best in the world, in many ways Americas educational system is not living up to its expectations. Taking an interdisciplinary approach to learning and training through integrating human factors (HF) is not a novel idea, yet it seems that further work can still be done to increase outcomes. This paper intends to investigate the similarities and differences of the theory of cognitive load (CLT), which is used extensively in instructional design, with various fundamental human factors constructs (workload, flow state, and transfer appropriate processing.). This may help to increase understanding between the fields. as well as find important similarities and differences between the given theories to increase the benefits of instructional design.

Considerations for Multiteam Systems in Emergency Medical Services.

Objective Despite good intentions, mishaps in teamwork continue to affect patients lives and plague the medical community at large and Emergency Medical Services (EMS) in particular. Effective and efficient management of patient care necessitates that sets of multiple teams (i.e., multiteam systems [MTSs] - EMS ground crews, EMS air crews, dispatch, and receiving hospital teams) seamlessly work together. Although advances have been made to improve teams, little research has been dedicated to enhancing MTSs especially in the critical yet often under studied domain of EMS. The purpose of this paper is to assist the pre-hospital community in strengthening patient care by presenting considerations unique to multiteam systems. Methods We synthesized the literature pertinent to multi-team systems and emergency medical services. Results From this synthesis, we derived five unique considerations: goals, boundary spanning, adaptation, leadership, and social identity. Conclusions MTSs are prevalent in prehospital care, as they define how multiple component healthcare teams work together to intervene in emergency situations. We provided some initial directions regarding considerations for success in EMS MTSs based on existing research, but we also recognize the need for further study on these issues.