Andrew B. Talone

Field Assessment of Multimodal Communication for Dismounted Human-Robot Teams

A field assessment of multimodal communication (MMC) was conducted as part of a program integration demonstration to support and enable bi-directional communication between a dismounted Soldier and a robot teammate. In particular, the assessment was focused on utilizing auditory and visual/gesture based communications. The task involved commanding a robot using semantically-based MMC. Initial participant data indicates a positive experience with the multimodal interface (MMI) prototype. The results of the experiment inform recommendations for multimodal designers regarding perceived usability and functionality of the currently implemented MMI.

An Evaluation of Human Mental Models of Tactical Robot Movement

In this paper, we describe an ongoing exploratory study investigating human mental models of tactical robot movement under different combinations of mission commands, constraints, and environmental features. In particular, we are assessing the relationship between participants’ mental models of robot form and their expectations for robot movement. The results of this study will inform the design of future experimentation with a soldier population and the design of tactical robot movement behaviors. Due to data collection being in its early stages, findings will be presented at the 2015 HFES Annual Meeting.

Startle and Surprise on the Flight Deck Similarities, Differences, and Prevalence

Startle and surprise are often cited as potentially contributing factors to aircraft incidents due to their possible negative effects on flightcrew performance. In this paper, we provide definitions of startle and surprise with the goal of delineating their differences. In the past, these terms have often been used interchangeably; however, there are distinctive conceptual, behavioral, and physiological differences between the startle reflex and the surprise emotion. Furthermore, we investigated the prevale nce of startle and surprise on the flight deck by examining voluntary incident reports in the Aviation Safety Reporting System (ASRS) and found surprise to be more prevalent than startle. Implications of these findings and limitations of our initial exploratory analysis are discussed.

Comparing Physical and Virtual Simulation Use in UGV Research: Lessons Learned from HRI Research with Two Test Beds

This paper details lessons learned from human-robot interaction (HRI) research conducted with physical and virtual unmanned vehicle (UV) test beds. Two subject matter experts (SMEs) were interviewed regarding their experiences using the test beds, and content was categorized to address validity issues and practical concerns that researchers should consider when studying human operation of UVs. Interview data revealed that from a practical standpoint, virtual simulation is favored over physical simulation. Virtual simulation was also highlighted for permitting greater internal and construct validity than physical simulation. For tele-operation studies, however, physical simulation was identified as more externally valid than virtual simulation, but this advantage diminished for research at higher levels of autonomy. In general, this paper can serve as a resource for researchers who must choose between the two simulation methods.

Development of a Signal Detection-Based Task for Research on Distributed Human-Robot Teaming within Immersive Virtual Reality

The purpose of this paper is to describe the design and validation of a dynamic signal detection-based task experienced within immersive virtual reality (IVR). The task will be used as a primary task for investigating the workload introduced by interface devices used for human-robot team communications. Participants play the role of a Soldier performing a Cordon and Search operation monitoring an environment for threats. The task differs from traditional signal detection tasks in that it is continuous, dynamic, and signal stimuli move through participants’ field of view. Implementation of the task within simulation allows for direct control, measurement, and manipulation of multiple parameters that influence performance metrics, task difficulty, and participant workload. Lessons learned during the design and development of the task are shared to guide other researchers intending to implement a signal detection-based task within IVR.

Evaluation and Benefits of Head-Mounted Display Systems for HRI Research

The intent of this evaluation is to describe the unique benefits that may be provided to human robot interaction (HRI) researchers by the capabilities of commercially available binocular head-mounted displays (HMDs) and associated handheld controllers. Three popular HMDs (Oculus Rift, HTC Vive, and Google Daydream) were compared across eight factors: cost, head tracking fidelity, visual resolution, user mobility, hand tracking fidelity, number of input modes, adaptability of input, and provided tracking space. Each of these elements was considered in the context of their relevance to the field of HRI, and potential importance for conducting research in immersive virtual reality (IVR). A Pugh chart was developed to succinctly compare the pros and cons of each headset alongside a description of IVR tasks for HRI military research as well as examples taken from work currently being conducted in our lab.

The Use of Immersive Virtual Reality for the Test and Evaluation of Interactions with Simulated Agents

We aim to better inform the scientific community regarding test and evaluation techniques for validating devices that will potentially be used by individuals interfacing with autonomous robotic teammates (particularly, members of the U.S. Military). Testing within immersive virtual environments (IVRs) similar to those experienced in military operations will be discussed with focus on the use of a commercial gaming engine for task development. Highlights of using commercial gaming engines will be illustrated throughout the paper to emphasize their utility for evaluating future technologies with attention given to testing efficiency and ecological validity. The study of interactions with simulated agents and future communication devices will be described in the context of the Robotics Collaborative Technology Alliance (RCTA) research program.

Human factors and ergonomics assessment of food pantry work: A case study

BACKGROUND Research assessing work processes in food pantries has been limited to the clients experience and aspects of food donations [3-5]. Research on food pantries has yet to focus on understanding and evaluating worker-environment interaction. OBJECTIVE The present case study examined the interaction between workers and their work environment while performing common tasks in a food pantry. METHODS Data were collected through naturalistic observations and structured interviews. A task analysis was performed on the data. RESULTS Several potential issues in the pantry were identified including with the workspace layout, environmental conditions, and signage. Human factors and ergonomics principles were then utilized to provide insights and recommendations (e.g., use of numbered rather than color-coded signage). CONCLUSIONS Recommendations were provided to the case study food pantry for enhancing safety and productivity. Further research is needed to assess the generalizability of our findings to other food pantries.

Crew Resource Management (CRM): What Aviation Can Learn From the Application of CRM in Other Domains

Crew Resource Management (CRM) was implemented into the aviation training curriculum over three decades ago in an effort to optimize flight deck management, safety, and improve flightcrew team performance. Since the mid-1990s, other industries have shown considerable interest in adapting and implementing CRM training to train their personnel in non-technical skills. This paper reviews the implementation of CRM in healthcare, the military, and the maritime industry. A comparison of different training methods and training assessment techniques, as well as gaps in the assessment of CRM training effectiveness are discussed. Lastly, a discussion of CRM training techniques and evaluation methods developed in other industries are presented for the consideration of the aviation community.

Usability of Pay-as-you-go Cell Phones A Cross-Cultural Analysis

The goal of the current study was to assess the usability of pay-as-you-go cell phones across specific cultures- one cell phone model from Honduras and one model from the United States. Bilingual participants completed three basic tasks with both cell phones while performing the think-aloud protocol and then completed surveys evaluating their user experience. Findings revealed that participants had more difficulty and were less satisfied when using the Honduran phone to complete the tasks. Universal and cross-cultural usability heuristics are used to evaluate performance issues with the phones and provide basic design recommendations to optimize user performance with the cell phones across the two cultures.