Terrence Fong

A survey of socially interactive robots

This paper reviews “socially interactive robots”: robots for which social human–robot interaction is important. We begin by discussing the context for socially interactive robots, emphasizing the relationship to other research fields and the different forms of “social robots”. We then present a taxonomy of design methods and system components used to build socially interactive robots. Finally, we describe the impact of these robots on humans and discuss open issues. An expanded version of this paper, which contains a survey and taxonomy of current applications, is available as a technical report [T. Fong, I. Nourbakhsh, K. Dautenhahn, A survey of socially interactive robots: concepts, design and applications, Technical Report No. CMU-RI-TR-02-29, Robotics Institute, Carnegie Mellon University, 2002].

Vehicle Teleoperation Interfaces

Despite advances in autonomy, there will always be a need for human involvement in vehicle teleoperation. In particular, tasks such as exploration, reconnaissance and surveillance will continue to require human supervision, if not guidance and direct control. Thus, it is critical that the operator interface be as efficient and as capable as possible. In this paper, we provide an overview of vehicle teleoperation and present a summary of interfaces currently in use.

Robot, Asker of Questions

Collaborative control is a teleoperation system model based on human–robot dialogue. With this model, the robot asks questions to the human in order to obtain assistance with cognition and perception. This enables the human to function as a resource for the robot and help to compensate for limitations of autonomy. To understand how collaborative control influences human–robot interaction, we performed a user study based on contextual inquiry (CI). The study revealed that: (1) dialogue helps users understand problems encountered by the robot and (2) human assistance is a limited resource that must be carefully managed.

Advanced Interfaces for Vehicle Teleoperation: Collaborative Control, Sensor Fusion Displays, and Remote Driving Tools

We are working to make vehicle teleoperation accessible to all users, novices and experts alike. In our research, we are developing a new control model for teleoperation, sensor-fusion displays and a suite of remote driving tools. Our goal is to build a framework which enables humans and robots to communicate, to exchange ideas and to resolve differences. In short, to develop systems in which humans and robots work together and jointly solve problems.

Collaboration, Dialogue, Human-Robot Interaction

Teleoperation can be improved if humans and robots work as partners, exchanging information and assisting one another to achieve common goals. In this paper, we discuss the importance of collaboration and dialogue in human-robot systems. We then present collaborative control, a system model in which human and robot collaborate, and describe its use in vehicle teleoperation.

The Peer-to-Peer Human-Robot Interaction Project

The Peer-to-Peer Human-Robot Interaction (P2P-HRI) project is developing techniques to improve task coordination and collaboration between human and robot partners. Our hypothesis is that peer-to-peer interaction can enable robots to collaborate in a competent, non-disruptive (i.e., natural) manner with users who have limited training, experience, or knowledge of robotics. Specifically, we believe that failures and limitations of autonomy (in planning, in execution, etc.) can be compensated for using human-robot interaction. In this paper, we present an overview of P2P-HRI, describe our development approach and discuss our evaluation methodology.

Interaction challenges in human-robot space exploration

In January 2004, NASA established a new, long-term exploration program to fulfill the Presidents Vision for U.S. Space Exploration. The primary goal of this program is to establish a sustained human presence in space, beginning with robotic missions to the Moon in 2008, followed by extended human expeditions to the Moon as early as 2015. In addition, the program places significant emphasis on the development of joint human-robot systems. A key difference from previous exploration efforts is that future space exploration activities must be sustainable over the long-term. Experience with the space station has shown that cost pressures will keep astronaut teams small. Consequently, care must be taken to extend the effectiveness of these astronauts well beyond their individual human capacity. Thus, in order to reduce human workload, costs, and fatigue-driven error and risk, intelligent robots will have to be an integral part of mission design.

Effective vehicle teleoperation on the World Wide Web

Our goal is to make vehicle teleoperation accessible to all users. To do this, we develop easy-to-use yet capable Web tools which enable efficient, robust teleoperation in unknown and unstructured environments. Web-based teleoperation, however, raises many research issues, as well as prohibiting the use of traditional approaches. Thus, it is essential to develop new methods which minimize bandwidth usage, which provide sensor fusion displays, and which optimize human-computer interaction. We believe that existing systems do not adequately address these issues and have severely limited capability and performance as a result. In this paper we present a system design for safe and reliable Web-based vehicle teleoperation, describe an active and dynamic user interface, and explain how our approach differs from existing systems.

ROBOT AS PARTNER: VEHICLE TELEOPERATION WITH COLLABORATIVE CONTROL

We have developed a new teleoperation system model called collaborative control. With this model, the robot asks the human questions, to obtain assistance with cognition and perception during task execution. This enables the human to support the robot and to compensate for inadequacies in autonomy. In the following, we review the system models conventionally used in teleoperation, describe collaborative control, and discuss its use.

VEVI: A Virtual Environment Teleoperations Interface for Planetary Exploration

Remotely operating complex robotic mechanisms in unstructured natural environments is difficult at best. When the communications time delay is large, as for a Mars exploration rover operated from Earth, the difficulties become enormous. Conventional approaches, such as rate control of the rover actuators, are too inefficient and risky. The Intelligent Mechanisms Laboratory at the NASA Ames Research Center has developed over the past four years an architecture for operating science exploration robots in the presence of large communications time delays. The operator interface of this system is called the Virtual Environment Vehicle Interface (VEVI), and draws heavily on Virtual Environment (or Virtual Reality) technology. This paper describes the current operational version of VEVI, which we refer to as version 2.0. In this paper we will describe the VEVI design philosophy and implementation, and will describe some past examples of its use in field science exploration missions.