Maria Bualat

Virtual Reality Interfaces for Visualization and Control of Remote Vehicles

The Autonomy and Robotics Area (ARA) at NASA Ames Research Center has investigated the use of various types of Virtual Reality-based operator interfaces to remotely control complex robotic mechanisms. In this paper, we describe the major accomplishments and technology applications of the ARA in this area, and highlight the advantages and issues related to this technology.

Initial results from vision-based control of the Ames Marsokhod rover

A terrestrial geologist investigates an area by systematically moving among and inspecting surface features, such as outcrops, boulders, contacts and faults. A planetary geologist must explore remotely and use a robot to approach and image surface features. To date, position-based control has been developed to accomplish this task. This method requires an accurate estimate of the feature position, and frequent update of the robots position. In practice this is error prone, since it relies on interpolation and continuous integration of data from inertial or odometric sensors or other position determination techniques. The development of vision-based control of robot manipulators suggests an alternative approach for mobile robots. We have developed a vision-based control system that enables our Marsokhod mobile robot to drive autonomously to within sampling distance of a visually designated natural feature. This system utilizes a robust correlation technique based on matching the sign of the difference of the Gaussian of images. We will describe our system and our initial results using it during a field experiment in the Painted Desert of Arizona.

Operating Nomad during the Atacama Desert Trek

Nomad is a mobile robot designed for extended planetary exploration. In June and July of 1997, Nomad performed the first such mission, traversing more than 220 kilometers in the Atacama Desert of Chile and exploring a landscape analogous to that of the Moon and Mars. Nomads journey, the Atacama Desert Trek, was an unprecedented demonstration of long-distance, long-duration robotic operation. Guided by operators thousands of kilometers away but telepresent via immersive imagery and interfaces, Nomad operated continuously for 45 days. Science field experiments evaluated exploration strategies and analysis techniques for future terrestrial and planetary missions.

Field Experiments with the Ames Marsokhod Rover

In an ongoing series of field experiments, the Ames Marsokhod rover is deployed to remote locations and operated by scientists in simulated planetary explorations. These experiments provide insight both for scientists preparing for real planetary surface exploration and for robotics researchers. In this paper we will provide an overview of our work with the Marsokhod, describe the various subsystems that have been developed, discuss the latest in a series of field experiments, and discuss the lessons learned about performing remote geology.

Human-Robot Site Survey and Sampling for Space Exploration

NASA is planning to send humans and robots back to the Moon before 2020. In order for extended missions to be productive, high quality maps of lunar terrain and resources are required. Although orbital images can provide much information, many features (local topography, resources, etc) will have to be characterized directly on the surface. To address this need, we are developing a system to perform site survey and sampling. The system includes multiple robots and humans operating in a variety of team configurations, coordinated via peer-to-peer human-robot interaction. In this paper, we present our system design and describe planned field tests.

Visual target tracking for rover-based planetary exploration

To command a rover to go to a location of scientific interest on a remote planet, the rover must be capable of reliably tracking the target designated by a scientist from about ten rover lengths away. The rover must maintain lock on the target while traversing rough terrain and avoiding obstacles without the need for communication with Earth. Among the challenges of tracking targets from a rover are the large changes in the appearance and shape of the selected target as the rover approaches it, the limited frame rate at which images can be acquired and processed, and the sudden changes in camera pointing as the rover goes over rocky terrain. We have investigated various techniques for combining 2D and 3D information in order to increase the reliability of visually tracking targets under Mars like conditions. We present the approaches that we have examined on simulated data and tested onboard the Rocky 8 rover in the JPL Mars Yard and the K9 rover in the ARC Marscape. These techniques include results for 2D trackers, ICP, visual odometry, and 2D/3D trackers.

Developing an autonomy infusion infrastructure for robotic exploration

In this paper, we present an overview of the CLARAty (coupled layer architecture for robotic autonomy) architecture and describe the growth of capabilities and algorithms now available within this framework. We discuss the challenges of developing a software system with remote institutions and the lessons learned in our experience developing CLARAty with ARC, JPL, and Carnegie Mellon University. We describes the rover testbeds, in particular the K9 rover, and the integration and demonstration of new technologies enabling robust execution, single communication cycle instrument placement, fault diagnosis, and autonomous science.

Instrument deployment for Mars Rovers

Future Mars rovers, such as the planned 2009 MSL rover, require sufficient autonomy to robustly approach rock targets and place an instrument in contact with them. It took the 1997 Sojourner Mars rover between 3 and 5 communications cycles to accomplish this. This paper describes the NASA Ames approach to robustly accomplishing single cycle instrument deployment, using the K9 prototype Mars rover. An off-board 3D site model is used to select science targets for the rover. K9 navigates to targets using deduced reckoning, and autonomously assesses the target area to determine where to place an arm mounted microscopic camera. Onboard K9 is a resource cognizant conditional executive, which extends the complexity and duration of operations that a can be accomplished without intervention from mission control.

Astrobee: Developing a Free Flying Robot for the International Space Station

Astronaut time will always be in short supply, consumables (e.g., oxygen) will always be limited, and some work will not be feasible, or productive, for astronauts to do manually. Free flyers offer significant potential to perform a great variety of tasks, include routine, repetitive or simple but long-duration work, such as conducting environment surveys, taking sensor readings or monitoring crew activities. The “Astrobee” project is developing a new free flying robot system suitable for performing Intravehicular Activity (IVA) work on the Internation Space Station (ISS). This paper will describe the Astrobee project objectives, initial design, concept of operations, and key challenges.

Autonomous Robotic Inspection for Lunar Surface Operations

In this paper, we describe NASA Ames Research Center’s K10 rover as used in the 2006 Coordinated Field Demonstration at Meteor Crater, Arizona. We briefly discuss the control software architecture and describe a high dynamic range imaging system and panoramic display system used for the remote inspection of an EVA crew vehicle.