William McMahan

Tool Contact Acceleration Feedback for Telerobotic Surgery

Minimally invasive telerobotic surgical systems enable surgeons to perform complicated procedures without large incisions. Unfortunately, these systems typically do not provide the surgeon with sensory feedback aside from stereoscopic vision. We have, thus, developed VerroTouch, a sensing and actuating device that can be added to Intuitive Surgicals existing da Vinci S Surgical System to provide auditory and vibrotactile feedback of tool contact accelerations. These cues let the surgeon feel and hear contact with rough textures as well as the making and breaking of contact with objects and other tools. To evaluate the merits of this approach, we had 11 surgeons use an augmented da Vinci S to perform three in vitro manipulation tasks under four different feedback conditions: with no acceleration feedback, with audio feedback, with haptic feedback, and with both audio and haptic. Subjects expressed a significant preference for the inclusion of tool contact acceleration feedback, although they disagreed over which sensory modality was best. Other survey responses and qualitative written comments indicate that the feedback may have improved the subjects concentration and situational awareness by strengthening the connection between the surgeon and the surgical instruments. Analysis of quantitative task metrics shows that the feedback neither improves nor impedes the performance of the chosen tasks.

Octopus-inspired grasp-synergies for continuum manipulators

Human operation of continuum “continuous-backbone” manipulators remains difficult, because of both the complex kinematics of these manipulators and the need to coordinate their many degrees of freedom. We present a novel synergy-based approach for operator interfaces, by introducing a series of octopus-arm inspired grasp-synergies. These grasp-synergies automatically coordinate the degrees of freedom of the continuum manipulator, allowing an operator to perform kinematically complex grasping motions through simple and intuitive joystick inputs. This effectively reduces the complexity of operation and allows the operator to devote more of his attention to higher-level concerns (e.g. goal, environment). We demonstrate the grasp-synergies interface design in both simulation and hardware using the nine degree of freedom Octarm continuum manipulator.

Haptic display of realistic tool contact via dynamically compensated control of a dedicated actuator

High frequency contact accelerations convey important information that the vast majority of haptic interfaces cannot render. Building on prior work, we present an approach to haptic interface design that uses a dedicated linear voice coil actuator and a dynamic system model to allow the user to feel these signals. This approach was tested through use in a bilateral teleoperation experiment where a user explored three textured surfaces under three different acceleration control architectures: none, constant gain, and dynamic compensation. The controllers that use the dedicated actuator vastly outperform traditional position-position control at conveying realistic contact accelerations. Analysis of root mean square error, linear regression, and discrete Fourier transforms of the acceleration data also indicate a slight performance benefit for dynamic compensation over constant gain.

Dimensional reduction of high-frequency accelerations for haptic rendering

Haptics research has seen several recent efforts at understanding and recreating real vibrations to improve the quality of haptic feedback in both virtual environments and teleoperation. To simplify the modeling process and enable the use of single-axis actuators, these previous efforts have used just one axis of a three-dimensional vibration signal, even though the main vibration mechanoreceptors in the hand are know to detect vibrations in all directions. Furthermore, the fact that these mechanoreceptors are largely insensitive to the direction of high-frequency vibrations points to the existence of a transformation that can reduce three-dimensional high-frequency vibration signals to a one-dimensional signal without appreciable perceptual degradation. After formalizing the requirements for this transformation, this paper describes and compares several candidate methods of varying degrees of sophistication, culminating in a novel frequency-domain solution that performs very well on our chosen metrics.

VerroTouch: High-Frequency Acceleration Feedback for Telerobotic Surgery

The Intuitive da Vinci system enables surgeons to see and manipulate structures deep within the body via tiny incisions. Though the robotic tools mimic ones hand motions, surgeons cannot feel what the tools are touching, a striking contrast to non-robotic techniques. We have developed a new method for partially restoring this lost sense of touch. Our VerroTouch system measures the vibrations caused by tool contact and immediately recreates them on the master handles for the surgeon to feel. This augmentation enables the surgeon to feel the texture of rough surfaces, the start and end of contact with manipulated objects, and other important tactile events. While it does not provide low frequency forces, we believe vibrotactile feedback will be highly useful for surgical task execution, a hypothesis we we will test in future work.

Practical kinematics for real-time implementation of continuum robots

This paper introduces three algorithms which are essential for the practical, real-time implementation of continuum robots. Continuum robots lack the joints and links which compose traditional and high-degree-of-freedom robots, instead relying on finite actuation mechanisms to shape the robot into a smooth curve. Actuator length limits shape the configuration or joint space of continuum manipulators, introducing couplings analyzed in this paper which must be understood to make effective use of continuum robot hardware. Based on the new understanding of the configuration space uncovered, this paper then derives the workspace of continuum robots when constrained by actuator length limits. Finally, a tangle/untangle algorithm correctly computes the shape of the distal segments of multisection tendon-actuated continuum robots. These contributions are essential for effective use of a wide range of continuum robots, and have been implemented and tested on two different types of continuum robots. Results and insight gained from this implementation are presented

Haptography: Capturing and Recreating the Rich Feel of Real Surfaces

Haptic interfaces, which allow a user to touch virtual and remote environments through a hand-held tool, have opened up exciting new possibilities for applications such as computer-aided design and robot-assisted surgery. Unfortunately, the haptic renderings produced by these systems seldom feel like authentic re-creations of the richly varied surfaces one encounters in the real world. We have thus envisioned the new approach of haptography, or haptic photography, in which an individual quickly records a physical interaction with a real surface and then recreates that experience for a user at a different time and/or place. This paper presents an overview of the goals and methods of haptography, emphasizing the importance of accurately capturing and recreating the high frequency accelerations that occur during tool-mediated interactions. In the capturing domain, we introduce a new texture modeling and synthesis method based on linear prediction applied to acceleration signals recorded from real tool interactions. For recreating, we show a new haptography handle prototype that enables the user of a Phantom Omni to feel fine surface features and textures.

OctArm - A soft robotic manipulator

Summary form only given. Continuum robots are biologically-inspired by the invertebrate organisms such as octopus arms and elephant trunks. These robots with a backbone-less structure offer a superior performance in unstructured and cluttered environments such as collapsed buildings, unknown geographical terrain, holes and tunnels. This video features OctArm, a continuum robot that demonstrates its capabilities in whole arm manipulation, biologically-inspired maneuvering, and grasping. The video also depicts a 3D graphical model of OctArm in that can be rendered in real-time in Matlabs real-time workshop.

Dynamic modeling and control of voice-coil actuators for high-fidelity display of haptic vibrations

Researchers have demonstrated haptic interfaces that display high-frequency vibrations by applying an oscillating waveform to a linear voice-coil actuator (also referred to as a linear resonant or recoil-type actuator). Seeking to optimize the performance of this class of haptic devices, this paper analyzes the electrical and mechanical dynamics of this haptic display approach. Experimental evaluation of the most common commercial voice-coil actuator, the Tactile Labs Haptuator, reveals how the drive circuitry, the actuators suspension, and the users hand impedance affect the systems frequency response and thus distort the desired vibration output. Compared to current-drive, voltage-drive circuitry beneficially increases the effective damping of this underdamped system. Previously assumed to be linear, the systems dynamic response is found to depend highly on the material used for the actuators suspension; the nonlinearity of the standard Haptuator suspension undesirably causes the resonant frequency to shift based on the amplitude of the input signal. We reduce the output distortion by installing a more linear suspension material, and we use a feedforward controller to compensate for the remaining dynamics, instead of the standard constant-gain controller. Considering the metrics of unity frequency response and spectral dissimilarity, our approach considerably reduces the distortion presented to the user.

Spectral subtraction of robot motion noise for improved event detection in tactile acceleration signals

New robots for teleoperation and autonomous manipulation are increasingly being equipped with high-bandwidth accelerometers for measuring the transient vibrational cues that occur during contact with objects. Unfortunately, the robots own internal mechanisms often generate significant high-frequency accelerations, which we term ego-vibrations. This paper presents an approach to characterizing and removing these signals from acceleration measurements. We adapt the audio processing technique of spectral subtraction over short time windows to remove the noise that is estimated to occur at the robots present joint velocities. Implementation for the wrist roll and gripper joints on a Willow Garage PR2 robot demonstrates that spectral subtraction significantly increases signal-to-noise ratio, which should improve vibrotactile event detection in both teleoperation and autonomous robotics.