Angela Faragasso

A three-axial body force sensor for flexible manipulators

This paper introduces an optical based three axis force sensor which can be integrated with the robot arm of the EU project STIFF-FLOP (STIFFness controllable Flexible and Learnable Manipulator for Surgical Operations) in order to measure applied external forces. The structure of the STIFF-FLOP arm is free of metal components and electric circuits and, hence, is inherently safe near patients during surgical operations. In addition, this feature makes the performance of this sensing system immune against strong magnetic fields inside magnetic resonance (MR) imaging scanners. The hollow structure of the sensor allows the implementation of distributed actuation and sensing along the body of the manipulator. In this paper, we describe the design and calibration procedure of the proposed three axis optics-based force sensor. The experimental results confirm the effectiveness of our optical sensing approach and its applicability to determine the force and momentum components during the physical interaction of the robot arm with its environment.

Bio-inspired tactile sensor sleeve for surgical soft manipulators

Robotic manipulators for Robot-assisted Minimally Invasive Surgery (RMIS) pass through small incisions into the patients body and interact with soft internal organs. The performance of traditional robotic manipulators such as the da Vinci Robotic System is limited due to insufficient flexibility of the manipulator and lack of haptic feedback. Modern surgical manipulators have taken inspiration from biology e.g. snakes or the octopus. In order for such soft and flexible arms to reconfigure itself and to control its pose with respect to organs as well as to provide haptic feedback to the surgeon, tactile sensors can be integrated with the robots flexible structure. The work presented here takes inspiration from another area of biology: cucumber tendrils have shown to be ideal tactile sensors for the plant that they are associated with providing useful environmental information during the plants growth. Incorporating the sensing principles of cucumber tendrils, we have created miniature sensing elements that can be distributed across the surface of soft manipulators to form a sensor network capable of acquire tactile information. Each sensing element is a retractable hemispherical tactile measuring applied pressure. The actual sensing principle chosen for each tactile makes use of optic fibres that transfer light signals modulated by the applied pressure from the sensing element to the proximal end of the robot arm. In this paper, we describe the design and structure of the sensor system, the results of an analysis using Finite Element Modeling in ABAQUS as well as sensor calibration and experimental results. Due to the simple structure of the proposed tactile sensor element, it is miniaturisable and suitable for MIS. An important contribution of this work is that the developed sensor system can be ”loosely” integrated with a soft arm effectively operating independently of the arm and without affecting the arms motion during bending or elongation.

Vision-based corridor navigation for humanoid robots

We present a control-based approach for visual navigation of humanoid robots in office-like environments. In particular, the objective of the humanoid is to follow a maze of corridors, walking as close as possible to their center to maximize motion safety. Our control algorithm is inspired by a technique originally designed for unicycle robots and extended here to cope with the presence of turns and junctions. The feedback signals computed for the unicycle are transformed to inputs that are suited for the locomotion system of the humanoid, producing a natural, human-like behavior. Experimental results for the humanoid robot NAO are presented to show the validity of the approach, and in particular the successful extension of the controller to turns and junctions.

Novel uniaxial force sensor based on visual information for minimally invasive surgery

This paper presents an innovative approach of utilising visual feedback to determine physical interaction forces with soft tissue during Minimally Invasive Surgery (MIS). This novel force sensing device is composed of a linear retractable mechanism and a spherical visual feature. The sensor mechanism can be adapted to endoscopic cameras used in MIS. As the distance between the camera and feature varies due to the sliding joint, interaction forces with anatomical surfaces can be computed based on the visual appearance of the feature in the image. Hence, this device allows the measurement of forces without introducing new stand-alone sensors. A mathematical model was derived based on validation data tests and preliminary experiments were conducted to verify the models accuracy. Experimental results confirm the effectiveness of our vision based approach.

A continuum body force sensor designed for flexible surgical robotics devices

This paper presents a novel three-axis force sensor based on optical photo interrupters and integrated with the robot arm STIFF-FLOP (STIFFness controllable Flexible and Learnable Manipulator for Surgical Operations) to measure external interacting forces and torques. The ring-shape bio-compatible sensor presented here embeds the distributed actuation and sensing system of the STIFF-FLOP manipulator and is applicable to the geometry of its structure as well to the structure of any other similar soft robotic manipulator. Design and calibration procedures of the device are introduced: experimental results allow defining a stiffness sensor matrix for real-time estimation of force and torque components and confirm the usefulness of the proposed optical sensing approach.

Tendon-Based Stiffening for a Pneumatically Actuated Soft Manipulator

There is an emerging trend toward soft robotics due to its extended manipulation capabilities compared to traditionally rigid robot links, showing promise for an extended applicability to new areas. However, as a result of the inherent property of soft robotics being less rigid, the ability to control/obtain higher overall stiffness when required is yet to be further explored. In this letter, an innovative design is introduced which allows varying the stiffness of a continuum silicon-based manipulator and proves to have potential for applications in Minimally Invasive Surgery. Inspired by muscular structures occurring in animals such as the octopus, we propose a hybrid and inherently antagonistic actuation scheme. In particular, the octopus makes use of this principle activating two sets of muscles-longitudinal and transverse muscles-thus, being capable of controlling the stiffness of parts of its arm in an antagonistic fashion. Our designed manipulator is pneumatically actuated employing chambers embedded within the robots silicone structure. Tendons incorporated in the structure complement the pneumatic actuation placed inside the manipulators wall to allow variation of overall stiffness. Experiments are carried out by applying an external force in different configurations while changing the stiffness by means of the two actuation mechanisms. Our test results show that dual, antagonistic actuation increases the load bearing capabilities for soft continuum manipulators and thus their range of applications.

Embedded electro-conductive yarn for shape sensing of soft robotic manipulators.

Flexible soft and stiffness-controllable surgical manipulators enhance the manoeuvrability of surgical tools during Minimally Invasive Surgery (MIS), as opposed to conventional rigid laparoscopic instruments. These flexible and soft robotic systems allow bending around organs, navigating through complex anatomical pathways inside the human body and interacting inherently safe with its soft environment. Shape sensing in such systems is a challenge and one essential requirement for precise position feedback control of soft robots. This paper builds on our previous work integrating multiple optical fibres into a soft manipulator to estimate the robots pose using light intensity modulation. Here, we present an enhanced version of our embedded bending/shape sensor based on electro-conductive yarn. The new system is miniaturised and able to measure bending behaviour as well as elongation. The integrated yarn material is helically wrapped around an elastic strap and protected inside a 1.5mm outer-diameter stretchable pipe. Three of these resulting stretch sensors are integrated in the periphery of a pneumatically actuated soft manipulator for direct measurement of the actuation chamber lengths. The capability of the sensing system in measuring the bending curvature and elongation of the arm is evaluated.

A novel tumor localization method using haptic palpation based on soft tissue probing data.

Current surgical tele-manipulators do not provide explicit haptic feedback during soft tissue palpation. Haptic information could improve the clinical outcomes significantly and help to detect hard inclusions within soft-tissue organs indicating potential abnormalities. However, system instability is often caught by direct force feedback. In this paper, a new approach to intra-operative tumor localization is introduced. A virtual-environment tissue model is created based on the reconstructed surface of a soft-tissue organ using a Kinect depth sensor and the organs stiffness distribution acquired during rolling indentation measurements. Palpation applied to this tissue model is haptically fed back to the user. In contrast to previous work, our method avoids the control issues inherent to systems that provide direct force feedback. We demonstrate the feasibility of this method by evaluating the performance of our tumor localization method on a soft tissue phantom containing buried stiff nodules. Results show that participants can identify the embedded tumors; the proposed method performed nearly as well as manual palpation.

Endoscopic add-on stiffness probe for real-time soft surface characterisation in MIS.

This paper explores a novel stiffness sensor which is mounted on the tip of a laparoscopic camera. The proposed device is able to compute stiffness when interacting with soft surfaces. The sensor can be used in Minimally Invasive Surgery, for instance, to localise tumor tissue which commonly has a higher stiffness when compared to healthy tissue. The purely mechanical sensor structure utilizes the functionality of an endoscopic camera to the maximum by visually analyzing the behavior of trackers within the field of view. Two pairs of spheres (used as easily identifiable features in the camera images) are connected to two springs with known but different spring constants. Four individual indenters attached to the spheres are used to palpate the surface. During palpation, the spheres move linearly towards the objective lens (i.e. the distance between lens and spheres is changing) resulting in variations of their diameters in the camera images. Relating the measured diameters to the different spring constants, a developed mathematical model is able to determine the surface stiffness in real-time. Tests were performed using a surgical endoscope to palpate silicon phantoms presenting different stiffness. Results show that the accuracy of the sensing system developed increases with the softness of the examined tissue.

Vision-based maze navigation for humanoid robots

We present a vision-based approach for navigation of humanoid robots in networks of corridors connected through curves and junctions. The objective of the humanoid is to follow the corridors, walking as close as possible to their center to maximize motion safety, and to turn at curves and junctions. Our control algorithm is inspired by a technique originally designed for unicycle robots that we have adapted to humanoid navigation and extended to cope with the presence of turns and junctions. In addition, we prove here that the corridor following control law provides asymptotic convergence of robot heading and position to the corridor bisector even when the corridor walls are not parallel. A state transition system is designed to allow navigation in mazes of corridors, curves and T-junctions. Extensive experimental validation proves the validity and robustness of the approach.