Edoardo Battaglia

ThimbleSense: An individual-digit wearable tactile sensor for experimental grasp studies

Measuring contact forces applied by a hand to a grasped object is a necessary step to understand the mysteries that still hide in the unparalleled human grasping ability. Nevertheless, simultaneous collection of information about the position of contacts and about the magnitude and direction of forces is still an elusive task. In this paper we introduce a wearable device that addresses this problem, and can be used to measure generalized forces during grasping. By assembling two supports around a commercial 6-axis force/torque sensor we obtain a thimble that can be easily positioned on a fingertip. The device is used in conjunction with an active marker-based motion capture system to simultaneously obtain absolute position and orientation of the thimbles, without requiring any assumptions on the kinematics of the hand. Finally, using the contact centroid algorithm, introduced in [1], position of contact points during grasping are determined. This paper shows the design and implementation of the device, as well as some preliminary experimental validation.

A Wearable Fabric-based display for haptic multi-cue delivery

Softness represents one of the most informative haptic properties, which plays a fundamental role in both everyday tasks and more complex procedures. Thus, it is not surprising that much effort has been devoted to designing haptic systems able to suitably reproduce this information. At the same time, wearability has gained an increasing importance as a novel paradigm to enable a more effective and naturalistic human robot interaction. Capitalizing upon our previous works on grounded softness devices, in this paper we present the Wearable Fabric Yielding Display (W-FYD), a fabric-based tactile display for multi-cue delivery that can be worn by users finger. W-FYD enables to implement both passive and active tactile exploration. Different levels of stiffness can be reproduced by modulating the stretching state of a fabric through two DC motors. An additional vertical degree of freedom is implemented through a lifting mechanism, which enables to convey softness stimuli to the users finger pad. Furthermore, a sliding effect on the finger can be also induced. Experiments with humans show the effectiveness of W-FYD for haptic multi-cue delivery.

Exploiting hand kinematic synergies and wearable under-sensing for hand functional grasp recognition

Wearable sensing represents an effective manner to correctly recognize hand functional grasps. The need of wearability is strictly related to the minimization of the number of sensors, in order to avoid cumbersome and hence obtrusive systems. In this paper we present a wearable glove, which is able to provide accurate measurements from three joint angles. These measurements are then completed to reconstruct the whole hand posture, by exploiting a priori synergistic information on how human commonly shape their hands in grasping tasks. Results, although preliminary, show the effectiveness of the here described devices and methods and encourage to further investigate this kind of approach.

ThimbleSense: A Fingertip-Wearable Tactile Sensor for Grasp Analysis

Accurate measurement of contact forces between hand and grasped objects is crucial to study sensorimotor control during grasp and manipulation. In this work, we introduce ThimbleSense, a prototype of individual-digit wearable force/torque sensor based on the principle of intrinsic tactile sensing. By exploiting the integration of this approach with an active marker-based motion capture system, the proposed device simultaneously measures absolute position and orientation of the fingertip, which in turn yields measurements of contacts and force components expressed in a global reference frame. The main advantage of this approach with respect to more conventional solutions is its versatility. Specifically, ThimbleSense can be used to study grasping and manipulation of a wide variety of objects, while still retaining complete force/torque measurements. Nevertheless, validation of the proposed device is a necessary step before it can be used for experimental purposes. In this work, we present the results of a series of experiments designed to validate the accuracy of ThimbleSense measurements and evaluate the effects of distortion of tactile afferent inputs caused by the devices rigid shells on grasp forces.

The Rice Haptic Rocker: Skin stretch haptic feedback with the Pisa/IIT SoftHand

Myoelectric prostheses have seen increased application in clinical practice and research, due to their potential for good functionality and versatility. Yet, myoelectric prostheses still suffer from a lack of intuitive control and haptic feedback, which can frustrate users and lead to abandonment. To address this problem, we propose to convey proprioceptive information for a prosthetic hand with skin stretch using the Rice Haptic Rocker. This device was integrated with the myo-controlled version of Pisa/IIT SoftHand and a size discrimination test with 18 able bodied subjects was performed to evaluate the effectiveness of the proposed approach. Results show that the Rice Haptic Rocker can be successfully used to convey proprioceptive information. A Likert survey was also presented to the experiment participants, who evaluated the integrated setup as easy to use and effective in conveying proprioception.

A Synergy-Based Optimally Designed Sensing Glove for Functional Grasp Recognition

Achieving accurate and reliable kinematic hand pose reconstructions represents a challenging task. The main reason for this is the complexity of hand biomechanics, where several degrees of freedom are distributed along a continuous deformable structure. Wearable sensing can represent a viable solution to tackle this issue, since it enables a more natural kinematic monitoring. However, the intrinsic accuracy (as well as the number of sensing elements) of wearable hand pose reconstruction (HPR) systems can be severely limited by ergonomics and cost considerations. In this paper, we combined the theoretical foundations of the optimal design of HPR devices based on hand synergy information, i.e., the inter-joint covariation patterns, with textile goniometers based on knitted piezoresistive fabrics (KPF) technology, to develop, for the first time, an optimally-designed under-sensed glove for measuring hand kinematics. We used only five sensors optimally placed on the hand and completed hand pose reconstruction (described according to a kinematic model with 19 degrees of freedom) leveraging upon synergistic information. The reconstructions we obtained from five different subjects were used to implement an unsupervised method for the recognition of eight functional grasps, showing a high degree of accuracy and robustness.

Unvealing the Principal Modes of Human Upper Limb Movements through Functional Analysis

The rich variety of human upper limb movements requires an extraordinary coordination of different joints according to specific spatio-temporal patterns. However, unvealing these motor schemes is a challenging task. Principal components have been often used for analogous purposes, but such an approach relies on hypothesis of temporal uncorrelation of upper limb poses in time. To overcome these limitations, in this work we leverage on functional Principal Component Analysis (fPCA). We carried out experiments with 7 s​bjects performing a set of most significant human actions, selected considering state-of-the-art grasp taxonomies and human kinematic workspace. fPCA results show that human upper limb trajectories can be reconstructed by a linear combination of few principal time dependent functions, with a first component alone explaining around 60/70% of the observed behaviours. This allows to infer that in daily living activities humans reduce the complexity of movement by modulating their motions through a reduced set of few principal patterns. Finally, we discuss how this approach could be profitably applied in robotics and bioengineering, opening fascinating perspectives to advance the state of the art of artificial systems, as it was the case of hand synergies.

Towards a novel generation of haptic and robotic interfaces: Integrating affective physiology in human-robot interaction

Haptic interfaces are special robots that interact with people to convey touch-related information. In addition to such a discriminative aspect, touch is also a highly emotion-related sense. However, while a lot of effort has been spent to investigate the perceptual mechanisms of discriminative touch and to suitably replicate them through haptic systems in human robot interaction (HRI), there is still a lot of work to do in order to take into account also the emotional aspects of tactual experience (i.e., the so-called affective haptics), for a more naturalistic human-robot communication. In this paper, we report evidences on how a haptic device designed to convey caress-like stimuli can influence physiological measures related to the autonomous nervous system (ANS), which is intimately connected to evoked emotions in humans. Specifically, a discriminant role of electrodermal response and heart rate variability can be associated to two different caressing velocities, which can also be linked to two different levels of pleasantness. Finally, we discuss how the results from this study could be profitably employed and generalized to pave the path towards a novel generation of robotic devices for HRI.

Design of an under-actuated wrist based on adaptive synergies

An effective robotic wrist represents a key enabling element in robotic manipulation, especially in prosthetics. In this paper, we propose an under-actuated wrist system, which is also adaptable and allows to implement different under-actuation schemes. Our approach leverages upon the idea of soft synergies — in particular the design method of adaptive synergies — as it derives from the field of robot hand design. First we introduce the design principle and its implementation and function in a configurable test bench prototype, which can be used to demonstrate the feasibility of our idea. Furthermore, we report on results from preliminary experiments with humans, aiming to identify the most probable wrist pose during the pre-grasp phase in activities of daily living. Based on these outcomes, we calibrate our wrist prototype accordingly and demonstrate its effectiveness to accomplish grasping and manipulation tasks.

Reflex control of the Pisa/IIT SoftHand during object slippage

In this work, to guarantee the Pisa/IIT SoftHands grasp robustness against slippage, three reflex control modes, namely Current, Pose and Impedance, are implemented and experimentally evaluated. Towards this objective, ThimbleSense fingertip sensors are designed and integrated into the thumb and middle fingers of the SoftHand for real-time detection and control of the slippage. Current reflex regulates the restoring grasp forces of the hand by modulating the motors current profile according to an update law. Pose and Impedance reflex modes instead replicate this behaviour by implementing an impedance control scheme. The difference between the two latter is that the stiffness gain in Impedance reflex mode is being varied in addition to the hand pose, as a function of the slippage on the fingertips. Experimental setup also includes a seven degrees-of-freedom robotic arm to realize consistent trajectories (e.g. lifting) among three control modes for the sake of comparison. Different test objects are considered to evaluate the efficacy of the proposed reflex modes in our experimental setup. Results suggest that task-appropriate restoring forces can be achieved using Impedance reflex due to its capability in demonstrating instantaneous and rather smooth reflexive behaviour during slippage. Preliminary experiments on five healthy human subjects provide evidence on the similarity of the control concepts exploited by the humans and the one realized by the Impedance reflex, highlighting its potential in prosthetic applications.