Emmanuele Tidoni

Kinematics fingerprints of leader and follower role-taking during cooperative joint actions.

Performing online complementary motor adjustments is quintessential to joint actions since it allows interacting people to coordinate efficiently and achieve a common goal. We sought to determine whether, during dyadic interactions, signaling strategies and simulative processes are differentially implemented on the basis of the interactional role played by each partner. To this aim, we recorded the kinematics of the right hand of pairs of individuals who were asked to grasp as synchronously as possible a bottle-shaped object according to an imitative or complementary action schedule. Task requirements implied an asymmetric role assignment so that participants performed the task acting either as (1) Leader (i.e., receiving auditory information regarding the goal of the task with indications about where to grasp the object) or (2) Follower (i.e., receiving instructions to coordinate their movements with their partner’s by performing imitative or complementary actions). Results showed that, when acting as Leader, participants used signaling strategies to enhance the predictability of their movements. In particular, they selectively emphasized kinematic parameters and reduced movement variability to provide the partner with implicit cues regarding the action to be jointly performed. Thus, Leaders make their movements more “communicative” even when not explicitly instructed to do so. Moreover, only when acting in the role of Follower did participants tend to imitate the Leader, even in complementary actions where imitation is detrimental to joint performance. Our results show that mimicking and signaling are implemented in joint actions according to the interactional role of the agent, which in turn is reflected in the kinematics of each partner.

Mere observation of body discontinuity affects perceived ownership and vicarious agency over a virtual hand

The mental representation of one’s body typically implies the continuity of its parts. Here, we used immersive virtual reality to explore whether mere observation of visual discontinuity between the hand and limb of an avatar could influence a person’s sense of ownership of the virtual body (feeling of ownership, FO) and being the agent of its actions (vicarious agency, VA). In experiment 1, we tested whether placing different amounts of visual discontinuity between a virtual hand and limb differently modulate the perceived FO and VA. Participants passively observed from a first-person perspective four different versions of a virtual limb: (1) a full limb; a hand detached from the proximal part of the limb because of deletion of (2) the wrist; (3) the wrist and forearm; (4) and the wrist, forearm and elbow. After observing the static or moving virtual limb, participants reported their feeling of ownership (FO) and vicarious agency (VA) over the hand. We found that even a small visual discontinuity between the virtual hand and arm significantly decreased participants’ FO over the hand during observation of the static limb. Moreover, in the same condition, we found that passive observation of the avatar’s actions induced a decrease in both FO and VA. We replicated the same results in a second study (experiment 2) where we investigated the modulation of FO and VA by comparing the visual body discontinuity with a condition in which the virtual limb was partially occluded. Our data show that mere observation of limb discontinuity can change a person’s ownership and agency over a virtual body observed from a first-person perspective, even in the absence of any multisensory stimulation of the real body. These results shed new light on the role of body visual continuity in modulating self-awareness and agency in immersive virtual reality.

Rubber hand illusion highlights massive visual capture and sensorimotor face-hand remapping in a tetraplegic man

PURPOSE The illusory ownership of a fake hand as part the body follows synchronous tactile stimulation over a visible rubber hand and a covered hand. Whether brain plasticity mechanisms after sensory and motor disconnection modulates this illusion remain unexplored. METHODS We tested a tetraplegic man after synchronous and asynchronous stimulation of the hand and face. RESULTS The illusory ownership of the fake hand was tested four times in separate days and always reported. To verify whether this ownership feeling generalized also to object not resembling the human body we tested this illusion with a plastic bottle and a rubber hand. The illusionary perception of owning an external object using the rubber hand paradigm showed that the temporally matched tactile stimulation on a fake hand and visual capture mechanism create the illusionary feeling that the rubber hand was part of his body. CONCLUSIONS Despite lesions that dramatically disconnect the access to sensory inputs and motor outputs our data suggests a strong visual capture of a rubber hand and a possible remapping of hand-face representations after the spinal lesion. We suggest that vision and brain plasticity may represent a supportive tool for motor rehabilitation in patients with sensory deficits.

Sensorimotor Network Crucial for Inferring Amusement from Smiles

Abstract Understanding whether anothers smile reflects authentic amusement is a key challenge in social life, yet, the neural bases of this ability have been largely unexplored. Here, we combined transcranial magnetic stimulation (TMS) with a novel empathic accuracy (EA) task to test whether sensorimotor and mentalizing networks are critical for understanding anothers amusement. Participants were presented with dynamic displays of smiles and explicitly requested to infer whether the smiling individual was feeling authentic amusement or not. TMS over sensorimotor regions representing the face (i.e., in the inferior frontal gyrus (IFG) and ventral primary somatosensory cortex (SI)), disrupted the ability to infer amusement authenticity from observed smiles. The same stimulation did not affect performance on a nonsocial task requiring participants to track the smiling expression but not to infer amusement. Neither TMS over prefrontal and temporo‐parietal areas supporting mentalizing, nor peripheral control stimulations, affected performance on either task. Thus, motor and somatosensory circuits for controlling and sensing facial movements are causally essential for inferring amusement from anothers smile. These findings highlight the functional relevance of IFG and SI to amusement understanding and suggest that EA abilities may be grounded in sensorimotor networks for moving and feeling the body.

Rubber hand illusion induced by touching the face ipsilaterally to a deprived hand: evidence for plastic "somatotopic" remapping in tetraplegics

Background: Studies in animals and humans indicate that the interruption of body-brain connections following spinal cord injury (SCI) leads to plastic cerebral reorganization. Objective: To explore whether inducing the Rubber Hand Illusion (RHI) via synchronous multisensory visuo-tactile bodily stimulation may reveal any perceptual correlates of plastic remapping in SCI. Methods: In 16 paraplegic, 16 tetraplegic and 16 healthy participants we explored whether RHI may be induced by tactile stimuli involving not only the left hand but also the left hemi-face. Touching the participants actual hand or face was either synchronous or asynchronous with tactile stimuli seen on a rubber hand. We assessed two components of the illusion, namely perceived changes in the real hand in space (indexed by proprioceptive drift) and ownership of the rubber hand (indexed by subjective responses to an ad-hoc questionnaire). Results: Proprioceptive drift and ownership were found in the healthy group only in the condition where the left real and fake hand were touched simultaneously. In contrast, no drift was found in the SCI patients who, however, showed ownership after both synchronous and asynchronous hand stroking. Importantly, only tetraplegics showed the effect also after synchronous face stroking. Conclusions: RHI may reveal plastic phenomena in SCI. In hand representation-deprived tetraplegics, stimuli on the face (represented contiguously in the somatic and motor systems), drive the sense of hand ownership. This hand-face remapping phenomenon may be useful for restoring a sense of self in massively deprived individuals.

Body visual discontinuity affects feeling of ownership and skin conductance responses.

When we look at our hands we are immediately aware that they belong to us and we rarely doubt about the integrity, continuity and sense of ownership of our bodies. Here we explored whether the mere manipulation of the visual appearance of a virtual limb could influence the subjective feeling of ownership and the physiological responses (Skin Conductance Responses, SCRs) associated to a threatening stimulus approaching the virtual hand. Participants observed in first person perspective a virtual body having the right hand-forearm (i) connected by a normal wrist (Full-Limb) or a thin rigid wire connection (Wire) or (ii) disconnected because of a missing wrist (m-Wrist) or a missing wrist plus a plexiglass panel positioned between the hand and the forearm (Plexiglass). While the analysis of subjective ratings revealed that only the observation of natural full connected virtual limb elicited high levels of ownership, high amplitudes of SCRs were found also during observation of the non-natural, rigid wire connection condition. This result suggests that the conscious embodiment of an artificial limb requires a natural looking visual body appearance while implicit reactivity to threat may require physical body continuity, even non-naturally looking, that allows the implementation of protective reactions to threat.

Audio-visual feedback improves the BCI performance in the navigational control of a humanoid robot

Advancement in brain computer interfaces (BCI) technology allows people to actively interact in the world through surrogates. Controlling real humanoid robots using BCI as intuitively as we control our body represents a challenge for current research in robotics and neuroscience. In order to successfully interact with the environment the brain integrates multiple sensory cues to form a coherent representation of the world. Cognitive neuroscience studies demonstrate that multisensory integration may imply a gain with respect to a single modality and ultimately improve the overall sensorimotor performance. For example, reactivity to simultaneous visual and auditory stimuli may be higher than to the sum of the same stimuli delivered in isolation or in temporal sequence. Yet, knowledge about whether audio-visual integration may improve the control of a surrogate is meager. To explore this issue, we provided human footstep sounds as audio feedback to BCI users while controlling a humanoid robot. Participants were asked to steer their robot surrogate and perform a pick-and-place task through BCI-SSVEPs. We found that audio-visual synchrony between footsteps sound and actual humanoids walk reduces the time required for steering the robot. Thus, auditory feedback congruent with the humanoid actions may improve motor decisions of the BCIs user and help in the feeling of control over it. Our results shed light on the possibility to increase robots control through the combination of multisensory feedback to a BCI user.

Primary somatosensory cortex necessary for the perception of weight from other people's action: A continuous theta-burst TMS experiment

ABSTRACT The presence of a network of areas in the parietal and premotor cortices, which are active both during action execution and observation, suggests that we might understand the actions of other people by activating those motor programs for making similar actions. Although neurophysiological and imaging studies show an involvement of the somatosensory cortex (SI) during action observation and execution, it is unclear whether SI is essential for understanding the somatosensory aspects of observed actions. To address this issue, we used off‐line transcranial magnetic continuous theta‐burst stimulation (cTBS) just before a weight judgment task. Participants observed the right hand of an actor lifting a box and estimated its relative weight. In counterbalanced sessions, we delivered sham and active cTBS over the hand region of the left SI and, to test anatomical specificity, over the left motor cortex (M1) and the left superior parietal lobule (SPL). Active cTBS over SI, but not over M1 or SPL, impaired task performance relative to sham cTBS. Moreover, active cTBS delivered over SI just before participants were asked to evaluate the weight of a bouncing ball did not alter performance compared to sham cTBS. These findings indicate that SI is critical for extracting somatosensory features (heavy/light) from observed action kinematics and suggest a prominent role of SI in action understanding. HighlightsTMS over the somatosensory cortex disrupts performance on a weight judgment task.Disruption is specific for judgements based on observed human actions.No TMS effect is found for judgements based on observed non‐human motion.No effect is found when TMS is administered over nearby frontal and parietal region.

Apparent Biological Motion in First and Third Person Perspective

Apparent biological motion is the perception of plausible movements when two alternating images depicting the initial and final phase of an action are presented at specific stimulus onset asynchronies. Here, we show lower subjective apparent biological motion perception when actions are observed from a first relative to a third visual perspective. These findings are discussed within the context of sensorimotor contributions to body ownership.

Illusion of arm movement evoked by tendon vibration in patients with spinal cord injury

BACKGROUND Studies in healthy people show that stimulation of muscle spindles through frequency-specific tendon vibration (TV) induces the illusory perception of movement. Following spinal cord injury (SCI), motor and sensory connections between the brain and parts of the body below-the-lesion level are partially or totally impaired. OBJECTIVE The present investigation is a descriptive study aimed to investigate whether people living with SCI may experience movement illusions comparable to a control group. METHODS Healthy and people with SCI were asked to report on three illusion-related features (Vividness, Duration, Illusory Extension) after receiving 70 Hz TV on the biceps brachii tendon of both arms. Two different forces of stimulation were applied: 2.4 N and 4.2 N. RESULTS Both patients and controls were susceptible to the kinesthetic illusion. However patients presented lower sensitivity to TV than healthy subjects. Participants rated stronger illusions of movement after 4.2 N than 2.4 N stimulation in all the three illusion-related features. Further, patients reported atypical illusory experiences of movement (e.g. as if the arm wanted to extend, or a sensation of pushing against something) that may reflect different reorganization processes following spinal cord injury. CONCLUSION The study provides a preliminary evidence of the possible use of the proprioceptive stimulation in the upper limbs of people living with SCI. Results are discussed in the light of recent advancements of brain-computer applications based on motor imagery for the control of neuroprosthetic and robotic devices in patients with severe sensorimotor deficits.