Lari Vainio

On the relations between action planning, object identification, and motor representations of observed actions and objects

Recent evidence suggests that viewing a static prime object (a hand grasp), can activate action representations that affect the subsequent identification of graspable target objects. The present study explored whether stronger effects on target object identification would occur when the prime object (a hand grasp) was made more action-rich and dynamic. Of additional interest was whether this type of action prime would affect the generation of motor activity normally elicited by the target object. Three experiments demonstrated that grasp observation improved the identification of grasp-congruent target objects relative to grasp-incongruent target objects. We argue from this data that identifying a graspable object includes the processing of its action-related attributes. In addition, grasp observation was shown to influence the motor activity elicited by the target object, demonstrating interplay between action-based and object-based motor coding.

Effect of Syllable Articulation on Precision and Power Grip Performance

The present study was motivated by a theory, which proposes that speech includes articulatory gestures that are connected to particular hand actions. We hypothesized that certain articulatory gestures would be more associated with the precision grip than with the power grip, and vice versa. In the study, the participants pronounced a syllable and performed simultaneously a precision or power grip that was theorized to be either congruent or incongruent with the syllable. Relatively fast precision grip responses were associated with articulatory gestures in which the tip of the tongue contacted the alveolar ridge ([te]) or the aperture of the vocal tract remained small ([hi]), as well as gestures that required lip protrusion ([pu]). In contrast, relatively fast power grip responses were associated with gestures that were produced by moving the back of the tongue against the velum ([ke]) or in which the aperture of the vocal tract remained large ([hα]). In addition to demonstrating that certain articulatory gestures are systematically connected to different grip types, the study may shed some light on discussion concerning sound symbolism and evolution of speech.

Mapping the Identity of a Viewed Hand in the Motor System: Evidence from Stimulus-Response Compatibility.

Brain-imaging research has shown that a viewed acting hand is mapped to the observers hand representation that corresponds with the identity of the hand. In contrast, behavioral research has suggested that rather than representing a seen hand in relation to ones own manual system, it is represented in relation to the midline of an imaginary body. This view was drawn from the finding that indicated that the posture of the viewed hand determines how the hand facilitates responses. The present study explored how an identity of a viewed static hand facilitates responses by varying the onset time and the posture of the hand. The results were in line with the view that an observed hand can activate the observers hand representation that corresponds with the identity of the hand. However, the posture of the hand did not influence these mapping processes. What mattered was the perspective (i.e., egocentric vs. allocentric) from which the hand was viewed.

Shared processing of planning articulatory gestures and grasping

It has been proposed that articulatory gestures are shaped by tight integration in planning mouth and hand acts. This hypothesis is supported by recent behavioral evidence showing that response selection between the precision and power grip is systematically influenced by simultaneous articulation of a syllable. For example, precision grip responses are performed relatively fast when the syllable articulation employs the tongue tip (e.g., [te]), whereas power grip responses are performed relatively fast when the syllable articulation employs the tongue body (e.g., [ke]). However, this correspondence effect, and other similar effects that demonstrate the interplay between grasping and articulatory gestures, has been found when the grasping is performed during overt articulation. The present study demonstrates that merely reading the syllables silently (Experiment 1) or hearing them (Experiment 2) results in a similar correspondence effect. The results suggest that the correspondence effect is based on integration in planning articulatory gestures and grasping rather than requiring an overt articulation of the syllables. We propose that this effect reflects partially overlapped planning of goal shapes of the two distal effectors: a vocal tract shape for articulation and a hand shape for grasping. In addition, the paper shows a pitch–grip correspondence effect in which the precision grip is associated with a high-pitched vocalization of the auditory stimuli and the power grip is associated with a low-pitched vocalization. The underlying mechanisms of this phenomenon are discussed in relation to the articulation–grip correspondence.

Motor inhibition associated with the affordance of briefly displayed objects.

Research has demonstrated that left- and right-hand responses are facilitated when they are performed with the hand compatible with the orientation of a viewed object. This suggests that graspable objects automatically activate the motor representations that correspond to their orientation. It has recently been proposed that similar positive stimulus–response compatibility effects (PCE) may turn into negative compatibility effects (NCE) when a prime object is displayed very briefly. These NCEs are suggested to reflect motor inhibition mechanisms—motor activation triggered by briefly viewed objects may be treated by the motor system as unwanted, and thus it is rapidly inhibited. We examined whether the motor activation triggered by the orientation of a task-irrelevant object is similarly inhibited when the object is displayed briefly. In Experiment 1, a NCE was observed between the orientation of an object and the responding hand when the object was displayed for 30 or 70 ms. The effect turned into a PCE when the object was displayed for 370 ms. Experiment 2 confirmed that this motor inhibition effect was produced by the handle affordance of the object rather than some abstract visual properties of the object.

Negative Stimulus-Response Compatibility Observed with a Briefly Displayed Image of a Hand.

Manual responses can be primed by viewing an image of a hand. The left-right identity of the viewed hand reflexively facilitates responses of the hand that corresponds to the identity. Previous research also suggests that when the response activation is triggered by an arrow, which is backward-masked and presented briefly, the activation manifests itself in the negative priming effect. The present study showed that response activation, which is produced by an identity of a briefly presented image of a hand, can be similarly associated with a negative priming effect. However, in contrast to the previously reported negative priming effects, the hand stimuli produced negative priming even when the hand was not backward-masked and did not contain task-relevant information. The study supports the view that the automatic inhibition of motor activation triggered by briefly viewed objects is a general and basic functional principle in exogenous motor control processes.

Interrupted Object-Based Updating of Reach Program Leads to a Negative Compatibility Effect

The author investigated how the motor program elicited by an objects orientation is updated by object-based information while a participant reaches for the object. Participants selected the hand of response according to the thickness of the graspable object and then reached toward the location in which the object appeared. Reach initiation times decreased when the handle of the object was oriented toward the responding hand. This positive compatibility effect turned into a negative compatibility effect (NCE) during reach execution when the object was removed from the display 300 ms after object onset or replaced with a mask at movement onset. The results demonstrate that interrupted object-based updating of an ongoing reach movement triggers the NCE.

Interaction in planning vocalizations and grasping

Previous studies have shown a congruency effect between manual grasping and syllable articulation. For instance, a power grip is associated with syllables whose articulation involves the tongue body and/or large mouth aperture ([kɑ]) whereas a precision grip is associated with articulations that involve the tongue tip and/or small mouth aperture ([ti]). Previously, this effect has been observed in manual reaction times. The primary aim of the current study was to investigate whether this congruency effect also takes place in vocal responses and to investigate involvement of action selection processes in the effect. The congruency effect was found in vocal and manual responses regardless of whether or not the syllable or grip was known a priori, suggesting that the effect operates with minimal or absent action selection processes. In addition, the effect was observed in vocal responses even when the grip was only prepared but not performed, suggesting that merely planning a grip response primes the corresponding articulatory response. These results support the view that articulation and grasping are processed in a partially overlapping network.

Interaction in planning movement direction for articulatory gestures and manual actions

Some theories concerning speech mechanisms assume that overlapping representations are involved in programming certain articulatory gestures and hand actions. The present study investigated whether planning of movement direction for articulatory gestures and manual actions could interact. The participants were presented with written vowels (Experiment 1) or syllables (Experiment 2) that were associated with forward or backward movement of tongue (e.g., [i] vs. [ɑ] or [te] vs. [ke], respectively). They were required to pronounce the speech unit and simultaneously move the joystick forward or backward according to the color of the stimulus. Manual and vocal responses were performed relatively rapidly when the articulation and the hand action required movement into the same direction. The study suggests that planning horizontal tongue movements for articulation shares overlapping neural mechanisms with planning horizontal movement direction of hand actions.

Mug handle affordance and automatic response inhibition: behavioural and electrophysiological evidence.

Behavioural evidence has shown that the perception of an objects handle automatically activates the corresponding action representation. The activation appears to be inhibited if the object is a task-irrelevant prime mug that is presented very briefly prior to responding to the target arrow. The present study uses an electrophysiological indicator of automatic response priming, the lateralized readiness potential (LRP), to investigate the mechanisms of this inhibition effect. We presumed that this effect would reflect motor self-inhibition processes. The self-inhibition explanation of the effect would assume that the effect reflects activation-followed-by-inhibition observed rapidly after the offset of the prime at the primary motor cortex. However, the results showed that the effect is not associated with modulation of the early LRP deflections. In contrast, the inhibition manifested itself in the later LRP deflections that we assume to be linked to interference in the processing of response-related aspects of the target. We propose that the LRP pattern is similar to what would be predicted from the negative priming explanation of the effect. The study sheds light on understanding inhibition mechanisms associated with automatically activated affordance representations.