Hein T. van Schie

Modulation of activity in medial frontal and motor cortices during error observation

We used measures of the human event-related brain potential (ERP) to investigate the neural mechanisms underlying error processing during action observation. Participants took part in two conditions, a task execution condition and a task observation condition. We found that activity in both the medial frontal cortex and the motor cortices, as measured via the error-related negativity and the lateralized readiness potential, respectively, was modulated by the correctness of observed behavior. These data suggest that similar neural mechanisms are involved in monitoring ones own actions and the actions of others.

The mirror neuron system is more active during complementary compared with imitative action

We assessed the role of the human mirror neuron system (MNS) in complementary actions using functional magnetic resonance imaging while participants prepared to execute imitative or complementary actions. The BOLD signal in the right inferior frontal gyrus and bilateral inferior parietal lobes was greater during preparation of complementary than during imitative actions, suggesting that the MNS may be essential in dynamically coupling action observation to action execution.

Semantic activation in action planning

Four experiments investigated activation of semantic information in action preparation. Participants either prepared to grasp and use an object (e.g., to drink from a cup) or to lift a finger in association with the objects position following a go/no-go lexical-decision task. Word stimuli were consistent to the action goals of the object use (Experiment 1) or to the finger lifting (Experiment 2). Movement onset times yielded a double dissociation of consistency effects between action preparation and word processing. This effect was also present for semantic categorizations (Experiment 3), but disappeared when introducing a letter identification task (Experiment 4). In sum, our findings indicate that action semantics are activated selectively in accordance with the specific action intention of an actor.

Joint action: Neurocognitive mechanisms supporting human interaction

Humans are experts in cooperating with each other when trying to accomplish tasks they cannot achieve alone. Recent studies of joint action have shown that when performing tasks together people strongly rely on the neurocognitive mechanisms that they also use when performing actions individually, that is, they predict the consequences of their co-actors behavior through internal action simulation. Context-sensitive action monitoring and action selection processes, however, are relatively underrated but crucial ingredients of joint action. In the present paper, we try to correct the somewhat simplified view on joint action by reviewing recent studies of joint action simulation, monitoring, and selection while emphasizing the intricate interrelationships between these processes. We complement our review by defining the contours of a neurologically plausible computational framework of joint action.

Understanding Action beyond Imitation: Reversed Compatibility Effects of Action Observation in Imitation and Joint Action

A robust finding in imitation literature is that people perform their actions more readily if they are congruent with the behavior of another person. These action congruency effects are typically explained by the idea that the observation of someone else acting automatically activates our motor system in a directly matching way. In the present study action congruency effects were investigated between an imitation task and a complementary action task. Subjects imitated or complemented a virtual actors grasp on a manipulandum. In both tasks, a color-cue could be presented forcing subjects to ignore the task rule and execute a predefined grasp. Reaction times revealed a reversal of congruency effects in the complementary action task, suggesting that subjects were able to circumvent the automatic tendency to copy actions or postures of another person. In 2 additional control experiments, congruency effects were replicated, and a Simon effect was identified to underlie faster responses in the imitation task. These results make a case against current theoretical views on imitation and direct matching in favor of more flexible models of perception-action coupling.

2006 Special issue: Goals and means in action observation: A computational approach

Many of our daily activities are supported by behavioural goals that guide the selection of actions, which allow us to reach these goals effectively. Goals are considered to be important for action observation since they allow the observer to copy the goal of the action without the need to use the exact same means. The importance of being able to use different action means becomes evident when the observer and observed actor have different bodies (robots and humans) or bodily measurements (parents and children), or when the environments of actor and observer differ substantially (when an obstacle is present or absent in either environment). A selective focus on the action goals instead of the action means furthermore circumvents the need to consider the vantage point of the actor, which is consistent with recent findings that people prefer to represent the actions of others from their own individual perspective. In this paper, we use a computational approach to investigate how knowledge about action goals and means are used in action observation. We hypothesise that in action observation human agents are primarily interested in identifying the goals of the observed actors behaviour. Behavioural cues (e.g. the way an object is grasped) may help to disambiguate the goal of the actor (e.g. whether a cup is grasped for drinking or handing it over). Recent advances in cognitive neuroscience are cited in support of the models architecture.

The role of inferior frontal and parietal areas in differentiating meaningful and meaningless object-directed actions

Over the past two decades single cell recordings in primates and neuroimaging experiments in humans have uncovered the key properties of visuo-motor mirror neurons located in monkey premotor cortex and parietal cortices as well as homologous areas in the human inferior frontal and inferior parietal cortices which presumably house neurons with similar response properties. One of the most interesting claims regarding the human mirror neuron system (MNS) is that its activity reflects high-level action understanding. If this was the case, one would expect signal in the MNS to differentiate between meaningful and meaningless actions. In the current experiment we tested this prediction using a novel paradigm. Functional magnetic resonance images were collected while participants viewed (i) short films of object-directed actions (ODAs) which were either semantically meaningful, i.e. a hand pressed a stapler or semantically meaningless, i.e. a foot pressed a stapler, (ii) short films of pantomimed actions and (iii) static pictures of objects. Consistent with the notion that the MNS represents high-level action understanding, meaningful and meaningless actions elicited BOLD signal differences at bilateral sites in the supramarginal gyrus (SMG) of the inferior parietal lobule (IPL) where we observed a double dissociation between BOLD response and meaningfullness of actions. Comparison of superadditive responses in the inferior frontal gyrus (IFG) and IPL (supramarginal) regions revealed differential contributions to action understanding. These data further specify the role of specific components of the MNS in understanding object-directed actions.

Self-identification and empathy modulate error-related brain activity during the observation of penalty shots between friend and foe

The ability to detect and process errors made by others plays an important role is many social contexts. The capacity to process errors is typically found to rely on sites in the medial frontal cortex. However, it remains to be determined whether responses at these sites are driven primarily by action errors themselves or by the affective consequences normally associated with their commission. Using an experimental paradigm that disentangles action errors and the valence of their affective consequences, we demonstrate that sites in the medial frontal cortex (MFC), including the ventral anterior cingulate cortex (vACC) and pre-supplementary motor area (pre-SMA), respond to action errors independent of the valence of their consequences. The strength of this response was negatively correlated with the empathic concern subscale of the Interpersonal Reactivity Index. We also demonstrate a main effect of self-identification by showing that errors committed by friends and foes elicited significantly different BOLD responses in a separate region of the middle anterior cingulate cortex (mACC). These results suggest that the way we look at others plays a critical role in determining patterns of brain activation during error observation. These findings may have important implications for general theories of error processing.

Movement-Specific Repetition Suppression in Ventral and Dorsal Premotor Cortex during Action Observation

There are several models of premotor cortex contributions to sensorimotor behavior. For instance, the ventral premotor cortex (PMv) appears to be involved in processing visuospatial object properties for grasping, whereas the dorsal premotor cortex (PMd) is involved in using arbitrary rules to guide advance motor planning. These models have focused on individual movements. Here, we examine the premotor responses evoked during the processing of individual movements functionally embedded in an action. We tested whether processing hand–object interactions and action end states would differentially engage PMv and PMd. We used a repetition suppression (RS)–functional magnetic resonance imaging paradigm in which we independently manipulated the observed grip, the end position of the object (independent of its spatial location), and the hand trajectory. By comparing novel and repeated trials for each of these action components, we could isolate RS effects specific to each of them. Repeating the grasp component attenuated activity in right PMv, whereas repeating the end state of the action reduced blood oxygen level–dependent activity in the left PMd. These results suggest that PMv is involved in controlling the kinematic means of an appropriate hand–object interaction, whereas PMd is focused on specifying the desired end state of an action.

Compromised motor planning and Motor Imagery in right Hemiparetic Cerebral Palsy

We investigated whether motor planning problems in people with Hemiparetic Cerebral Palsy (HCP) are paralleled by impaired ability to use Motor Imagery (MI). While some studies have shown that individuals with HCP can solve a mental rotation task, it was not clear if they used MI or Visual Imagery (VI). In the present study, motor planning and MI were examined in individuals with right HCP (n=10) and controls. Motor planning was measured using an object manipulation task, where participants had to anticipate the end of the motor action. MI was measured using a mental rotation paradigm, where participants judged laterality of hands presented from a back view and a palm view. To test if participants used MI or VI we compared reaction times of lateral versus medial rotations, under the assumption that MI is subject to biomechanical constraints of rotated hands, but VI is not. Individuals with HCP had a higher proportion of task failures due to inappropriate grip choice, exemplifying impaired planning. Second, individuals with HCP did not show a reaction time difference between lateral and medial rotations, indicating an impaired ability to use MI. These findings show that compromised motor planning in HCP is paralleled by an impairment in the ability to use MI. Training of MI may be a useful entry-point for rehabilitation of motor planning problems.