Katja Fiehler

Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring

Goal-directed behavior requires the continuous monitoring and dynamic adjustment of ongoing actions. Here, we report a direct coupling between the event-related electroencephalogram (EEG), functional magnetic resonance imaging (fMRI), and behavioral measures of performance monitoring in humans. By applying independent component analysis to EEG signals recorded simultaneously with fMRI, we found the single-trial error-related negativity of the EEG to be systematically related to behavior in the subsequent trial, thereby reflecting immediate behavioral adjustments of a cognitive performance monitoring system. Moreover, this trial-by-trial EEG measure of performance monitoring predicted the fMRI activity in the rostral cingulate zone, a brain region thought to play a key role in processing of response errors. We conclude that investigations of the dynamic coupling between EEG and fMRI provide a powerful approach for the study of higher order brain functions.

Neural correlates of error detection and error correction: is there a common neuroanatomical substrate?

Successful behaviour requires error detection resulting in remedial actions, such as immediate error correction. The present event‐related functional magnetic resonance imaging study in humans examined the neural correlates of error detection and error correction using a speeded modified flankers task. In order to investigate corrective behaviour, participants were randomly divided into two groups. The correction instructed group was asked to correct all encountered errors immediately. The correction not instructed group was unaware that corrective responses were recorded. The intention to correct errors significantly increased the correction rate. Brain activations correlating with error detection were isolated in the rostral cingulate zone and in the pre‐supplementary motor area, supporting their important role in error processing. Error correction activated similar brain regions, suggesting a common neuroanatomical substrate. Additional activations were found in the parietal cortex, representing an interconnected cortical network, which processes somatosensory information of tactile stimuli.

The human dorsal action control system develops in the absence of vision.

The primate dorsal pathway has been proposed to compute vision for action. Although recent findings suggest that dorsal pathway structures contribute to somatosensory action control as well, it is yet not clear whether or not the development of dorsal pathway functions depends on early visual experience. Using functional magnetic resonance imaging, we investigated the pattern of cortical activation in congenitally blind and matched blindfolded sighted adults while performing kinesthetically guided hand movements. Congenitally blind adults activated similar dorsal pathway structures as sighted controls. Group-specific activations were found in the extrastriate cortex and the auditory cortex for congenitally blind humans and in the precuneus and the presupplementary motor area for sighted humans. Dorsal pathway activity was in addition observed for working memory maintenance of kinesthetic movement information in both groups. Thus, the results suggest that dorsal pathway functions develop in the absence of vision. This favors the idea of a general mechanism of movement control that operates regardless of the sensory input modality. Group differences in cortical activation patterns imply different movement control strategies as a function of visual experience.

How moving objects become animated : The human mirror neuron system assimilates non-biological movement patterns

Abstract The so-called mirror neuron system (MNS) responds when humans observe actions performed by a member of their own species. This activity is understood as an internal motor representation of the observed movement pattern. By contrasting meaningless human hand movements with meaningless artificial movements of objects in space, we tested the claim that exclusively movements belonging to the human motor repertoire have direct access to the MNS. Eighteen participants observed video clips of moving hands and objects while the hemodynamic response was recorded with functional magnetic resonance imaging. Second-level analysis of the hemodynamic response revealed substantially overlapping activation patterns for both types of movements including relevant structures of the MNS (bilateral premotor and parietal areas, occipito-temporal junction, postcentral gyrus and the right superior temporal sulcus). This suggests that perceptual processing of moving hands and objects recruits similar and overlapping cortical networks. Direct comparison of the two movement types revealed stronger activations for hand movements mainly in structures of the MNS suggesting an “expertise effect”. Overall, our results provide evidence that observing movements not explicitly belonging to the human motor repertoire can activate the human MNS, most likely because an association with a biological movement is evoked.

Functional Magnetic Resonance Imaging Adaptation Reveals the Cortical Networks for Processing Grasp-Relevant Object Properties

Grasping behaviors require the selection of grasp-relevant object dimensions, independent of overall object size. Previous neuroimaging studies found that the intraparietal cortex processes object size, but it is unknown whether the graspable dimension (i.e., grasp axis between selected points on the object) or the overall size of objects triggers activation in that region. We used functional magnetic resonance imaging adaptation to investigate human brain areas involved in processing the grasp-relevant dimension of real 3-dimensional objects in grasping and viewing tasks. Trials consisted of 2 sequential stimuli in which the objects grasp-relevant dimension, its global size, or both were novel or repeated. We found that calcarine and extrastriate visual areas adapted to object size regardless of the grasp-relevant dimension during viewing tasks. In contrast, the superior parietal occipital cortex (SPOC) and lateral occipital complex of the left hemisphere adapted to the grasp-relevant dimension regardless of object size and task. Finally, the dorsal premotor cortex adapted to the grasp-relevant dimension in grasping, but not in viewing, tasks, suggesting that motor processing was complete at this stage. Taken together, our results provide a complete cortical circuit for progressive transformation of general object properties into grasp-related responses.

Plasticity of multisensory dorsal stream functions: Evidence from congenitally blind and sighted adults

The dorsal stream has been proposed to compute vision for space perception and for the control of action. However, perceiving space and guiding movements is not only based on vision but also on other sensory modalities such as proprioception and kinesthesia. Blind people who lost vision early in life provide an exceptional example to study the plasticity of dorsal stream functions. Using fMRI and psychophysical methods, action control and space perception was investigated in congenitally blind and sighted adults while performing active and passive hand movements without visual feedback. The functional imaging data showed largely overlapping activation patterns for kinesthetically guided hand movements in congenitally blind and sighted participants covering regions of the dorsal stream. In contrast to the sighted participants, congenitally blind participants additionally activated the extrastriate cortex and the auditory cortex. The psychophysical results revealed a significant correlation between proprioceptive spatial discrimination acuity of the blind and the age when they had attended an orientation and mobility training, i.e., an extensive non-visual spatial training. The earlier the blind acquired such a spatial training the more accurate and the more precise was their space perception in later life. Our findings suggest a multisensory network of movement control that develops on the basis of sensorimotor feedback rather than being under the exclusive control of vision. Thus, visual deprivation seems to result in both cross-modal and compensatory intra-modal plasticity. The present findings further imply that dorsal stream functions are shaped by non-visual spatial information during early development.

Working memory maintenance of grasp-target information in the human posterior parietal cortex

Event-related functional magnetic resonance imaging was applied to identify cortical areas involved in maintaining target information in working memory used for an upcoming grasping action. Participants had to grasp with their thumb and index finger of the dominant right hand three-dimensional objects of different size and orientation. Reaching-to-grasp movements were performed without visual feedback either immediately after object presentation or after a variable delay of 2-12 s. The right inferior parietal cortex demonstrated sustained neural activity throughout the delay, which overlapped with activity observed during encoding of the grasp target. Immediate and delayed grasping activated similar motor-related brain areas and showed no differential activity. The results suggest that the right inferior parietal cortex plays an important functional role in working memory maintenance of grasp-related information. Moreover, our findings confirm the assumption that brain areas engaged in maintaining information are also involved in encoding the same information, and thus extend previous findings on working memory function of the posterior parietal cortex in saccadic behavior to reach-to-grasp movements.

Optimal integration of visual and proprioceptive movement information for the perception of trajectory geometry.

Many studies demonstrated a higher accuracy in perception and action when using more than one sense. The maximum-likelihood estimation (MLE) model offers a recent approach on how perceptual information is integrated across different sensory modalities suggesting statistically optimal integration. The purpose of the present study was to investigate how visual and proprioceptive movement information is integrated for the perception of trajectory geometry. To test this, participants sat in front of an apparatus that moved a handle along a horizontal plane. Participants had to decide whether two consecutive trajectories formed an acute or an obtuse movement path. Judgments had to be based on information from a single modality alone, i.e., vision or proprioception, or on the combined information of both modalities. We estimated both the bias and variance for each single modality condition and predicted these parameters for the bimodal condition using the MLE model. Consistent with previous findings, variability decreased for perceptual judgments about trajectory geometry based on combined visual-proprioceptive information. Furthermore, the observed bimodal data corresponded well to the predicted parameters. Our results suggest that visual and proprioceptive movement information for the perception of trajectory geometry is integrated in a statistically optimal manner.

Interaction between gaze and visual and proprioceptive position judgements

There is considerable evidence that targets for action are represented in a dynamic gaze-centered frame of reference, such that each gaze shift requires an internal updating of the target. Here, we investigated the effect of eye movements on the spatial representation of targets used for position judgements. Participants had their hand passively placed to a location, and then judged whether this location was left or right of a remembered visual or remembered proprioceptive target, while gaze direction was varied. Estimates of position of the remembered targets relative to the unseen position of the hand were assessed with an adaptive psychophysical procedure. These positional judgements significantly varied relative to gaze for both remembered visual and remembered proprioceptive targets. Our results suggest that relative target positions may also be represented in eye-centered coordinates. This implies similar spatial reference frames for action control and space perception when positions are coded relative to the hand.

A task-dependent effect of memory and hand-target on proprioceptive localization

We examine whether the task goal affects the accuracy and precision with which participants can localize an unseen hand. Proprioceptive localization was measured using three different tasks: two goal-directed movement tasks (reaching to and reproducing final hand-target location) and a perceptual estimation task in which participants judged the location of the hand-target relative to visual references. We also assessed whether proprioceptive localization in these different tasks is affected by localization from memory, the hand-target being localized (left or right) or the movement path of the proprioceptive target (9 paths, derived from combinations of starting and final hand-target positions). We found that participants were less precise when reaching from memory, but not when reproducing or estimating remembered final hand-target location. Participants also misperceived the felt location of their hands, judging their left hand to be more leftward and their right hand to be more rightward when reaching to and when estimating final hand-target location, but not when reproducing hand-target location. The movement path of the proprioceptive target did not affect localization, regardless of the task goal. Overall, localization seems poorer when proprioception is used to guide a reach with the opposite hand, particularly from memory, and best when merely reproducing the proprioceptive target site. This may have an important application in neuro-rehabilitation, whereby one task may better establish or re-establish important or failing sensory connections.