Guido Hesselmann

Spontaneous local variations in ongoing neural activity bias perceptual decisions

Neural variability in responding to identical repeated stimuli has been related to trial-by-trial fluctuations in ongoing activity, yet the neural and perceptual consequences of these fluctuations remain poorly understood. Using functional neuroimaging, we recorded brain activity in subjects who reported perceptual decisions on an ambiguous figure, Rubins vase-faces picture, which was briefly presented at variable intervals of ≥20 s. Prestimulus activity in the fusiform face area, a cortical region preferentially responding to faces, was higher when subjects subsequently perceived faces instead of the vase. This finding suggests that endogenous variations in prestimulus neuronal activity biased subsequent perceptual inference. Furnishing evidence that evoked sensory responses, we then went on to show that the pre- and poststimulus activity interact in a nonlinear way and the ensuing perceptual decisions depend upon the prestimulus context in which they occur.

Distributed and antagonistic contributions of ongoing activity fluctuations to auditory stimulus detection.

Recent studies have shown that ongoing activity fluctuations influence trial-by-trial perception of identical stimuli. Some brain systems seem to bias toward better perceptual performance and others toward worse. We tested whether these observations generalize to another as of yet unassessed sensory modality, audition, and a nonspatial but memory-dependent paradigm. In a sparse event-related functional magnetic resonance imaging design, we investigated detection of auditory near-threshold stimuli as a function of prestimulus baseline activity in early auditory cortex as well as several distributed networks that were defined on the basis of resting state functional connectivity. In accord with previous studies, hits were associated with higher prestimulus activity in related early sensory cortex as well as in a system comprising anterior insula, anterior cingulate, and thalamus, which other studies have related to processing salience and maintaining task set. In contrast to previous studies, however, higher prestimulus activity in the so-called dorsal attention system of frontal and parietal cortex biased toward misses, whereas higher activity in the so-called default mode network that includes posterior cingulate and precuneus biased toward hits. These results contradict a simple dichotomic view on the function of these two latter brain systems where higher ongoing activity in the dorsal attention network would facilitate perceptual performance, and higher activity in the default mode network would deteriorate perceptual performance. Instead, we show that the way in which ongoing activity fluctuations impact on perception depends on the specific sensory (i.e., nonspatial) and cognitive (i.e., mnemonic) context that is relevant.

The relation of ongoing brain activity, evoked neural responses, and cognition

Ongoing brain activity has been observed since the earliest neurophysiological recordings and is found over a wide range of temporal and spatial scales. It is characterized by remarkably large spontaneous modulations. Here, we review evidence for the functional role of these ongoing activity fluctuations and argue that they constitute an essential property of the neural architecture underlying cognition. The role of spontaneous activity fluctuations is probably best understood when considering both their spatiotemporal structure and their functional impact on cognition. We first briefly argue against a “segregationist” view on ongoing activity, both in time and space, which would selectively associate certain frequency bands or levels of spatial organization with specific functional roles. Instead, we emphasize the functional importance of the full range, from differentiation to integration, of intrinsic activity within a hierarchical spatiotemporal structure. We then highlight the flexibility and context-sensitivity of intrinsic functional connectivity that suggest its involvement in functionally relevant information processing. This role in information processing is pursued by reviewing how ongoing brain activity interacts with afferent and efferent information exchange of the brain with its environment. We focus on the relationship between the variability of ongoing and evoked brain activity, and review recent reports that tie ongoing brain activity fluctuations to variability in human perception and behavior. Finally, these observations are discussed within the framework of the free-energy principle which – applied to human brain function – provides a theoretical account for a non-random, coordinated interaction of ongoing and evoked activity in perception and behavior.

Ongoing Activity Fluctuations in hMT+ Bias the Perception of Coherent Visual Motion

We have recently shown that intrinsic fluctuations of ongoing activity during baseline have an impact on perceptual decisions reported for an ambiguous visual stimulus (Hesselmann et al., 2008). To test whether this result generalizes from the visual object domain to other perceptual and neural systems, the current study investigated the effect of ongoing signal fluctuations in motion-sensitive brain regions on the perception of coherent visual motion. We determined motion coherence thresholds individually for each subject using a dynamic random dot display. During functional magnetic resonance imaging (fMRI), brief events of subliminal, supraliminal, and periliminal coherent motion were presented with long and variable interstimulus intervals between them. On each trial, subjects reported whether they had perceived “coherent” or “random” motion, and fMRI signal time courses were analyzed separately as a function of stimulus and percept type. In the right motion-sensitive occipito-temporal cortex (hMT+), coherent percepts of periliminal stimuli yielded a larger stimulus-evoked response than random percepts. Prestimulus baseline activity in this region was also significantly higher in these coherent trials than in random trials. As in our previous study, however, the relation between ongoing and evoked activity was not additive but interacted with perceptual outcome. Our data thus suggest that endogenous fluctuations in baseline activity have a generic effect on subsequent perceptual decisions. Although mainstream analytical techniques used in functional neuroimaging do not capture this nonadditive effect of baseline on evoked response, it is in accord with postulates from theoretical frameworks as, for instance, predictive coding.

Predictive Coding or Evidence Accumulation? False Inference and Neuronal Fluctuations

Perceptual decisions can be made when sensory input affords an inference about what generated that input. Here, we report findings from two independent perceptual experiments conducted during functional magnetic resonance imaging (fMRI) with a sparse event-related design. The first experiment, in the visual modality, involved forced-choice discrimination of coherence in random dot kinematograms that contained either subliminal or periliminal motion coherence. The second experiment, in the auditory domain, involved free response detection of (non-semantic) near-threshold acoustic stimuli. We analysed fluctuations in ongoing neural activity, as indexed by fMRI, and found that neuronal activity in sensory areas (extrastriate visual and early auditory cortex) biases perceptual decisions towards correct inference and not towards a specific percept. Hits (detection of near-threshold stimuli) were preceded by significantly higher activity than both misses of identical stimuli or false alarms, in which percepts arise in the absence of appropriate sensory input. In accord with predictive coding models and the free-energy principle, this observation suggests that cortical activity in sensory brain areas reflects the precision of prediction errors and not just the sensory evidence or prediction errors per se.

Neural processing of visual information under interocular suppression: a critical review

When dissimilar stimuli are presented to the two eyes, only one stimulus dominates at a time while the other stimulus is invisible due to interocular suppression. When both stimuli are equally potent in competing for awareness, perception alternates spontaneously between the two stimuli, a phenomenon called binocular rivalry. However, when one stimulus is much stronger, e.g., due to higher contrast, the weaker stimulus can be suppressed for prolonged periods of time. A technique that has recently become very popular for the investigation of unconscious visual processing is continuous flash suppression (CFS): High-contrast dynamic patterns shown to one eye can render a low-contrast stimulus shown to the other eye invisible for up to minutes. Studies using CFS have produced new insights but also controversies regarding the types of visual information that can be processed unconsciously as well as the neural sites and the relevance of such unconscious processing. Here, we review the current state of knowledge in regard to neural processing of interocularly suppressed information. Focusing on recent neuroimaging findings, we discuss whether and to what degree such suppressed visual information is processed at early and more advanced levels of the visual processing hierarchy. We review controversial findings related to the influence of attention on early visual processing under interocular suppression, the putative differential roles of dorsal and ventral areas in unconscious object processing, and evidence suggesting privileged unconscious processing of emotional and other socially relevant information. On a more general note, we discuss methodological and conceptual issues, from practical issues of how unawareness of a stimulus is assessed to the overarching question of what constitutes an adequate operational definition of unawareness. Finally, we propose approaches for future research to resolve current controversies in this exciting research area.

Frontoparietal Cortex Mediates Perceptual Transitions in Bistable Perception

During bistable vision, perception oscillates between two mutually exclusive percepts despite constant sensory input. Greater BOLD responses in frontoparietal cortex have been shown to be associated with endogenous perceptual transitions compared with “replay” transitions designed to closely match bistability in both perceptual quality and timing. It has remained controversial, however, whether this enhanced activity reflects causal influences of these regions on processing at the sensory level or, alternatively, an effect of stimulus differences that result in, for example, longer durations of perceptual transitions in bistable perception compared with replay conditions. Using a rotating Lissajous figure in an fMRI experiment on 15 human participants, we controlled for potential confounds of differences in transition duration and confirmed previous findings of greater activity in frontoparietal areas for transitions during bistable perception. In addition, we applied dynamic causal modeling to identify the neural model that best explains the observed BOLD signals in terms of effective connectivity. We found that enhanced activity for perceptual transitions is associated with a modulation of top-down connectivity from frontal to visual cortex, thus arguing for a crucial role of frontoparietal cortex in perceptual transitions during bistable perception.

Reduction in inter-hemispheric connectivity in disorders of consciousness.

Clinical diagnosis of disorders of consciousness (DOC) caused by brain injury poses great challenges since patients are often behaviorally unresponsive. A promising new approach towards objective DOC diagnosis may be offered by the analysis of ultra-slow (<0.1 Hz) spontaneous brain activity fluctuations measured with functional magnetic resonance imaging (fMRI) during the resting-state. Previous work has shown reduced functional connectivity within the “default network”, a subset of regions known to be deactivated during engaging tasks, which correlated with the degree of consciousness impairment. However, it remains unclear whether the breakdown of connectivity is restricted to the “default network”, and to what degree changes in functional connectivity can be observed at the single subject level. Here, we analyzed resting-state inter-hemispheric connectivity in three homotopic regions of interest, which could reliably be identified based on distinct anatomical landmarks, and were part of the “Extrinsic” (externally oriented, task positive) network (pre- and postcentral gyrus, and intraparietal sulcus). Resting-state fMRI data were acquired for a group of 11 healthy subjects and 8 DOC patients. At the group level, our results indicate decreased inter-hemispheric functional connectivity in subjects with impaired awareness as compared to subjects with intact awareness. Individual connectivity scores significantly correlated with the degree of consciousness. Furthermore, a single-case statistic indicated a significant deviation from the healthy sample in 5/8 patients. Importantly, of the three patients whose connectivity indices were comparable to the healthy sample, one was diagnosed as locked-in. Taken together, our results further highlight the clinical potential of resting-state connectivity analysis and might guide the way towards a connectivity measure complementing existing DOC diagnosis.

Give it time: Neural evidence for distorted time perception and enhanced memory encoding in emotional situations

Time perception is compromised in emotional situations, yet our ability to remember these events is enhanced. Here we suggest how the two phenomena might be functionally linked and describe the neural networks that underlie this association. We found that participants perceived an emotionally aversive stimulus longer than it was, compared to an immediately following neutral stimulus. These time estimation errors were in the same trials associated with better recognition memory for the emotionally aversive stimuli and poorer memory for the neutral stimuli. Functional imaging revealed that the superior frontal gyrus was activated during time perception with aversive stimuli, and the amygdala, putamen and insula showed activations that are specific to time estimation errors in this aversive context. We further found that activity in the insula and putamen was correlated with memory performance but only during over-estimation of time with the aversive stimuli. We suggest that processing is accelerated during the experience of emotionally aversive events, presumably in the service of memory-related operations, resulting in better encoding but at the expense of time perception accuracy.

What Visual Information Is Processed in the Human Dorsal Stream

The idea of a division between a dorsal and a ventral visual stream is one of the most basic principles of visual processing in the brain ([Milner and Goodale, 1995][1]). The ventral stream originates in primary visual cortex and extends along the ventral surface into the temporal cortex; the dorsal