Klaas Bombeke

Open your eyes for prediction errors

Previous studies have demonstrated that autonomic arousal is increased following correct task performance on a difficult, relative to an easy, task. Here, we hypothesized that this arousal response reflects the (relative) surprise of correct performance following a difficult versus an easy task. Following this line of reasoning, we would expect to find a reversed pattern following erroneous responses, because errors are less expected during an easy than during a difficult task. To test this, participants performed a flanker task while pupil size was measured online. As predicted, the results demonstrated that pupil size was larger following difficult (incongruent) correct trials than following easy (congruent) correct trials, but smaller following difficult than following easy incorrect trials. Moreover, participants with larger congruency effects, and hence a larger difference in outcome expectancies between the two trial types, showed larger differences in pupil size after both correct and incorrect responses, further corroborating the idea that pupil size increased as a measure of performance prediction errors.

Pupil size directly modulates the feedforward response in human primary visual cortex independently of attention

Controversy revolves around the question of whether psychological factors like attention and emotion can influence the initial feedforward response in primary visual cortex (V1). Although traditionally, the electrophysiological correlate of this response in humans (the C1 component) has been found to be unaltered by psychological influences, a number of recent studies have described attentional and emotional modulations. Yet, research into psychological effects on the feedforward V1 response has neglected possible direct contributions of concomitant pupil-size modulations, which are known to also occur under various conditions of attentional load and emotional state. Here we tested the hypothesis that such pupil-size differences themselves directly affect the feedforward V1 response. We report data from two complementary experiments, in which we used procedures that modulate pupil size without differences in attentional load or emotion while simultaneously recording pupil-size and EEG data. Our results confirm that pupil size indeed directly influences the feedforward V1 response, showing an inverse relationship between pupil size and early V1 activity. While it is unclear in how far this effect represents a functionally-relevant adaptation, it identifies pupil-size differences as an important modulating factor of the feedforward response of V1 and could hence represent a confounding variable in research investigating the neural influence of psychological factors on early visual processing.

The effect of alcohol and placebo on post-error adjustments.

Several studies have shown detrimental effects of alcohol on post-error adjustments. In contrast to previous studies, which focused on only one aspect of post-error adaptive behavior, we compared the effect of alcohol and placebo on post-error slowing (PES), post-error reduction of interference (PERI) and post-error improvement of accuracy (PIA). Moreover, we used a between-subjects design (N = 45) comparing a control condition to both an alcohol and an alcohol-placebo condition as to disentangle physiological and expectancy effects of alcohol. In a standard Stroop congruency task, we found that intoxicated participants as well as participants with the incorrect belief of being intoxicated showed significant decreased PES compared to a control group. Furthermore, we found evidence for a condition-independent post-error increase of interference and post-error decrease of accuracy. The underlying mechanisms of the post-error adaptation effects are discussed in terms of the orienting account (Notebaert et al., 2009).

Visual quality assessment of H.264/AVC compressed laparoscopic video

The digital revolution has reached hospital operating rooms, giving rise to new opportunities such as tele-surgery and tele-collaboration. Applications such as minimally invasive and robotic surgery generate large video streams that demand gigabytes of storage and transmission capacity. While lossy data compression can offer large size reduction, high compression levels may significantly reduce image quality. In this study we assess the quality of compressed laparoscopic video using a subjective evaluation study and three objective measures. Test sequences were full High-Definition videos captures of four laparoscopic surgery procedures acquired on two camera types. Raw sequences were processed with H.264/AVC IPPP-CBR at four compression levels (19.5, 5.5, 2.8, and 1.8 Mbps). 16 non-experts and 9 laparoscopic surgeons evaluated the subjective quality and suitability for surgery (surgeons only) using Single Stimulus Continuous Quality Evaluation methodology. VQM, HDR-VDP-2, and PSNR objective measures were evaluated. The results suggest that laparoscopic video may be lossy compressed approximately 30 to 100 times (19.5 to 5.5 Mbps) without sacrificing perceived image quality, potentially enabling real-time streaming of surgical procedures even over wireless networks. Surgeons were sensitive to content but had large variances in quality scores, whereas non-experts judged all scenes similarly and over-estimated the quality of some sequences. There was high correlation between surgeons’ scores for quality and “suitability for surgery”. The objective measures had moderate to high correlation with subjective scores, especially when analyzed separately by camera type. Future studies should evaluate surgeons’ task performance to determine the clinical implications of conducting surgery with lossy compressed video.

The effect of vagus nerve stimulation on response inhibition

In the current study, we explored whether vagus nerve stimulation (VNS) in patients with epilepsy, which is believed to increase norepinephrine (NE) levels via activation of the locus coeruleus, would positively affect response inhibition. Moreover, we tried to identify the dynamics of the underlying neural processes by investigating event-related potentials (ERPs) and pupil size. Patients performed a stop-signal task once when stimulation was switched on and once when it was switched off. We found a correlational pattern suggesting that patients who clinically benefit more from VNS treatment also show a larger behavioral advantage, in terms of faster response inhibition, when the vagus nerve is being stimulated. Event-related potential (ERP) results suggested more pronounced reactive inhibition when stimulation was switched on, independent of the individual amount of seizure reduction. Transient go-locked pupil size was increased from go trials to successful stop trials to unsuccessful stop trials but without displaying a clear VNS effect, which however, might relate to limited sensitivity. We conclude that VNS likely has a positive effect on response inhibition, at least in patients with epilepsy that benefit clinically from the treatment, presumably relating to enhancements of response-inhibition mechanisms and, therefore, identify enhanced response inhibition as a possible cognitive benefit of VNS.

Modulation of locus coeruleus activity by novel oddball stimuli

It has long been known from animal literature that the locus coeruleus (LC), the source region of noradrenergic neurons in the brain, is sensitive to unexpected, novel, and other salient events. In humans, however, direct assessment of LC activity has proven to be challenging due to its small size and difficult localization, which is why noradrenergic activity has often been assessed using more indirect measures such as electroencephalography (EEG) and pupil recordings. Here, we combined high-resolution functional magnetic resonance imaging (fMRI) with a special anatomical sequence to assess neural activity in the LC in response to different types of salient stimuli in an oddball paradigm (novel neutral oddballs, novel emotional oddballs, and familiar target oddballs). We found a significant linear increase of LC activity from standard trials, over familiar target oddballs, to novel neutral and novel emotional oddballs. Importantly, when breaking down this linear trend, only novel oddball stimuli led to robust activity increases as compared to standard trials, with no statistical difference between neutral and emotional ones. This pattern suggests that activity modulations in the LC in the present study were mainly driven by stimulus novelty, rather than by emotional saliency, task relevance, or contextual novelty alone. Moreover, the absence of significant activity modulations in response to target oddballs (which were reported in a recent study) suggests that the LC represents relative rather than absolute saliency of a stimulus in its respective context.

The role of temporal predictability for early attentional adjustments after conflict

A frequently-studied phenomenon in cognitive-control research is conflict adaptation, or the finding that congruency effects are smaller after incongruent trials. Prominent cognitive control accounts suggest that this adaptation effect can be explained by transient conflict-induced modulations of selective attention, reducing congruency effects on the next trial. In the present study, we investigated these possible attentional modulations in four experiments using the Stroop and Flanker tasks, dissociating possible enhancements of task-relevant information from suppression of task-irrelevant information by varying when this information was presented. In two experiments, the irrelevant stimulus information was randomly presented shortly before, at the same time, or briefly after the presentation of the relevant dimension. In the other two, irrelevant information was always presented first, making this aspect fully predictable. Despite the central role that attentional adjustments play in theoretical accounts of conflict adaption, we only found evidence for such processes in one of the four experiments. Specifically, we found a modulation of the attention-related posterior N1 event-related potential component that was consistent with paying less attention to the irrelevant information after incongruent trials. This was accompanied by increased inter-trial mid-frontal theta power and a theta-power conflict adaptation effect. We interpret these results as evidence for an adaptive mechanism based on relative attentional inhibition. Importantly, this mechanism only clearly seems to be implemented in a very specific context of high temporal predictability, and only in the Flanker task.

Differential effects of sustained and transient effort triggered by reward : a combined EEG and pupillometry study

&NA; In instrumental task contexts, incentive manipulations such as posting reward on successful performance usually trigger increased effort, which is signified by effort markers like increased pupil size. Yet, it is not fully clear under which circumstances incentives really promote performance, and which role effort plays therein. In the present study, we compared two schemes of associating reward with a Flanker task, while simultaneously acquiring electroencephalography (EEG) and pupillometry data in order to explore the contribution of effort‐related processes. In Experiment 1, reward was administered in a block‐based fashion, with series of targets in pure reward and no‐reward blocks. The results imply increased sustained effort in the reward blocks, as reflected in particular in sustained increased pupil size. Yet, this was not accompanied by a behavioral benefit, suggesting a failure of translating increased effort into a behavioral pay‐off. In Experiment 2, we introduced trial‐based cues in order to also promote transient preparatory effort application, which indeed led to a behavioral benefit. Again, we observed a sustained pupil‐size increase, but also transient ones. Consistent with this, the EEG data of Experiment 2 indicated increased transient preparatory effort preceding target onset, as well as reward modulations of target processing that arose earlier than in Experiment 1. Jointly, our results indicate that incentive‐triggered effort can operate on different time‐scales, and that, at least for the current task, its transient (and largely preparatory) form is critical for achieving a behavioral benefit, which may relate to the temporal dynamics of the catecholaminergic systems.

Do Not Disturb: Psychophysiological Correlates of Boredom, Flow and Frustration During VR Gaming

Since the technology behind virtual reality (VR) is evolving rapidly and the number of VR applications is growing every year, research on the user’s experience of being in the virtual environment itself and the methodologies to measure these experiences becomes highly important. In this study, we apply the methodology of measuring attentional allocation by means of a dual-task paradigm to the topic of VR gaming. The idea is to ask participants to react to oddball sounds (secondary task), pulling attention away from the primary task (the game). The behavioral (reaction time and accuracy) and neural response (P300 component) to these oddball sounds then tells us something about indirect attentional allocation to the game and possibly the experience of flow. In order to check the latter, we created experiences of boredom, flow and frustration by manipulating the mechanics of the game. In addition, we were interested in other psychophysiological correlates like brain oscillations and average heart rate and whether these differed between gaming with a regular and a VR set-up. Although we were not able to accurately induce feelings of boredom, flow and frustration and could not replicate previous studies showing increased reaction times for oddball sounds during flow, we did find a decreased P300 and more high-frequency brain oscillations in VR compared to regular gaming (indicating more attention to the game). Together, this suggests that psychophysiological measures are promising tools to quantify attentional allocation in VR, but more research is needed to clarify whether and how this translates to flow.