Stefan Scherbaum

How decisions evolve: the temporal dynamics of action selection.

To study the process of decision-making under conflict, researchers typically analyze response latency and accuracy. However, these tools provide little evidence regarding how the resolution of conflict unfolds over time. Here, we analyzed the trajectories of mouse movements while participants performed a continuous version of a spatial conflict task (the Simon task). We applied a novel combination of multiple regression analysis and distribution analysis to determine how conflict on the present trial and carry-over from the previous trial affect responding. Response on the previous trial and the degree of conflict on the previous and the current trial all influenced performance, but they did so differently: The previous response influenced the early part of the mouse trajectory, but the degree of previous and current conflict influenced later parts. This suggests that in this task experiencing conflict may not proactively ready the system to handle conflict on the next trial; rather, when conflict is experienced on the subsequent trial the previous compensatory processing may be re-activated more efficiently.

The dynamics of cognitive control: Evidence for within‐trial conflict adaptation from frequency‐tagged EEG

A central topic in the cognitive sciences is how cognitive control is adapted flexibly to changing task demands. Conflict monitoring theory originally proposed conflict triggered adjustments of cognitive control after a conflict trial to improve subsequent performance. In the present study, we tested the hypothesis that readjustments of cognitive control occur continuously within a conflict trial itself. Using frequency tagged electroencephalogram in a flanker task, we traced the allocation of attention to target and distracter stimuli. We found evidence for a conflict-triggered within-trial contrast enhancement dissociating target and distracters. This contrast enhancement vanished for consecutive trials with constant tagging frequencies, indicating that trial-to-trial conflict adaptation effects may, at least partly, be the product of interacting processes serving conflict resolution within trials.

How decisions emerge: action dynamics in intertemporal decision making.

In intertemporal decision making, individuals prefer smaller rewards delivered sooner over larger rewards delivered later, often to an extent that seems irrational from an economical perspective. This behavior has been attributed to a lack of self-control and reflection, the nonlinearity of human time perception, and several other sources. Although an increasing number of models propose different mathematical descriptions of temporal discounting, the dynamics of the decision process behind temporal discounting are much less clear. In this study, we obtained further insights into the mechanisms of intertemporal decisions by observing choice action dynamics via a novel combination of continuously recorded mouse movements and a multiple regression approach. Participants had to choose between two hypothetical options (sooner/smaller vs. later/larger) by moving the mouse cursor from the bottom of the screen either to the top left or to the top right. We observed less direct mouse movements when participants chose later/larger rewards, indicating that participants had to overcome the attraction of the sooner/smaller reward first. Additionally, our results suggest that framing time information differently changes the weighting of value. We conclude that using a continuous process-oriented approach could further advance the understanding of intertemporal choice beyond the identification of the best fitted mathematical description of the discounting function by uncovering the way intertemporal decisions are performed.

Dysfunctional decision-making in pathological gambling: Pattern specificity and the role of impulsivity

Dysfunctional decision-making in individuals with pathological gambling (PGs) may result from dominating reward-driven processes, indicated by higher impulsivity. In the current study we examined (1) if PGs show specific decision-making impairments related to dominating reward-driven processes rather than to strategic planning deficits and (2) whether these impairments are related to impulsivity. Nineteen PGs according to DSM-IV and 19 matched control subjects undertook the Cambridge Gambling Task (CGT) to assess decision-making. The delay discounting paradigm (DDP) as well as the UPPS Impulsive Behavior Scale (measuring urgency, premeditation, perseverance and sensation seeking) were administered as multidimensional measures of impulsivity. Results revealed that (1) PGs exhibited higher risk seeking and an immediate reward focus in the CGT and, in contrast, comparable strategic planning to the control group. (2) Decision-making impairments were related to more severe delay discounting and, specifically, to increased urgency and less premeditation. Our findings suggest (1) the necessity to disentangle decision-making components in order to improve etiological models of PGs, and (2) that urgency and premeditation are specifically related to disadvantageous decision-making and should be tackled in intervention strategies focusing on emotion tolerance and control strategies.

Dynamic goal states: adjusting cognitive control without conflict monitoring.

A central topic in the cognitive sciences is how cognitive control is adjusted flexibly to changing environmental demands at different time scales to produce goal-oriented behavior. According to an influential account, the context-sensitive recruitment of cognitive control is mediated by a specialized conflict monitoring process that registers current conflict and signals the demand for enhanced control in subsequent trials. This view has been immensely successful not least due to supporting evidence from neuroimaging studies suggesting that the conflict monitoring function is localized within the anterior cingulate cortex (ACC) which, in turn, signals the demand for enhanced control to the prefrontal cortex (PFC). In this article, we propose an alternative model of the adaptive regulation of cognitive control based on multistable goal attractor network dynamics and adjustments of cognitive control within a conflict trial. Without incorporation of an explicit conflict monitoring module, the model mirrors behavior in conflict tasks accounting for effects of response congruency, sequential conflict adaptation, and proportion of incongruent trials. Importantly, the model also mirrors frequency tagged EEG data indicating continuous conflict adaptation and suggests a reinterpretation of the correlation between ACC and the PFC BOLD data reported in previous imaging studies. Together, our simulation data propose an alternative interpretation of both behavioral data as well as imaging data that have previously been interpreted in favor of a specialized conflict monitoring process in the ACC.

Building a Bridge into the Future: Dynamic Connectionist Modeling as an Integrative Tool for Research on Intertemporal Choice

Temporal discounting denotes the fact that individuals prefer smaller rewards delivered sooner over larger rewards delivered later, often to a higher extent than suggested by normative economical theories. In this article, we identify three lines of research studying this phenomenon which aim (i) to describe temporal discounting mathematically, (ii) to explain observed choice behavior psychologically, and (iii) to predict the influence of specific factors on intertemporal decisions. We then opt for an approach integrating postulated mechanisms and empirical findings from these three lines of research. Our approach focuses on the dynamical properties of decision processes and is based on computational modeling. We present a dynamic connectionist model of intertemporal choice focusing on the role of self-control and time framing as two central factors determining choice behavior. Results of our simulations indicate that the two influences interact with each other, and we present experimental data supporting this prediction. We conclude that computational modeling of the decision process dynamics can advance the integration of different strands of research in intertemporal choice.

Harder than Expected: Increased Conflict in Clearly Disadvantageous Delayed Choices in a Computer Game

When choosing between immediate and temporally delayed goods, people sometimes decide disadvantageously. Here, we aim to provide process-level insight into differences between individually determined advantageous and disadvantageous choices. Participants played a computer game, deciding between two different rewards of varying size and distance by moving an agent towards the chosen reward. We calculated individual models of advantageous choices and characterized the decision process by analyzing mouse movements. The larger amount of participants’ choices was classified as advantageous and the disadvantageous choices were biased towards choosing sooner/smaller rewards. The deflection of mouse movements indicated more conflict in disadvantageous choices compared with advantageous choices when the utilities of the options differed clearly. Further process oriented analysis revealed that disadvantageous choices were biased by a tendency for choice-repetition and an undervaluation of the value information in favour of the delay information, making rather simple choices harder than could be expected from the properties of the decision situation.

Increased impulsivity in pathological gambling: Considering nicotine dependence

Introduction: It has been highlighted that increased impulsivity is an important etiological factor in pathological gambling (PG). However, the role of the highly prevalent comorbid mental disorders in PG remains unclear. This is of special concern as the highest comorbidity was found between PG and nicotine dependence (ND), which, in turn, has also been associated with heightened impulsivity. This study aimed to find out whether increased impulsivity in PG is a specific characteristic related to comorbid mental disorders in general or especially to ND. Method: A cross-sectional study was designed that included a healthy control group and three disorder groups with comorbid PG excluding ND, comorbid PG including ND, and ND alone according to the Diagnostic and Statistical Manual of Mental Disorders–Fourth Edition. Impulsivity was assessed according to the dimensions response and choice impulsivity applying behavioral and self-report measures. Results: We found (a) increased response impulsivity in the comorbid PG group when compared to the control group. Furthermore, increased choice impulsivity was found (b) in comorbid PG excluding ND and (c) in comorbid PG including ND when compared to ND alone. Other group differences did not reach significance. Conclusions: Our findings highlight that comorbid PG shares deficits in inhibitory control with ND. In contrast, maladaptive choices are a specific disorder characteristic of comorbid PG when compared to ND. If replicated in further studies, intervention strategies strengthening cognitive control skills might be effective for comorbid PG as well as ND whereas strategies enhancing maladaptive valuation of rewards might be specifically effective in comorbid PG.

Unraveling the sub-processes of selective attention: insights from dynamic modeling and continuous behavior

Selective attention biases information processing toward stimuli that are relevant for achieving our goals. However, the nature of this bias is under debate: Does it solely rely on the amplification of goal-relevant information or is there a need for additional inhibitory processes that selectively suppress currently distracting information? Here, we explored the processes underlying selective attention with a dynamic, modeling-based approach that focuses on the continuous evolution of behavior over time. We present two dynamic neural field models incorporating the diverging theoretical assumptions. Simulations with both models showed that they make similar predictions with regard to response times but differ markedly with regard to their continuous behavior. Human data observed via mouse tracking as a continuous measure of performance revealed evidence for the model solely based on amplification but no indication of persisting selective distracter inhibition.

Step by step: Harvesting the dynamics of delay discounting decisions

People show a tendency to devalue rewards when they are delayed in time. This so-called delay discounting often happens to an extent that seems irrational from an economical perspective. Research studying outcomes of delay discounting decisions has successfully derived descriptive models for such choice preferences. However, this outcome-based approach faces limitations in integrating the influence of contextual factors on the decision. Recently, this outcome-centred perspective on delay discounting has been complemented by a focus on the process dynamics leading to delay discounting decisions. Here, we embrace and add to this approach: We show how an attractor model can extend discounting descriptive discounting curves into the temporal dimension. From the model, we derive three predictions and study the predictions in a delay discounting experiment based on mouse tracking. We find differences in discounting depending on the order of option presentation and more direct movements to options presented first. Together with the analysis of specific temporal patterns of information integration, these results show that considering the continuous process dynamics of delay discounting decisions and harvesting them with continuous behavioural measures allow the integration of contextual factors into existing models of delay discounting, not as noise but as a signal on their own.