Roshan Cools

Inverted-U shaped dopamine actions on human working memory and cognitive control

Brain dopamine (DA) has long been implicated in cognitive control processes, including working memory. However, the precise role of DA in cognition is not well-understood, partly because there is large variability in the response to dopaminergic drugs both across different behaviors and across different individuals. We review evidence from a series of studies with experimental animals, healthy humans, and patients with Parkinsons disease, which highlight two important factors that contribute to this large variability. First, the existence of an optimum DA level for cognitive function implicates the need to take into account baseline levels of DA when isolating the effects of DA. Second, cognitive control is a multifactorial phenomenon, requiring a dynamic balance between cognitive stability and cognitive flexibility. These distinct components might implicate the prefrontal cortex and the striatum, respectively. Manipulating DA will thus have paradoxical consequences for distinct cognitive control processes, depending on distinct basal or optimal levels of DA in different brain regions.

Serotonin and Dopamine: Unifying Affective, Activational, and Decision Functions

Serotonin, like dopamine (DA), has long been implicated in adaptive behavior, including decision making and reinforcement learning. However, although the two neuromodulators are tightly related and have a similar degree of functional importance, compared with DA, we have a much less specific understanding about the mechanisms by which serotonin affects behavior. Here, we draw on recent work on computational models of dopaminergic function to suggest a framework by which many of the seemingly diverse functions associated with both DA and serotonin—comprising both affective and activational ones, as well as a number of other functions not overtly related to either—can be seen as consequences of a single root mechanism.

Striatal Dopamine Predicts Outcome-Specific Reversal Learning and Its Sensitivity to Dopaminergic Drug Administration

Individual variability in reward-based learning has been ascribed to quantitative variation in baseline levels of striatal dopamine. However, direct evidence for this pervasive hypothesis has hitherto been unavailable. We demonstrate that individual differences in reward-based reversal learning reflect variation in baseline striatal dopamine synthesis capacity, as measured with neurochemical positron emission tomography. Subjects with high baseline dopamine synthesis in the striatum showed relatively better reversal learning from unexpected rewards than from unexpected punishments, whereas subjects with low baseline dopamine synthesis in the striatum showed the reverse pattern. In addition, baseline dopamine synthesis predicted the direction of dopaminergic drug effects. The D2 receptor agonist bromocriptine improved reward-based relative to punishment-based reversal learning in subjects with low baseline dopamine synthesis capacity, while impairing it in subjects with high baseline dopamine synthesis capacity in the striatum. Finally, this pattern of drug effects was outcome-specific, and driven primarily by drug effects on punishment-, but not reward-based reversal learning. These data demonstrate that the effects of D2 receptor stimulation on reversal learning in humans depend on task demands and baseline striatal dopamine synthesis capacity.

L-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson's disease.

Evidence indicates that dopaminergic medication in Parkinsons disease may impair certain aspects of cognitive function, such as reversal learning. We used functional magnetic resonance imaging in patients with mild Parkinsons disease to investigate the neural site at which L-DOPA acts during reversal learning. Patients were scanned both ON and OFF their normal dopamine-enhancing L-DOPA medication during the performance of a probabilistic reversal learning task. We demonstrate that L-DOPA modulated reversal-related activity in the nucleus accumbens, but not in the dorsal striatum or the prefrontal cortex. These data concur with evidence from studies with experimental animals and indicate an important role for the human nucleus accumbens in the dopaminergic modulation of reversal learning.

Differential Responses in Human Striatum and Prefrontal Cortex to Changes in Object and Rule Relevance

Event-related functional magnetic resonance imaging was used to measure blood oxygenation level-dependent responses in 16 young healthy human volunteers during performance of an attentional switching task. The task allowed the separate investigation of lower-order switching between concrete objects and higher-order switching between abstract task rules. Significant signal change in the ventral striatum was demonstrated on trials when subjects switched between objects but not when subjects switched between abstract task rules. In contrast, signal change in the lateral prefrontal cortex (PFC) was observed during all switch trials. The switch-related responses were not contaminated by task difficulty, because the greatest signal change was observed during the relatively easy switch trials, which required both lower-order and higher-order switching at the same time. The present data suggest that mechanisms of inhibitory response control in frontostriatal systems are organized according to distinct levels of abstraction. Specifically, the response selection computation carried by the ventral striatum, which projects to the orbitofrontal cortex and the medial PFC, is restricted to the transformation of concrete stimulus exemplar information into motor responses, whereas the adaptive function of the lateral PFC extends to the transformation of abstract task-rule representations into action.

Working Memory Capacity Predicts Dopamine Synthesis Capacity in the Human Striatum

Evidence from psychopharmacological research has revealed that dopamine receptor agents have opposite effects on cognitive function depending on baseline levels of working memory capacity. These contrasting effects have been interpreted to reflect differential baseline levels of dopamine. Here we demonstrate for the first time that working memory capacity as measured by listening span predicts dopamine synthesis capacity in the striatum, indicating that subjects with low working memory capacity have low DA synthesis capacity in the striatum, whereas subjects with high working memory capacity have high DA synthesis capacity in the striatum.

Serotonergic modulation of prefrontal cortex during negative feedback in probabilistic reversal learning.

This study used functional magnetic resonance imaging to examine the effects of acute tryptophan (TRP) depletion (ATD), a well-recognized method for inducing transient cerebral serotonin depletion, on brain activity during probabilistic reversal learning. Twelve healthy male volunteers received a TRP-depleting drink or a balanced amino-acid drink (placebo) in a double-blind crossover design. At 5 h after drink ingestion, subjects were scanned while performing a probabilistic reversal learning task and while viewing a flashing checkerboard. The probabilistic reversal learning task enabled the separate examination of the effects of ATD on behavioral reversal following negative feedback and negative feedback per se that was not followed by behavioral adaptation. Consistent with previous findings, behavioral reversal was accompanied by significant signal change in the right ventrolateral prefrontal cortex (PFC) and the dorsomedial prefrontal cortex. ATD enhanced reversal-related signal change in the dorsomedial PFC, but did not modulate the ventrolateral PFC response. The ATD-induced signal change in the dorsomedial PFC during behavioral reversal learning extended to trials where subjects received negative feedback but did not change their behavior. These data suggest that ATD affects reversal learning and the processing of aversive signals by modulation of the dorsomedial PFC.

Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding

Hard-wired, Pavlovian, responses elicited by predictions of rewards and punishments exert significant benevolent and malevolent influences over instrumentally-appropriate actions. These influences come in two main groups, defined along anatomical, pharmacological, behavioural and functional lines. Investigations of the influences have so far concentrated on the groups as a whole; here we take the critical step of looking inside each group, using a detailed reinforcement learning model to distinguish effects to do with value, specific actions, and general activation or inhibition. We show a high degree of sophistication in Pavlovian influences, with appetitive Pavlovian stimuli specifically promoting approach and inhibiting withdrawal, and aversive Pavlovian stimuli promoting withdrawal and inhibiting approach. These influences account for differences in the instrumental performance of approach and withdrawal behaviours. Finally, although losses are as informative as gains, we find that subjects neglect losses in their instrumental learning. Our findings argue for a view of the Pavlovian system as a constraint or prior, facilitating learning by alleviating computational costs that come with increased flexibility.

Acute Tryptophan Depletion in Healthy Volunteers Enhances Punishment Prediction but Does not Affect Reward Prediction

Central serotonin (5-HT) has been implicated in emotional and behavioral control processes for many decades, but its precise contribution is not well understood. We used the acute tryptophan depletion procedure in young healthy volunteers to test the hypothesis that central 5-HT is critical for predicting punishment. An observational reversal-learning task was employed that provided separate measures of punishment and reward prediction. Under baseline, subjects made more prediction errors for punishment-associated stimuli than for reward-associated stimuli. This bias was abolished after central 5-HT depletion, which enhanced the ability to predict punishment while not affecting reward prediction. The selective potentiation of punishment prediction concurs with recent theorizing, suggesting that central 5-HT carries a prediction error for future punishment, but not for future reward (Daw et al, 2002). Furthermore, the finding highlights the importance of central 5-HT in resilience to adversity and may have implications for a variety of neuropsychiatric disorders including depression and anxiety.

Striatal Dopamine Mediates the Interface between Motivational and Cognitive Control in Humans: Evidence from Genetic Imaging

Dopamine has been hypothesized to provide the basis for the interaction between motivational and cognitive control. However, there is no evidence for this hypothesis in humans. We fill this gap by using fMRI, a novel behavioral paradigm and a common polymorphism in the DAT1 gene (SLC6A3). Carriers of the 9-repeat (9R) allele of a 40 base pair repeat polymorphism in the 3′ untranslated region of DAT1, associated with high striatal dopamine, showed greater activity in the ventromedial striatum during reward anticipation than homozygotes for the 10-repeat allele, replicating previous genetic imaging studies. The crucial novel finding is that 9R carriers also exhibited a greater influence of anticipated reward on switch costs, as well as greater activity in the dorsomedial striatum during task switching in anticipation of high reward relative to low reward. These data establish a crucial role for human striatal dopamine in the modulation of cognitive flexibility by reward anticipation, thus, elucidating the neurochemical mechanism of the interaction between motivation and cognitive control.