Colin M. Stopper

Contributions of the nucleus accumbens and its subregions to different aspects of risk-based decision making

The nucleus accumbens (NAc) has been implicated in mediating different forms of decision making in humans and animals. In the present study, we observed that inactivation of the rat NAc, via infusion of GABA agonists, reduced preference for a large/risky option and increased response latencies on a probabilistic discounting task. Discrete inactivations of the NAc shell and core revealed further differences between these regions in mediating choice and response latencies, respectively. The effect on choice was attributable to reduced win–stay performance (i.e., choosing risky after a being rewarded for a risky choice on a preceding trial). Moreover, NAc inactivation altered choice only when the large/risky option had greater long-term value, in terms of the amount of food that could be obtained over multiple trials relative to the small/certain option. Inactivation of the NAc or the shell subregion also slightly reduced preference for larger rewards on a reward magnitude discrimination. Thus, the NAc seems to play a small role in biasing choice toward larger rewards, but its contribution to behavior is amplified when delivery of these rewards is uncertain, helping to direct response selection toward more favorable outcomes.

Separate prefrontal-subcortical circuits mediate different components of risk-based decision making

Choosing between smaller, assured rewards or larger, uncertain ones requires reconciliation of competing biases toward more certain or riskier options. We used disconnection and neuroanatomical techniques to reveal that separate, yet interconnected, neural pathways linking the medial prefrontal cortex (PFC), the basolateral amygdala (BLA), and nucleus accumbens (NAc) contribute to these different decision biases in rats. Disrupting communication between the BLA and NAc revealed that this subcortical circuit biases choice toward larger, uncertain rewards on a probabilistic discounting task. In contrast, disconnections between the BLA and PFC increased choice of the Large/Risky option. PFC–NAc disconnections did not affect choice but did increase choice latencies and trial omissions. Neuroanatomical studies confirmed that projection pathways carrying axons from BLA-to-PFC transverse a distinctly different route relative to PFC-to-BLA pathways (via the ventrolateral amydalofugal pathway and ventromedial internal capsule, respectively). We exploited these dissociable axonal pathways to selectively disrupt bottom-up and top-down communication between the BLA and PFC. Subsequent disconnection studies revealed that disruption of top-down (but not bottom-up) information transfer between the medial PFC and BLA increased choice of the larger, riskier option, suggesting that this circuit facilitates tracking of actions and outcomes to temper urges for riskier rewards as they become less profitable. These findings provide novel insight into the dynamic competition between these cortical/subcortical circuits that shape our decision biases and underlie conflicting urges when evaluating options that vary in terms of potential risks and rewards.

Nucleus Accumbens Adenosine A2A Receptors Regulate Exertion of Effort by Acting on the Ventral Striatopallidal Pathway

Goal-directed actions are sensitive to work-related response costs, and dopamine in nucleus accumbens is thought to modulate the exertion of effort in motivated behavior. Dopamine-rich striatal areas such as nucleus accumbens also contain high numbers of adenosine A2A receptors, and, for that reason, the behavioral and neurochemical effects of the adenosine A2A receptor agonist CGS 21680 [2-p-(2-carboxyethyl) phenethylamino-5′-N-ethylcarboxamidoadenosine] were investigated. Stimulation of accumbens adenosine A2A receptors disrupted performance of an instrumental task with high work demands (i.e., an interval lever-pressing schedule with a ratio requirement attached) but had little effect on a task with a lower work requirement. Immunohistochemical studies revealed that accumbens neurons that project to the ventral pallidum showed adenosine A2A receptors immunoreactivity. Moreover, activation of accumbens A2A receptors by local injections of CGS 21680 increased extracellular GABA levels in the ventral pallidum. Combined contralateral injections of CGS 21680 into the accumbens and the GABAA agonist muscimol into ventral pallidum (i.e., “disconnection” methods) also impaired response output, indicating that these structures are part of a common neural circuitry regulating the exertion of effort. Thus, accumbens adenosine A2A receptors appear to regulate behavioral activation and effort-related processes by modulating the activity of the ventral striatopallidal pathway. Research on the effort-related functions of these forebrain systems may lead to a greater understanding of pathological features of motivation, such as psychomotor slowing, anergia, and fatigue in depression.

Nucleus accumbens and effort-related functions: behavioral and neural markers of the interactions between adenosine A2A and dopamine D2 receptors.

Nucleus accumbens dopamine (DA) is a critical component of the brain circuitry regulating work output in reinforcement-seeking behavior and effort-related choice behavior. Moreover, there is evidence of an interaction between DA D(2) and adenosine A(2A) receptor function. Systemic administration of adenosine A(2A) antagonists reverses the effects of D(2) antagonists on tasks that assess effort related choice. The present experiments were conducted to determine if nucleus accumbens is a brain locus at which adenosine A(2A) and DA D(2) antagonists interact to regulate effort-related choice behavior. A concurrent fixed ratio 5 (FR5)/chow feeding procedure was used; with this procedure, rats can choose between completing an FR5 lever-pressing requirement for a preferred food (i.e., high carbohydrate operant pellets) or approaching and consuming a freely available food (i.e., standard rodent chow). Rats trained with this procedure spend most of their time pressing the lever for the preferred food, and eat very little of the concurrently available chow. Intracranial injections of the selective DA D(2) receptor antagonist eticlopride (1.0, 2.0, 4.0 microg) into nucleus accumbens core, but not a dorsal control site, suppressed FR5 lever-pressing and increased consumption of freely available chow. Either systemic or intra-accumbens injections of the adenosine A(2A) receptor antagonist MSX-3 reversed these effects of eticlopride on effort-related choice. Intra-accumbens injections of eticlopride also increased local expression of c-Fos immunoreactivity, and this effect was attenuated by co-administration of MSX-3. Adenosine and DA systems interact to regulate instrumental behavior and effort-related processes, and nucleus accumbens is an important locus for this interaction. These findings may have implications for the treatment of psychiatric symptoms such as psychomotor slowing, anergia and fatigue.

Receptor-Specific Modulation of Risk-Based Decision Making by Nucleus Accumbens Dopamine

The nucleus accumbens (NAc) serves as an integral node within cortico-limbic circuitry that regulates various forms of cost–benefit decision making. The dopamine (DA) system has also been implicated in enabling organisms to overcome a variety of costs to obtain more valuable rewards. However, it remains unclear how DA activity within the NAc may regulate decision making involving reward uncertainty. This study investigated the contribution of different DA receptor subtypes in the NAc to risk-based decision making, assessed with a probabilistic discounting task. In well-trained rats, D1 receptor blockade with SCH 23 390 decreased preference for larger, uncertain rewards, which was associated with enhanced negative-feedback sensitivity (ie, an increased tendency to select a smaller/certain option after an unrewarded risky choice). Treatment with a D1 agonist (SKF 81 297) optimized decision making, increasing choice of the risky option when reward probability was high, and decreasing preference under low probability conditions. In stark contrast, neither blockade of NAc D2 receptors with eticlopride, nor stimulation of these receptors with quinpirole or bromocriptine influenced risky choice. In comparison, infusion of the D3-preferring agonist PD 128 907 decreased reward sensitivity and risky choice. Collectively, these results show that mesoaccumbens DA refines risk–reward decision biases via dissociable mechanisms recruiting D1 and D3, but not D2 receptors. D1 receptor activity mitigates the effect of reward omissions on subsequent choices to promote selection of reward options that may have greater long-term utility, whereas excessive D3 receptor activity blunts the impact that larger/uncertain rewards have in promoting riskier choices.

Overriding Phasic Dopamine Signals Redirects Action Selection during Risk/Reward Decision Making

Phasic increases and decreases in dopamine (DA) transmission encode reward prediction errors thought to facilitate reward-related learning, yet how these signals guide action selection in more complex situations requiring evaluation of different reward remains unclear. We manipulated phasic DA signals while rats performed a risk/reward decision-making task, using temporally discrete stimulation of either the lateral habenula (LHb) or rostromedial tegmental nucleus (RMTg) to suppress DA bursts (confirmed with neurophysiological studies) or the ventral tegmental area (VTA) to override phasic dips. When rats chose between small/certain and larger/risky rewards, LHb or RMTg stimulation, time-locked to delivery of one of these rewards, redirected bias toward the alternative option, whereas VTA stimulation after non rewarded choices increased risky choice. LHb stimulation prior to choices shifted bias away from more preferred options. Thus, phasic DA signals provide feedback on whether recent actions were rewarded to update decision policies and direct actions toward more desirable reward.

Selective Involvement by the Medial Orbitofrontal Cortex in Biasing Risky, But Not Impulsive, Choice

Separate regions of the orbitofrontal cortex (OFC) have been implicated in mediating different aspects of cost-benefit decision-making in humans and animals. Anatomical and functional imaging studies indicate that the medial (mOFC) and lateral OFC may subserve dissociable functions related to reward and decision-making processes, yet the majority of studies in rodents have focused on the lateral OFC. The present study investigated the contribution of the rat mOFC to risk and delay-based decision-making, assessed with probabilistic and delay-discounting tasks. In well-trained rats, reversible inactivation of the mOFC increase a risky choice on the probabilistic discounting task, irrespective of whether the odds of obtaining a larger/risky reward decreased (100-12.5%) or increased (12.5-100%) over the course of a session. The increase in risky choice was associated with enhanced win-stay behavior, wherein rats showed an increased tendency to choose the risky option after being rewarded for the risky choice on a preceding trial. In contrast, mOFC inactivation did not alter delay discounting. These findings suggest that the mOFC plays a selective role in decisions involving reward uncertainty, mitigating the impact that larger, probabilistic rewards exert on subsequent choice behavior. This function may promote the exploration of novel options when reward contingencies change.

Stimulant effects of adenosine antagonists on operant behavior: differential actions of selective A2A and A1 antagonists.

RationaleAdenosine A2A antagonists can reverse many of the behavioral effects of dopamine antagonists, including actions on instrumental behavior. However, little is known about the effects of selective adenosine antagonists on operant behavior when these drugs are administered alone.ObjectiveThe present studies were undertaken to investigate the potential for rate-dependent stimulant effects of both selective and nonselective adenosine antagonists.MethodsSix drugs were tested: two nonselective adenosine antagonists (caffeine and theophylline), two adenosine A1 antagonists (DPCPX and CPT), and two adenosine A2A antagonists (istradefylline (KW6002) and MSX-3). Two schedules of reinforcement were employed; a fixed interval 240-s (FI-240 sec) schedule was used to generate low baseline rates of responding and a fixed ratio 20 (FR20) schedule generated high rates.ResultsCaffeine and theophylline produced rate-dependent effects on lever pressing, increasing responding on the FI-240 sec schedule but decreasing responding on the FR20 schedule. The A2A antagonists MSX-3 and istradefylline increased FI-240 sec lever pressing but did not suppress FR20 lever pressing in the dose range tested. In fact, there was a tendency for istradefylline to increase FR20 responding at a moderate dose. A1 antagonists failed to increase lever pressing rate, but DPCPX decreased FR20 responding at higher doses.ConclusionsThese results suggest that adenosine A2A antagonists enhance operant response rates, but A1 antagonists do not. The involvement of adenosine A2A receptors in regulating aspects of instrumental response output and behavioral activation may have implications for the treatment of effort-related psychiatric dysfunctions, such as psychomotor slowing and anergia in depression.