Jonathan A. Sugam

Phasic nucleus accumbens dopamine encodes risk-based decision-making behavior

BACKGROUND To optimize behavior, organisms evaluate the risks and benefits of available choices. The mesolimbic dopamine (DA) system encodes information about response costs and reward delays that bias choices. However, it remains unclear whether subjective value associated with risk-taking behavior is encoded by DA release. METHODS Rats (n = 11) were trained on a risk-based decision-making task in which visual cues predicted the opportunity to respond for smaller certain (safer) or larger uncertain (riskier) rewards. Following training, DA release within the nucleus accumbens (NAc) was monitored on a rapid time scale using fast-scan cyclic voltammetry during the risk-based decision-making task. RESULTS Individual differences in risk-taking behavior were observed as animals displayed a preference for either safe or risky rewards. When only one response option was available, reward predictive cues evoked increases in DA concentration in the NAc core that scaled with each animals preferred reward contingency. However, when both options were presented simultaneously, cue-evoked DA release signaled the animals preferred reward contingency, regardless of the future choice. Furthermore, DA signaling in the NAc core also tracked unexpected presentations or omissions of rewards following prediction error theory. CONCLUSIONS These results suggest that the dopaminergic projections to the NAc core encode the subjective value of future rewards that may function to influence future decisions to take risks.

Rapid dopamine dynamics in the accumbens core and shell: learning and action.

The catecholamine dopamine (DA) has been implicated in a host of neural processes as diverse as schizophrenia, parkinsonism and reward encoding. Importantly, these distinct features of DA function are due in large part to separate neural circuits involving connections arising from different DA-releasing nuclei and projections to separate afferent targets. Emerging data has suggested that this same principle of separate neural circuits may be applicable within structural subregions, such as the core and shell of the nucleus accumbens (NAc). Further, DA may act selectively on smaller ensembles of cells (or, microcircuits) via differential DA receptor density and distinct inputs and outputs of the microcircuits, thus enabling new learning about Pavlovian cues, instrumental responses, subjective reward processing and decision-making. In this review, by taking advantage of studies using subsecond voltammetric techniques in behaving animals to study how rapid changes in DA levels affect behavior, we examine the spatial and temporal features of DA release and how it relates to both normal learning and similarities to pathological learning in the form of addiction.

Mesolimbic Dopamine Dynamically Tracks, and Is Causally Linked to, Discrete Aspects of Value-Based Decision Making

BACKGROUND To make appropriate choices, organisms must weigh the costs and benefits of potential valuable outcomes, a process known to involve the nucleus accumbens (NAc) and its dopaminergic input. However, it is currently unknown if dopamine dynamically tracks alterations in expected reward value online as behavioral preferences change and if so, if it is causally linked to specific components of value such as reward magnitude and/or delay to reinforcement. METHODS Electrochemical methods were used to measure subsecond NAc dopamine release during a delay discounting task where magnitude was fixed but delay varied across blocks (n = 7 rats). Next, to assess whether this dopamine signaling was causally related to specific components of choice behavior, we employed selective optogenetic stimulation of dopamine terminals in the NAc using a modified delay discounting task in which both delay and magnitude varied independently (n = 23 rats). RESULTS Cues predictive of available choices evoked dopamine release that scaled with the rats preferred choices and dynamically shifted as delay to reinforcement for the large reward increased. In the second experiment, dopamine signaling was causally related to features of decision making, as optogenetically enhanced dopamine release within the NAc during predictive cue presentation was sufficient to alter subsequent value-related choices. Importantly, this dopamine-mediated shift in choice was limited to delay-based, but not magnitude-based, decisions. CONCLUSIONS These findings indicate that NAc dopamine dynamically tracks delay discounting and establishes a causal role for this signaling in a subset of value-based associative strategies.

Neuropeptide regulation of signaling and behavior in the BNST

Recent technical developments have transformed how neuroscientists can probe brain function. What was once thought to be difficult and perhaps impossible, stimulating a single set of long range inputs among many, is now relatively straight-forward using optogenetic approaches. This has provided an avalanche of data demonstrating causal roles for circuits in a variety of behaviors. However, despite the critical role that neuropeptide signaling plays in the regulation of behavior and physiology of the brain, there have been remarkably few studies demonstrating how peptide release is causally linked to behaviors. This is likely due to both the different time scale by which peptides act on and the modulatory nature of their actions. For example, while glutamate release can effectively transmit information between synapses in milliseconds, peptide release is potentially slower [See the excellent review by Van Den Pol on the time scales and mechanisms of release (van den Pol, 2012)] and it can only tune the existing signals via modulation. And while there have been some studies exploring mechanisms of release, it is still not as clearly known what is required for efficient peptide release. Furthermore, this analysis could be complicated by the fact that there are multiple peptides released, some of which may act in contrast. Despite these limitations, there are a number of groups making progress in this area. The goal of this review is to explore the role of peptide signaling in one specific structure, the bed nucleus of the stria terminalis, that has proven to be a fertile ground for peptide action.

Cocaine Self-Administration Experience Induces Pathological Phasic Accumbens Dopamine Signals and Abnormal Incentive Behaviors in Drug-Abstinent Rats

Chronic exposure to drugs of abuse is linked to long-lasting alterations in the function of limbic system structures, including the nucleus accumbens (NAc). Although cocaine acts via dopaminergic mechanisms within the NAc, less is known about whether phasic dopamine (DA) signaling in the NAc is altered in animals with cocaine self-administration experience or if these animals learn and interact normally with stimuli in their environment. Here, separate groups of rats self-administered either intravenous cocaine or water to a receptacle (controls), followed by 30 d of enforced abstinence. Next, all rats learned an appetitive Pavlovian discrimination and voltammetric recordings of real-time DA release were taken in either the NAc core or shell of cocaine and control subjects. Cocaine experience differentially impaired DA signaling in the core and shell relative to controls. Although phasic DA signals in the shell were essentially abolished for all stimuli, in the core, DA did not distinguish between cues and was abnormally biased toward reward delivery. Further, cocaine rats were unable to learn higher-order associations and even altered simple conditioned approach behaviors, displaying enhanced preoccupation with cue-associated stimuli (sign-tracking; ST) but diminished time at the food cup awaiting reward delivery (goal-tracking). Critically, whereas control DA signaling correlated with ST behaviors, cocaine experience abolished this relationship. These findings show that cocaine has persistent, differential, and pathological effects on both DA signaling and DA-dependent behaviors and suggest that psychostimulant experience may remodel the very circuits that bias organisms toward repeated relapse. SIGNIFICANCE STATEMENT Relapsing to drug abuse despite periods of abstinence and sincere attempts to quit is one of the most pernicious facets of addiction. Unfortunately, little is known about how the dopamine (DA) system functions after periods of drug abstinence, particularly its role in behavior in nondrug situations. Here, rats learned about food-paired stimuli after prolonged abstinence from cocaine self-administration. Using voltammetry, we found that real-time DA signals in cocaine-experienced rats were strikingly altered relative to controls. Further, cocaine-experienced animals found reward-predictive stimuli abnormally salient and spent more time interacting with cues. Therefore, cocaine induces neuroplastic changes in the DA system that biases animals toward salient stimuli (including reward-associated cues), putting addicts at increasing risk to relapse as addiction increases in severity.

Mu Opioid Receptor Modulation of Dopamine Neurons in the Periaqueductal Gray/Dorsal Raphe: A Role in Regulation of Pain

The periaqueductal gray (PAG) is a brain region involved in nociception modulation, and an important relay center for the descending nociceptive pathway through the rostral ventral lateral medulla. Given the dense expression of mu opioid receptors and the role of dopamine in pain, the recently characterized dopamine neurons in the ventral PAG (vPAG)/dorsal raphe (DR) region are a potentially critical site for the antinociceptive actions of opioids. The objectives of this study were to (1) evaluate synaptic modulation of the vPAG/DR dopamine neurons by mu opioid receptors and to (2) dissect the anatomy and neurochemistry of these neurons, in order to assess the downstream loci and functions of their activation. Using a mouse line that expresses eGFP under control of the tyrosine hydroxylase (TH) promoter, we found that mu opioid receptor activation led to a decrease in inhibitory inputs onto the vPAG/DR dopamine neurons. Furthermore, combining immunohistochemistry, optogenetics, electrophysiology, and fast-scan cyclic voltammetry in a TH-cre mouse line, we demonstrated that these neurons also express the vesicular glutamate type 2 transporter and co-release dopamine and glutamate in a major downstream projection structure—the bed nucleus of the stria terminalis. Finally, activation of TH-positive neurons in the vPAG/DR using Gq designer receptors exclusively activated by designer drugs displayed a supraspinal, but not spinal, antinociceptive effect. These results indicate that vPAG/DR dopamine neurons likely play a key role in opiate antinociception, potentially via the activation of downstream structures through dopamine and glutamate release.

Prior Cocaine Experience Impairs Normal Phasic Dopamine Signals of Reward Value in Accumbens Shell.

Dopamine signals have repeatedly been linked to associative learning and motivational processes. However, there is considerably less agreement on a role for dopamine in reward processing, and therefore whether neuroplastic changes in dopamine function following chronic exposure to drugs of abuse such as cocaine may impair appropriate valuation of rewarding stimuli. To quantify this, we voltammetrically measured real-time dopamine release in the nucleus accumbens (NAc) core or shell while rats received unsignaled deliveries of either a small (1 pellet) or large (2 pellets) reward. In drug-naive controls, core dopamine signals did not discriminate between reward size at any point, while in the shell dopamine encoded magnitude differences only in a slower postpeak period. Despite this lack of discrimination between rewards by the peak DA response, controls easily discriminated between reward options in a subsequent choice task. In contrast, phasic dopamine reward signals were strongly altered by cocaine experience; core dopamine decreased peak response but increased discrimination between reward magnitudes while shell lost phasic responses to reward receipt altogether. Notably, animals with cocaine-associated alterations in dopamine signals for reward magnitude failed to subsequently discriminate between reward options. These findings suggest that cocaine self-administration alters the ability for dopamine signals to appropriately assign value to rewards and thus may in part contribute to later deficits in behaviors that depend on appropriate outcome valuation.

Fear extinction requires infralimbic cortex projections to the basolateral amygdala

Fear extinction involves the formation of a new memory trace that attenuates fear responses to a conditioned aversive memory, and extinction impairments are implicated in trauma- and stress-related disorders. Previous studies in rodents have found that the infralimbic prefrontal cortex (IL) and its glutamatergic projections to the basolateral amygdala (BLA) and basomedial amygdala (BMA) instruct the formation of fear extinction memories. However, it is unclear whether these pathways are exclusively involved in extinction, or whether other major targets of the IL, such as the nucleus accumbens (NAc) also play a role. To address this outstanding issue, the current study employed a combination of electrophysiological and chemogenetic approaches in mice to interrogate the role of IL-BLA and IL-NAc pathways in extinction. Specifically, we used patch-clamp electrophysiology coupled with retrograde tracing to examine changes in neuronal activity of the IL and prelimbic cortex (PL) projections to both the BLA and NAc following fear extinction. We found that extinction produced a significant increase in the intrinsic excitability of IL-BLA projection neurons, while extinction appeared to reverse fear-induced changes in IL-NAc projection neurons. To establish a causal counterpart to these observations, we then used a pathway-specific Designer Receptors Exclusively Activated by Designer Drugs (DREADD) strategy to selectively inhibit PFC-BLA projection neurons during extinction acquisition. Using this approach, we found that DREADD-mediated inhibition of PFC-BLA neurons during extinction acquisition impaired subsequent extinction retrieval. Taken together, our findings provide further evidence for a critical contribution of the IL-BLA neural circuit to fear extinction.

Nociceptin receptor antagonist SB 612111 decreases high fat diet binge eating.

Binge eating is a dysregulated form of feeding behavior that occurs in multiple eating disorders including binge-eating disorder, the most common eating disorder. Feeding is a complex behavioral program supported through the function of multiple brain regions and influenced by a diverse array of receptor signaling pathways. Previous studies have shown the overexpression of the opioid neuropeptide nociceptin (orphanin FQ, N/OFQ) can induce hyperphagia, but the role of endogenous nociceptin receptor (NOP) in naturally occurring palatability-induced hyperphagia is unknown. In this study we adapted a simple, replicable form of binge eating of high fat food (HFD). We found that male and female C57BL/6J mice provided with daily one-hour access sessions to HFD eat significantly more during this period than those provided with continuous 24h access. This form of feeding is rapid and entrained. Chronic intermittent HFD binge eating produced hyperactivity and increased light zone exploration in the open field and light-dark assays respectively. Treatment with the potent and selective NOP antagonist SB 612111 resulted in a significant dose-dependent reduction in binge intake in both male and female mice, and, unlike treatment with the serotonin selective reuptake inhibitor fluoxetine, produced no change in total 24-h food intake. SB 612111 treatment also significantly decreased non-binge-like acute HFD consumption in male mice. These data are consistent with the hypothesis that high fat binge eating is modulated by NOP signaling and that the NOP system may represent a promising novel receptor to explore for the treatment of binge eating.