Ann E. Kelley

The Neuroscience of Natural Rewards: Relevance to Addictive Drugs

Addictive drugs act on brain reward systems, although the brain evolved to respond not to drugs but to natural rewards, such as food and sex. Appropriate responses to natural rewards were evolutionarily important for survival, reproduction, and fitness. In a quirk of evolutionary fate, humans

Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learning

The nucleus accumbens is a brain region that participates in the control of behaviors related to natural reinforcers, such as ingestion, sexual behavior, incentive and instrumental learning, and that also plays a role in addictive processes. This paper comprises a review of work from our laboratory that focuses on two main research areas: (i). the role of the nucleus accumbens in food motivation, and (ii). its putative functions in cellular plasticity underlying appetitive learning. First, work within a number of different behavioral paradigms has shown that accumbens neurochemical systems play specific and dissociable roles in different aspects of food seeking and food intake, and part of this function depends on integration with the lateral hypothalamus and amygdala. We propose that the nucleus accumbens integrates information related to cognitive, sensory, and emotional processing with hypothalamic mechanisms mediating energy balance. This system as a whole enables complex hierarchical control of adaptive ingestive behavior. Regarding the second research area, our studies examining acquisition of lever-pressing for food in rats have shown that activation of glutamate N-methyl-d-aspartate (NMDA) receptors, within broadly distributed but interconnected regions (nucleus accumbens core, posterior striatum, prefrontal cortex, basolateral and central amygdala), is critical for such learning to occur. This receptor stimulation triggers intracellular cascades that involve protein phosphorylation and new protein synthesis. It is hypothesized that activity in this distributed network (including D1 receptor activity) computes coincident events and thus enhances the probability that temporally related actions and events (e.g. lever pressing and delivery of reward) become associated. Such basic mechanisms of plasticity within this reinforcement learning network also appear to be profoundly affected in addiction.

Memory and addiction: shared neural circuitry and molecular mechanisms.

An important conceptual advance in the past decade has been the understanding that the process of drug addiction shares striking commonalities with neural plasticity associated with natural reward learning and memory. Basic mechanisms involving dopamine, glutamate, and their intracellular and genomic targets have been the focus of attention in this research area. These two neurotransmitter systems, widely distributed in many regions of cortex, limbic system, and basal ganglia, appear to play a key integrative role in motivation, learning, and memory, thus modulating adaptive behavior. However, many drugs of abuse exert their primary effects precisely on these pathways and are able to induce enduring cellular alterations in motivational networks, thus leading to maladaptive behaviors. Current theories and research on this topic are reviewed from an integrative systems perspective, with special emphasis on cellular, molecular, and behavioral aspects of dopamine D-1 and glutamate NMDA signaling, instrumental learning, and drug cue conditioning.

Corticostriatal-hypothalamic circuitry and food motivation: integration of energy, action and reward.

Work over the past decade has supported the idea that discrete aspects of appetitive motivation are differentially mediated by separate but interacting neurochemical systems within the nucleus accumbens (Acb). We review herein a series of studies in rats comparing the effects of manipulating Acb amino acid, opioid, acetylcholine, and dopamine systems on tests of free-feeding and food-reinforced operant responding. Results from our laboratory and in the literature support three general conclusions: (1) GABA output neurons localized exclusively within the Acb shell directly influence hypothalamic effector mechanisms for feeding motor patterns, but do not participate in the execution of more complex food-seeking strategies; (2) enkephalinergic neurons distributed throughout the Acb and caudate-putamen mediate the hedonic impact of palatable (high sugar/fat) foods, and these neurons are under modulatory control by striatal cholinergic interneurons; and (3) dopamine transmission in the Acb governs general motoric and arousal processes related to response selection and invigoration, as well as motor learning-related plasticity. These dissociations may reflect the manner in which these neurochemical systems differentially access pallido-thalamo-cortical loops reaching the voluntary motor system (in the case of opioids and dopamine), versus more restricted efferent connections to hypothalamic motor/autonomic control columns (in the case of Acb shell GABA and glutamate systems). Moreover, we hypothesize that while these systems work in tandem to coordinate the anticipatory and consummatory phases of feeding with hypothalamic energy-sensing substrates, the striatal opioid network evolved a specialized capacity to promote overeating of energy-dense foods beyond acute homeostatic needs, to ensure an energy reserve for potential future famine.

Methylphenidate preferentially increases catecholamine neurotransmission within the prefrontal cortex at low doses that enhance cognitive function.

BACKGROUND Low doses of psychostimulants, such as methylphenidate (MPH), are widely used in the treatment of attention-deficit/hyperactivity disorder (ADHD). Surprisingly little is known about the neural mechanisms that underlie the behavioral/cognitive actions of these drugs. The prefrontal cortex (PFC) is implicated in ADHD. Moreover, dopamine (DA) and norepinephrine (NE) are important modulators of PFC-dependent cognition. To date, the actions of low-dose psychostimulants on PFC DA and NE neurotransmission are unknown. METHODS In vivo microdialysis was used to compare the effects of low-dose MPH on NE and DA efflux within the PFC and select subcortical fields in male rats. Doses used (oral, 2.0 mg/kg; intraperitoneal, .25-1.0 mg/kg) were first determined to produce clinically relevant plasma concentrations and to facilitate both PFC-dependent attention and working memory. RESULTS At low doses that improve PFC-dependent cognitive function and that are devoid of locomotor-activating effects, MPH substantially increases NE and DA efflux within the PFC. In contrast, outside the PFC these doses of MPH have minimal impact on NE and DA efflux. CONCLUSIONS The current observations suggest that the therapeutic actions of low-dose psychostimulants involve the preferential activation of catecholamine neurotransmission within the PFC.

GABA in the Nucleus Accumbens Shell Participates in the Central Regulation of Feeding Behavior

We have demonstrated previously that injections of 6,7-dinitroquinoxaline-2,3-dione into the nucleus accumbens shell (AcbSh) elicits pronounced feeding in satiated rats. This glutamate antagonist blocks AMPA and kainate receptors and most likely increases food intake by disrupting a tonic excitatory input to the AcbSh, thus decreasing the firing rate of a population of local neurons. Because the application of GABA agonists also decreases neuronal activity, we hypothesized that administration of GABA agonists into the AcbSh would stimulate feeding in satiated rats. We found that acute inhibition of cells in the AcbSh via administration of the GABAA receptor agonist muscimol or the GABAB receptor agonist baclofen elicited intense, dose-related feeding without altering water intake. Muscimol-induced feeding was blocked by coadministration of the selective GABAA receptor blocker bicuculline, but not by the GABAB receptor blocker saclofen. Conversely, baclofen-induced feeding was blocked by coadministration of saclofen, but was not affected by bicuculline. Furthermore, we found that increasing local levels of GABA by administration of a selective GABA-transaminase inhibitor, γ-vinyl-GABA, elicited robust feeding in satiated rats, suggesting a physiological role for endogenous AcbSh GABA in the control of feeding. A mapping study showed that although some feeding can be elicited by muscimol injections near the lateral ventricles, the ventromedial AcbSh is the most sensitive site for eliciting feeding. These findings demonstrate that manipulation of GABA-sensitive cells in the AcbSh can have a pronounced, but specific, effect on feeding behavior in rats. They also constitute the initial description of a novel and potentially important component of the central mechanisms controlling food intake.

Microinjection of cocaine into the nucleus accumbens elicits locomotor activation in the rat

Cocaine is believed to exert its psychostimulant effects through activation of the mesocorticolimbic system. Although the nucleus accumbens, in particular, has been hypothesized as the site of action of cocaines stimulating effects, there is no direct evidence that microinjection of cocaine into this region produces behavioral activation. The present experiments investigated the locomotor response to microinjection of cocaine (0, 10, 30, 100 micrograms/0.5 microliter) into the nucleus accumbens in rats. Cocaine elicited a pronounced, dose- dependent motor activation of approximately 60 min duration. This stimulant effect was blocked by prior administration of a dopamine (DA) receptor antagonist, cis-flupenthixol. The response to cocaine was differentiated from nucleus accumbens microinjections of procaine and lidocaine, compounds that have potent local anesthetic effects but little affinity for the dopamine-uptake site. Neither procaine nor lidocaine (0, 10, 30, 100 micrograms/0.5 microliter) had any overall effect, although activity was somewhat decreased in the initial part of the test session and increased at the end, relative to control activity. Cocaine injected into the anterior dorsal or ventrolateral striatum (100 micrograms) also increased motor activity; procaine and lidocaine had no effect. Cocaine injected into the ventrolateral striatum significantly increased stereotypy. The amplitude of motor activation following cocaine injection into nucleus accumbens was much greater than that elicited at the other striatal sites. Further, observation of the time course of motor activation following cocaine injection into the anterior dorsal and ventrolateral striatum suggested that the motor effect was due to diffusion, most likely to the nucleus accumbens.(ABSTRACT TRUNCATED AT 250 WORDS)

Overlapping distributions of orexin/hypocretin‐ and dopamine‐β‐hydroxylase immunoreactive fibers in rat brain regions mediating arousal, motivation, and stress

A double‐label immunohistochemical study was carried out to investigate overlap between dopamine‐β‐hydroxylase (DβH) ‐immunopositive projections and the projections of hypothalamic neurons containing the arousal‐ and feeding‐related peptide, orexin/hypocretin (HCRT), in rat brain. Numerous intermingled HCRT‐immunopositive and DβH‐immunopositive fibers were seen in a ventrally situated corridor extending from the hypothalamus to deep layers of the infralimbic cortex. Both fiber types avoided the nucleus accumbens core, caudate putamen, and the globus pallidus. In the diencephalon, overlap was observed in several hypothalamic areas, including the perifornical, dorsomedial, and paraventricular nuclei, as well as in the paraventricular thalamic nucleus. Intermingled HCRT‐containing and DβH‐containing fibers extended from the hypothalamus into areas within the medial and central amygdala, terminating at the medial border of the lateral subdivision of the central nucleus of the amygdala. Dense overlap between the two fiber types was also observed in the periaqueductal gray, particularly in the vicinity of the dorsal raphe, as well as (to a lesser extent) in the ventral tegmental area, the retrorubral field, and the pedunculopontine tegmental nucleus. Hypocretin‐containing cell bodies, located in the perifornical and lateral hypothalamus, were embedded within a dense plexus of DβH‐immunopositive fibers and boutons, with numerous cases of apparent contacts of DβH‐containing boutons onto HCRT‐immunopositive soma and dendrites. HCRT‐containing fibers were observed amid the noradrenergic cells of the locus coeruleus, and in the vicinity of the A1, A2, and A5 cell groups. Hence, the projections of these two arousal‐related systems, originating in distinctly different parts of the brain, jointly target several forebrain regions and brainstem monoaminergic nuclei involved in regulating core motivational processes. J. Comp. Neurol. 464:220–237, 2003.

Wake-promoting and sleep-suppressing actions of hypocretin (orexin): basal forebrain sites of action

The hypocretins (orexins) are a newly identified peptide family comprised of two peptides, hypocretin-1 and hypocretin-2. Recent observations suggest an involvement of these peptides in the regulation of behavioral state. For example, these peptides are found in a variety of brain regions associated with the regulation of forebrain neuronal and behavioral activity states. Furthermore, when infused into the lateral ventricles in awake animals, hypocretin-1 elicits increased duration of waking beyond that observed in vehicle-treated animals. Previous studies have been limited to an examination of the sleep-wake effects of hypocretin-1 in awake animals. Currently, the sleep-wake effects of hypocretin-2 and the extent to which hypocretins can initiate waking in the sleeping animal remain unclear. To better characterize the wake-promoting actions of the hypocretins, the current studies examined the sleep-wake effects of varying doses (0.007, 0.07 and 0.7 nmol) of hypocretin-1 and hypocretin-2 when administered into sleeping rats (e.g. remote-controlled infusions). Infusions of hypocretin-1 and hypocretin-2 into the lateral ventricles elicited a short latency (0.7 nmol hypocretin-1; 93+/-30 s from the start of the 120-s infusion) increase in electroencephalographic, electromyographic, and behavioral indices of waking. These infusions also produced substantial decreases in slow-wave and rapid-eye movement sleep. Hypocretin-1 was more potent than hypocretin-2 in these actions. Interestingly, hypocretin-1 infused into the fourth ventricle elicited less robust waking which occurred with a longer latency than infusions into the lateral ventricles. These latter observations suggest a forebrain site of action participates in hypocretin-1-induced waking. Within the forebrain, a variety of basal forebrain structures, including the medial preoptic area, the medial septal area and the substantia innominata, receive a moderate hypocretin innervation. Therefore, additional studies examined the sleep-wake effects of bilateral hypocretin-1 infusions into these basal forebrain structures. Robust increases in waking were observed following infusions into, but not outside, the medial septal area, the medial preoptic area and the substantia innominata. These results indicate a potentially prominent role of hypocretins in sleep-wake regulation via actions within certain basal forebrain structures and are consistent with studies indicating a prominent role of hypocretins in sleep/arousal disorders.

A proposed hypothalamic-thalamic-striatal axis for the integration of energy balance, arousal, and food reward.

We elaborate herein a novel theory of basal ganglia function that accounts for why palatable, energy‐dense foods retain high incentive value even when immediate physiological energy requirements have been met. Basal ganglia function has been studied from the perspective of topographical segregation of processing within parallel circuits, with primary focus on motor control and cognition. Recent findings suggest, however, that the striatum can act as an integrated unit to modulate motivational state. We describe evidence that the striatal enkephalin system, which regulates the hedonic impact of preferred foods, undergoes coordinated gene expression changes that track current motivational state with regard to food intake. Striatal enkephalin gene expression is also downregulated by an intrastriatal infusion of a cholinergic muscarinic antagonist, a manipulation that greatly suppresses food intake. To account for these findings, we propose that signaling through a hypothalamic–midline thalamic–striatal axis impinges on the cholinergic interneurons of the striatum, which via their large, overlapping axonal fields act as a network to modulate enkephalin‐containing striatal output neurons. A key relay in this circuit is the paraventricular thalamic nucleus, which receives convergent input from orexin‐coded hypothalamic energy‐sensing and behavioral state‐regulating neurons, as well as from circadian oscillators, and projects to cholinergic interneurons throughout the striatal complex. We hypothesize that this system evolved to coordinate feeding and arousal, and to prolong the feeding central motivational state beyond the fulfillment of acute energy needs, thereby promoting “overeating” and the consequent development of an energy reserve for potential future food shortages. J. Comp. Neurol. 493:72–85, 2005.