Andrew M. Farrar

Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits.

BackgroundOver the last several years, it has become apparent that there are critical problems with the hypothesis that brain dopamine (DA) systems, particularly in the nucleus accumbens, directly mediate the rewarding or primary motivational characteristics of natural stimuli such as food. Hypotheses related to DA function are undergoing a substantial restructuring, such that the classic emphasis on hedonia and primary reward is giving way to diverse lines of research that focus on aspects of instrumental learning, reward prediction, incentive motivation, and behavioral activation.ObjectiveThe present review discusses dopaminergic involvement in behavioral activation and, in particular, emphasizes the effort-related functions of nucleus accumbens DA and associated forebrain circuitry.ResultsThe effects of accumbens DA depletions on food-seeking behavior are critically dependent upon the work requirements of the task. Lever pressing schedules that have minimal work requirements are largely unaffected by accumbens DA depletions, whereas reinforcement schedules that have high work (e.g., ratio) requirements are substantially impaired by accumbens DA depletions. Moreover, interference with accumbens DA transmission exerts a powerful influence over effort-related decision making. Rats with accumbens DA depletions reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and instead, these rats select a less-effortful type of food-seeking behavior.ConclusionsAlong with prefrontal cortex and the amygdala, nucleus accumbens is a component of the brain circuitry regulating effort-related functions. Studies of the brain systems regulating effort-based processes may have implications for understanding drug abuse, as well as energy-related disorders such as psychomotor slowing, fatigue, or anergia in depression.

Dopamine, behavioral economics, and effort

There are numerous problems with the hypothesis that brain dopamine (DA) systems, particularly in the nucleus accumbens, directly mediate the rewarding or primary motivational characteristics of natural stimuli such as food. Research and theory related to the functions of mesolimbic DA are undergoing a substantial conceptual restructuring, with the traditional emphasis on hedonia and primary reward yielding to other concepts and lines of inquiry. The present review is focused upon the involvement of nucleus accumbens DA in behavioral activation and effort-related processes. Viewed from the framework of behavioral economics, the effects of accumbens DA depletions and antagonism on food-reinforced behavior are highly dependent upon the work requirements of the instrumental task, and DA depleted rats are more sensitive to increases in response costs (i.e., ratio requirements). Moreover, interference with accumbens DA transmission exerts a powerful influence over effort-related choice behavior. Rats with accumbens DA depletions or antagonism reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and instead these rats select a less-effortful type of food-seeking behavior. Nucleus accumbens DA and adenosine interact in the regulation of effort-related functions, and other brain structures (anterior cingulate cortex, amygdala, ventral pallidum) also are involved. Studies of the brain systems regulating effort-based processes may have implications for understanding drug abuse, as well as energy-related disorders such as psychomotor slowing, fatigue or anergia in depression and other neurological disorders.

Nucleus Accumbens Adenosine A2A Receptors Regulate Exertion of Effort by Acting on the Ventral Striatopallidal Pathway

Goal-directed actions are sensitive to work-related response costs, and dopamine in nucleus accumbens is thought to modulate the exertion of effort in motivated behavior. Dopamine-rich striatal areas such as nucleus accumbens also contain high numbers of adenosine A2A receptors, and, for that reason, the behavioral and neurochemical effects of the adenosine A2A receptor agonist CGS 21680 [2-p-(2-carboxyethyl) phenethylamino-5′-N-ethylcarboxamidoadenosine] were investigated. Stimulation of accumbens adenosine A2A receptors disrupted performance of an instrumental task with high work demands (i.e., an interval lever-pressing schedule with a ratio requirement attached) but had little effect on a task with a lower work requirement. Immunohistochemical studies revealed that accumbens neurons that project to the ventral pallidum showed adenosine A2A receptors immunoreactivity. Moreover, activation of accumbens A2A receptors by local injections of CGS 21680 increased extracellular GABA levels in the ventral pallidum. Combined contralateral injections of CGS 21680 into the accumbens and the GABAA agonist muscimol into ventral pallidum (i.e., “disconnection” methods) also impaired response output, indicating that these structures are part of a common neural circuitry regulating the exertion of effort. Thus, accumbens adenosine A2A receptors appear to regulate behavioral activation and effort-related processes by modulating the activity of the ventral striatopallidal pathway. Research on the effort-related functions of these forebrain systems may lead to a greater understanding of pathological features of motivation, such as psychomotor slowing, anergia, and fatigue in depression.

Nucleus accumbens and effort-related functions: behavioral and neural markers of the interactions between adenosine A2A and dopamine D2 receptors.

Nucleus accumbens dopamine (DA) is a critical component of the brain circuitry regulating work output in reinforcement-seeking behavior and effort-related choice behavior. Moreover, there is evidence of an interaction between DA D(2) and adenosine A(2A) receptor function. Systemic administration of adenosine A(2A) antagonists reverses the effects of D(2) antagonists on tasks that assess effort related choice. The present experiments were conducted to determine if nucleus accumbens is a brain locus at which adenosine A(2A) and DA D(2) antagonists interact to regulate effort-related choice behavior. A concurrent fixed ratio 5 (FR5)/chow feeding procedure was used; with this procedure, rats can choose between completing an FR5 lever-pressing requirement for a preferred food (i.e., high carbohydrate operant pellets) or approaching and consuming a freely available food (i.e., standard rodent chow). Rats trained with this procedure spend most of their time pressing the lever for the preferred food, and eat very little of the concurrently available chow. Intracranial injections of the selective DA D(2) receptor antagonist eticlopride (1.0, 2.0, 4.0 microg) into nucleus accumbens core, but not a dorsal control site, suppressed FR5 lever-pressing and increased consumption of freely available chow. Either systemic or intra-accumbens injections of the adenosine A(2A) receptor antagonist MSX-3 reversed these effects of eticlopride on effort-related choice. Intra-accumbens injections of eticlopride also increased local expression of c-Fos immunoreactivity, and this effect was attenuated by co-administration of MSX-3. Adenosine and DA systems interact to regulate instrumental behavior and effort-related processes, and nucleus accumbens is an important locus for this interaction. These findings may have implications for the treatment of psychiatric symptoms such as psychomotor slowing, anergia and fatigue.

Nucleus Accumbens Dopamine and the Forebrain Circuitry Involved in Behavioral Activation and Effort-Related Decision Making: Implications for Understanding Anergia and Psychomotor Slowing in Depression

The notion that motivated behaviors having an energetic or activational component is an old one, and there are numerous examples of this idea from the literatures of psychology and ethology. Behavioral researchers have demonstrated that vigor or persistence of work output in stimulus-seeking behavior is a fundamental aspect of motivation. In addition, psychiatrists and clinical psychologists have come to emphasize the importance of energy-related dysfunctions, such as psychomotor slowing and apathy, in various clinical syndromes. Because of the potential scientific importance and clinical relevance of behavioral activation processes, it is critical to determine the brain mechanisms that are involved. Considerable evidence indicates that DA in nucleus accumbens is involved in activational aspects of motivation. Accumbens DA depletions decrease spontaneous, stimulant-induced, and food-induced motor activity. In addition, the effects of accumbens DA depletions on food-seeking behavior depend greatly upon the response requirements of the task. Research involving concurrent choice tasks has shown that rats with accumbens DA depletions reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and instead select a less-effortful type of food-seeking behavior. Rats with accumbens DA depletions are particularly sensitive to lever pressing schedules with high ratio requirements (i.e., a large number of lever presses must be emitted for reinforcement to occur). Together with studies of frontal cortex function in animals, and clinical studies on neurochemical and other functional changes in the human brain, this line of research could have implications for understanding the brain circuitry involved in energy-related psychiatric disorders such as psychomotor slowing in depression, anergia, fatigue and apathy.

Forebrain circuitry involved in effort-related choice: Injections of the GABAA agonist muscimol into ventral pallidum alter response allocation in food-seeking behavior.

Organisms often make effort-related choices based upon assessments of motivational value and work requirements. Nucleus accumbens dopamine is a critical component of the brain circuitry regulating work output in reinforcement-seeking behavior. Rats with accumbens dopamine depletions reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and instead they select a less-effortful type of food-seeking behavior. The ventral pallidum is a brain area that receives substantial GABAergic input from nucleus accumbens. It was hypothesized that stimulation of GABA(A) receptors in the ventral pallidum would result in behavioral effects that resemble those produced by interference with accumbens dopamine transmission. The present studies employed a concurrent choice lever pressing/chow intake procedure; with this task, interference with accumbens dopamine transmission shifts choice behavior such that lever pressing for food is decreased but chow intake is increased. In the present experiments, infusions of the GABA(A) agonist muscimol (5.0-10.0 ng) into the ventral pallidum decreased lever pressing for preferred food, but increased consumption of the less preferred chow. In contrast, ventral pallidal infusions of muscimol (10.0 ng) had no significant effect on preference for the palatable food in free-feeding choice tests. Furthermore, injections of muscimol into a control site dorsal to the ventral pallidum produced no significant effects on lever pressing and chow intake. These data indicate that stimulation of GABA receptors in ventral pallidum produces behavioral effects similar to those produced by accumbens dopamine depletions. Ventral pallidum appears to be a component of the brain circuitry regulating response allocation and effort-related choice behavior, and may act to convey information from nucleus accumbens to other parts of this circuitry. This research may have implications for understanding the brain mechanisms involved in energy-related psychiatric dysfunctions such as psychomotor retardation in depression, anergia, and apathy.

Nucleus accumbens lesions decrease sensitivity to rapid changes in the delay to reinforcement

Both humans and non-humans discount the value of rewards that are delayed or uncertain, and individuals that discount delayed rewards at a relatively high rate are considered impulsive. To investigate the neural mechanisms that mediate delay discounting, the present study examined the effects of excitotoxic lesions of the nucleus accumbens (NAC) on discounting of reward value by delay and probability. Rats were trained on delay (n=24) or probability discounting (n=24) tasks. Following training, excitotoxic lesions of the NAC were made by intracranial injections of 0.5 microl 0.15 M quinolinic acid (n=12) or vehicle (n=12) aimed at the NAC (AP +1.6, ML +/-1.5, DV -7.1). NAC lesions did not alter performance in animals tested with a constant delay (4s) or probability (0.4) of reinforcement. However, when tested with between session changes in the delay (0, 1, 2, 4, and 8s) of reinforcement, the lesioned rats had flatter discount curves than the sham group, indicating that they were less sensitive to frequent changes in the delay to reward. In contrast, the NAC lesions did not affect discounting of probabilistic rewards. NAC lesions impaired the ability to adapt to frequent between session changes in the delay to reward but did not increase or decrease discounting when the delay was held constant across sessions. NAC lesions may disrupt the ability of the animals to predict the timing of delayed rewards when the delay to reward is changed frequently.

Differential actions of adenosine A1 and A2A antagonists on the effort-related effects of dopamine D2 antagonism

Adenosine and dopamine receptors in striatal areas interact to regulate a number of different functions, including aspects of motor control and motivation. Recent studies indicate that adenosine A(2A) receptor antagonists can reverse the effects of dopamine (DA) D(2) antagonists on instrumental tasks that provide measures of effort-related choice behavior. The present experiments compared the ability of the adenosine A(2A) antagonist KW6002, the nonselective adenosine antagonist caffeine, and the adenosine A(1) receptor selective antagonist DPCPX, to reverse the behavioral effects of the DA D(2) antagonist haloperidol. For these studies, a concurrent choice procedure was used in which rats could select between lever pressing on a fixed ratio 5 schedule for a preferred food or approaching and consuming a less preferred lab chow that was concurrently available in the chamber. Under baseline or control conditions, rats show a strong preference for lever pressing, and eat little of the chow; IP injections of 0.1 mg/kg haloperidol significantly reduced lever pressing and substantially increased chow intake. The adenosine A(2A) antagonist KW6002 (0.125-0.5 mg/kg IP) and the nonselective adenosine antagonist caffeine (5.0-20.0 mg/kg) significantly reversed the effects of haloperidol. However, the adenosine A(1) antagonist DPCPX (0.1875-0.75 mg/kg IP) failed to reverse the effects of the D(2) antagonist. The rank order of effect sizes in the reversal experiments was KW6002>caffeine>DPCPX. None of these drugs had any effect on behavior when they were injected in the absence of haloperidol. These results indicate that the ability of an adenosine antagonist to reverse the effort-related effects of a D(2) antagonist depends upon the subtype of adenosine receptor being blocked. Together with other recent results, these experiments indicate that there is a specific interaction between DA D(2) and adenosine A(2A) receptors, which could be related to the co-localization of these receptors on the same population of striatal neurons.

Prenatal alcohol exposure causes attention deficits in male rats

Children with fetal alcohol spectrum disorder (FASD) are often diagnosed with attention-deficit/ hyperactivity disorder (ADHD). These children show increases in reaction time (RT) variability and false alarms on choice reaction time (CRT) tasks. In this study, adult rats prenatally exposed to ethanol were trained to perform a CRT task. An analysis of the distribution of RTs obtained from the CRT task found that rats with a history of prenatal ethanol exposure had more variable RT distributions, possibly because of lapses of attention. In addition, it was found that, similar to children with FASD, the ethanol-exposed rats had more false alarms. Thus, rats with prenatal ethanol exposure show attention deficits that are similar to those of children with FASD and ADHD.

Dopamine/adenosine interactions related to locomotion and tremor in animal models: Possible relevance to parkinsonism

Adenosine A(2A) antagonists can exert antiparkinsonian effects in animal models. Recent experiments studied the ability of MSX-3 (an adenosine A(2A) antagonist) to reverse the locomotor suppression and tremor produced by dopamine antagonists in rats. MSX-3 reversed haloperidol-induced suppression of locomotion, and reduced the tremulous jaw movements induced by haloperidol, pimozide, and reserpine. Infusions of MSX-3 into the nucleus accumbens core increased locomotion in haloperidol-treated rats, but there were no effects of infusions into the accumbens shell or ventrolateral neostriatum. In contrast, MSX-3 injected into the ventrolateral neostriatum reduced pimozide-induced tremulous jaw movements. Dopamine/adenosine interactions in different striatal subregions are involved in distinct aspects of motor function.