Marta Pardo

Dopamine, behavioral economics, and effort

There are numerous problems with the hypothesis that brain dopamine (DA) systems, particularly in the nucleus accumbens, directly mediate the rewarding or primary motivational characteristics of natural stimuli such as food. Research and theory related to the functions of mesolimbic DA are undergoing a substantial conceptual restructuring, with the traditional emphasis on hedonia and primary reward yielding to other concepts and lines of inquiry. The present review is focused upon the involvement of nucleus accumbens DA in behavioral activation and effort-related processes. Viewed from the framework of behavioral economics, the effects of accumbens DA depletions and antagonism on food-reinforced behavior are highly dependent upon the work requirements of the instrumental task, and DA depleted rats are more sensitive to increases in response costs (i.e., ratio requirements). Moreover, interference with accumbens DA transmission exerts a powerful influence over effort-related choice behavior. Rats with accumbens DA depletions or antagonism reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and instead these rats select a less-effortful type of food-seeking behavior. Nucleus accumbens DA and adenosine interact in the regulation of effort-related functions, and other brain structures (anterior cingulate cortex, amygdala, ventral pallidum) also are involved. Studies of the brain systems regulating effort-based processes may have implications for understanding drug abuse, as well as energy-related disorders such as psychomotor slowing, fatigue or anergia in depression and other neurological disorders.

Dopaminergic modulation of effort-related choice behavior as assessed by a progressive ratio chow feeding choice task: pharmacological studies and the role of individual differences.

Mesolimbic dopamine (DA) is involved in behavioral activation and effort-related processes. Rats with impaired DA transmission reallocate their instrumental behavior away from food-reinforced tasks with high response requirements, and instead select less effortful food-seeking behaviors. In the present study, the effects of several drug treatments were assessed using a progressive ratio (PROG)/chow feeding concurrent choice task. With this task, rats can lever press on a PROG schedule reinforced by a preferred high-carbohydrate food pellet, or alternatively approach and consume the less-preferred but concurrently available laboratory chow. Rats pass through each ratio level 15 times, after which the ratio requirement is incremented by one additional response. The DA D2 antagonist haloperidol (0.025–0.1 mg/kg) reduced number of lever presses and highest ratio achieved but did not reduce chow intake. In contrast, the adenosine A2A antagonist MSX-3 increased lever presses and highest ratio achieved, but decreased chow consumption. The cannabinoid CB1 inverse agonist and putative appetite suppressant AM251 decreased lever presses, highest ratio achieved, and chow intake; this effect was similar to that produced by pre-feeding. Furthermore, DA-related signal transduction activity (pDARPP-32(Thr34) expression) was greater in nucleus accumbens core of high responders (rats with high lever pressing output) compared to low responders. Thus, the effects of DA antagonism differed greatly from those produced by pre-feeding or reduced CB1 transmission, and it appears unlikely that haloperidol reduces PROG responding because of a general reduction in primary food motivation or the unconditioned reinforcing properties of food. Furthermore, accumbens core signal transduction activity is related to individual differences in work output.

Glycogen synthase kinase-3 inhibitors: Rescuers of cognitive impairments

Impairment of cognitive processes is a devastating outcome of many diseases, injuries, and drugs affecting the central nervous system (CNS). Most often, very little can be done by available therapeutic interventions to improve cognitive functions. Here we review evidence that inhibition of glycogen synthase kinase-3 (GSK3) ameliorates cognitive deficits in a wide variety of animal models of CNS diseases, including Alzheimers disease, Fragile X syndrome, Down syndrome, Parkinsons disease, spinocerebellar ataxia type 1, traumatic brain injury, and others. GSK3 inhibitors also improve cognition following impairments caused by therapeutic interventions, such as cranial irradiation for brain tumors. These findings demonstrate that GSK3 inhibitors are able to ameliorate cognitive impairments caused by a diverse array of diseases, injury, and treatments. The improvements in impaired cognition instilled by administration of GSK3 inhibitors appear to involve a variety of different mechanisms, such as supporting long-term potentiation and diminishing long-term depression, promotion of neurogenesis, reduction of inflammation, and increasing a number of neuroprotective mechanisms. The potential for GSK3 inhibitors to repair cognitive deficits associated with many conditions warrants further investigation of their potential for therapeutic interventions, particularly considering the current dearth of treatments available to reduce loss of cognitive functions.

Piecing together the puzzle of acetaldehyde as a neuroactive agent.

Mainly known for its more famous parent compound, ethanol, acetaldehyde was first studied in the 1940s, but then research interest in this compound waned. However, in the last two decades, research on acetaldehyde has seen a revitalized and uninterrupted interest. Acetaldehyde, per se, and as a product of ethanol metabolism, is responsible for many pharmacological effects which are not clearly distinguishable from those of its parent compound, ethanol. Consequently, the most recent advances in acetaldehydes psychopharmacology have been inspired by the experimental approach to test the hypothesis that some of the effects of ethanol are mediated by acetaldehyde and, in this regard, the characterization of metabolic pathways for ethanol and the localization within discrete brain regions of these effects have revitalized the interest on the role of acetaldehyde in ethanols central effects. Here we present and discuss a wealth of experimental evidence that converges to suggest that acetaldehyde is an intrinsically active compound, is metabolically generated in the brain and, finally, mediates many of the psychopharmacological properties of ethanol.

Adenosine A2A receptor antagonism and genetic deletion attenuate the effects of dopamine D2 antagonism on effort-based decision making in mice.

Brain dopamine (DA) and adenosine interact in the regulation of behavioral activation and effort-related processes. In the present studies, a T-maze task was developed in mice for the assessment of effort-related decision making. With this task, the two arms of the maze have different reinforcement densities, and a vertical barrier is positioned in the arm with the higher density (HD), presenting the animal with an effort-related challenge. Under control conditions mice prefer the HD arm, and climb the barrier to obtain the larger amount of food. The DA D(2) receptor antagonist haloperidol decreased selection of the HD arm and increased selection of the arm with the low density of reinforcement. However, the HD arm was still the preferred choice in haloperidol-treated mice trained with barriers in both arms. Pre-feeding the mice to reduce food motivation dramatically increased omissions, an effect that was distinct from the actions of haloperidol. Co-administration of theophylline, a nonselective adenosine receptor antagonist, partially reversed the effects of haloperidol. This effect seems to be mediated by the A(2A) receptor but not the A(1) receptor, since the A(2A) antagonist MSX-3, but not the A(1) antagonist CPT, dose dependently reversed the effects of haloperidol on effort-related choice and on c-Fos expression in the dorsal striatum and nucleus accumbens. In addition, adenosine A(2A) receptor knockout mice were resistant to the effects of haloperidol on effort-related choice in the maze. These results indicate that DA D(2) and adenosine A(2A) receptors interact to regulate effort-related decision making and effort expenditure in mice.

Stress-induced neuroinflammation is mediated by GSK3-dependent TLR4 signaling that promotes susceptibility to depression-like behavior.

Most psychiatric and neurological diseases are exacerbated by stress. Because this may partially result from stress-induced inflammation, we examined factors involved in this stress response. After a paradigm of inescapable foot shock stress that causes learned helplessness depression-like behavior, eighteen cytokines and chemokines increased in mouse hippocampus, peaking 6-12h after stress. A 24h prior pre-conditioning stress accelerated the rate of stress-induced hippocampal cytokine and chemokine increases, with most reaching peak levels after 1-3h, often without altering the maximal levels. Toll-like receptor 4 (TLR4) was involved in this response because most stress-induced hippocampal cytokines and chemokines were attenuated in TLR4 knockout mice. Stress activated glycogen synthase kinase-3 (GSK3) in wild-type mouse hippocampus, but not in TLR4 knockout mice. Administration of the antidepressant fluoxetine or the GSK3 inhibitor TDZD-8 reduced the stress-induced increases of most hippocampal cytokines and chemokines. Stress increased hippocampal levels of the danger-associated molecular pattern (DAMP) protein high mobility group box 1 (HMGB1), activated the inflammatory transcription factor NF-κB, and the NLRP3 inflammasome. Knockdown of HMGB1 blocked the acceleration of cytokine and chemokine increases in the hippocampus caused by two successive stresses. Fluoxetine treatment blocked stress-induced up-regulation of HMGB1 and subsequent NF-κB activation, whereas TDZD-8 administration attenuated NF-κB activation downstream of HMGB1. To test if stress-induced cytokines and chemokines contribute to depression-like behavior, the learned helplessness model was assessed. Antagonism of TNFα modestly reduced susceptibility to learned helplessness induction, whereas TLR4 knockout mice were resistant to learned helplessness. Thus, stress-induces a broad inflammatory response in mouse hippocampus that involves TLR4, GSK3, and downstream inflammatory signaling, and these stress responses contribute to susceptibility to depression-like behavior in mice.

Choosing voluntary exercise over sucrose consumption depends upon dopamine transmission: Effects of haloperidol in wild type and adenosine A2AKO mice

RationaleMesolimbic dopamine (DA) regulates behavioral activation and effort-related decision-making in motivated behaviors. Mesolimbic DA D2 receptors are co-localized with adenosine A2A receptors, and they interact in an antagonistic manner.ObjectivesA T-maze task was developed to assess dopaminergic involvement in preference between a reinforcer that involves vigorous voluntary activity (running wheel) and a reinforcer that requires minimal behavioral activation (sucrose pellets). Haloperidol (D2 antagonist) was administered to adenosine A2A receptor knockout (A2AKO) and wild-type (WT) littermate controls to assess the involvement of these two receptors in the selection of running wheel activity versus sucrose consumption.ResultsUnder control conditions, mice spent more time running and less time eating. In WT mice, haloperidol reduced time running but actually increased time-consuming sucrose. However, A2AKO mice did not show the haloperidol-induced shift from running wheel activity to sucrose intake. Prefeeding reduced sucrose consumption in the T-maze in both strains, indicating that this paradigm is sensitive to motivational devaluation. Haloperidol increased c-Fos immunoreactivity in anterior cingulate cortex (ACg) and nucleus accumbens (Acb) core of WT but not KO mice.ConclusionsThese results indicate that after DA antagonism, the preference for vigorous physical activity is reduced, while palatable food selection increases. Adenosine A2A receptor deletion provides resistance to these effects of D2 receptor antagonism. These two receptors in Acb core and ACg seem to be involved in the regulation of the intrinsic reinforcing characteristics of voluntary exercise but not in the regulation of the primary reinforcing characteristics of palatable sedentary reinforcers.

Conditional neural knockout of the adenosine A2A receptor and pharmacological A2A antagonism reduce pilocarpine-induced tremulous jaw movements: Studies with a mouse model of parkinsonian tremor

Tremulous jaw movements are rapid vertical deflections of the lower jaw that resemble chewing but are not directed at any particular stimulus. In rats, tremulous jaw movements can be induced by a number of conditions that parallel those seen in human parkinsonism, including dopamine depletion, dopamine antagonism, and cholinomimetic drugs. Moreover, tremulous jaw movements in rats can be attenuated using antiparkinsonian agents such as L-DOPA, dopamine agonists, muscarinic antagonists, and adenosine A(2A) antagonists. In the present studies, a mouse model of tremulous jaw movements was established to investigate the effects of adenosine A(2A) antagonism, and a conditional neuronal knockout of adenosine A(2A) receptors, on cholinomimetic-induced tremulous jaw movements. The muscarinic agonist pilocarpine significantly induced tremulous jaw movements in a dose-dependent manner (0.25-1.0mg/kg IP). These movements occurred largely in the 3-7.5 Hz local frequency range. Administration of the adenosine A(2A) antagonist MSX-3 (2.5-10.0 mg/kg IP) significantly attenuated pilocarpine-induced tremulous jaw movements. Furthermore, adenosine A(2A) receptor knockout mice showed a significant reduction in pilocarpine-induced tremulous jaw movements compared to littermate controls. These results demonstrate the feasibility of using the tremulous jaw movement model in mice, and indicate that adenosine A(2A) receptor antagonism and deletion are capable of reducing cholinomimetic-induced tremulous jaw movements in mice. Future studies should investigate the effects of additional genetic manipulations using the mouse tremulous jaw movement model.

Effect of subtype-selective adenosine receptor antagonists on basal or haloperidol-regulated striatal function: Studies of exploratory locomotion and c-Fos immunoreactivity in outbred and A2AR KO mice

Behavioral activation is regulated by dopamine (DA) in striatal areas. At low doses, while typical antipsychotic drugs produce psychomotor slowing, psychostimulants promote exploration. Minor stimulants such as caffeine, which act as adenosine receptor antagonists, can also potentiate behavioral activation. Striatal areas are rich in adenosine and DA receptors, and adenosine A2A receptors are mainly expressed in the striatum where they are co-localized with DA D2 receptors. Adenosine antagonists with different receptor-selectivity profiles were used to study spontaneous or haloperidol-impaired exploration and c-Fos expression in different striatal areas. Because A2A antagonists were expected to be more selective for reversing the effects of the D2 antagonist haloperidol, A2A receptor knockout (A2ARKO) mice were also assessed. CD1 and A2ARKO male mice were tested in an open field and in a running wheel. Only the A1/A2A receptor antagonist theophylline (5.0-15.0 mg/kg) and the A2A antagonist MSX-3 (2.0 mg/kg) increased spontaneous locomotion and rearing. Co-administration of theophylline (10.0-15.0 mg/kg), and MSX-3 (1.0-3.0 mg/kg) reversed haloperidol-induced suppression of locomotion. The A1 antagonist CPT was only marginally effective in reversing the effects of haloperidol. Although adenosine antagonists did not affect c-Fos expression on their own, theophylline and MSX-3, but not CPT, attenuated haloperidol induction of c-Fos expression. A2ARKO mice were resistant to the behavioral effects of haloperidol at intermediate doses (0.1 mg/kg) in the open field and in the running wheel. A2A receptors are important for regulating behavioral activation, and interact with D2 receptors in striatal areas to regulate neural processes involved in exploratory activity.

GSK3β isoform-selective regulation of depression, memory and hippocampal cell proliferation

Abnormally active glycogen synthase kinase‐3 (GSK3) contributes to pathological processes in multiple psychiatric and neurological disorders. Modeled in mice, this includes increasing susceptibility to dysregulation of mood‐relevant behaviors, impairing performance in several cognitive tasks and impairing adult hippocampal neural precursor cell (NPC) proliferation. These deficits are all evident in GSK3α/β knockin mice, in which serine‐to‐alanine mutations block the inhibitory serine phosphorylation regulation of both GSK3 isoforms, leaving GSK3 hyperactive. It was unknown if both GSK3 isoforms perform redundant actions in these processes, or if hyperactivity of one GSK3 isoform has a predominant effect. To test this, we examined GSK3α or GSK3β knockin mice in which only one isoform was mutated to a hyperactive form. Only GSK3β, not GSK3α, knockin mice displayed heightened vulnerability to the learned helplessness model of depression‐like behavior. Three cognitive measures impaired in GSK3α/β knockin mice showed differential regulation by GSK3 isoforms. Novel object recognition was impaired in GSK3β, not in GSK3α, knockin mice, whereas temporal order memory was not impaired in GSK3α or GSK3β knockin mice, and co‐ordinate spatial processing was impaired in both GSK3α and GSK3β knockin mice. Adult hippocampal NPC proliferation was severely impaired in GSK3β knockin mice, but not impaired in GSK3α knockin mice. Increased activity of GSK3β, in the absence of overexpression or disease pathology, is sufficient to impair mood regulation, novel object recognition and hippocampal NPC proliferation, whereas hyperactive GSK3α individually does not impair these processes. These results show that hyperactivity of the two GSK3 isoforms execute non‐redundant effects on these processes.