Kathleen M. Taylor

Increasing dopamine D2 receptor expression in the adult nucleus accumbens enhances motivation

A decrease in dopamine D2 receptor (D2R) binding in the striatum is one of the most common findings in disorders that involve a dysregulation of motivation, including obesity, addiction and attention deficit hyperactivity disorder. As disruption of D2R signaling in the ventral striatum—including the nucleus accumbens (NAc)—impairs motivation, we sought to determine whether potentiating postsynaptic D2R-dependent signaling in the NAc would improve motivation. In this study, we used a viral vector strategy to overexpress postsynaptic D2Rs in either the NAc or the dorsal striatum. We investigated the effects of D2R overexpression on instrumental learning, willingness to work, use of reward value representations and modulation of motivation by reward associated cues. Overexpression of postsynaptic D2R in the NAc selectively increased motivation without altering consummatory behavior, the representation of the value of the reinforcer, or the capacity to use reward associated cues in flexible ways. In contrast, D2R overexpression in the dorsal striatum did not alter performance on any of the tasks. Thus, consistent with numerous studies showing that reduced D2R signaling impairs motivated behavior, our data show that postsynaptic D2R overexpression in the NAc specifically increases an animal’s willingness to expend effort to obtain a goal. Taken together, these results provide insight into the potential impact of future therapeutic strategies that enhance D2R signaling in the NAc.

Dissociation of Hedonic Reaction to Reward and Incentive Motivation in an Animal Model of the Negative Symptoms of Schizophrenia

We previously showed that mice that selectively and reversibly overexpress striatal D2 receptors (D2R-OE) model the negative symptoms of schizophrenia. Specifically, D2R-OE mice display a deficit in incentive motivation. The present studies investigated the basis for this deficit. First, we assessed whether hedonic reaction to reward is intact in D2R-OE mice. We assessed licking behavior and video-scored positive hedonic facial reactions to increasing concentrations of sucrose in control and D2R-OE mice. We found no difference between D2R-OE mice and controls in hedonic reactions. To further understand the basis of the motivational deficit, mice were given a choice between pressing a lever for access to a preferred reward (evaporated milk) or consuming a freely available less preferred reward (home-cage chow). D2R-OE mice pressed less for the preferred milk and consumed more of the freely available less preferred chow, indicating that striatal overexpression of postsynaptic D2Rs can alter cost/benefit computations, leading to a motivational deficit. This motivational impairment was ameliorated when the transgene was turned off and D2R levels were normalized. Such a deficit may arise from impaired ability to represent the value of future rewards. To test this, we used operant concurrent schedules and found reduced sensitivity to the value of future outcomes in D2R-OE mice. These results demonstrate for the first time in a transgenic animal model of schizophrenia a dissociation between hedonic reaction to reward and incentive motivation, and show a striking parallel to the proposed neurobiological and psychological mechanisms of impaired incentive motivation in schizophrenia.

Mediodorsal Thalamus Hypofunction Impairs Flexible Goal-Directed Behavior

BACKGROUND Cognitive inflexibility is a core symptom of several mental disorders including schizophrenia. Brain imaging studies in schizophrenia patients performing cognitive tasks have reported decreased activation of the mediodorsal thalamus (MD). Using a pharmacogenetic approach to model MD hypofunction, we recently showed that decreasing MD activity impairs reversal learning in mice. While this demonstrates causality between MD hypofunction and cognitive inflexibility, questions remain about the elementary cognitive processes that account for the deficit. METHODS Using the Designer Receptors Exclusively Activated by Designer Drugs system, we reversibly decreased MD activity during behavioral tasks assessing elementary cognitive processes inherent to flexible goal-directed behaviors, including extinction, contingency degradation, outcome devaluation, and Pavlovian-to-instrumental transfer (n = 134 mice). RESULTS While MD hypofunction impaired reversal learning, it did not affect the ability to learn about nonrewarded cues or the ability to modulate action selection based on the outcome value. In contrast, decreasing MD activity delayed the ability to adapt to changes in the contingency between actions and their outcomes. In addition, while Pavlovian learning was not affected by MD hypofunction, decreasing MD activity during Pavlovian learning impaired the ability of conditioned stimuli to modulate instrumental behavior. CONCLUSIONS Mediodorsal thalamus hypofunction causes cognitive inflexibility reflected by an impaired ability to adapt actions when their consequences change. Furthermore, it alters the encoding of environmental stimuli so that they cannot be properly utilized to guide behavior. Modulating MD activity could be a potential therapeutic strategy for promoting adaptive behavior in human subjects with cognitive inflexibility.

Amphetamine affects the start of responding in the peak interval timing task

In this paper we investigate how amphetamine affects performance in a PI task by comparing two analyses of responding during peak trials. After training on 24 s fixed interval (FI-24) with 96 s peak trials, rats were given amphetamine for 4 consecutive days at doses of .5 and 1.0 mg/kg. Responses during peak trials were fitted with a Gaussian distribution to estimate the expected time of reinforcement from the peak time. A single trials analysis was also performed to determine the start time and stop time of the transition into and out of a high rate of responding on each peak trial. Amphetamine significantly decreased peak times as measured with the Gaussian curve fitting. However, in the single trials analysis, animals initiated responding significantly earlier, but did not stop responding earlier. Thus, fitting a Gaussian to the average performance across trials sometimes provides a different characterization of the timing process than does analyzing the start and stop of responding on individual trials. In the current experiment, the latter approach provided a more precise characterization of the effects of amphetamine on response timing.

Timing and anticipation: conceptual and methodological approaches

Anticipation occurs on timescales ranging from milliseconds to hours to days. This paper relates the theoretical and methodological developments in the study of interval timing in the seconds, minutes and hours range to research on the anticipatory activity induced by regularly timed daily meals. Daily food‐anticipatory activity (FAA) is entrained by procedures which are formally identical to procedures studied in Pavlovian and operant conditioning except for the long duration of the interval between feeding opportunities. As in FAA, the conditioning procedures induce orderly anticipatory activity in advance of food presentation. During the interval between foods the behaviors that express anticipation change as the interval progresses. Consequently, no single response represents a pure measure of anticipation. The ability to distinguish between properties of general anticipatory timing mechanisms such as the scalar property ( Gibbon, 1977 ) and dynamic properties of specific response output systems has been facilitated by teaching animals to use arbitrary anticipatory responses like bar‐pressing to obtain food. Interval timing research highlights the importance of identifying the mechanisms of perception, memory, decision making and motivation that all contribute to food anticipation. We suggest that future work focused on the similarities and differences in the neural bases of FAA and interval timing may be useful in unravelling the mechanisms mediating timing behavior.

A novel strategy for dissecting goal-directed action and arousal components of motivated behavior with a progressive hold-down task.

Motivation serves 2 important functions: It guides actions to be goal-directed, and it provides the energy and vigor required to perform the work necessary to meet those goals. Dissociating these 2 processes with existing behavioral assays has been a challenge. In this article, we report a novel experimental strategy to distinguish the 2 processes in mice. First, we characterize a novel motivation assay in which animals must hold down a lever for progressively longer intervals to earn each subsequent reward; we call this the progressive hold-down (PHD) task. We find that performance on the PHD task is sensitive to both food deprivation level and reward value. Next, we use a dose of methamphetamine (METH) 1.0 mg/kg, to evaluate behavior in both the progressive ratio (PR) and PHD tasks. Treatment with METH leads to more persistent lever pressing for food rewards in the PR. In the PHD task, we found that METH increased arousal, which leads to numerous bouts of hyperactive responding but neither increases nor impairs goal-directed action. The results demonstrate that these tools enable a more precise understanding of the underlying processes being altered in manipulations that alter motivated behavior.

Conditioned taste aversion from neostigmine or methyl-naloxonium in the nucleus accumbens

An opioid antagonist injected in the nucleus accumbens of a morphine-dependent rat will lower extracellular dopamine and release acetylcholine (ACh), as also seen in opiate withdrawal. It was hypothesized that raising extracellular ACh experimentally would be aversive as reflected by the induction of a conditioned taste aversion. Rats were implanted with cannulas aimed above the nucleus accumbens (NAc) for injection of the opiate antagonist methyl-naloxonium in morphine-dependent animals or neostigmine to increase ACh in drug naïve animals. Experiment 1 in addicted rats showed that local morphine withdrawal by local injection of methyl-naloxonium paired with the taste of saccharin induces a conditioned taste aversion. Experiment 2 in non-addicted rats demonstrated the same learned aversion after local administration of the cholinergic agonist neostigmine in the NAc. These results suggest that ACh released in the NAc during opiate withdrawal contributes to the dysphoric, aversive state characteristic of withdrawal. This accumbens system is implicated in the mechanism for generating the memory of an aversive event that is expressed as learned taste aversion.

Temporal maps in appetitive Pavlovian conditioning.

Previous research suggests animals may integrate temporal information into mental representations, or temporal maps. We examined the parameters under which animals integrate temporal information in three appetitive conditioning experiments. In Experiment 1 the temporal relationship between 2 auditory cues was established during sensory preconditioning (SPC). Subsequently, rats were given first order conditioning (FOC) with one of the cues. Results showed integration of the order of cues between the SPC and FOC training phases. In subsequent experiments we tested the hypothesis that quantitative temporal information can be integrated across phases. In Experiment 2, SPC of two short auditory cues superimposed on a longer auditory cue was followed by FOC of either one of the short cues, or of the long cue at different times in the cue. Contrary to our predictions we did not find evidence of integration of temporal information across the phases of the experiment and instead responding to the SPC cues in Experiment 2 appeared to be dominated by generalization from the FOC cues. In Experiment 3 shorter auditory cues were superimposed on a longer duration light cue but with asynchronous onset and offset of the superimposed cues. There is some evidence consistent with the hypothesis that quantitative discrimination of whether reward should be expected during the early or later parts of a cue could be integrated across experiences. However, the pattern of responding within cues was not indicative of integration of quantitative temporal information. Generalization of expected times of reward during FOC seems to be the dominant determinant of within-cue response patterns in these experiments. Consequently, while we clearly demonstrated the integration of temporal order in the modulation of this dominant pattern we did not find strong evidence of integration of precise quantitative temporal information. This article is part of a Special Issue entitled: Associative and Temporal Learning.

Prior alcohol use enhances vulnerability to compulsive cocaine self-administration by promoting degradation of HDAC4 and HDAC5

Prior alcohol use increases vulnerability to cocaine addiction by promoting degradation of HDAC4 and HDAC5. Addiction to cocaine is commonly preceded by experiences with legal or decriminalized drugs, such as alcohol, nicotine, and marijuana. The biological mechanisms by which these gateway drugs contribute to cocaine addiction are only beginning to be understood. We report that in the rat, prior alcohol consumption results in enhanced addiction-like behavior to cocaine, including continued cocaine use despite aversive consequences. Conversely, prior cocaine use has no effect on alcohol preference. Long-term, but not short-term, alcohol consumption promotes proteasome-mediated degradation of the nuclear histone deacetylases HDAC4 and HDAC5 in the nucleus accumbens, a brain region critical for reward-based memory. Decreased nuclear HDAC activity results in global H3 acetylation, creating a permissive environment for cocaine-induced gene expression. We also find that selective degradation of HDAC4 and HDAC5, facilitated by the class II–specific HDAC inhibitor MC1568, enhances compulsive cocaine self-administration. These results parallel our previously reported findings that the gateway drug nicotine enhances the behavioral effects of cocaine via HDAC inhibition. Together, our findings suggest a shared mechanism of action for the gateway drugs alcohol and nicotine, and reveal a novel mechanism by which environmental factors may alter the epigenetic landscape of the reward system to increase vulnerability to cocaine addiction.

Target-absent controls in blocking experiments with rats

In three between-groups blocking experiments with rats, two concurrent and one forward, several common control procedures were employed: Reinforced trials with the putative blocking stimulus were either omitted entirely (Kamin control), replaced by unsignaled reinforcements (Wagner control), or replaced by reinforced trials with a different stimulus (C1 control). In each experiment, parallel treatments with the target stimulus absent during training served to examine the possibility that differential responding in tests with the target stimulus might be traced solely to differential exposure to the nontarget stimuli. In Experiment 1, responding by a concurrent blocking group during the test was no different than responding by a Kamin control group, and responding by a Wagner control group was greater than that of either of the other groups—a pattern of results, mirrored in the performance of the target-absent groups, that could be attributed to the elevation of contextual excitation by unsignaled reinforcement. In Experiment 2, responding in the test by a concurrent blocking group was no different than that by a C1 control group. In Experiment 3, a finding of less responding by a forward blocking group than by a C1 control group when the target stimulus was present during training, but not when it was absent, provided plausible evidence of blocking.