Jonathan D. Morrow

Quantifying Individual Variation in the Propensity to Attribute Incentive Salience to Reward Cues

If reward-associated cues acquire the properties of incentive stimuli they can come to powerfully control behavior, and potentially promote maladaptive behavior. Pavlovian incentive stimuli are defined as stimuli that have three fundamental properties: they are attractive, they are themselves desired, and they can spur instrumental actions. We have found, however, that there is considerable individual variation in the extent to which animals attribute Pavlovian incentive motivational properties (“incentive salience”) to reward cues. The purpose of this paper was to develop criteria for identifying and classifying individuals based on their propensity to attribute incentive salience to reward cues. To do this, we conducted a meta-analysis of a large sample of rats (N = 1,878) subjected to a classic Pavlovian conditioning procedure. We then used the propensity of animals to approach a cue predictive of reward (one index of the extent to which the cue was attributed with incentive salience), to characterize two behavioral phenotypes in this population: animals that approached the cue (“sign-trackers”) vs. others that approached the location of reward delivery (“goal-trackers”). This variation in Pavlovian approach behavior predicted other behavioral indices of the propensity to attribute incentive salience to reward cues. Thus, the procedures reported here should be useful for making comparisons across studies and for assessing individual variation in incentive salience attribution in small samples of the population, or even for classifying single animals.

Interleukin-6 alters sleep of rats

Although it is well established that the cytokines tumor necrosis factor (TNF) and interleukin (IL)-1 regulate sleep, there is no direct evidence implicating IL-6 in the regulation/modulation of sleep. We tested the hypotheses that central administration of rat recombinant IL-6 increases non-rapid eye movements (NREM) sleep of rats, and that central administration of anti-IL-6 antibodies reduces NREM sleep. Effective doses of IL-6 (100 and 500 ng) initially enhance NREM sleep, after which NREM sleep may be suppressed. IL-6 induces febrile responses at doses lower (50 ng) than those required to alter sleep. Rapid eye movements (REM) sleep is not altered by the doses of IL-6 tested. Central administration of monoclonal or polyclonal anti-rat IL-6 antibodies does not alter any of the parameters determined in this study. Collectively, these results support the hypothesis that IL-6 possesses sleep modulatory properties. However, this cytokine may not be involved in the regulation of spontaneous sleep in healthy animals because antagonizing the IL-6 system using antibodies does not alter sleep. The interpretation of these data is consistent with those of previous studies demonstrating correlations between increased IL-6 and excessive daytime sleepiness during some pathophysiological conditions.

Diurnal variation of lipopolysaccharide-induced alterations in sleep and body temperature of interleukin-6-deficient mice

Infectious challenge triggers a broad array of coordinated changes within the host organism, including alterations in sleep-wake behavior and body temperature. Pro-inflammatory cytokines orchestrate many of the behavioral, metabolic, and endocrine responses to immune challenge. Although interleukin (IL)-6 mediates several aspects of sickness behavior, a role for this cytokine as a mediator of alterations in sleep in response to immune challenge has not been established. We evaluated sleep-wake behavior and core body temperature of IL-6-deficient (IL-6 KO; B6.129S6-Il6tm1Kopf) mice and C57BL/6J control mice after intraperitoneal (IP) administration of 10 microg lipopolysaccharide (LPS). Because feedback mechanisms that regulate responses to immune challenge exhibit circadian rhythms, we evaluated responses to LPS administered at the beginning of both the light and dark portions of the light:dark cycle. LPS-induced increases in non-rapid eye movements sleep (NREMS) of both mouse strains, but this increase was less pronounced in IL-6 KO mice than in C57BL/6J mice. Strain differences in LPS-induced increases in NREMS were greatest after light-onset administration. During the 12 h light period, NREMS of C57BL/6J mice increased from 53.0+/-1.7% of recording time after vehicle to 65.4+/-1.4% of recording time after LPS. During this same time period, NREMS of IL-6 KO mice increased from 50.5+/-1.8% after vehicle to only 52.4+/-1.8% of recording time after LPS. REMS of both mouse strains was suppressed to the same extent after LPS, irrespective of timing of administration. LPS-induced fever in C57BL/6J mice, with peak magnitude of 1.4+/-0.3 degrees C and 1.8+/-0.2 degrees C after dark onset and light onset administration, respectively. In contrast, this dose of LPS-induced profound hypothermia in IL-6 KO mice, with nadirs of hypothermia reaching 4.9+/-1.0 degrees C after injection at dark onset and 2.2+/-0.5 degrees C after administration at light onset. These results indicate that IL-6 mediates some of the effects of LPS on NREMS and body temperature of mice, and that the magnitude and duration of these effects differ as a function of the time at which the challenge is given.

Sleep-wake behavior and responses of interleukin-6-deficient mice to sleep deprivation.

Interleukin (IL)-1 and tumor necrosis factor (TNF) are involved in the regulation of non-rapid eye movements sleep (NREMS). Accumulating evidence suggests IL-6 modulates sleep under some pathophysiologic conditions. We used mice lacking a functional IL-6 gene to investigate further a potential role for IL-6 in the regulation of sleep. IL-6 knockout mice (B6.129S6-Il6tm1Kopf; n=10) and C57BL/6J mice (n=10) were purchased from the Jackson Laboratory (Bar Harbor, ME). Twenty-four-hour baseline recordings were obtained from mice in the absence of any experimental manipulation. Mice were then subjected to 6-h sleep deprivation beginning at light onset. Recordings were obtained during the deprivation period and for 18 h thereafter. During baseline conditions there were no differences between mouse strains with respect to the duration, timing or intensity of NREMS. However, across the 24-h recording period IL-6 knockout mice spent approximately 30% more time in rapid eye movements sleep (REMS) than did C57BL/6J mice. Relative to C57BL/6J mice, core body temperatures of IL-6 knockout mice were higher during the light period of the light:dark cycle. Both strains responded to sleep deprivation by spending more time in NREMS and REMS. Although the total increase in the amount of NREMS after sleep deprivation was the same in both strains, IL-6 knockout mice took 6h longer to accumulate this additional sleep. Under the conditions of this study, IL-6 does not appear necessary for the full manifestation of NREMS, although this cytokine may influence the dynamics of responses to sleep deprivation. That mice lacking IL-6 spend more time in REMS suggests that interactions between IL-6 and REMS regulatory mechanisms may differ from those of IL-1 and/or TNF.

Variation in the form of Pavlovian conditioned approach behavior among outbred male Sprague-Dawley rats from different vendors and colonies: sign-tracking vs. goal-tracking.

Even when trained under exactly the same conditions outbred male Sprague-Dawley (SD) rats vary in the form of the Pavlovian conditioned approach response (CR) they acquire. The form of the CR (i.e. sign-tracking vs. goal-tracking) predicts to what degree individuals attribute incentive salience to cues associated with food or drugs. However, we have noticed variation in the incidence of these two phenotypes in rats obtained from different vendors. In this study, we quantified sign- and goal-tracking behavior in a reasonably large sample of SD rats obtained from two vendors (Harlan or Charles River), as well as from individual colonies operated by both vendors. Our sample of rats acquired from Harlan had, on average, more sign-trackers than goal-trackers, and vice versa for our sample of rats acquired from Charles River. Furthermore, there were significant differences among colonies of the same vendor. Although it is impossible to rule out environmental variables, SD rats at different vendors and barriers may have reduced phenotypic heterogeneity as a result of genetic variables, such as random genetic drift or population bottlenecks. Consistent with this hypothesis, we identified marked population structure among colonies from Harlan. Therefore, despite sharing the same name, investigators should be aware that important genetic and phenotypic differences exist among SD rats from different vendors or even from different colonies of the same vendor. If used judiciously this can be an asset to experimental design, but it can also be a pitfall for those unaware of the issue.

Individual variation in the propensity to attribute incentive salience to an appetitive cue predicts the propensity to attribute motivational salience to an aversive cue

It has been proposed that animals that attribute high levels of incentive salience to reward-related cues may be especially vulnerable to addiction. Individual variation has also been observed in the motivational value attributed to aversive cues, which may confer vulnerability to anxiety disorders such as post-traumatic stress disorder (PTSD). There may be a core behavioral trait that contributes to individual variation in the motivational value assigned to predictive cues regardless of emotional valence. To test this hypothesis, we used a Pavlovian conditioned approach procedure to classify rats based on whether they learned to approach and interact with a cue predicting food reward (sign-trackers) or learned upon cue presentation to go to the location of impending food delivery (goal-trackers), and then examined Pavlovian fear conditioning in the same animals. It has recently been proposed that sign-trackers are more vulnerable to substance abuse because they attribute greater incentive motivational value to drug cues. Here we show that sign-trackers also have a tendency to be more fearful of discrete cues that predict footshock. In addition, we found that goal-trackers exhibited greater contextual fear when placed back into the original fear-conditioning context in the absence of temporally discrete cues. These results suggest that there may be a subset of individuals who tend to attribute high levels of motivational salience to predictive cues regardless of emotional valence, which may predispose them to a number of psychiatric comorbidities including PTSD and substance abuse. Other individuals use contexts to appropriately modify their reactions to such salient stimuli.

Rats that sign-track are resistant to Pavlovian but not instrumental extinction

Individuals vary in the extent to which they attribute incentive salience to a discrete cue (conditioned stimulus; CS) that predicts reward delivery (unconditioned stimulus; US), which results in some individuals approaching and interacting with the CS (sign-trackers; STs) more than others (goal-trackers; GTs). Here we asked how periods of non-reinforcement influence conditioned responding in STs vs. GTs, in both Pavlovian and instrumental tasks. After classifying rats as STs or GTs by pairing a retractable lever (the CS) with the delivery of a food pellet (US), we introduced periods of non-reinforcement, first by simply withholding the US (i.e., extinction training; experiment 1), then by signaling alternating periods of reward (R) and non-reward (NR) within the same session (experiments 2 and 3). We also examined how alternating R and NR periods influenced instrumental responding for food (experiment 4). STs and GTs did not differ in their ability to discriminate between R and NR periods in the instrumental task. However, in Pavlovian settings STs and GTs responded to periods of non-reward very differently. Relative to STs, GTs very rapidly modified their behavior in response to periods of non-reward, showing much faster extinction and better and faster discrimination between R and NR conditions. These results highlight differences between Pavlovian and instrumental extinction learning, and suggest that if a Pavlovian CS is strongly attributed with incentive salience, as in STs, it may continue to bias attention toward it, and to facilitate persistent and relatively inflexible responding, even when it is no longer followed by reward.

Neuroscience of resilience and vulnerability for addiction medicine: From genes to behavior.

Addiction is a complex behavioral disorder arising from roughly equal contributions of genetic and environmental factors. Behavioral traits such as novelty-seeking, impulsivity, and cue-reactivity have been associated with vulnerability to addiction. These traits, at least in part, arise from individual variation in functional neural systems, such as increased striatal dopaminergic activity and decreased prefrontal cortical control over subcortical emotional and motivational responses. With a few exceptions, genetic studies have largely failed to consistently identify specific alleles that affect addiction liability. This may be due to the multifactorial nature of addiction, with different genes becoming more significant in certain environments or in certain subsets of the population. Epigenetic mechanisms may also be an important source of risk. Adolescence is a particularly critical time period in the development of addiction, and environmental factors at this stage of life can have a large influence on whether inherited risk factors are actually translated into addictive behaviors. Knowledge of how individual differences affect addiction liability at the level of genes, neural systems, behavioral traits, and sociodevelopmental trajectories can help to inform and improve clinical practice.

Lesions of the ventral hippocampus attenuate the acquisition but not expression of sign‐tracking behavior in rats

Individual variation in the attribution of motivational salience to reward‐related cues is believed to underlie addiction vulnerability. Pavlovian conditioned approach measures individual variation in motivational salience by identifying rats that are attracted to and motivated by reward cues (sign‐trackers) or motivationally fixed on the reward itself (goal‐trackers). Previously, it has been demonstrated that sign‐trackers are more vulnerable to addiction‐like behavior. Moreover, sign‐trackers release more dopamine in the nucleus accumbens than goal‐trackers in response to reward‐related cues, and sign‐ but not goal‐tracking behavior is dopamine‐dependent. In the present study, we investigated whether the ventral hippocampus, a potent driver of dopaminergic activity in the nucleus accumbens, modulates the acquisition and expression of Pavlovian conditioned approach behavior. In Experiment 1, lesions of the ventral, but not dorsal or total hippocampus, decreased sign‐tracking behavior. In Experiment 2, lesions of the ventral hippocampus did not affect the expression of sign‐ or goal‐tracking behaviors nor conditioned reinforcement. In addition, temporary inactivation of the ventral subiculum, the main output pathway of the ventral hippocampus, did not affect the expression of sign‐ or goal‐tracking behaviors. High‐pressure liquid chromatography of nucleus accumbens tissue punches revealed that ventral hippocampal lesions decreased levels of homovanillic acid and the homovanillic acid/dopamine ratio (a marker of dopamine release and metabolism) in only sign‐trackers, and decreased accumbal norepinephrine levels in both sign‐ and goal‐trackers. These results suggest that the ventral hippocampus is important for the acquisition but not expression of sign‐tracking behavior, possibly as a result of altered dopamine and norepinephrine in the nucleus accumbens.

Neurobiology of Adolescent Substance Use Disorders

There are many facets of the neurobiology of substance use that are distinct in adolescence as compared with adulthood. The adolescent brain is subject to intense subcortical reward processes, but is left with an immature prefrontal control system that is often unable to resist the pull of potentially exciting activities like substance use, even when fully aware of the dangers involved. Peer influences serve only to magnify these effects and foster more sensation-seeking, risky behavior. The unique aspects of neurobiology should be taken into consideration when designing prevention programs and clinical interventions for adolescent substance use disorders.