Vincent D. Campese

The birth, death and resurrection of avoidance: a reconceptualization of a troubled paradigm

Research on avoidance conditioning began in the late 1930s as a way to use laboratory experiments to better understand uncontrollable fear and anxiety. Avoidance was initially conceived of as a two-factor learning process in which fear is first acquired through Pavlovian aversive conditioning (so-called fear conditioning), and then behaviors that reduce the fear aroused by the Pavlovian conditioned stimulus are reinforced through instrumental conditioning. Over the years, criticisms of both the avoidance paradigm and the two-factor fear theory arose. By the mid-1980s, avoidance had fallen out of favor as an experimental model relevant to fear and anxiety. However, recent progress in understanding the neural basis of Pavlovian conditioning has stimulated a new wave of research on avoidance. This new work has fostered new insights into contributions of not only Pavlovian and instrumental learning but also habit learning, to avoidance, and has suggested that the reinforcing event underlying the instrumental phase should be conceived in terms of cellular and molecular events in specific circuits rather than in terms of vague notions of fear reduction. In our approach, defensive reactions (freezing), actions (avoidance) and habits (habitual avoidance) are viewed as being controlled by unique circuits that operate nonconsciously in the control of behavior, and that are distinct from the circuits that give rise to conscious feelings of fear and anxiety. These refinements, we suggest, overcome older criticisms, justifying the value of the new wave of research on avoidance, and offering a fresh perspective on the clinical implications of this work.

Unconditioned Stimulus Devaluation Effects in Nutrient-Conditioned Flavor Preferences

Experiments with different temporal relations between the conditioned stimulus (CS) and the unconditioned stimulus (US) in conditioning assessed whether US devaluation effects can be obtained after nutrient-conditioned flavor preference learning. One flavor (CScarb) was paired with a carbohydrate, Polycose; a 2nd flavor (CSprot) was paired with a protein, casein; and a 3rd flavor (CS-) was presented by itself. Following conditioning, one of the nutrients was devalued through pairings with lithium chloride in the absence of the CS flavors. In a subsequent 2-bottle test, rats preferred CScarb over CSprot; however, this preference was smaller when the carbohydrate was devalued than when the protein was devalued. Results suggest that CS flavors are able to form associations with the sensory features of nutrient USs under a wide variety of circumstances.

Lesions of lateral or central amygdala abolish aversive Pavlovian-to-instrumental transfer in rats

Aversive Pavlovian conditioned stimuli (CSs) elicit defensive reactions (e.g., freezing) and motivate instrumental actions like active avoidance (AA). Pavlovian reactions require connections between the lateral (LA) and central (CeA) nuclei of the amygdala, whereas AA depends on LA and basal amygdala (BA). Thus, the neural circuits mediating conditioned reactions and motivation appear to diverge in the amygdala. However, AA is not ideal for studying conditioned motivation, because Pavlovian and instrumental learning are intermixed. Pavlovian-to-instrumental transfer (PIT) allows for the study of conditioned motivation in isolation. PIT refers to the ability of a Pavlovian CS to modulate a separately-trained instrumental action. The role of the amygdala in aversive PIT is unknown. We designed an aversive PIT procedure in rats and tested the effects of LA, BA, and CeA lesions. Rats received Pavlovian tone-shock pairings followed by Sidman shock-avoidance training. PIT was assessed by comparing shuttling rates in the presence and absence of the tone. Tone presentations facilitated instrumental responding. Aversive PIT was abolished by lesions of LA or CeA, but was unaffected by lesions of BA. These results suggest that LA and CeA are essential for aversive conditioned motivation. More specifically, the results are consistent with a model of amygdala processing in which the CS is encoded in the LA and then, via connections to CeA, the motivation to perform the aversive task is enhanced. These findings have implications for understanding the contribution of amygdala circuits to aversive instrumental motivation, but also for the relation of aversive and appetitive behavioral control.

Development of an aversive Pavlovian-to-instrumental transfer task in rat

Pavlovian-to-instrumental transfer (PIT) is an effect whereby a classically conditioned stimulus (CS) enhances ongoing instrumental responding. PIT has been extensively studied with appetitive conditioning but barely at all with aversive conditioning. Although its been argued that conditioned suppression is a form of aversive PIT, this effect is fundamentally different from appetitive PIT because the CS suppresses, instead of facilitates, responding. Five experiments investigated the importance of a variety of factors on aversive PIT in a rodent Sidman avoidance paradigm in which ongoing shuttling behavior (unsignaled active avoidance or USAA) was facilitated by an aversive CS. Experiment 1 demonstrated a basic PIT effect. Experiment 2 found that a moderate amount of USAA extinction produces the strongest PIT with shuttling rates best at around 2 responses per minute prior to the CS. Experiment 3 tested a protocol in which the USAA behavior was required to reach the 2-response per minute mark in order to trigger the CS presentation and found that this produced robust and reliable PIT. Experiment 4 found that the Pavlovian conditioning US intensity was not a major determinant of PIT strength. Experiment 5 demonstrated that if the CS and US were not explicitly paired during Pavlovian conditioning, PIT did not occur, showing that CS-US learning is required. Together, these studies demonstrate a robust, reliable and stable aversive PIT effect that is amenable to analysis of neural circuitry.

Renewal and Spontaneous Recovery, but Not Latent Inhibition, Are Mediated by Gamma-Aminobutyric Acid in Appetitive Conditioning

Previous research has reported a role for the neurotransmitter gamma-aminobutyric acid (GABA) in the extinction and renewal of conditioned fear. Here, the authors examine whether GABA is involved in the acquisition, extinction, renewal, spontaneous recovery, and latent inhibition of appetitive conditioning. Using Long-Evans rats, systemic injection of the GABA A receptor inverse agonist FG 7142 was shown to eliminate ABA renewal (Experiment 1) and spontaneous recovery (Experiment 4) of appetitive responding by selectively reducing the recovery of extinguished magazine approach. Furthermore, treatment with FG 7142 had no effects on acquisition or single-session extinction (Experiment 3) or on the context-specific expression of latent inhibition (Experiment 2). These data suggest that ABA renewal and spontaneous recovery, but not latent inhibition or responding during acquisition and an initial extinction session, are mediated by GABAergic mechanisms in appetitive Pavlovian conditioning. They provide support for the view that renewal and spontaneous recovery share a common psychological mechanism.

The Neural Foundations of Reaction and Action in Aversive Motivation.

Much of the early research in aversive learning concerned motivation and reinforcement in avoidance conditioning and related paradigms. When the field transitioned toward the focus on Pavlovian threat conditioning in isolation, this paved the way for the clear understanding of the psychological principles and neural and molecular mechanisms responsible for this type of learning and memory that has unfolded over recent decades. Currently, avoidance conditioning is being revisited, and with what has been learned about associative aversive learning, rapid progress is being made. We review, below, the literature on the neural substrates critical for learning in instrumental active avoidance tasks and conditioned aversive motivation.

ABA and ABC renewal of conditioned magazine approach are not impaired by dorsal hippocampus inactivation or lesions

Three experiments investigated the role of the dorsal hippocampus (DH) in renewal of conditioned and then extinguished magazine approach responding in rats. Experiments 1 and 2 found no effect of muscimol inactivation of the DH during testing on ABA and ABC renewal, respectively. However, subjects from these studies were subsequently found to be impaired on a delayed non-matching-to-place task following muscimol but not saline infusions. Experiment 3 found no effects of post-training excitotoxic lesions of the DH on ABA and ABC renewal. Lesioned subjects were, however, impaired on the delayed non-matching-to-place task compared to control subjects. These findings suggest that the DH may not play a similar role in Pavlovian extinction in appetitive learning tasks as has previously been reported in aversive learning.

Differential involvement of the basolateral amygdala and orbitofrontal cortex in the formation of sensory-specific associations in conditioned flavor preference and magazine approach paradigms.

Four experiments examined the roles of the basolateral amygdala and orbitofrontal cortex in the formation of sensory‐specific associations in conditioned flavor preference and conditioned magazine approach paradigms using unconditioned stimulus (US) devaluation and selective Pavlovian‐instrumental transfer procedures in Long Evans rats. Experiment 1 found that pre‐training amygdala and orbitofrontal cortex lesions had no detectable effect on the formation or flexible use of sensory‐specific flavor–nutrient associations in a US devaluation task, where flavor cues were paired either simultaneously or sequentially with nutrient rewards in water‐deprived subjects. In Experiment 2, pre‐training amygdala and orbitofrontal cortex lesions both attenuated outcome‐specific Pavlovian‐instrumental transfer. Experiment 3 indicated that amygdala lesions have no effect on the formation of sensory‐specific flavor–nutrient associations in a US devaluation task in food‐deprived subjects. Finally, Experiment 4 demonstrated that the outcomes used in Experiment 3 were sufficiently motivationally significant to support conditioned flavor preference. These findings suggest that, although both orbitofrontal cortex and amygdala lesions attenuate the acquisition of sensory‐specific associations in magazine approach conditioning, neither lesion reduces the ability to appropriately respond to a flavor cue that was paired with a devalued outcome.

Modulation of instrumental responding by a conditioned threat stimulus requires lateral and central amygdala

Two studies explored the role of the amygdala in response modulation by an aversive conditioned stimulus (CS) in rats. Experiment 1 investigated the role of amygdala circuitry in conditioned suppression using a paradigm in which licking for sucrose was inhibited by a tone CS that had been previously paired with footshock. Electrolytic lesions of the lateral amygdala (LA) impaired suppression relative to sham-operated animals, and produced the same pattern of results when applied to central amygdala. In addition, disconnection of the lateral and central amygdala, by unilateral lesion of each on opposite sides of the brain, also impaired suppression relative to control subjects that received lesions of both areas on the same side. In each case, lesions were placed following Pavlovian conditioning and instrumental training, but before testing. This procedure produced within-subjects measures of the effects of lesion on freezing and between-group comparisons for the effects on suppression. Experiment 2 extended this analysis to a task where an aversive CS suppressed shuttling responses that had been previously food reinforced and also found effects of bilateral lesions of the central amygdala in a pre-post design. Together, these studies demonstrate that connections between the lateral and central amygdala constitute a serial circuit involved in processing aversive Pavlovian stimuli, and add to a growing body of findings implicating central amygdala in the modulation of instrumental behavior.

Dorsal hippocampus inactivation impairs spontaneous recovery of Pavlovian magazine approach responding in rats.

Destruction or inactivation of the dorsal hippocampus (DH) has been shown to eliminate the renewal of extinguished fear [1-4]. However, it has recently been reported that the contextual control of responding to extinguished appetitive stimuli is not disrupted when the DH is destroyed or inactivated prior to tests for renewal of Pavlovian conditioned magazine approach [5]. In the present study we extend the analysis of DH control of appetitive extinction learning to the spontaneous recovery of Pavlovian conditioned magazine approach responding. Subjects were trained to associate two separate stimuli with the delivery of food and had muscimol or vehicle infused into the DH prior to a single test-session for spontaneous recovery occurring immediately following extinction of one of these stimuli, but one week following extinction of the other. While vehicle treated subjects showed more recovery to the distally extinguished stimulus than the proximal one, muscimol treated subjects failed to show spontaneous recovery to either stimulus. This result suggests that, while the DH is not involved in the control of extinction by physical contexts [5], it may be involved when time is the gating factor controlling recovery of extinguished responding.