Dorothy W. S. Kwok

Conditioned inhibition and reinforcement rate

We investigated conditioned inhibition in a magazine approach paradigm. Rats were trained on a feature negative discrimination between an auditory conditioned stimulus (CS) reinforced at one rate versus a compound of that CS and a visual stimulus (L) reinforced at a lower rate. This training established L as a conditioned inhibitor. We then tested the inhibitory strength of L by presenting it in compound with other auditory CSs. L reduced responding when tested with a CS that had been reinforced at a high rate, but had less or even no inhibitory effect when tested with a CS that had been reinforced at a low rate. The inhibitory strength of L was greater if it signaled a decrease in reinforcement from an already low rate than if it signaled an equivalent decrease in reinforcement from a high rate. We conclude that the strength of inhibition is not a linear function of the change in reinforcement that it signals. We discuss the implications of this finding for models of learning (e.g., Rescorla & Wagner, 1972) that identify inhibition with a difference (subtraction) rule.

Serial overshadowing of taste aversion learning by stimuli preceding the target taste

Three experiments tested whether events taking place before a rat has access to a target taste, sucrose, can proactively interfere with the acquisition of a sucrose aversion when sucrose is followed by a lithium chloride injection. Using a serial overshadowing procedure with various delays before lithium injection, proactive interference by a taste (Experiments 1 and 3) and by a novel context (Experiment 2) was found following two conditioning sessions, but not after a single conditioning session. Conversely, overshadowing by a taste given after the target was detectable after a single conditioning trial (Experiment 3) and, thus, indicated that retroactive interference involves a process different from that producing proactive interference. A simulation confirmed that the results are consistent with a modified Rescorla and Wagner (1972) interpretation of Revusky’s (1971) concurrent interference theory of delay learning.

Blocking of acquisition of a taste aversion by a context experienced prior to the taste

This experiment tested the proposal that events taking place before a rat has access to a taste can proactively interfere with acquisition of an aversion to the taste when this has been followed by lithium chloride injection. Rats were initially given context discrimination whereby placement in one distinctive context (target) was followed by lithium injection, while placement in a second context (safe) was followed by saline injection. In the subsequent 1-trial taste conditioning session, rats were first placed in either their target context (Blocking group), their safe context (Control-Safe group) or a neutral context (Control-Neutral group), then given access to sucrose and 30 min later were injected with lithium. Subsequent tests of sucrose intakes revealed a blocking effect. These results indicate that proactive interference with taste aversion learning by a context can occur that is unlikely to be based on generalization decrement.

Proximal, but not distal, pre-exposure reduces serial overshadowing in one-trial taste aversion learning

This experiment tested whether pre-exposing a taste would reduce its ability to overshadow conditioning to a target taste and whether this effect would depend on the delay between pre-exposure and conditioning. Two groups of rats were pre-exposed to an interfering taste (HCl) either a week before conditioning (Group Distal) or the day preceding conditioning (Group Proximal). In the single conditioning trial, rats were given the target taste (sucrose) and 65min later were injected with lithium. The groups differed as to what they were given to drink 50min after sucrose: The Distal, Proximal and Novel groups were given HCl, while the Control group was given water. Pre-exposure to HCl reduced overshadowing of the sucrose aversion by HCl in Group Proximal but not in Group Distal. Possible explanations for the latter result include extinction of the context-HCl association and loss of context control over an HCl-no outcome association.

Situational relevance: Context as a factor in serial overshadowing of taste aversion learning

In a serial overshadowing procedure, a target stimulus, A, is followed after an interval by a potentially interfering stimulus, B, and this is then followed by an unconditioned stimulus (US). An untested proposal from over four decades ago was that the degree to which B overshadows conditioning of A depends on whether or not the two events take place in the same context. To test this, two experiments used a 1-trial long-delay conditioned taste aversion (CTA) procedure: sucrose served as the target taste (A) and dilute hydrochloric acid (HCl) as the overshadowing taste (B), with lithium chloride injection providing the US. In Experiment 1, these tastes were novel: weaker overshadowing by HCl of an aversion to sucrose was found when the two tastes were presented in different contexts. Experiment 2 tested whether the effect of pre-exposure to HCl, thereby rendering it less effective in overshadowing a sucrose aversion, was also context dependent. In the conditioning session, rats again received either context-same or context-different presentations of sucrose and HCl. However, for some rats, HCl was pre-exposed in the same context to which it was later presented during conditioning (Consistent), while others were pre-exposed to HCl in a different context to the one in which it was presented during conditioning (Inconsistent). The Inconsistent group produced greater overshadowing than the Consistent group and thus confirmed that the latent inhibition effect was also context dependent. This study confirms the concept of situational relevance.

Timing of interfering events in one-trial serial overshadowing of a taste aversion.

This set of experiments examined the question of when a stimulus would be most effective in overshadowing the acquisition of long-delay taste aversion learning. In Experiment 1 rats drank sucrose, the target solution, followed by a hydrochloric acid (HCl) solution before lithium injection some time later; HCl was presented either early or late in the interval. The late condition produced greater overshadowing than the early condition. The importance of the HCl-injection interval was confirmed by Experiment 2, in which the sucrose-injection interval was varied. Experiment 3 found that even placement in a different context – an event that normally produces little overshadowing of a CTA – produced one-trial overshadowing of a sucrose aversion as long as the context was novel and exposure to it occurred immediately before lithium injection. No current theoretical account of one-trial overshadowing predicts that a late event produces more overshadowing than an early event. This result can, however, be accommodated within a modified version of the Rescorla-Wagner model.

The probability of reinforcement per trial affects posttrial responding and subsequent extinction but not within-trial responding.

During magazine approach conditioning, rats do not discriminate between a conditional stimulus (CS) that is consistently reinforced with food and a CS that is occasionally (partially) reinforced, as long as the CSs have the same overall reinforcement rate per second. This implies that rats are indifferent to the probability of reinforcement per trial. However, in the same rats, the per-trial reinforcement rate will affect subsequent extinction—responding extinguishes more rapidly for a CS that was consistently reinforced than for a partially reinforced CS. Here, we trained rats with consistently and partially reinforced CSs that were matched for overall reinforcement rate per second. We measured conditioned responding both during and immediately after the CSs. Differences in the per-trial probability of reinforcement did not affect the acquisition of responding during the CS but did affect subsequent extinction of that responding, and also affected the post-CS response rates during conditioning. Indeed, CSs with the same probability of reinforcement per trial evoked the same amount of post-CS responding even when they differed in overall reinforcement rate and thus evoked different amounts of responding during the CS. We conclude that reinforcement rate per second controls rats’ acquisition of responding during the CS, but at the same time, rats also learn specifically about the probability of reinforcement per trial. The latter learning affects the rats’ expectation of reinforcement as an outcome of the trial, which influences their ability to detect retrospectively that an opportunity for reinforcement was missed, and, in turn, drives extinction.

Mediated overshadowing and potentiation of long-delay taste aversion learning: Two versus six cue-taste pairings.

Mediated overshadowing occurs when an evoked representation of one stimulus interferes with the formation of an association between two other stimuli. This study tested whether such an effect can be found in long-delay taste aversion learning. The general methodology was to pair a cue with a sour taste (hydrochloric acid [HCl]) and then introduce the cue during the delay between the target taste, sucrose, and injection with lithium chloride (LiCl). Either 2 or 6 cue-HCl pairings were given. In Experiment 1, introduction of the cue, an almond flavor, produced overshadowing of the sucrose aversion in the group given 2 cue-HCl pairings (Paired-2), relative to an unpaired control, but potentiation of the sucrose aversion in the group given 6 cue-HCl pairings (Paired-6). This confirms that few pairings can be better than many in determining whether representation-mediated effects occur (Holland, 1990). A possible explanation for the Paired-6 results is that almond evoked an aversive response rather than memory of the sour HCl and that this added to the aversion produced by the sucrose-lithium pairing. Experiment 2 obtained similar results when a context was used as the cue intended to evoke an HCl representation.