Adam H. Doughty

Differential resurgence and response elimination.

Resurgence refers to the transient recovery of previously reinforced, but presently not reinforced, responding when more recently reinforced responding is extinguished. The primary purpose of our research was to determine how differential resurgence results from the procedures used to eliminate that responding. There were three conditions in each of five experiments. In Condition 1, key pecking by pigeons was maintained under a two-component multiple variable-interval (VI) 30-s VI 30-s schedule. In Condition 2, this pecking was eliminated in different ways across components. In Condition 3, extinction was in effect for all responses, and resurgence of key pecking was compared across components. These three conditions were repeated for most pigeons, and the procedures used to eliminate responding in Condition 2 varied across experiments. In Experiment 1, there was greater resurgence, and an earlier onset of it, after a differential-reinforcement-of-other-behavior (DRO) schedule than after a VI schedule was correlated with pecking an alternative key. Experiments 2 and 3 showed that the differential resurgence in Experiment 1 probably was not due to conditional stimulus control or the periodicity of food delivery, respectively. In Experiment 4, there was no systematic difference in resurgence after either a DRO schedule or a VI schedule correlated with treadle pressing. In Experiment 5, there was greater resurgence, and/or an earlier onset of it, after a VI schedule correlated with treadle pressing than after a VI schedule correlated with pecking an alternative key. Taken together, the results showed that the reinforcement of an alternative key-peck response was the most effective means of reducing subsequent key-peck resurgence. The relation of these results to an understanding of resurgence is discussed.

Differential reinstatement predicted by preextinction response rate

Reinstatement refers to the recovery of previously extinguished responding by the responseindependent delivery of a stimulus that was a reinforcer in training. Two experiments were conducted to examine relative reinstatement following the training of differential preextinction response rates, either with equal (Experiment 1) or unequal (Experiment 2) preextinction reinforcement rates. In Experiment 1, each of 3 pigeons first pecked at relatively high rates in the tandem variable-time 117-sec fixed-interval 3-sec component of a multiple schedule and at lower rates in a separate tandem variableinterval 117-sec fixed-time 3-sec component. Reinforcement rates were equal between components. Pecking then was extinguished in each component, before being reinstated under a multiple variabletime 120-sec variable-time 120-sec schedule. Greater reinstatement occurred in the component previously correlated with higher rates of pecking. In Experiment 2, in an initial condition, the mean rate of lever pressing for one group of 8 rats was significantly higher under a fixed-ratio 3 schedule than for another group of 8 rats under a fixed-ratio 1 schedule. Mean reinforcement rate was significantly higher for the group exposed to the fixed-ratio 1 schedule. For each group, lever pressing then was extinguished, before being reinstated under a variable-time 30-sec schedule. Significantly greater mean reinstatement occurred for the group previously exposed to the fixed-ratio 3 schedule. These results suggest that differential reinstatement may be predicted by preextinction response rate, perhaps independently of preextinction reinforcement rate.

Effects of Behavioral History on Resistance to Change.

Two experiments examined whether differential resistance to change would occur under identical variable-interval schedules as a function of a differential behavioral history. In Experiment 1, each of 3 pigeons first pecked at different rates under a multiple variable-ratio differential-reinforcement-of-low-rate schedule. In a subsequent condition, a multiple variable-interval variable interval schedule operated in the presence of the same training stimuli, during which there were three 4-session prefeeding probes each occurring during a different stage of training. Pecking generally was more resistant to change in the presence of the stimulus previously correlated with the differential-reinforcement-of-low-rate schedule, and this result was more reliable during the earlier probes. In Experiment 2, each of 3 pigeons first was exposed to a multiple variable-interval extinction schedule, after which a variable-interval schedule replaced extinction. During 3 probes, each conducted during a different stage of multiple variable-interval variable-interval schedule training, food was delivered response independently between components. In the first probe, pecking was more resistant to change for each pigeon under the variable-interval schedule that had been in effect longer, but during the final 2 probes this differential resistance was absent. The present results, therefore, show that under identical schedules a behavioral history can influence resistance to change differentially, but that these history effects tend to dissipate with continued exposure to the identical schedules.

Response persistence under variable-time schedules following immediate and unsignalled delayed reinforcement

Key pecking of three pigeons was maintained in separate components of a multiple schedule by either immediate reinforcement (i.e., tandem variable-time fixed-interval schedule) or unsignalled delayed reinforcement (i.e., tandem variable-interval fixed-time schedule). The relative rate of food delivery was equal across components, and this absolute rate differed across conditions. Immediate reinforcement always generated higher response rates than did unsignalled delayed reinforcement. Then, variable-time schedules of food delivery replaced the contingencies just described such that food was delivered at the same rate but independently of responding. In most cases, response rates decreased to near-zero levels. In addition, response persistence was not systematically different between multiple-schedule components across pigeons. The implications of the results for the concepts of response strength and the response-reinforcer relation are noted.

Superstitious Responding and Reinforcement Rate Under Concurrent Variable-Interval Extinction Schedules

To examine superstitious responding, four pigeons key pecked under multiple concurrent variable-interval 45 s variable-interval 90 s concurrent variable-interval 90 s variable-interval 180 s schedules in the absence of a changeover delay. The two variable-interval 90 s schedules then were replaced by extinction, and key-peck responding during extinction was examined as a function of the prevailing reinforcement rate. During the first several sessions, extinction-key responding was maintained closer to baseline levels in the presence of the higher reinforcement rate, and this effect dissipated or even reversed with continued exposure to extinction. Although extinction-key responding generally decreased to near-zero levels after several sessions, in a few instances, it continued for 30 and 45 sessions. These results demonstrate how concurrent variable-interval extinction schedules can be used to investigate what often has been labeled superstitious responding.

Psychological distance to reward: equating the number of stimulus and response segments

Psychological distance to reward, or the segmentation effect, refers to the preference for a terminal link of a concurrent-chains schedule consisting of a simple reinforcement schedule (e.g. fixed interval [FI] 30s) relative to its chained-schedule counterpart (e.g. chained FI 15s FI 15s). This experiment was conducted to examine whether the segmentation effect is due to the number of terminal-link stimulus and response segments per se. Three pigeons pecked under a concurrent-chains schedule in which identical variable-interval (VI) schedules operated in the initial links. In each session, half the terminal-link entries followed one initial-link key and the other half followed the other initial-link key. The initial-link keys correlated with the different terminal links were manipulated across conditions. In the first three conditions, each terminal link contained a chained fixed-time (FT) FT schedule, and in the final three conditions, each terminal link contained a chained FI FI schedule. In each condition, in one terminal link (alternating), the order of two key colors correlated with the different schedule segments alternated across terminal-link entries, whereas in the other terminal link (constant), the order of two other key colors was identical for each entry. With the chained FT FT schedule terminal links, there was indifference between the alternating and constant terminal links within and across pigeons, as indexed by initial-link choice proportions. In addition, terminal-link response rates were relatively low. With the chained FI FI schedule terminal links, for each pigeon, there was relatively more preference for the alternating terminal link and terminal-link response rates increased relative to conditions with the chained FT FT schedule terminal links. These data suggest that the segmentation effect is not due simply to the number of terminal-link stimulus or response segments per se, but rather to a required period of responding during a stimulus segment that never is paired with reinforcement.