Mary M. Sweeney

A MODEL OF RESURGENCE BASED ON BEHAVIORAL MOMENTUM THEORY

Resurgence is the reappearance of an extinguished behavior when an alternative behavior reinforced during extinction is subsequently placed on extinction. Resurgence is of particular interest because it may be a source of relapse to problem behavior following treatments involving alternative reinforcement. In this article we develop a quantitative model of resurgence based on the augmented model of extinction provided by behavioral momentum theory. The model suggests that alternative reinforcement during extinction of a target response acts as both an additional source of disruption during extinction and as a source of reinforcement in the context that increases the future strength of the target response. The model does a good job accounting for existing data in the resurgence literature and makes novel and testable predictions. Thus, the model appears to provide a framework for understanding resurgence and serves to integrate the phenomenon into the existing theoretical account of persistence provided by behavioral momentum theory. In addition, we discuss some potential implications of the model for further development of behavioral momentum theory.

Effects of high, low, and thinning rates of alternative reinforcement on response elimination and resurgence.

A common treatment for operant problem behavior is alternative reinforcement. When alternative reinforcement is removed or reduced, however, resurgence of the target behavior can occur. Shahan and Sweeney (2011) developed a quantitative model of resurgence based on behavioral momentum theory that suggests higher rates of alternative reinforcement result in faster response elimination and greater resurgence when removed, whereas lower rates of alternative reinforcement result in slower response elimination but are followed by less resurgence. Thus, the present study was designed to examine whether faster target response elimination and less resurgence could be achieved by beginning with a high rate of alternative reinforcement and gradually thinning it such that a low rate is ultimately removed during a simulated treatment lapse. Results showed that high rates of alternative reinforcement were more effective than low or thinning rates at target response suppression but resulted in resurgence when discontinued. Low and thinning rates, on the other hand, were less effective at response suppression but target responding did not increase when alternative reinforcement was discontinued. The quantitative model cannot currently account for the finding that lower-rate alternative reinforcement may not effectively disrupt behavior relative to an extinction only control. Relative advantages of high, low, thinning, or no alternative reinforcement are discussed with respect to suppression of target response rate during treatment, resurgence when alternative reinforcement is removed, and alternative response persistence, while taking into account differences between this animal model and modern applied behavior analytic treatments.

Behavioral momentum and resurgence: Effects of time in extinction and repeated resurgence tests

Resurgence is an increase in a previously extinguished operant response that occurs if an alternative reinforcement introduced during extinction is removed. Shahan and Sweeney (2011) developed a quantitative model of resurgence based on behavioral momentum theory that captures existing data well and predicts that resurgence should decrease as time in extinction and exposure to the alternative reinforcement increases. Two experiments tested this prediction. The data from Experiment 1 suggested that without a return to baseline, resurgence decreases with increased exposure to alternative reinforcement and to extinction of the target response. Experiment 2 tested the predictions of the model across two conditions, one with constant alternative reinforcement for five sessions, and the other with alternative reinforcement removed three times. In both conditions, the alternative reinforcement was removed for the final test session. Experiment 2 again demonstrated a decrease in relapse across repeated resurgence tests. Furthermore, comparably little resurgence was observed at the same time point in extinction in the final test, despite dissimilar previous exposures to alternative reinforcement removal. The quantitative model provided a good description of the observed data in both experiments. More broadly, these data suggest that increased exposure to extinction may be a successful strategy to reduce resurgence. The relationship between these data and existing tests of the effect of time in extinction on resurgence is discussed.

The nature of impulsivity: visual exposure to natural environments decreases impulsive decision-making in a delay discounting task.

The benefits of visual exposure to natural environments for human well-being in areas of stress reduction, mood improvement, and attention restoration are well documented, but the effects of natural environments on impulsive decision-making remain unknown. Impulsive decision-making in delay discounting offers generality, predictive validity, and insight into decision-making related to unhealthy behaviors. The present experiment evaluated differences in such decision-making in humans experiencing visual exposure to one of the following conditions: natural (e.g., mountains), built (e.g., buildings), or control (e.g., triangles) using a delay discounting task that required participants to choose between immediate and delayed hypothetical monetary outcomes. Participants viewed the images before and during the delay discounting task. Participants were less impulsive in the condition providing visual exposure to natural scenes compared to built and geometric scenes. Results suggest that exposure to natural environments results in decreased impulsive decision-making relative to built environments.

Effects of baseline reinforcement rate on operant ABA and ABC renewal.

Renewal is a relapse phenomenon that occurs when the contextual stimuli present during extinction change, and consequently, an extinguished response increases in rate. Two experiments assessed extinction and renewal of key-pecking in pigeons in a two-component multiple schedule wherein baseline reinforcer rates were delivered at relatively rich or lean rates. In Experiment 1, an ABA design was used in which baseline stimuli were steady key lights (Context A). Food was then removed during extinction, and simultaneously, the context was changed by flashing the key lights (Context B). Following extinction, steady key lights were reintroduced, but food remained unavailable. Key-pecking was more resistant to extinction and recovered to a greater degree in the rich relative to the lean component. In Experiment 2, we introduced novel stimuli following extinction (ABC renewal) rather than reintroducing baseline stimuli. Similar to Experiment 1, in Experiment 2 resistance to change and renewal remained greater in the component associated with higher reinforcer rates during baseline. These findings provide additional support for the context-specificity of operant extinction, and support the prediction of behavioral momentum theory that stimuli associated with higher rates of reinforcement engender greater persistence and relapse than those associated with lower rates of reinforcement.

Quantitative models of persistence and relapse from the perspective of behavioral momentum theory: Fits and misfits☆

We review quantitative accounts of behavioral momentum theory (BMT), its application to clinical treatment, and its extension to post-intervention relapse of target behavior. We suggest that its extension can account for relapse using reinstatement and renewal models, but that its application to resurgence is flawed both conceptually and in its failure to account for recent data. We propose that the enhanced persistence of target behavior engendered by alternative reinforcers is limited to their concurrent availability within a distinctive stimulus context. However, a failure to find effects of stimulus-correlated reinforcer rates in a Pavlovian-to-Instrumental Transfer (PIT) paradigm challenges even a straightforward Pavlovian account of alternative reinforcer effects. BMT has been valuable in understanding basic research findings and in guiding clinical applications and accounting for their data, but alternatives are needed that can account more effectively for resurgence while encompassing basic data on resistance to change as well as other forms of relapse.

Modeling the effects of sensory reinforcers on behavioral persistence with alternative reinforcement

Problem behavior often has sensory consequences that cannot be separated from the target response, even if external, social reinforcers are removed during treatment. Because sensory reinforcers that accompany socially mediated problem behavior may contribute to persistence and relapse, research must develop analog sensory reinforcers that can be experimentally manipulated. In this research, we devised analogs to sensory reinforcers in order to control for their presence and determine how sensory reinforcers may impact treatment efficacy. Experiments 1 and 2 compared the efficacy of differential reinforcement of alternative behavior (DRA) versus noncontingent reinforcement (NCR) with and without analog sensory reinforcers in a multiple schedule. Experiment 1 measured the persistence of key pecking in pigeons, whereas Experiment 2 measured the persistence of touchscreen responses in children with intellectual and developmental disabilities. Across both experiments, the presence of analog sensory reinforcers increased the levels, persistence, and variability of responding relative to when analog sensory reinforcers were absent. Also in both experiments, target responding was less persistent under conditions of DRA compared to NCR regardless of the presence or absence of analog sensory reinforcers.

Effects of signaled and unsignaled alternative reinforcement on persistence and relapse in children and pigeons.

Three experiments explored the impact of different reinforcer rates for alternative behavior (DRA) on the suppression and post-DRA relapse of target behavior, and the persistence of alternative behavior. All experiments arranged baseline, intervention with extinction of target behavior concurrently with DRA, and post-treatment tests of resurgence or reinstatement, in two- or three-component multiple schedules. Experiment 1, with pigeons, arranged high or low baseline reinforcer rates; both rich and lean DRA schedules reduced target behavior to low levels. When DRA was discontinued, the magnitude of relapse depended on both baseline reinforcer rate and the rate of DRA. Experiment 2, with children exhibiting problem behaviors, arranged an intermediate baseline reinforcer rate and rich or lean signaled DRA. During treatment, both rich and lean DRA rapidly reduced problem behavior to low levels, but post-treatment relapse was generally greater in the DRA-rich than the DRA-lean component. Experiment 3, with pigeons, repeated the low-baseline condition of Experiment 1 with signaled DRA as in Experiment 2. Target behavior decreased to intermediate levels in both DRA-rich and DRA-lean components. Relapse, when it occurred, was directly related to DRA reinforcer rate as in Experiment 2. The post-treatment persistence of alternative behavior was greater in the DRA-rich component in Experiment 1, whereas it was the same or greater in the signaled-DRA-lean component in Experiments 2 and 3. Thus, infrequent signaled DRA may be optimal for effective clinical treatment.

Renewal, Resurgence, and Alternative Reinforcement Context

Resurgence, relapse induced by the removal of alternative reinforcement, and renewal, relapse induced by a change in contextual stimuli, are typically studied separately in operant conditioning paradigms. In analogous treatments of operant problem behavior, aspects of both relapse phenomena can operate simultaneously. Therefore, the purpose of this study was to examine a novel method for studying resurgence and renewal in the same experimental preparation. An alternative source of reinforcement was available during extinction for one group of rats (a typical resurgence preparation). Another group experienced an operant renewal preparation in which the extinction context was distinguished via olfactory and visual stimuli. A third group experienced alternative reinforcement delivery in the new context, a novel combination of typical resurgence and renewal preparations. Removal of alternative reinforcement and/or a change in context induced relapse relative to an extinction-only control group. When alternative reinforcement was delivered in a novel context, the alternative response was less persistent relative to when extinction of the alternative response took place in the context in which it was trained. This methodology might be used to illustrate shared (or distinct) mechanisms of resurgence and renewal, and to determine how delivering alternative reinforcement in another context may affect persistence and relapse.

Resurgence of target responding does not exceed increases in inactive responding in a forced-choice alternative reinforcement procedure in humans

Resurgence following removal of alternative reinforcement has been studied in non-human animals, children with developmental disabilities, and typically functioning adults. Adult human laboratory studies have included responses without a controlled history of reinforcement, included only two response options, or involved extensive training. Arbitrary responses allow for control over history of reinforcement. Including an inactive response never associated with reinforcement allows the conclusion that resurgence exceeds extinction-induced variability. Although procedures with extensive training produce reliable resurgence, a brief procedure with the same experimental control would allow more efficient examination of resurgence in adult humans. We tested the acceptability of a brief, single-session, three-alternative forced-choice procedure as a model of resurgence in undergraduates. Selecting a shape was the target response (reinforced in Phase I), selecting another shape was the alternative response (reinforced in Phase II), and selecting a third shape was never reinforced. Despite manipulating number of trials and probability of reinforcement, resurgence of the target response did not consistently exceed increases in the inactive response. Our findings reiterate the importance of an inactive control response and call for reexamination of resurgence studies using only two response options. We discuss potential approaches to generate an acceptable, brief human laboratory resurgence procedure.