Gene M. Heyman

Operant matching is not a logical consequence of maximizing reinforcement rate

The distribution of behavior between concurrently available schedules of reinforcement approximates the distribution of reinforcements between the schedules. This equality, called matching, has been explained as an instance of the principle that organisms maximize reinforcement rate. However, a precise account of the relationship between the distribution of behavior and reinforcement rate on the standard concurrent schedule shows that matching and maximizing are different.

Resolving the contradictions of addiction

Research findings on addiction are contradictory. According to biographical records and widely used diagnostic manuals, addicts use drugs compulsively, meaning that drug use is out of control and independent of its aversive consequences. This account is supported by studies that show significant heritabilities for alcoholism and other addictions and by laboratory experiments in which repeated administration of addictive drugs caused changes in neural substrates associated with reward. Epidemiological and experimental data, however, show that the consequences of drug consumption can significantly modify drug intake in addicts. The disease model can account for the compulsive features of addiction, but not occasions in which price and punishment reduced drug consumption in addicts. Conversely, learning models of addiction can account for the influence of price and punishment, but not compulsive drug taking. The occasion for this target article is that recent developments in behavioral choice theory resolve the apparent contradictions in the addiction literature. The basic argument includes the following four statements: First, repeated consumption of an addictive drug decreases its future value and the future value of competing activities. Second, the frequency of an activity is a function of its relative (not absolute) value. This implies that an activity that reduces the values of competing behaviors can increase in frequency even if its own value also declines. Third, a recent experiment (Heyman & Tanz 1995) shows that the effective reinforcement contingencies are relative to a frame of reference, and this frame of reference can change so as to favor optimal or suboptimal choice. Fourth, if the frame of reference is local, reinforcement contingencies will favor excessive drug use, but if the frame of reference is global, the reinforcement contingencies will favor controlled drug use. The transition from a global to a local frame of reference explains relapse and other compulsive features of addiction.

Ethanol regulated preference in rats.

A series of experiments evaluated the determinants of preference for mixtures of ethanol plus sucrose relative to sucrose in rats. One dipper served 10% ethanol mixed with 10% sucrose, and the second dipper served 10% sucrose. Lever presses operated each dipper according to a variable-interval 5-s schedule. In three experiments the subjects were given pre-session meals of sucrose (2.5–20 ml) or sucrose (20 ml) plus chow (5 or 10 g). Pre-session meals decreased responding maintained by sucrose but not responding maintained by ethanol mixture. In two experiments body weight was varied from 85% to 125% of the initial free-feeding values. Increases in body weight, like pre-session meals, decreased responding reinforced by sucrose, but typically did not decrease responding reinforced by ethanol mixture. Throughout most of the study, ethanol consumption remained at about 1.25 ml per half hour session (3–4 g/kg per 30 min). For example, pre-session access to ethanol mixture decreased within-session ethanol consumption, but total consumption, counting both sources, remained about 1.25 ml/session. The within-session patterns of responding also differed. Responding reinforced by ethanol mix decreased as a function of ethanol consumption, whereas responding reinforced by sucrose was relatively constant throughout the session. The simplest explanation of the results is that ethanols pharmacological consequences regulated preference.

A matching law analysis of the reinforcing efficacy of wheel running in rats

Previous research has demonstrated that running in a rotating wheel functions as a reinforcer for leverpressing in rats. In these studies, the pattern of responding was similar to the pattern of responding maintained by consummatory reinforcers, such as food and water. The present study investigated quantitative features of responding maintained by running. In previous experiments in which responses were reinforced according to variable-interval (VI) schedules and food and water served as the reinforcer, the equation for a rectangular hyperbola described the relationship between response rate and reinforcement rate. This experiment tested whether this quantitative regularity also applies to leverpressing maintained by the opportunity to run in a wheel. Fourteen male Wistar rats responded on levers for the opportunity to run. In each session, subjects were exposed to a series of VI schedules. An opportunity to run for 60 sec was the reinforcing consequence. Results showed that response rate was a negatively accelerated function of reinforcement rate, and the relationship between these two variables was described well by the equation for a rectangular hyperbola. To further test the similarity between running and consummatory reinforcers, the response requirement and access were manipulated. In previous experiments with food and water, these types of manipulations differentially changed the two parameters of the hyperbola. A similar pattern of results was obtained with wheel running. Thus, the equation appears to apply to running about as well as it does to consummatory reinforcers.

Addiction and choice: Theory and new data

Addiction’s biological basis has been the focus of much research. The findings have persuaded experts and the public that drug use in addicts is compulsive. But the word “compulsive” identifies patterns of behavior, and all behavior has a biological basis, including voluntary actions. Thus, the question is not whether addiction has a biology, which it must, but whether it is sensible to say that addicts use drugs compulsively. The relevant research shows most of those who meet the American Psychiatric Association’s criteria for addiction quit using illegal drugs by about age 30, that they usually quit without professional help, and that the correlates of quitting include legal concerns, economic pressures, and the desire for respect, particularly from family members. That is, the correlates of quitting are the correlates of choice not compulsion. However, addiction is, by definition, a disorder, and thereby not beneficial in the long run. This is precisely the pattern of choices predicted by quantitative choice principles, such as the matching law, melioration, and hyperbolic discounting. Although the brain disease model of addiction is perceived by many as received knowledge it is not supported by research or logic. In contrast, well established, quantitative choice principles predict both the possibility and the details of addiction.

Preference for saccharin-sweetened alcohol relative to isocaloric sucrose

Abstract This experiment tested the reinforcing efficacy of a saccharin-sweetened alcohol solution relative to an isocaloric sucrose drink in rats. One dipper served 10% alcohol plus 0.25% saccharin, and a second, concurrently available, dipper served 14.2% sucrose. During the course of the experiment, access to the two drinks was challenged by increasing the schedule requirement (variable-interval) that determined when a lever press would operate the dipper. There were two main findings. First, the rats continued to consume significant amounts of alcohol despite access to the isocaloric sucrose solution. Second, schedule-requirement increases that decreased sucrose-reinforced responding failed to decrease saccharin-sweetened alcohol reinforced responding. These results extend and replicate earlier findings from studies in which alcohol was mixed with sucrose, and the alcohol mixtures held a caloric advantage over the competing sucrose solutions. The experiment also included controls for differences in baseline response rates and for the influence of saccharin on preference. In the baseline response-rate control conditions, the two reinforcers were 10% sucrose and a mixture of 10% sucrose-plus-quinine. The results showed that the persistence of sweetened-alcohol reinforced responding could not be explained by differences in baseline response rates or the reinforcing properties of saccharin. Rather, the findings were consistent with the idea that the rats were defending baseline levels of alcohol-plus-saccharin consumption.

Quitting Drugs: Quantitative and Qualitative Features

According to the idea that addiction is a chronic relapsing disease, remission is at most a temporary state. Either addicts never stop using drugs, or if they do stop, remission is short lived. However, research on remission reveals a more complex picture. In national epidemiological surveys that recruited representative drug users, remission rates varied widely and were markedly different for legal and illegal drugs and for different racial/ethnic groups. For instance, the half-life for cocaine dependence was four years, but for alcohol dependence it was 16 years, and although most dependent cocaine users remitted before age 30, about 5% remained heavy cocaine users well into their forties. Although varied, the remission results were orderly. An exponential growth curve closely approximated the cumulative frequency of remitting for different drugs and different ethnic/racial groups. Thus, each year a constant proportion of those still addicted remitted, independent of the number of years since the onset of dependence.

Decision biases and persistent illicit drug use: an experimental study of distributed choice and addiction

This experiment tested the hypothesis that differences in drug use are correlated with differences in decision making. The subjects were 22 drug clinic patients who had used either opiates or stimulants for an average of 10 years, and 21 community residents who reported that they had rarely used illicit addictive drugs. The procedure consisted of a series of binary choices with two consequences; they earned money and determined the intervals that separated choice trials. Each choice earned the same amount of money, but one initiated a shorter delay to the next trial, whereas the other initiated a shorter delay as averaged over the next two trials. Shorter delays were advantageous in that they increased the overall rate of earnings and they reduced the time spent waiting for the next trial. Thus, one choice was better from the perspective of the current trial, while the other choice was better from the perspective of two or more consecutive trials. Drug-clinic patients were more likely to favor the one-trial solution compared with control subjects, who were more likely to favor the two-trial solution. There were five different choice games, with different versions varying in the magnitude of the advantage for switching from the two-trial to the one-trial solution. Drug clinic and control subjects differed most in the games in which the immediate advantage of the one-trial solution was larger, and all subjects were more likely to choose the global solution when the incentive for switching to the one-trial solution was lower. The results support the view that individual differences in decision making influence the course of illicit drug use.

Effects of methylphenidate on response rate and measures of motor performance and reinforcement efficacy

This experiment evaluated the effects of methylphenidate on reinforced responding in rats. In each session the subjects (rats) earned reinforcement on seven different variable-interval reinforcement schedules. The average intervals varied from 108 to 3 s and provided reinforcement rates ranging from about 30 to 1100/h. Response rate was a negatively accelerated function of reinforcement rate. Low doses of methylphenidate (1.0 and 2.0 mg/kg) increased responding maintained by the four leanest schedules, but had little effect on responding maintained by the three densest schedules. In contrast, an 8.0 mg/kg dose increased responding maintained by the three densest schedules and slightly decreased responding maintained by leaner schedules. A quantitative model of reinforced responding, referred to as the matching law or response strength equation, was fitted to the data. This equation has two parameters. On the basis of previous experiments, one was used to measure changes in reinforcement efficacy and the other was used to measure changes in motor performance. The 1.0 and 2.0 mg/kg doses changed the reinforcement parameter in the same way as did increases in deprivation and reward magnitude. The 8.0 mg/kg dose changed the motor parameter in the same was as did decreases in lever weight. It was concluded that methylphenidate increases reinforcement efficacy, and that the highest dose changed the topography of responding. The results are discussed in terms of the response strength equation, the rate dependency principle, and the question of how to interpret changes in reinforcement efficacy and motor performance.

Inelastic demand for alcohol in rats.

Abstract  Rationale: For the purpose of investigating the determinants of preference for alcohol, it would be advantageous to use a procedure in which the subjects had concurrent access to alcohol and an isocaloric food. However, in widely used animal models, the introduction of a weak sucrose solution markedly reduced alcohol consumption. In contrast, when alcohol was sweetened, rats defended high baseline levels of alcohol intake despite access to chow, 10% sucrose, and increases in body weight that markedly reduced food consumption. Under these conditions, certain pharmacological treatments selectively reduced alcohol consumption. The present experiment further tests the generality of the contrast between food and sweetened alcohol consumption in rats. Objective: To test if rats will defend baseline levels of alcohol consumption when (1) the competing reinforcer is an isocaloric, preferred food and (2) when the cost of defending alcohol entails a decrease in food consumption as well as an increase in response output. Methods: The rats had access to a 10% alcohol plus 0.25% saccharin solution and an isocaloric, 14.8% Polycose solution in a two-lever, choice procedure. In the initial condition, the response requirement for each drink was set at five responses (variable-ratio 5); in subsequent conditions the variable-ratio values were increased to 7.5, 10, 15, and 30 responses. Results: In the initial condition, the rats drank twice as much Polycose as alcohol. However, with increases in the variable-ratio requirements, Polycose consumption systematically decreased, whereas sweetened alcohol consumption remained at its baseline level or above in all but the variable-ratio 30 condition. Conclusions: Rats defended baseline alcohol consumption but not baseline food consumption. As alcohol and food consumption can be dissociated in humans, research on the mechanisms that mediate alcohol regulated preference in rats may shed light on the mechanisms that control human alcohol consumption.