Kimberly Kirkpatrick

Tracking of the expected time to reinforcement in temporal conditioning procedures

In one experiment, the rate and pattern of responding (head entry into the food cup) under different distributions of intervals between food deliveries were examined. Separate groups of rats received fixed-time (45, 90, 180, or 360 sec), random-time (45, 90, 180, or 360 sec), or tandem fixed-time (45 or 90 sec) random-time (45 or 90 sec) schedules of reinforcement. Schedule type affected the pattern of responding as a function of time, whereas mean interval duration affected the mean rate of responding. Responses occurred in bouts with characteristics that were invariant across conditions. Packet theory, which assumes that the momentary probability of bout occurrence is negatively related to the conditional expected time remaining until the next reinforcer, accurately predicted global and local measures of responding. The success of the model advances the prediction of multiple measures of responding across different types of time-based schedules.

The Role of the Nucleus Accumbens Core in Impulsive Choice, Timing, and Reward Processing

The present series of experiments aimed to pinpoint the source of nucleus accumbens core (AcbC) effects on delay discounting. Rats were trained with an impulsive choice procedure between an adjusting smaller sooner reward and a fixed larger later reward. The AcbC-lesioned rats produced appropriate choice behavior when the reward magnitude was equal. An increase in reward magnitude resulted in a failure to increase preference for the larger later reward in the AcbC-lesioned rats, whereas a decrease in the larger later reward duration resulted in normal alterations in choice behavior in AcbC-lesioned rats. Subsequent experiments with a peak timing (Experiments 2 and 3) and a behavioral contrast (Experiment 4) indicated that the AcbC-lesioned rats suffered from decreased incentive motivation during changes in reward magnitude (Experiments 2 and 4) and when expected rewards were omitted (Experiments 2 and 3), but displayed intact anticipatory timing of reward delays (Experiments 2 and 3). The results indicate that the nucleus accumbens core is critical for determining the incentive value of rewards, but does not participate in the timing of reward delays.

Packet theory of conditioning and timing.

Packet theory is based on the assumption that the momentary probability of producing a bout or packet of responding is controlled by the conditional expected time function. Bouts of head entry responses of rats into a food cup appear to have the same characteristics across a range of conditions. The conditional expected time function is the mean expected time remaining until the next food delivery as a function of time since an event such as food or stimulus onset. The conditional expected time function encodes mean interval duration as well as the distribution form so that both the mean response rate and form of responding in time can be predicted. Simulations of Packet theory produced accurate quantitative predictions of: (1) the effect of reinforcement density (mean food-food interval) and distribution form on responding; (2) scalar variance in fixed interval responding; (3) CS-US and intertrial interval effects on the strength of conditioning; and (4) the effect of the ratio of cycle:trial time on the strength of conditioning.

Independent effects of stimulus and cycle duration in conditioning: The role of timing processes

Rats received delay conditioning procedures with a white-noise conditioned stimulus (CS), a food unconditioned stimulus (US), and head entries into the food cup as the conditioned response. The stimulus duration (S) and the interval between food deliveries (C) were varied between groups:S=15, 30, 60, and 120 sec;C=90, 180, and 360 sec. The stimulus/cycle duration ratio was negatively related to the asymptotic level of conditioning but had no effect on the rate of acquisition. Conditioning and timing of responses emerged together in training. Timing occurred during the CS-US interval (ISI) and the US-US interval (ITI), as evidenced by increasing response rate gradients that were steeper for shorter intervals. The effects of the stimulus/cycle ratio on conditioning were attributed to independent timing of theS andC durations. Serial-, parallel-, and single-process accounts of conditioning and timing are compared.

Stimulus and temporal cues in classical conditioning.

In 2 experiments, separate groups of rats were given stimulus conditioning, temporal conditioning, untreated control and (in Experiment 2) learned irrelevance control procedures, followed by a compound with both stimulus and temporal cues. Stimulus conditioning consisted of a random 15-s duration conditioned stimulus (CS) followed by food; temporal conditioning consisted of food-food intervals of fixed 90 s (Experiment 1) or fixed 75 + random 15 s (Experiment 2). The stimulus group abruptly increased responding after CS onset, and the temporal group gradually increased responding over the food-food interval. When the food-food interval was fixed 90 s, the temporal cue exerted stronger control in the compound, whereas when the food-food interval was fixed 75 + random 15 s, the stimulus cue exerted stronger control. The strength of conditioning, temporal gradients of responding, and cue competition effects appear to reflect simultaneous timing of multiple intervals.

Mechanisms of impulsive choice: I. Individual differences in interval timing and reward processing

Impulsive choice behavior incorporates the psychological mechanisms involved in the processing of the anticipated magnitude and delay until reward. The goal of the present experiment was to determine whether individual differences in such processes related to individual differences in impulsive choice behavior. Two groups of rats (Delay Group and Magnitude Group) were initially exposed to an impulsive choice task with choices between smaller-sooner (SS) and larger-later (LL) rewards. The Delay Group was subsequently exposed to a temporal discrimination task followed by a progressive interval task, whereas the Magnitude Group was exposed to a reward magnitude sensitivity task followed by a progressive ratio task. Intertask correlations revealed that the rats in the Delay Group that made more self-controlled (LL) choices also displayed lower standard deviations in the temporal bisection task and greater delay tolerance in the progressive interval task. Impulsive choice behavior in the Magnitude Group did not display any substantial correlations with the reward magnitude sensitivity and progressive ratio tasks. The results indicate the importance of core timing processes in impulsive choice behavior, and encourage further research examining the effects of changes in core timing processes on impulsive choice.

Impulsive choice behavior in four strains of rats: Evaluation of possible models of Attention Deficit/Hyperactivity Disorder

Several studies have examined impulsive choice behavior in spontaneously hypertensive rats (SHRs) as a possible pre-clinical model for Attention-Deficit/Hyperactivity Disorder (ADHD). However, this strain was not specifically selected for the traits of ADHD and as a result their appropriateness as a model has been questioned. The present study investigated whether SHRs would exhibit impulsive behavior in comparison to their control strain, Wistar Kyoto (WKY) rats. In addition, we evaluated a strain that has previously shown high levels of impulsive choice, the Lewis (LEW) rats and compared them with their source strain, Wistar (WIS) rats. In the first phase, rats could choose between a smaller-sooner (SS) reward of 1 pellet after 10 s and a larger-later (LL) reward of 2 pellets after 30 s. Subsequently, the rats were exposed to increases in LL reward magnitude and SS delay. These manipulations were designed to assess sensitivity to magnitude and delay within the choice task to parse out possible differences in using the strains as models of specific deficits associated with ADHD. The SHR and WKY strains did not differ in their choice behavior under either delay or magnitude manipulations. In comparison to WIS, LEW showed deficits in choice behavior in the delay manipulation, and to a lesser extent in the magnitude manipulation. An examination of individual differences indicated that the SHR strain may not be sufficiently homogeneous in their impulsive choice behavior to be considered as a viable model for impulse control disorders such as ADHD. The LEW strain may be worthy of further consideration for their suitability as an animal model.

INDIVIDUAL DIFFERENCES IN IMPULSIVE CHOICE AND TIMING IN RATS

Individual differences in impulsive choice behavior have been linked to a variety of behavioral problems including substance abuse, smoking, gambling, and poor financial decision-making. Given the potential importance of individual differences in impulsive choice as a predictor of behavioral problems, the present study sought to measure the extent of individual differences in a normal sample of hooded Lister rats. Three experiments utilized variations of a delay discounting task to measure the degree of variation in impulsive choice behavior across individual rats. The individual differences accounted for 22-55% of the variance in choice behavior across the three experiments. In Experiments 2 and 3, the individual differences were still apparent when behavior was measured across multiple choice points. Large individual differences in the rate of responding, and modest individual differences in timing of responding were also observed during occasional peak trials. The individual differences in timing and rate, however, did not correlate consistently with individual differences in choice behavior. This suggests that a variety of factors may affect choice behavior, response rate, and response timing.

Motivation and timing: clues for modeling the reward system.

There is growing evidence that a change in reward magnitude or value alters interval timing, indicating that motivation and timing are not independent processes as was previously believed. The present paper reviews several recent studies, as well as presenting some new evidence with further manipulations of reward value during training vs. testing on a peak procedure. The combined results cannot be accounted for by any of the current psychological timing theories. However, in examining the neural circuitry of the reward system, it is not surprising that motivation has an impact on timing because the motivation/valuation system directly interfaces with the timing system. A new approach is proposed for the development of the next generation of timing models, which utilizes knowledge of the neuroanatomy and neurophysiology of the reward system to guide the development of a neurocomputational model of the reward system. The initial foundation along with heuristics for proceeding with developing such a model is unveiled in an attempt to stimulate new theoretical approaches in the field.

Effects of Varying Stimulus Size on Object Recognition in Pigeons

The authors investigated the pigeons ability to generalize object discrimination performance to smaller and larger versions of trained objects. In Experiment 1, they taught pigeons with line drawings of multipart objects and later tested the birds with both larger and smaller drawings. The pigeons exhibited significant generalization to new sizes, although they did show systematic performance decrements as the new size deviated from the original. In Experiment 2, the authors tested both linear and exponential size changes of computer-rendered basic shapes to determine which size transformation produced equivalent performance for size increases and decreases. Performance was more consistent with logarithmic than with linear scaling of size. This finding was supported in Experiment 3. Overall, the experiments suggest that the pigeon encodes size as a feature of objects and that the representation of size is most likely logarithmic.