Paulo Guilhardi

Dynamics of temporal discrimination.

The purpose of this research was to describe and explain the acquisition of temporal discriminations, transitions from one temporal interval to another, and asymptotic performance of stimulus and temporal discriminations. Rats were trained on a multiple cued interval (MCI) procedure with a head entry response on three signaled fixed-interval schedules of reinforcement (30, 60, and 120 sec). They readily learned the three temporal discriminations, whether they were presented simultaneously or successively, and they rapidly adjusted their performance to new intervals when the intermediate interval was varied daily. Although exponential functions provided good descriptions of many measures of temporal discrimination, different parameter values were required for each measure. The addition of a linear operator to a packet theory of timing with a single set of parameters provided a quantitative process model that fit many measures of the dynamics of temporal discrimination.

A modular theory of learning and performance

We describe a theory to account for the acquisition and extinction of response rate (conditioning) and pattern (timing). This modular theory is a development of packet theory (Kirkpatrick, 2002; Kirkpatrick & Church, 2003) that adds a distinction between pattern and strength memories, as well as contributing closed-form equations. We describe the theory using equations related to a flow diagram and illustrate it by an application to an experiment with repeated acquisitions and extinctions of a multiple-cued-interval procedure using rats. The parameter estimates for the theory were based on a calibration sample from the data, and the predictions for different measures of performance on a validation sample from the same data (cross-validation). The theory’s predictions were similar to predictions based on the reliability of the behavior.

How rats combine temporal cues

The procedures for classical and operant conditioning, and for many timing procedures, involve the delivery of reinforcers that may be related to the time of previous reinforcers and responses, and to the time of onsets and terminations of stimuli. The behavior resulting from such procedures can be described as bouts of responding that occur in some pattern at some rate. A packet theory of timing and conditioning is described that accounts for such behavior under a wide range of procedures. Applications include the food searching by rats in Skinner boxes under conditions of fixed and random reinforcement, brief and sustained stimuli, and several response-food contingencies. The approach is used to describe how multiple cues from reinforcers and stimuli combine to determine the rate and pattern of response bouts.

Measures of temporal discrimination in fixed- interval performance: A case study in archiving data

The primary data of many experimental studies of animal learning and performance consist of the times at which stimuli and reinforcers were delivered, and the times at which responses occurred. The articles based on most of these studies report selected data, either from some sessions or some animals, or summary measures of the animals’ behavior. The primary data are sufficient to produce any of the selected and summary measures, but the selected and summarized data cannot produce many of the measures used in other experimental reports. It is now feasible to archive the primary data from animal behavior experiments so that they are accessible for others to perform secondary analysis. The value of such secondary analysis of archived data is described with a case study in which rats were trained on three fixed-interval schedules of reinforcement. The full data set may be downloaded fromwww.psychonomic.org/archive/.

A Turing test of a timing theory

A quantitative theory of timing or conditioning can be evaluated with a Turing test in which the behavioral results of an experiment can be compared with the predicted results from the theory. An example is described based upon an experiment in which 12 rats were trained on three fixed-interval schedules of reinforcement, and a simulation of the predicted results from a packet theory of timing. An objective classification rule was used to determine whether a sample from the data or a sample from the theory was more similar to another sample from the theory. With an ideal theory, the expected probability of a correct classification would be 0.5. The observed probability of a correct classification was 0.6, which was slightly, but reliably, greater than 0.5. A Turing test provides a graded metric for the evaluation of a quantitative theory.

The pattern of responding after extensive extinction

Extensive extinction greatly reduces response rate and increases the relative frequency of short interresponse times, but does not affect temporal learning or operant response rate. In each of two experiments, 24 rats were trained in a multiple cued interval procedure with three stimuli (noise, light, and clicker) at three intervals (30, 60, and 120 sec). In Experiment 1, after 50 sessions of extinction, response rate decreased from about 25 to 0.5 responses/min, but temporal discriminations were maintained and the initial response gradients in reacquisition had a pattern that corresponded with the original (rather than current) training conditions. In Experiment 2, these results were replicated and extended by examination of the effect of stimulus duration on response patterns during extinction, but its lack of effect on reacquisition. The similarity of the initial performance in reacquisition to the asymptotic performance in acquisition was presumably due to the similarity of context. The individual subject data may be downloaded from www.psychonomic.org/archive.

Shifts in the psychophysical function in rats

The primary goal was to compare results from a free-operant procedure with pigeons [Machado, A., Guilhardi, P., 2000. Shifts in the psychometric function and their implications for models of timing. J. Exp. Anal. Behav. 74, 25-54, Experiment 2] with new results obtained with rats. The secondary goal was to compare the results of both experiments with dependent variables that were not used in the original publication. As in the original study with pigeons, rats were trained on a two-alternative free-operant psychophysical procedure in which left lever press responses were reinforced during the first and second quarters of a 60-s trial, and right lever press responses were reinforced during the third and fourth quarters of the trial. The quarters were reinforced according to four independent variable interval (VI) schedules of reinforcement. The VI duration was manipulated in each quarter, and shifts in the psychophysical functions that relate response rate with time since trial onset were measured. The results obtained with rats were consistent with those previously obtained with pigeons. In addition, results not originally reported were also consistent between rats and pigeons, and provided insights into the perception, memory, and decision processes in Scalar Expectancy Theory and Learning-to-Time Theory.

Effects of Repeated Acquisitions and Extinctions on Response Rate and Pattern

The procedure developed by R. A. Rescorla (2002) was used to study the effects of repeated acquisitions and extinctions of head entry responses into a food cup by rats. In each of 4 20-session phases, food was delivered at the end of particular 30-s auditory and visual stimuli, but not at the end of different 30-s auditory and visual stimuli. Based on response rates to individual stimuli and compound stimuli, the increase in response rate in acquisition occurred more rapidly than the decrease in extinction. Acquisition, but not extinction, occurred faster after successive transitions between acquisition and extinction. Temporal gradients of responding developed during acquisition and remained during extinction. Conclusions based on mean response rate, temporal gradients, and transfer tests were consistent.

The effects of combined perirhinal and postrhinal damage on complex discrimination tasks

Rats with combined lesions of the perirhinal (PER) and postrhinal (POR) cortices were trained on a complex discrimination in the simultaneous feature‐positive and feature‐negative discrimination task. In this task, a panel light (L) paired with an auditory stimulus determined whether a tone (T) or white noise (N) would be rewarded (+) or not rewarded (−). Thus, the light feature determined whether the target auditory stimuli were rewarded or not. In each session, trial types were LT+, T−, N+, and LN−. We had hypothesized that damage to the target regions would impair performance on this task. Acquisition was altered in the lesioned rats, but not in the predicted direction. Instead, lesioned rats exhibited significantly enhanced acquisition of the discrimination. Manipulation of intertrial intervals indicated that reduction of proactive interference did not explain the enhancement. Lesioned rats were not different from controls on a multiple‐cued interval timing task, providing evidence that the enhancement does not extend to all types of discriminations and is not due to a deficit in timing. Other research shows that rats with PER lesions are impaired on similar tasks, thus the enhancement is likely due to the effects of POR damage. Normally in this task, context is thought to accrue inhibitory control over other cues. Without this inhibitory control, animals might be expected to learn the task more efficiently. Our conclusion is that deficits in processing contextual information underlie the enhanced acquisition observed in rats with combined PER and POR damage on this complex discrimination task.

Differences between simultaneous and blocked training detected by a transfer test

Secondary data analysis was used to compare responding early on a transfer test from rats previously trained simultaneously or successively on multiple temporal discriminations for the same number of trials [Guilhardi, P., Church, R.M., 2005 a. Dynamics of temporal discrimination. Learn. Behav., 33, 399-416]. Three fixed intervals (30, 60, and 120 s) were signaled by three stimuli (light, noise, and clicker). Twelve rats were trained with the three stimulus-interval pairs intermixed on each experimental session (simultaneous condition); 12 other rats were trained in successive blocks of 10 sessions on each pair (blocked condition). Then, all rats had a transfer test in which all three stimulus-interval pairs were presented intermixed on each session. Rats in the simultaneous and blocked condition responded similarly during training, but differently during early stages of the transfer test. One possibility is that rats in the blocked condition were controlled by the previous interval, not by the current stimulus. These results challenge the usual assumptions from models of timing and conditioning that both simultaneous and blocked training produce learning of the associations between stimulus and interval in a multiple interval training task.