Óscar García-Leal

Autoshaped choice in artificial neural networks: implications for behavioral economics and neuroeconomics.

An existing neural network model of conditioning was used to simulate autoshaped choice. In this phenomenon, pigeons first receive an autoshaping procedure with two keylight stimuli X and Y separately paired with food in a forward-delay manner, intermittently for X and continuously for Y. Then pigeons receive unreinforced choice test trials of X and Y concurrently present. Most pigeons choose Y. This preference for a more valuable response alternative is a form of economic behavior that makes the phenomenon relevant to behavioral economics. The phenomenon also suggests a role for Pavlovian contingencies in economic behavior. The model used, in contrast to others, predicts autoshaping and automaintenance, so it is uniquely positioned to predict autoshaped choice. The model also contemplates neural substrates of economic behavior in neuroeconomics, such as dopaminergic and hippocampal systems. A feedforward neural network architecture was designed to simulate a neuroanatomical differentiation between two environment-behavior relations X-R1 and Y-R2, [corrected] where R1 and R2 denote two different emitted responses (not unconditionally elicited by the reward). Networks with this architecture received a training protocol that simulated an autoshaped-choice procedure. Most networks simulated the phenomenon. Implications for behavioral economics and neuroeconomics, limitations, and the issue of model appraisal are discussed.

Transitive Inference Remains Despite Overtraining on Premise Pair C+D-

Transitive inference (TI) has been studied in humans and several animals such as rats, pigeons and fishes. Using different methods for training premises it has been shown that a non-trained relation between stimuli can be stablished, so that if A > B > C > D > E, then B > D. Despite the widely reported cases of TI, the specific mechanisms underlying this phenomenon remain under discussion. In the present experiment pigeons were trained in a TI procedure with four premises. After being exposed to all premises, the pigeons showed a consistent preference for B over D during the test. After overtraining C+D- alone, B was still preferred over D. However, the expected pattern of training performance (referred to as serial position effect) was distorted, whereas TI remained unaltered. The results are discussed regarding value transfer and reinforcement contingencies as possible mechanisms. We conclude that reinforcement contingencies can affect training performance without altering TI.

Pigeons and the Ambiguous-Cue Problem: A Riddle that Remains Unsolved

The ambiguous-cue task is composed of two-choice simultaneous discriminations involving three stimuli: positive (P), ambiguous (A), and negative (N). Two different trial types are presented: PA and NA. The ambiguous cue (A) served as an S- in PA trials, but as an S+ in NA trials. When using this procedure, it is typical to observe a less accurate performance in PA trials than in NA trials. This is called the ambiguous-cue effect. Recently, it was reported in starlings that the ambiguous-cue effect decreases when the stimuli are presented on an angled (120°) panel. The hypothesis is that the angled panel facilitates that the two cues from each discrimination are perceived as a compound, precluding value transfer via a second-order conditioning mechanism. In this experiment, we used pigeons and a flat panel. Nevertheless, our data were quite similar to the previous data in starlings. We conclude that the form of the panel cannot explain the ambiguous-cue effect. Several alternatives to be explored in future experiments are suggested. The riddle of the ambiguous-cue problem still remains unsolved.