Milen L. Radell

Predicting shifts in generalization gradients with perceptrons

Perceptron models have been used extensively to model perceptual learning and the effects of discrimination training on generalization, as well as to explore natural classification mechanisms. Here, we assess the ability of existing models to account for the time course of generalization shifts that occur when individuals learn to distinguish sounds. A set of simulations demonstrates that commonly used single-layer and multilayer perceptron networks do not predict transitory shifts in generalization over the course of training but that such dynamics can be accounted for when the output functions of these networks are modified to mimic the properties of cortical tuning curves. The simulations further suggest that prudent selection of stimuli and training criteria can allow for more precise predictions of learning-related shifts in generalization gradients in behavioral experiments. In particular, the simulations predict that individuals will show maximal peak shift after different numbers of trials, that easier contrasts will lead to slower development of shifted peaks, and that whether generalization shifts persist or dissipate will depend on which stimulus dimensions individuals use to distinguish stimuli and how those dimensions are neurally encoded.

The Personality Trait of Intolerance to Uncertainty Affects Behavior in a Novel Computer-Based Conditioned Place Preference Task

Recent work has found that personality factors that confer vulnerability to addiction can also affect learning and economic decision making. One personality trait which has been implicated in vulnerability to addiction is intolerance to uncertainty (IU), i.e., a preference for familiar over unknown (possibly better) options. In animals, the motivation to obtain drugs is often assessed through conditioned place preference (CPP), which compares preference for contexts where drug reward was previously received. It is an open question whether participants with high IU also show heightened preference for previously rewarded contexts. To address this question, we developed a novel computer-based CPP task for humans in which participants guide an avatar through a paradigm in which one room contains frequent reward (i.e., rich) and one contains less frequent reward (i.e., poor). Following exposure to both contexts, subjects are assessed for preference to enter the previously rich and previously poor room. Individuals with low IU showed little bias to enter the previously rich room first, and instead entered both rooms at about the same rate which may indicate a foraging behavior. By contrast, those with high IU showed a strong bias to enter the previously rich room first. This suggests an increased tendency to chase reward in the intolerant group, consistent with previously observed behavior in opioid-addicted individuals. Thus, the personality factor of high IU may produce a pre-existing cognitive bias that provides a mechanism to promote decision-making processes that increase vulnerability to addiction.

Greater avoidance behavior in individuals with posttraumatic stress disorder symptoms

Abstract While avoidance is a core symptom of PTSD, little is known about whether individuals with PTSD show a general cognitive bias to acquire and express avoidance, in situations not related to trauma or fear. Here, we used a computer-based task to examine operant acquisition and extinction of avoidance in participants with and without severe self-reported PTSD symptoms. A total of 119 participants (77 male, 42 female; 74 veteran, 45 civilian) with symptoms (PTSS; n = 63) or with few/no symptoms (noPTSS; n = 56) performed a task, in which they controlled a spaceship and could shoot a target to gain points or hide in “safe areas” to escape or avoid on-screen aversive events. Results show that participants with PTSS exhibited more avoidance across trials than noPTSS participants, particularly due to more avoidance behavior in PTSS females compared to noPTSS females. Avoidance behavior decreased across extinction trials but interactions with PTSS and gender fell short of significance. Overall, PTSD symptoms were associated with propensity to acquire and express avoidance behavior, in both civilians and veterans, and even in a cognitive task that does not explicitly involve trauma or fear. This effect was more pronounced in females, highlighting the role of gender differences in PTSD symptomatology. Importantly, this study also demonstrates the potential of an objective assessment of avoidance behavior, which could be used to supplement the common but limited self-report tools.

Post-traumatic stress disorder symptom burden and gender each affect generalization in a reward- and punishment-learning task

Post-traumatic stress disorder (PTSD) can develop following exposure to a traumatic event. Re-experiencing, which includes intrusive memories or flashbacks of the trauma, is a core symptom cluster of PTSD. From an associative learning perspective, this cluster may be attributed to cues associated with the trauma, which have come to elicit symptoms in a variety of situations encountered in daily life due to a tendency to overgeneralize. Consistent with this, prior studies have indicated that both individuals with clinically diagnosed with PTSD, and those with self-reported symptoms who may not meet full diagnostic criteria, show changes in generalization. Building on prior research, the current study examined whether PTSD symptom burden, but also gender, veteran status, and combat experience–all associated with PTSD vulnerability–modulate learning and generalization in a computer-based task. Participants were presented with stimulus compounds consisting of a foreground and background that could be predictive of reward, punishment or no outcome. Learning was followed by a generalization test where these components were recombined to form novel configurations. An interaction between PTSD symptom burden and gender was found where females with more severe PTSD symptoms showed no evidence of sensitivity to the background. This result is consistent with increased generalization, and may indicate a decrease in the ability to process cue configurations leading to re-experiencing in a variety of situations. Further work is indicated to help elucidate the cognitive processes driving gender differences that may confer vulnerability to PTSD.

The personality trait of behavioral inhibition modulates perceptions of moral character and performance during the trust game: behavioral results and computational modeling

Decisions based on trust are critical for human social interaction. We judge the trustworthiness of partners in social interactions based on a number of partner characteristics as well as experiences with those partners. These decisions are also influenced by personality. The current study examined how the personality trait of behavioral inhibition, which involves the tendency to avoid or withdraw from novelty in both social and non-social situations, is related to explicit ratings of trustworthiness as well as decisions made in the trust game. In the game, healthy young adults interacted with three fictional partners who were portrayed as trustworthy, untrustworthy or neutral through biographical information. Participants could choose to keep

Using signals associated with safety in avoidance learning: computational model of sex differences

1 or send

Modeling possible effects of atypical cerebellar processing on eyeblink conditioning in autism.

3 of virtual money to a partner. The partner could then choose to send

Intolerance of uncertainty and conditioned place preference in opioid addiction

1.5 back to the participant or to keep the entire amount. On any trial in which the participant chose to send, the partner always reciprocated with 50% probability, irrespective of how that partner was portrayed in the biography. Behavioral inhibition was assessed through a self-report questionnaire. Finally, a reinforcement learning computational model was fit to the behavior of each participant. Self-reported ratings of trust confirmed that all participants, irrespective of behavioral inhibition, perceived differences in the moral character of the three partners (trustworthiness of good > neutral > bad partner). Decisions made in the game showed that inhibited participants tended to trust the neutral partner less than uninhibited participants. In contrast, this was not reflected in the ratings of the neutral partner (either pre- or post-game), indicating a dissociation between ratings of trustworthiness and decisions made by inhibited participants. Computational modeling showed that this was due to lower initial trust of the neutral partner rather than a higher learning rate associated with loss, suggesting an implicit bias against the neutral partner. Overall, the results suggest inhibited individuals may be predisposed to interpret neutral or ambiguous information more negatively which could, at least in part, account for the tendency to avoid unfamiliar people characteristic of behaviorally inhibited temperament, as well as its relationship to anxiety disorders.

Benefits of fading in perceptual learning are driven by more than dimensional attention

Avoidance behavior involves learning responses that prevent upcoming aversive events; these responses typically extinguish when the aversive events stop materializing. Stimuli that signal safety from aversive events can paradoxically inhibit extinction of avoidance behavior. In animals, males and females process safety signals differently. These differences help explain why women are more likely to be diagnosed with an anxiety disorder and exhibit differences in symptom presentation and course compared to men. In the current study, we extend an existing model of strain differences in avoidance behavior to simulate sex differences in rats. The model successfully replicates data showing that the omission of a signal associated with a period of safety can facilitate extinction in females, but not males, and makes novel predictions that this effect should depend on the duration of the period, the duration of the signal itself, and its occurrence within that period. Non-reinforced responses during the safe period were also found to be important in the expression of these patterns. The model also allowed us to explore underlying mechanisms for the observed sex effects, such as whether safety signals serve as occasion setters for aversive events, to determine why removing them can facilitate extinction of avoidance. The simulation results argue against this account, and instead suggest the signal may serve as a conditioned reinforcer of avoidance behavior.

Beyond symptom self-report: use of a computer “avatar” to assess post-traumatic stress disorder (PTSD) symptoms

Autism is unique among other disorders in that acquisition of conditioned eyeblink responses is enhanced in children, occurring in a fraction of the trials required for control participants. The timing of learned responses is, however, atypical. Two animal models of autism display a similar phenotype. Researchers have hypothesized that these differences in conditioning reflect cerebellar abnormalities. The present study used computer simulations of the cerebellar cortex, including inhibition by the molecular layer interneurons, to more closely examine whether atypical cerebellar processing can account for faster conditioning in individuals with autism. In particular, the effects of inhibitory levels on delay eyeblink conditioning were simulated, as were the effects of learning-related synaptic changes at either parallel fibers or ascending branch synapses from granule cells to Purkinje cells. Results from these simulations predict that whether molecular layer inhibition results in an enhancement or an impairment of acquisition, or changes in timing, may depend on (1) the sources of inhibition, (2) the levels of inhibition, and (3) the locations of learning-related changes (parallel vs. ascending branch synapses). Overall, the simulations predict that a disruption in the balance or an overall increase of inhibition within the cerebellar cortex may contribute to atypical eyeblink conditioning in children with autism and in animal models of autism.