Jony Sheynin

Learning to Obtain Reward, but Not Avoid Punishment, Is Affected by Presence of PTSD Symptoms in Male Veterans: Empirical Data and Computational Model

Post-traumatic stress disorder (PTSD) symptoms include behavioral avoidance which is acquired and tends to increase with time. This avoidance may represent a general learning bias; indeed, individuals with PTSD are often faster than controls on acquiring conditioned responses based on physiologically-aversive feedback. However, it is not clear whether this learning bias extends to cognitive feedback, or to learning from both reward and punishment. Here, male veterans with self-reported current, severe PTSD symptoms (PTSS group) or with few or no PTSD symptoms (control group) completed a probabilistic classification task that included both reward-based and punishment-based trials, where feedback could take the form of reward, punishment, or an ambiguous “no-feedback” outcome that could signal either successful avoidance of punishment or failure to obtain reward. The PTSS group outperformed the control group in total points obtained; the PTSS group specifically performed better than the control group on reward-based trials, with no difference on punishment-based trials. To better understand possible mechanisms underlying observed performance, we used a reinforcement learning model of the task, and applied maximum likelihood estimation techniques to derive estimated parameters describing individual participants’ behavior. Estimations of the reinforcement value of the no-feedback outcome were significantly greater in the control group than the PTSS group, suggesting that the control group was more likely to value this outcome as positively reinforcing (i.e., signaling successful avoidance of punishment). This is consistent with the control group’s generally poorer performance on reward trials, where reward feedback was to be obtained in preference to the no-feedback outcome. Differences in the interpretation of ambiguous feedback may contribute to the facilitated reinforcement learning often observed in PTSD patients, and may in turn provide new insight into how pathological behaviors are acquired and maintained in PTSD.

Enhanced avoidance learning in behaviorally inhibited young men and women

Behavioral inhibition (BI) is a temperamental tendency to avoid or withdraw from novel social and nonsocial situations, and has been shown to predispose individuals to anxiety disorders. However, adequate means to assess individual differences in avoidance learning in humans are presently limited. Here, we tested whether individuals with high self-reported BI show faster associative learning on a purely cognitive task and whether such inhibited individuals are more prone to avoid aversive outcomes. In Experiment 1, we tested 74 healthy undergraduate students (mean age 19.5 years; 55.4% female) on a computer-based probabilistic classification task, where participants were asked to classify four distinct visual stimuli into two categories. Two stimuli were associated with reward (point gain) and two were associated with punishment (point loss). In Experiment 2, 79 participants from the same population (mean age 19.8 years; 62% female) were tested on a novel modification of the same task, where they also had the option to opt out of responding on each trial, thus avoiding any chance of being punished (or rewarded) on that trial. Results show that inhibited participants demonstrated better associative learning in Experiment 1, while exhibiting a greater tendency to opt out in Experiment 2 (repeated-measures analysis of variance, main effects of BI, both p < 0.05). These results indicate that the facilitated classically conditioned learning previously observed in inhibited individuals can be extended to a cognitive task, and also highlight a specific preference in inhibited individuals for withdrawal (“opting out”) as a response strategy, when multiple strategies are available to avoid punishment.

Acquisition and Extinction of Human Avoidance Behavior: Attenuating Effect of Safety Signals and Associations with Anxiety Vulnerabilities

While avoidance behavior is often an adaptive strategy, exaggerated avoidance can be detrimental and result in the development of psychopathologies, such as anxiety disorders. A large animal literature shows that the acquisition and extinction of avoidance behavior in rodents depends on individual differences (e.g., sex, strain) and might be modulated by the presence of environmental cues. However, there is a dearth of such reports in human literature, mainly due to the lack of adequate experimental paradigms. In the current study, we employed a computer-based task, where participants control a spaceship and attempt to gain points by shooting an enemy spaceship that appears on the screen. Warning signals predict on-screen aversive events; the participants can learn a protective response to escape or avoid these events. This task has been recently used to reveal facilitated acquisition of avoidance behavior in individuals with anxiety vulnerability due to female sex or inhibited personality. Here, we extended the task to include an extinction phase, and tested the effect of signals that appeared during “safe” periods. Healthy young adults (n = 122) were randomly assigned to a testing condition with or without such signals. Results showed that the addition of safety signals during the acquisition phase impaired acquisition (in females) and facilitated extinction of the avoidance behavior. We also replicated our recent finding of an association between female sex and longer avoidance duration and further showed that females continued to demonstrate more avoidance behavior even on extinction trials when the aversive events no longer occurred. This study is the first to show sex differences on the acquisition and extinction of human avoidance behavior and to demonstrate the role of safety signals in such behavior, highlighting the potential relevance of safety signals for cognitive therapies that focus on extinction learning to treat anxiety symptoms.

Behaviourally-inhibited temperament and female sex, two vulnerability factors for anxiety disorders, facilitate conditioned avoidance (also) in humans

Acquisition and maintenance of avoidance behaviour is a key feature of all human anxiety disorders. Animal models have been useful in understanding how anxiety vulnerability could translate into avoidance learning. For example, behaviourally inhibited temperament and female sex, two vulnerability factors for clinical anxiety, are associated with faster acquisition of avoidance responses in rodents. However, to date, the translation of such empirical data to human populations has been limited since many features of animal avoidance paradigms are not typically captured in human research. Here, using a computer-based task that captures many features of rodent escape-avoidance learning paradigms, we investigated whether avoidance learning would be faster in humans with inhibited temperament and/or female sex and, if so, whether this facilitation would take the same form. Results showed that, as in rats, both vulnerability factors were associated with facilitated acquisition of avoidance behaviour in humans. Specifically, inhibited temperament was associated with higher rate of avoidance responding, while female sex was associated with longer avoidance duration. These findings strengthen the direct link between animal avoidance work and human anxiety vulnerability, further motivating the study of animal models while also providing a simple testbed for a direct human testing.

Circuit dysregulation and circuit-based treatments in posttraumatic stress disorder

Posttraumatic stress disorder (PTSD) is a psychiatric disorder that develops in some individuals in the aftermath of exposure to traumatic events, such as actual or threatened death, serious injury or sexual assault. It has been hypothesized that dysregulations in a number of specific neurocircuits, characterized by heightened responsivity of amygdala, dACC and insula, diminished responsivity of mPFC, impaired hippocampal function and deficits in cortical regions, underlie the development and expression of key PTSD symptoms. Here, we concisely describe three functional neural circuits implicated in PTSD pathophysiology and briefly review selected treatment strategies in the context of these neural circuits. We start with the commonly implicated neurocircuit model, namely, the fear learning and threat detection circuits, and then discuss the context processing circuitry, which plays an important role among others, in fear regulation. We then discuss the emotion regulation circuitry, which can further contribute to PTSD pathophysiology, and conclude with a discussion of the therapeutic approaches that might be targeting dysregulation in these circuits in PTSD patients. Specifically, we discuss how exposure-based treatments might be targeting fear learning circuits, and the pharmacological and brain-stimulation interventions aimed to augment these therapies. Finally, we discuss other pharmacological and cognitive therapeutic approaches that can augment or restore the function of the context processing and emotional regulation circuits.

Exaggerated acquisition and resistance to extinction of avoidance behavior in treated heroin-dependent men.

OBJECTIVE Addiction is often conceptualized as a behavioral strategy for avoiding negative experiences. In rodents, opioid intake has been associated with abnormal acquisition and extinction of avoidance behavior. Here, we tested the hypothesis that these findings would generalize to human opioid-dependent subjects. METHOD Adults meeting DSM-IV criteria for heroin dependence and treated with opioid medication (n = 27) and healthy controls (n = 26) were recruited between March 2013 and October 2013 and given a computer-based task to assess avoidance behavior. For this task, subjects controlled a spaceship and could either gain points by shooting an enemy spaceship or hide in safe areas to avoid on-screen aversive events. Hiding duration during different periods of the task was used to measure avoidance behavior. RESULTS While groups did not differ on escape responding (hiding) during the aversive event, heroin-dependent men (but not women) made more avoidance responses during a warning signal that predicted the aversive event (analysis of variance, sex × group interaction, P = .007). Heroin-dependent men were also slower to extinguish the avoidance response when the aversive event no longer followed the warning signal (P = .011). This behavioral pattern resulted in reduced opportunity to obtain reward without reducing risk of punishment. Results suggest that, in male patients, differences in avoidance behavior cannot be easily explained by impaired task performance or by exaggerated motor activity. CONCLUSIONS This study provides evidence for abnormal acquisition and extinction of avoidance behavior in opioid-dependent patients. Interestingly, data suggest that abnormal avoidance is demonstrated only by male patients. Findings shed light on cognitive and behavioral manifestations of opioid addiction and may facilitate development of therapeutic approaches to help affected individuals.

Testing the role of reward and punishment sensitivity in avoidance behavior: A computational modeling approach

Exaggerated avoidance behavior is a predominant symptom in all anxiety disorders and its degree often parallels the development and persistence of these conditions. Both human and non-human animal studies suggest that individual differences as well as various contextual cues may impact avoidance behavior. Specifically, we have recently shown that female sex and inhibited temperament, two anxiety vulnerability factors, are associated with greater duration and rate of the avoidance behavior, as demonstrated on a computer-based task closely related to common rodent avoidance paradigms. We have also demonstrated that avoidance is attenuated by the administration of explicit visual signals during “non-threat” periods (i.e., safety signals). Here, we use a reinforcement-learning network model to investigate the underlying mechanisms of these empirical findings, with a special focus on distinct reward and punishment sensitivities. Model simulations suggest that sex and inhibited temperament are associated with specific aspects of these sensitivities. Specifically, differences in relative sensitivity to reward and punishment might underlie the longer avoidance duration demonstrated by females, whereas higher sensitivity to punishment might underlie the higher avoidance rate demonstrated by inhibited individuals. Simulations also suggest that safety signals attenuate avoidance behavior by strengthening the competing approach response. Lastly, several predictions generated by the model suggest that extinction-based cognitive-behavioral therapies might benefit from the use of safety signals, especially if given to individuals with high reward sensitivity and during longer safe periods. Overall, this study is the first to suggest cognitive mechanisms underlying the greater avoidance behavior observed in healthy individuals with different anxiety vulnerabilities.

The Role of Informative and Ambiguous Feedback in Avoidance Behavior: Empirical and Computational Findings

Avoidance behavior is a critical component of many psychiatric disorders, and as such, it is important to understand how avoidance behavior arises, and whether it can be modified. In this study, we used empirical and computational methods to assess the role of informational feedback and ambiguous outcome in avoidance behavior. We adapted a computer-based probabilistic classification learning task, which includes positive, negative and no-feedback outcomes; the latter outcome is ambiguous as it might signal either a successful outcome (missed punishment) or a failure (missed reward). Prior work with this task suggested that most healthy subjects viewed the no-feedback outcome as strongly positive. Interestingly, in a later version of the classification task, when healthy subjects were allowed to opt out of (i.e. avoid) responding, some subjects (“avoiders”) reliably avoided trials where there was a risk of punishment, but other subjects (“non-avoiders”) never made any avoidance responses at all. One possible interpretation is that the “non-avoiders” valued the no-feedback outcome so positively on punishment-based trials that they had little incentive to avoid. Another possible interpretation is that the outcome of an avoided trial is unspecified and that lack of information is aversive, decreasing subjects’ tendency to avoid. To examine these ideas, we here tested healthy young adults on versions of the task where avoidance responses either did or did not generate informational feedback about the optimal response. Results showed that provision of informational feedback decreased avoidance responses and also decreased categorization performance, without significantly affecting the percentage of subjects classified as “avoiders.” To better understand these results, we used a modified Q-learning model to fit individual subject data. Simulation results suggest that subjects in the feedback condition adjusted their behavior faster following better-than-expected outcomes, compared to subjects in the no-feedback condition. Additionally, in both task conditions, “avoiders” adjusted their behavior faster following worse-than-expected outcomes, and treated the ambiguous no-feedback outcome as less rewarding, compared to non-avoiders. Together, results shed light on the important role of ambiguous and informative feedback in avoidance behavior.

Greater avoidance behavior in individuals with posttraumatic stress disorder symptoms

Abstract While avoidance is a core symptom of PTSD, little is known about whether individuals with PTSD show a general cognitive bias to acquire and express avoidance, in situations not related to trauma or fear. Here, we used a computer-based task to examine operant acquisition and extinction of avoidance in participants with and without severe self-reported PTSD symptoms. A total of 119 participants (77 male, 42 female; 74 veteran, 45 civilian) with symptoms (PTSS; n = 63) or with few/no symptoms (noPTSS; n = 56) performed a task, in which they controlled a spaceship and could shoot a target to gain points or hide in “safe areas” to escape or avoid on-screen aversive events. Results show that participants with PTSS exhibited more avoidance across trials than noPTSS participants, particularly due to more avoidance behavior in PTSS females compared to noPTSS females. Avoidance behavior decreased across extinction trials but interactions with PTSS and gender fell short of significance. Overall, PTSD symptoms were associated with propensity to acquire and express avoidance behavior, in both civilians and veterans, and even in a cognitive task that does not explicitly involve trauma or fear. This effect was more pronounced in females, highlighting the role of gender differences in PTSD symptomatology. Importantly, this study also demonstrates the potential of an objective assessment of avoidance behavior, which could be used to supplement the common but limited self-report tools.

Prognostic utility of admission cell-free DNA levels in patients with chronic obstructive pulmonary disease exacerbations

Background Chronic obstructive pulmonary disease exacerbations (COPDEs) are associated with increased morbidity and mortality. Cell-free DNA (cfDNA) is a novel biomarker associated with clinical outcomes in several disease states but has not been studied in COPD. The objectives of this study were to assess cfDNA levels during a COPDE, to evaluate the association of cfDNA with clinical parameters and to explore the prognostic implications of cfDNA levels on long-term survival. Methods This was an observational study that assessed cfDNA levels in patients admitted to hospital for a COPDE. Plasma cfDNA levels of COPDE patients were compared to those of matched stable COPD patients and healthy controls. Multivariable and Cox regression analyses were used to assess the association of cfDNA levels with blood gas parameters and long-term survival. Results A total of 62 patients (46 males, forced expiratory volume in 1 second [FEV1] 38%±13%) were included. The median cfDNA levels on admission for COPDE patients was 1,634 ng/mL (interquartile range [IQR] 1,016–2,319) compared to 781 ng/mL (IQR 523–855) for stable COPD patients, matched for age and disease severity, and 352 ng/mL (IQR 209–636) for healthy controls (P<0.0001, for both comparisons). cfDNA was correlated with partial arterial pressure of carbon dioxide (PaCO2, r=0.35) and pH (r=−0.35), P=0.01 for both comparisons. In a multivariable analysis, PaCO2 was the only independent predictor of cfDNA. Using a cfDNA level of 1,924 ng/mL (threshold for abnormal PaCO2), those with high levels had a trend for increased 5-year mortality risk adjusted for age, sex and FEV1% (hazard ratio 1.92, 95% confidence interval 0.93–3.95, P=0.08). Conclusion Plasma cfDNA might offer a novel technique to identify COPD patients at increased risk of poor outcomes, but the prognostic utility of this measurement requires further study.