Katia M. Harlé

Attenuated insular processing during risk predicts relapse in early abstinent methamphetamine-dependent individuals.

There is some evidence that neuroimaging can be used to predict relapse among abstinent methamphetamine-dependent (MD) individuals. However, it remains unclear what cognitive and neural processes contribute to relapse. This investigation examined whether insula activation during risk-taking decisions—a process shown to be disrupted in MD—is able to predict susceptibility for relapse. Sixty-eight MD enrolled in a treatment program during early abstinence completed a risk-taking task during functional magnetic resonance imaging. Sixty-three of the sixty-eight individuals were followed up 1 year after the study. Of these, 18 MD reported relapse. The 45 abstinent MD showed patterns of insula activation during risky decisions that resembled those found in prior studies of healthy controls, consisting of lower insula activation during safe decisions paired with higher activation during risky decisions. In contrast, the 18 relapsed MD showed similar insula activation during safe and risky decisions. An increase in one standard deviation in the difference in insula activation between risky and safe choices was associated with a 0.34 odds ratio for relapse at any given time. A median split of insula activation (difference between risky and safe) showed that individuals in the bottom half were two times more likely to relapse. In addition, a model that included several other brain regions increased prediction accuracy compared with insula-based model alone. These results suggest that failure to differentially activate the insula as a function of risk is a part of an altered risk-processing network associated with an increased susceptibility to relapse.

Altered Neural Processing of the Need to Stop in Young Adults at Risk for Stimulant Dependence

Identification of neurocognitive predictors of substance dependence is an important step in developing approaches to prevent addiction. Given evidence of inhibitory control deficits in substance abusers (Monterosso et al., 2005; Fu et al., 2008; Lawrence et al., 2009; Tabibnia et al., 2011), we examined neural processing characteristics in human occasional stimulant users (OSU), a population at risk for dependence. A total of 158 nondependent OSU and 47 stimulant-naive control subjects (CS) were recruited and completed a stop signal task while undergoing functional magnetic resonance imaging (fMRI). A Bayesian ideal observer model was used to predict probabilistic expectations of inhibitory demand, P(stop), on a trial-to-trial basis, based on experienced trial history. Compared with CS, OSU showed attenuated neural activation related to P(stop) magnitude in several areas, including left prefrontal cortex and left caudate. OSU also showed reduced neural activation in the dorsal anterior cingulate cortex (dACC) and right insula in response to an unsigned Bayesian prediction error representing the discrepancy between stimulus outcome and the predicted probability of a stop trial. These results indicate that, despite minimal overt behavioral manifestations, OSU use fewer brain processing resources to predict and update the need for response inhibition, processes that are critical for adjusting and optimizing behavioral performance, which may provide a biomarker for the development of substance dependence.

The influence of emotions on cognitive control: feelings and beliefs—where do they meet?

The influence of emotion on higher-order cognitive functions, such as attention allocation, planning, and decision-making, is a growing area of research with important clinical applications. In this review, we provide a computational framework to conceptualize emotional influences on inhibitory control, an important building block of executive functioning. We first summarize current neuro-cognitive models of inhibitory control and show how Bayesian ideal observer models can help reframe inhibitory control as a dynamic decision-making process. Finally, we propose a Bayesian framework to study emotional influences on inhibitory control, providing several hypotheses that may be useful to conceptualize inhibitory control biases in mental illness such as depression and anxiety. To do so, we consider the neurocognitive literature pertaining to how affective states can bias inhibitory control, with particular attention to how valence and arousal may independently impact inhibitory control by biasing probabilistic representations of information (i.e., beliefs) and valuation processes (e.g., speed-error tradeoffs).

Altered Statistical Learning and Decision-Making in Methamphetamine Dependence: Evidence from a Two-Armed Bandit Task

Understanding how humans weigh long-term and short-term goals is important for both basic cognitive science and clinical neuroscience, as substance users need to balance the appeal of an immediate high vs. the long-term goal of sobriety. We use a computational model to identify learning and decision-making abnormalities in methamphetamine-dependent individuals (MDI, n = 16) vs. healthy control subjects (HCS, n = 16), in a two-armed bandit task. In this task, subjects repeatedly choose between two arms with fixed but unknown reward rates. Each choice not only yields potential immediate reward but also information useful for long-term reward accumulation, thus pitting exploration against exploitation. We formalize the task as comprising a learning component, the updating of estimated reward rates based on ongoing observations, and a decision-making component, the choice among options based on current beliefs and uncertainties about reward rates. We model the learning component as iterative Bayesian inference (the Dynamic Belief Model), and the decision component using five competing decision policies: Win-stay/Lose-shift (WSLS), ε-Greedy, τ-Switch, Softmax, Knowledge Gradient. HCS and MDI significantly differ in how they learn about reward rates and use them to make decisions. HCS learn from past observations but weigh recent data more, and their decision policy is best fit as Softmax. MDI are more likely to follow the simple learning-independent policy of WSLS, and among MDI best fit by Softmax, they have more pessimistic prior beliefs about reward rates and are less likely to choose the option estimated to be most rewarding. Neurally, MDIs tendency to avoid the most rewarding option is associated with a lower gray matter volume of the thalamic dorsal lateral nucleus. More broadly, our work illustrates the ability of our computational framework to help reveal subtle learning and decision-making abnormalities in substance use.

The Influence of Depression on Cognitive Control: Disambiguating Approach and Avoidance Tendencies

Dysfunctions of approach and avoidance motivation play an important role in depression, which in turn may affect cognitive control, i.e., the ability to regulate thoughts and action to achieve internal goals. We use a novel experimental paradigm, i.e. a computer simulated driving-task, to study the impact of depression on cognitive control by measuring approach and avoidance actions in continuous time. In this task, 39 subjects with minimal to severe depression symptoms were instructed to use a joystick to move a virtual car as quickly as possible to a target point without crossing a stop-sign or crashing into a wall. We recorded their continuous actions on a joystick and found that depression 1) leads to further stopping distance to task target; and 2) increases the magnitude of late deceleration (avoidance) but not early acceleration (approach), which was only observed in the stop-sign condition. Taken together, these results are consistent with the hypothesis that depressed individuals have greater avoidance motivation near stopping target, but are minimally affected by approach motivation.

Anhedonia and anxiety underlying depressive symptomatology have distinct effects on reward-based decision-making

Depressive pathology, which includes both heightened negative affect (e.g., anxiety) and reduced positive affect (e.g., anhedonia), is known to be associated with sub-optimal decision-making, particularly in uncertain environments. Here, we use a computational approach to quantify and disambiguate how individual differences in these affective measures specifically relate to different aspects of learning and decision-making in reward-based choice behavior. Fifty-three individuals with a range of depressed mood completed a two-armed bandit task, in which they choose between two arms with fixed but unknown reward rates. The decision-making component, which chooses among options based on current expectations about reward rates, is modeled by two different decision policies: a learning-independent Win-stay/Lose-shift (WSLS) policy that ignores all previous experiences except the last trial, and Softmax, which prefers the arm with the higher expected reward. To model the learning component for the Softmax choice policy, we use a Bayesian inference model, which updates estimated reward rates based on the observed history of trial outcomes. Softmax with Bayesian learning better fits the behavior of 55% of the participants, while the others are better fit by a learning-independent WSLS strategy. Among Softmax “users”, those with higher anhedonia are less likely to choose the option estimated to be most rewarding. Moreover, the Softmax parameter mediates the inverse relationship between anhedonia and overall monetary gains. On the other hand, among WSLS “users”, higher state anxiety correlates with increasingly better ability of WSLS, relative to Softmax, to explain subjects’ trial-by-trial choices. In summary, there is significant variability among individuals in their reward-based, exploratory decision-making, and this variability is at least partly mediated in a very specific manner by affective attributes, such as hedonic tone and state anxiety.

Using Optimal Control to Disambiguate the Effect of Depression on Sensorimotor, Motivational and Goal-Setting Functions.

Differentiating the ability from the motivation to act is of central importance to psychiatric disorders in general and depression in particular. However, it has been difficult to develop quantitative approaches to relate depression to poor motor performance in goal-directed tasks. Here, we use an inverse optimal control approach to provide a computational framework that can be used to infer and factorize performance deficits into three components: sensorimotor speed, goal setting and motivation. Using a novel computer-simulated driving experiment, we found that (1) severity of depression is associated with both altered sensorimotor speed and motivational function; (2) moderately to severely depressed individuals show an increased distance from the stop sign indicating aversive learning affecting goal setting functions. Taken together, the inverse optimal control framework can disambiguate on an individual basis the sensorimotor from the motivational dysfunctions in depression, which may help to develop more precisely targeted interventions.