Mauricio R. Delgado

Extinction learning in humans: role of the amygdala and vmPFC.

Understanding how fears are acquired is an important step in translating basic research to the treatment of fear-related disorders. However, understanding how learned fears are diminished may be even more valuable. We explored the neural mechanisms of fear extinction in humans. Studies of extinction in nonhuman animals have focused on two interconnected brain regions: the amygdala and the ventral medial prefrontal cortex (vmPFC). Consistent with animal models suggesting that the amygdala is important for both the acquisition and extinction of conditioned fear, amygdala activation was correlated across subjects with the conditioned response in both acquisition and early extinction. Activation in the vmPFC (subgenual anterior cingulate) was primarily linked to the expression of fear learning during a delayed test of extinction, as might have been expected from studies demonstrating this region is critical for the retention of extinction. These results provide evidence that the mechanisms of extinction learning may be preserved across species.

ArticleExtinction Learning in Humans: Role of the Amygdala and vmPFC

Understanding how fears are acquired is an important step in translating basic research to the treatment of fear-related disorders. However, understanding how learned fears are diminished may be even more valuable. We explored the neural mechanisms of fear extinction in humans. Studies of extinction in nonhuman animals have focused on two interconnected brain regions: the amygdala and the ventral medial prefrontal cortex (vmPFC). Consistent with animal models suggesting that the amygdala is important for both the acquisition and extinction of conditioned fear, amygdala activation was correlated across subjects with the conditioned response in both acquisition and early extinction. Activation in the vmPFC (subgenual anterior cingulate) was primarily linked to the expression of fear learning during a delayed test of extinction, as might have been expected from studies demonstrating this region is critical for the retention of extinction. These results provide evidence that the mechanisms of extinction learning may be preserved across species.

The Role of the Dorsal Striatum in Reward and Decision-Making

Although the involvement in the striatum in the refinement and control of motor movement has long been recognized, recent description of discrete frontal corticobasal ganglia networks in a range of species has focused attention on the role particularly of the dorsal striatum in executive functions. Current evidence suggests that the dorsal striatum contributes directly to decision-making, especially to action selection and initiation, through the integration of sensorimotor, cognitive, and motivational/emotional information within specific corticostriatal circuits involving discrete regions of striatum. We review key evidence from recent studies in rodent, nonhuman primate, and human subjects.

Reward-Related Responses in the Human Striatum

Abstract:  Much of our knowledge of how reward information is processed in the brain comes from a rich animal literature. Recently, the advancement of neuroimaging techniques has allowed researchers to extend such investigations to the human brain. A common finding across species and methodologies is the involvement of the striatum, the input structure of the basal ganglia, in a circuit responsible for mediating goal‐directed behavior. Central to this idea is the role of the striatum in the processing of affective stimuli, such as rewards and punishments. The goal of this article is to probe the human reward circuit, specifically the striatum and its subdivisions, with an emphasis on how the affective properties of outcomes or feedback influence the underlying neural activity and subsequent decision making. Discussion will first focus on anatomical and functional considerations regarding the striatum that have emerged from animal models. The rest of the article will center on how human neuroimaging studies map to findings from the animal literature, and how more recently, this research can be extended into the social and economic domains.

Modulation of Caudate Activity by Action Contingency

Research has increasingly implicated the striatum in the processing of reward-related information in both animals and humans. However, it is unclear whether human striatal activation is driven solely by the hedonic properties of rewards or whether such activation is reliant on other factors, such as anticipation of upcoming reward or performance of an action to earn a reward. We used event-related functional magnetic resonance imaging to investigate hemodynamic responses to monetary rewards and punishments in three experiments that made use of an oddball paradigm. We presented reward and punishment displays randomly in time, following an anticipatory cue, or following a button press response. Robust and differential activation of the caudate nucleus occurred only when a perception of contingency existed between the button press response and the outcome. This finding suggests that the caudate is involved in reinforcement of action potentially leading to reward, rather than in processing reward per se.

Neural Circuitry Underlying the Regulation of Conditioned Fear and Its Relation to Extinction

Recent efforts to translate basic research to the treatment of clinical disorders have led to a growing interest in exploring mechanisms for diminishing fear. This research has emphasized two approaches: extinction of conditioned fear, examined across species; and cognitive emotion regulation, unique to humans. Here, we sought to examine the similarities and differences in the neural mechanisms underlying these two paradigms for diminishing fear. Using an emotion regulation strategy, we examine the neural mechanisms of regulating conditioned fear using fMRI and compare the resulting activation pattern with that observed during classic extinction. Our results suggest that the lateral PFC regions engaged by cognitive emotion regulation strategies may influence the amygdala, diminishing fear through similar vmPFC connections that are thought to inhibit the amygdala during extinction. These findings further suggest that humans may have developed complex cognition that can aid in regulating emotional responses while utilizing phylogenetically shared mechanisms of extinction.

Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations

The goal of this research was to further our understanding of how the striatum responds to the delivery of affective feedback. Previously, we had found that the striatum showed a pattern of sustained activation after presentation of a monetary reward, in contrast to a decrease in the hemodynamic response after a punishment. In this study, we tested whether the activity of the striatum could be modulated by parametric variations in the amount of financial reward or punishment. We used an event-related fMRI design in which participants received large or small monetary rewards or punishments after performance in a gambling task. A parametric ordering of conditions was observed in the dorsal striatum according to both magnitude and valence. In addition, an early response to the presentation of feedback was observed and replicated in a second experiment with increased temporal resolution. This study further implicates the dorsal striatum as an integral component of a reward circuitry responsible for the control of motivated behavior, serving to code for such feedback properties as valence and magnitude.

An fMRI study of reward-related probability learning.

The human striatum has been implicated in processing reward-related information. More recently, activity in the striatum, particularly the caudate nucleus, has been observed when a contingency between behavior and reward exists, suggesting a role for the caudate in reinforcement-based learning. Using a gambling paradigm, in which affective feedback (reward and punishment) followed simple, random guesses on a trial by trial basis, we sought to investigate the role of the caudate nucleus as reward-related learning progressed. Participants were instructed to make a guess regarding the value of a presented card (if the value of the card was higher or lower than 5). They were told that five different cues would be presented prior to making a guess, and that each cue indicated the probability that the card would be high or low. The goal was to learn the contingencies and maximize the reward attained. Accuracy, as measured by participants choices, improved throughout the experiment for cues that strongly predicted reward, while no change was observed for unpredictable cues. Event-related fMRI revealed that activity in the caudate nucleus was more robust during the early phases of learning, irrespective of contingencies, suggesting involvement of this region during the initial stages of trial and error learning. Further, the reward feedback signal in the caudate nucleus for well-learned cues decreased as learning progressed, suggesting an evolving adaptation of reward feedback expectancy as a behavior-outcome contingency becomes more predictable.

Extending animal models of fear conditioning to humans

A goal of fear and anxiety research is to understand how to treat the potentially devastating effects of anxiety disorders in humans. Much of this research utilizes classical fear conditioning, a simple paradigm that has been extensively investigated in animals, helping outline a brain circuitry thought to be responsible for the acquisition, expression and extinction of fear. The findings from non-human animal research have more recently been substantiated and extended in humans, using neuropsychological and neuroimaging methodologies. Research across species concur that the neural correlates of fear conditioning include involvement of the amygdala during all stages of fear learning, and prefrontal areas during the extinction phase. This manuscript reviews how animal models of fear are translated to human behavior, and how some fears are more easily acquired in humans (i.e., social-cultural). Finally, using the knowledge provided by a rich animal literature, we attempt to extend these findings to human models targeted to helping facilitate extinction or abolishment of fears, a trademark of anxiety disorders, by discussing efficacy in modulating the brain circuitry involved in fear conditioning via pharmacological treatments or emotion regulation cognitive strategies.

Functional dissociations within the inferior parietal cortex in verbal working memory

Neuroimaging studies of working memory have revealed two sites in the left supramarginal gyrus that may support the short-term storage of phonological information. Activation in the left dorsal aspect of the inferior parietal cortex (DIPC) has been observed in contrasts of working memory load, whereas activation in the ventral aspect of the inferior parietal cortex (VIPC) has been found primarily in contrast of information type (verbal vs. nonverbal). Our goal was to determine whether these two areas are functionally distinct or if instead they are part of a homogeneous region with large variations in the focus of peak activity. Toward this end, we used fMRI to assess the neural response in two working memory tasks (N-back and item recognition) in which we also manipulated memory load and the type of information to be recalled (verbal vs. nonverbal). We found both DIPC and VIPC activation in the same group of subjects and further demonstrated that they have differential sensitivity to our experimental factors. Only the DIPC showed robust load effects, whereas only the VIPC showed reliable effects of information type. These results help to account for the differences observed in between-subject comparisons, and they indicate that the two regions are functionally dissociable. In contrast to the DIPC, activity of the VIPC was also recruited in the fixation and low-load conditions, a surprising result that has not been fully explored in prior studies. Despite their distinctive patterns of performance, neither of these regions displayed a pattern of activity that entirely corresponds to common assumptions of a dedicated phonological short-term store (STS). Instead, we hypothesize that the DIPC may support domain-general executive processes, while the VIPC may support phonological encoding-recoding processes central to a variety of language tasks.