Bianca C. Wittmann

Reward-related fMRI activation of dopaminergic midbrain Is associated with enhanced hippocampus- dependent long-term memory formation

Long-term potentiation in the hippocampus can be enhanced and prolonged by dopaminergic inputs from midbrain structures such as the substantia nigra. This improved synaptic plasticity is hypothesized to be associated with better memory consolidation in the hippocampus. We used a condition that reliably elicits a dopaminergic response, reward anticipation, to study the relationship between activity of dopaminergic midbrain areas and hippocampal long-term memory in healthy adults. Pictures of object drawings that predicted monetary reward were associated with stronger fMRI activity in reward-related brain areas, including the substantia nigra, compared with non-reward-predicting pictures. Three weeks later, recollection and source memory were better for reward-predicting than for non-reward-predicting pictures. FMRI activity in the hippocampus and the midbrain was higher for reward-predicting pictures that were later recognized compared with later forgotten pictures. These data are consistent with the hypothesis that activation of dopaminergic midbrain regions enhances hippocampus-dependent memory formation, possibly by enhancing consolidation.

Striatal Activity Underlies Novelty-Based Choice in Humans

Summary The desire to seek new and unfamiliar experiences is a fundamental behavioral tendency in humans and other species. In economic decision making, novelty seeking is often rational, insofar as uncertain options may prove valuable and advantageous in the long run. Here, we show that, even when the degree of perceptual familiarity of an option is unrelated to choice outcome, novelty nevertheless drives choice behavior. Using functional magnetic resonance imaging (fMRI), we show that this behavior is specifically associated with striatal activity, in a manner consistent with computational accounts of decision making under uncertainty. Furthermore, this activity predicts interindividual differences in susceptibility to novelty. These data indicate that the brain uses perceptual novelty to approximate choice uncertainty in decision making, which in certain contexts gives rise to a newly identified and quantifiable source of human irrationality.

Functional imaging of the human dopaminergic midbrain

Invasive recording of dopamine neurons in the substantia nigra and ventral tegmental area (SN/VTA) of behaving animals suggests a role for these neurons in reward learning and novelty processing. In humans, functional magnetic resonance imaging (fMRI) is currently the only non-invasive event-related method to measure SN/VTA activity, but it is debated to what extent fMRI enables inference about dopaminergic responses within the SN/VTA. We consider the anatomical and functional parcellation of the primate SN/VTA and find that its homogeneity suggests little variation in the regional specificity of fMRI signals for reward-related dopaminergic responses. Hence, these responses seem to be well captured by the compound fMRI signal from the SN/VTA, which seems quantitatively related to dopamine release in positron emission tomography (PET). We outline how systematic investigation of the functional parcellation of the SN/VTA in animals, new developments in fMRI analysis and combined PET-fMRI studies can narrow the gap between fMRI and dopaminergic neurotransmission.

Anticipation of novelty recruits reward system and hippocampus while promoting recollection

The dopaminergic midbrain, which comprises the substantia nigra and ventral tegmental area (SN/VTA), plays a central role in reward processing. This region is also activated by novel stimuli, raising the possibility that novelty and reward have shared functional properties. It is currently unclear whether functional aspects of reward processing in the SN/VTA, namely, activation by unexpected rewards and cues that predict reward, also characterize novelty processing. To address this question, we conducted an fMRI experiment during which subjects viewed symbolic cues that predicted either novel or familiar images of scenes with 75% validity. We show that SN/VTA was activated by cues predicting novel images as well as by unexpected novel images that followed familiarity-predictive cues, an ‘unexpected novelty’ response. The hippocampus, a region implicated in detecting and encoding novel stimuli, showed an anticipatory novelty response but differed from the response profile of SN/VTA in responding at outcome to expected and ‘unexpected’ novelty. In a behavioral extension of the experiment, recollection increased relative to familiarity when comparing delayed recognition memory for anticipated novel stimuli with unexpected novel stimuli. These data reveal commonalities in SN/VTA responses to anticipating reward and anticipating novel stimuli. We suggest that this anticipatory response codes a motivational exploratory novelty signal that, together with anticipatory activation of the hippocampus, leads to enhanced encoding of novel events. In more general terms, the data suggest that dopaminergic processing of novelty might be important in driving exploration of new environments.

Mesolimbic interaction of emotional valence and reward improves memory formation

Animal studies suggest that dopaminergic neuromodulation is critical for hippocampal memory formation. Compatible with this notion, recent functional imaging evidence in humans showed that reward modulates the hippocampus-dependent formation of episodic memories through activation of areas belonging to the mesolimbic dopaminergic system, including the ventral striatum and substantia nigra/ventral tegmental area (SN/VTA). However, the amygdala is also closely embedded within this mesolimbic circuitry with reciprocal connections to the SN/VTA, raising the possibility that emotionally valenced stimuli might also interact with hippocampal encoding through dopaminergic neuromodulation. By the same token, emotional processing in the amygdala might be affected by reward-related processing in the mesolimbic system. In an event-related functional magnetic resonance imaging study, reward-related activity in the ventral striatum was enhanced by the concurrent presentation of emotionally positive but not emotionally negative stimuli. Emotional processing in the amygdala, on the other hand, was not affected by reward. One day after study, recollection of the positive stimuli was better when they were associated with reward at encoding as compared with unrewarded positive stimuli. The findings are compatible with the notion that the output of the reward system and memory formation in the hippocampus is influenced by positive emotional valence and suggest that the ventral striatum is a key structure for this modulation.

Behavioral specifications of reward-associated long-term memory enhancement in humans

Recent functional imaging studies link reward-related activation of the midbrain substantia nigra-ventral tegmental area (SN/VTA), the site of origin of ascending dopaminergic projections, with improved long-term episodic memory. Here, we investigated in two behavioral experiments how (1) the contingency between item properties and reward, (2) the magnitude of reward, (3) the uncertainty of outcomes, and (4) the contextual availability of reward affect long-term memory. We show that episodic memory is enhanced only when rewards are specifically predicted by the semantic identity of the stimuli and changes nonlinearly with increasing reward magnitude. These effects are specific to reward and do not occur in relation to outcome uncertainty alone. These behavioral specifications are relevant for the functional interpretation of how reward-related activation of the SN/VTA, and more generally dopaminergic neuromodulation, contribute to long-term memory.

DAT genotype modulates striatal processing and long-term memory for items associated with reward and punishment.

Previous studies have shown that appetitive motivation enhances episodic memory formation via a network including the substantia nigra/ventral tegmental area (SN/VTA), striatum and hippocampus. This functional magnetic resonance imaging (fMRI) study now contrasted the impact of aversive and appetitive motivation on episodic long-term memory. Cue pictures predicted monetary reward or punishment in alternating experimental blocks. One day later, episodic memory for the cue pictures was tested. We also investigated how the neural processing of appetitive and aversive motivation and episodic memory were modulated by dopaminergic mechanisms. To that end, participants were selected on the basis of their genotype for a variable number of tandem repeat polymorphism of the dopamine transporter (DAT) gene. The resulting groups were carefully matched for the 5-HTTLPR polymorphism of the serotonin transporter gene. Recognition memory for cues from both motivational categories was enhanced in participants homozygous for the 10-repeat allele of the DAT, the functional effects of which are not known yet, but not in heterozygous subjects. In comparison with heterozygous participants, 10-repeat homozygous participants also showed increased striatal activity for anticipation of motivational outcomes compared to neutral outcomes. In a subsequent memory analysis, encoding activity in striatum and hippocampus was found to be higher for later recognized items in 10-repeat homozygotes compared to 9/10-repeat heterozygotes. These findings suggest that processing of appetitive and aversive motivation in the human striatum involve the dopaminergic system and that dopamine plays a role in memory for both types of motivational information. In accordance with animal studies, these data support the idea that encoding of motivational events depends on dopaminergic processes in the hippocampus.

Levodopa administration modulates striatal processing of punishment-associated items in healthy participants.

RationaleAppetitive and aversive processes share a number of features such as their relevance for action and learning. On a neural level, reward and its predictors are associated with increased firing of dopaminergic neurons, whereas punishment processing has been linked to the serotonergic system and to decreases in dopamine transmission. Recent data indicate, however, that the dopaminergic system also responds to aversive stimuli and associated actions.ObjectivesIn this pharmacological functional magnetic resonance imaging study, we investigated the contribution of the dopaminergic system to reward and punishment processing in humans.MethodsTwo groups of participants received either placebo or the dopamine precursor levodopa and were scanned during alternating reward and punishment anticipation blocks.ResultsLevodopa administration increased striatal activations for cues presented in punishment blocks. In an interaction with individual personality scores, levodopa also enhanced striatal activation for punishment–predictive compared with neutral cues in participants scoring higher on the novelty-seeking dimension.ConclusionsThese data support recent indications that dopamine contributes to punishment processing and suggest that the novelty-seeking trait is a measure of susceptibility to drug effects on motivation. These findings are also consistent with the possibility of an inverted U-shaped response function of dopamine in the striatum, suggesting an optimal level of dopamine release for motivational processing.

Prior fear conditioning and reward learning interact in fear and reward networks

The ability to flexibly adapt responses to changes in the environment is important for survival. Previous research in humans separately examined the mechanisms underlying acquisition and extinction of aversive and appetitive conditioned responses. It is yet unclear how aversive and appetitive learning interact on a neural level during counterconditioning in humans. This functional magnetic resonance imaging (fMRI) study investigated the interaction of fear conditioning and subsequent reward learning. In the first phase (fear acquisition), images predicted aversive electric shocks or no aversive outcome. In the second phase (counterconditioning), half of the CS+ and CS− were associated with monetary reward in the absence of electric stimulation. The third phase initiated reinstatement of fear through presentation of electric shocks, followed by CS presentation in the absence of shock or reward. Results indicate that participants were impaired at learning the reward contingencies for stimuli previously associated with shock. In the counterconditioning phase, prior fear association interacted with reward representation in the amygdala, where activation was decreased for rewarded compared to unrewarded CS− trials, while there was no reward-related difference in CS+ trials. In the reinstatement phase, an interaction of previous fear association and previous reward status was observed in a reward network consisting of substantia nigra/ventral tegmental area (SN/VTA), striatum and orbitofrontal cortex (OFC), where activation was increased by previous reward association only for CS− but not for CS+ trials. These findings suggest that during counterconditioning, prior fear conditioning interferes with reward learning, subsequently leading to lower activation of the reward network.

Avoiding boredom: Caudate and insula activity reflects boredom-elicited purchase bias

People show a strong tendency to avoid boring situations, but the neural systems mediating this behavioural bias are yet unknown. We used functional magnetic resonance imaging (fMRI) to investigate how the anticipation of a boring task influences decisions to purchase entertainment. Participants accepted higher prices to avoid boredom compared to control tasks, and individual differences in boredom experience predicted the increase in price. This behavioural bias was associated with higher activity in the caudate nucleus during music purchases driven by boredom avoidance. Insula activation was increased during performance of the boring task and subsequently associated with individual differences in boredom-related decision making. These results identify a mechanism that drives decisions to avoid boring situations and potentially underlies consumer decisions.