Eva Friedel

Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding

Hard-wired, Pavlovian, responses elicited by predictions of rewards and punishments exert significant benevolent and malevolent influences over instrumentally-appropriate actions. These influences come in two main groups, defined along anatomical, pharmacological, behavioural and functional lines. Investigations of the influences have so far concentrated on the groups as a whole; here we take the critical step of looking inside each group, using a detailed reinforcement learning model to distinguish effects to do with value, specific actions, and general activation or inhibition. We show a high degree of sophistication in Pavlovian influences, with appetitive Pavlovian stimuli specifically promoting approach and inhibiting withdrawal, and aversive Pavlovian stimuli promoting withdrawal and inhibiting approach. These influences account for differences in the instrumental performance of approach and withdrawal behaviours. Finally, although losses are as informative as gains, we find that subjects neglect losses in their instrumental learning. Our findings argue for a view of the Pavlovian system as a constraint or prior, facilitating learning by alleviating computational costs that come with increased flexibility.

5-HTT genotype effect on prefrontal–amygdala coupling differs between major depression and controls

RationaleIn major depression, prefrontal regulation of limbic brain areas may be a key mechanism that is impaired during the processing of affective information. This prefrontal–limbic interaction has been shown to be modulated by serotonin (5-HTT) genotype, indicating a higher risk for major depressive disorder (MDD) with increasing number of 5-HTT low-expression alleles.ObjectiveFunctional magnetic resonance imaging was used to assess neural response to uncued unpleasant affective pictures in 21 unmedicated patients with MDD compared to 21 matched healthy controls, taking into account genetic influences of the 5-HTT (SCL6A4) high- and low-expression genotype.ResultsHealthy controls displayed greater prefrontal activation (BA10) to uncued negative pictures compared to patients with MDD. While in healthy controls prefrontal (BA10) activation and BA10–amygdala coupling increased with the number of 5-HTT low-expression risk alleles, this effect was abolished, and even reversed, in patients with MDD. In MDD, connectivity decreased with severity of depressive symptoms (HAMD total score).ConclusionThese findings suggest that increased medial prefrontal (BA10) activation and BA10–amygdala connectivity may counteract the risk for MDD in healthy carriers of 5-HTT low-expression alleles, while this protective factor might be lost in patients who actually suffer from MDD. Prefrontal–limbic regulation in risk populations could be a target of early interventions and should be the focus of further research.

Ventral striatal activation during reward processing in subjects with ultra-high risk for schizophrenia.

Background: Early dysfunction of the brain reward system in schizophrenia might be already recognized in the prodromal phase of this illness. We used functional magnetic resonance imaging to assess the blood oxygen level-dependent response in the ventral striatum (VS) of subjects with ultra-high risk for psychosis during the presentation of reward-indicating and loss-indicating stimuli. Methods: Thirteen prodromal patients (mean age: 25.5 ± 4.6 years) and 13 age-matched healthy volunteers participated in an incentive monetary delay task, in which visual cues predicted that a rapid response to a subsequent target stimulus will gain money, avoid losing money or have no consequence. Results: Compared with the neutral condition, anticipation of reward loss-avoidance elicited significant activation of the VS in both healthy subjects and subjects with ultra-high risk for psychosis, but there was only a statistical tendency for less activation during loss-avoidance anticipation in prodromal compared to healthy subjects. Discussion: This study provides a first weak hint, as revealed by functional magnetic resonance imaging, for impaired activation of a central area of the mesolimbic dopaminergic brain reward system, the VS, already in subjects with ultra-high risk for psychosis, which is in line with results of patients with full-blown schizophrenic psychosis. This pilot study has, however, strong limitations, and its results need to be replicated first before they can be used e.g. for early recognition of patients in the schizophrenic prodrome.

Pavlovian-to-instrumental transfer effects in the nucleus accumbens relate to relapse in alcohol dependence

In detoxified alcohol‐dependent patients, alcohol‐related stimuli can promote relapse. However, to date, the mechanisms by which contextual stimuli promote relapse have not been elucidated in detail. One hypothesis is that such contextual stimuli directly stimulate the motivation to drink via associated brain regions like the ventral striatum and thus promote alcohol seeking, intake and relapse. Pavlovian‐to‐Instrumental‐Transfer (PIT) may be one of those behavioral phenomena contributing to relapse, capturing how Pavlovian conditioned (contextual) cues determine instrumental behavior (e.g. alcohol seeking and intake). We used a PIT paradigm during functional magnetic resonance imaging to examine the effects of classically conditioned Pavlovian stimuli on instrumental choices in n = 31 detoxified patients diagnosed with alcohol dependence and n = 24 healthy controls matched for age and gender. Patients were followed up over a period of 3 months. We observed that (1) there was a significant behavioral PIT effect for all participants, which was significantly more pronounced in alcohol‐dependent patients; (2) PIT was significantly associated with blood oxygen level‐dependent (BOLD) signals in the nucleus accumbens (NAcc) in subsequent relapsers only; and (3) PIT‐related NAcc activation was associated with, and predictive of, critical outcomes (amount of alcohol intake and relapse during a 3 months follow‐up period) in alcohol‐dependent patients. These observations show for the first time that PIT‐related BOLD signals, as a measure of the influence of Pavlovian cues on instrumental behavior, predict alcohol intake and relapse in alcohol dependence.

Switching schizophrenia patients from typical neuroleptics to aripiprazole: Effects on working memory dependent functional activation

BACKGROUND Deficits in working memory (WM) are a core symptom of schizophrenia patients and have been linked to dysfunctional prefrontal activation, which might be caused by a mesocortical hypodopaminergic state. Aripiprazole--a partial dopamine antagonist--is a novel antipsychotic, which increases frontal dopamine concentrations in preclinical studies. However, little is known about specific medication effects on the modulation of frontal activation during WM performance. METHODS We measured BOLD-response during a WM task in a longitudinal fMRI-study in eleven schizophrenia patients first when they received conventional antipsychotics (T1) and a second time after they had been switched to aripiprazole (T2). A healthy control group matched for age, handedness and gender was investigated at two corresponding time points. Data was analyzed with SPM5 in a 2 x 2 x 2 design (groupxsessionxtask). RESULTS Schizophrenia patients showed fewer correct responses compared to healthy controls at T1 and a trend-wise normalization at T2. The task activated the fronto-parietal network during the contrast 2-back>0-back in all participants. At T1 patients revealed a hypoactivation in the dorsal anterior cingulate cortex (ACC), which normalized after switch to aripiprazole and correlated with improved task performance. This was due to a significant increase in the patients group while the control group did not change, as corroborated by a significant groupxtime interaction in this region. CONCLUSIONS This study showed for the first time that the partial dopamine antagonist aripiprazole increases BOLD-signal during a WM task in the cognitive part of the ACC in schizophrenia patients, which may reflect its beneficial effect on cognitive deficits.

Functional neuroanatomy of emotion processing in major depressive disorder is altered after successful antidepressant therapy

Major Depressive Disorder (MDD) is associated with impaired processing and regulation of emotions. A vast body of research has elucidated the altered neural processes that occur in response to emotional stimuli, while little is known about anticipatory processes. Here we used functional magnetic resonance imaging (fMRI) to investigate neural activation during the presentation and anticipation of negative stimuli. Furthermore, we examined the effects of an 8-week antidepressant treatment with escitalopram. We matched 12 unmedicated MDD patients and 12 healthy control participants to perform a task involving affective pictures. The design of our event-related task consisted of presenting positive, negative, and neutral pictures from the International Affective Picture System (IAPS) across two runs and under opposite conditions. For the ‘expected’ condition, the pictures were cued by a word indicating their emotional valence; whereas the ‘unexpected’ condition had a combination of random letters precede the emotion picture. MDD patients displayed greater amygdala activation when anticipating negative pictures and greater prefrontal activation when confronted with them without the anticipatory cues. After antidepressant treatment, both amygdala and prefrontal activation decreased significantly in the treated MDD patients relative to controls. These findings show that the neural mechanisms of emotion anticipation and processing are altered in patients with MDD and that these alterations are able to normalize after treatment with an antidepressant.

Childhood methylphenidate treatment of ADHD and response to affective stimuli.

Neural correlates of emotional dysregulation in attention-deficit/hyperactivity disorder (ADHD) and persisting influence of Methylphenidate (MPH) still remain insufficiently understood. Decreased activation in the subgenual cingulate and the ventral striatum were found during the perception of positive and negative affective pictures in drug-naïve males with ADHD during childhood (n=10). Males with ADHD during childhood treated with MPH (n=10) did not show any significant differences compared to healthy controls (n=10). Further prospective studies need to clarify direct and indirect mechanisms of MPH treatment that may contribute to emotional processing, which is dysfunctional in males without pharmacological treatment in childhood.

Devaluation and sequential decisions: linking goal-directed and model-based behavior.

In experimental psychology different experiments have been developed to assess goal–directed as compared to habitual control over instrumental decisions. Similar to animal studies selective devaluation procedures have been used. More recently sequential decision-making tasks have been designed to assess the degree of goal-directed vs. habitual choice behavior in terms of an influential computational theory of model-based compared to model-free behavioral control. As recently suggested, different measurements are thought to reflect the same construct. Yet, there has been no attempt to directly assess the construct validity of these different measurements. In the present study, we used a devaluation paradigm and a sequential decision-making task to address this question of construct validity in a sample of 18 healthy male human participants. Correlational analysis revealed a positive association between model-based choices during sequential decisions and goal-directed behavior after devaluation suggesting a single framework underlying both operationalizations and speaking in favor of construct validity of both measurement approaches. Up to now, this has been merely assumed but never been directly tested in humans.

Altered amygdala activation in schizophrenia patients during emotion processing

Dysfunctional emotion processing in patients suffering from schizophrenia is a prominent clinical feature of great importance for social functioning and subjective well-being. The neurobiological underpinnings are still poorly understood. Here we investigated a large sample of schizophrenia patients and matched healthy controls with an event-related fMRI task during emotion processing using emotional pictures from the International Affective Picture System (IAPS). Schizophrenia patients revealed stronger right amygdala activation during negative and attenuated response during positive affective picture processing compared to healthy controls. Further analysis indicated that medication status influences activation of the ventral anterior cingulate cortex during negative affective stimuli processing. These results might represent a correlate of altered emotional experience in schizophrenia patients who are known to report less positive and more negative affective states in daily life situations.

Pavlovian-to-Instrumental Transfer in Alcohol Dependence: A Pilot Study

Background: Pavlovian processes are thought to play an important role in the development, maintenance and relapse of alcohol dependence, possibly by influencing and usurping ongoing thought and behavior. The influence of pavlovian stimuli on ongoing behavior is paradigmatically measured by pavlovian-to-instrumental transfer (PIT) tasks. These involve multiple stages and are complex. Whether increased PIT is involved in human alcohol dependence is uncertain. We therefore aimed to establish and validate a modified PIT paradigm that would be robust, consistent and tolerated by healthy controls as well as by patients suffering from alcohol dependence, and to explore whether alcohol dependence is associated with enhanced PIT. Methods: Thirty-two recently detoxified alcohol-dependent patients and 32 age- and gender-matched healthy controls performed a PIT task with instrumental go/no-go approach behaviors. The task involved both pavlovian stimuli associated with monetary rewards and losses, and images of drinks. Results: Both patients and healthy controls showed a robust and temporally stable PIT effect. Strengths of PIT effects to drug-related and monetary conditioned stimuli were highly correlated. Patients more frequently showed a PIT effect, and the effect was stronger in response to aversively conditioned CSs (conditioned suppression), but there was no group difference in response to appetitive CSs. Conclusion: The implementation of PIT has favorably robust properties in chronic alcohol-dependent patients and in healthy controls. It shows internal consistency between monetary and drug-related cues. The findings support an association of alcohol dependence with an increased propensity towards PIT. 2014 S. Karger AG, Basel