Marissa A. Gorlick

Acute Stress Increases Sex Differences in Risk Seeking in the Balloon Analogue Risk Task

Background Decisions involving risk often must be made under stressful circumstances. Research on behavioral and brain differences in stress responses suggest that stress might have different effects on risk taking in males and females. Methodology/Principal Findings In this study, participants played a computer game designed to measure risk taking (the Balloon Analogue Risk Task) fifteen minutes after completing a stress challenge or control task. Stress increased risk taking among men but decreased it among women. Conclusions/Significance Acute stress amplifies sex differences in risk seeking; making women more risk avoidant and men more risk seeking. Evolutionary principles may explain these stress-induced sex differences in risk taking behavior.

Risk preferences and aging: The “Certainty Effect” in older adults’ decision making

A prevalent stereotype is that people become less risk taking and more cautious as they get older. However, in laboratory studies, findings are mixed and often reveal no age differences. In the current series of experiments, we examined whether age differences in risk seeking are more likely to emerge when choices include a certain option (a sure gain or a sure loss). In four experiments, we found that age differences in risk preferences only emerged when participants were offered a choice between a risky and a certain gamble but not when offered two risky gambles. In particular, Experiments 1 and 2 included only gambles about potential gains. Here, compared with younger adults, older adults preferred a certain gain over a chance to win a larger gain and thus, exhibited more risk aversion in the domain of gains. But in Experiments 3 and 4, when offered the chance to take a small sure loss rather than risking a larger loss, older adults exhibited more risk seeking in the domain of losses than younger adults. Both their greater preference for sure gains and greater avoidance of sure losses suggest that older adults weigh certainty more heavily than younger adults. Experiment 4 also indicates that older adults focus more on positive emotions than younger adults do when considering their options, and that this emotional shift can at least partially account for age differences in how much people are swayed by certainty in their choices.

With age comes wisdom: decision making in younger and older adults

In two experiments, younger and older adults performed decision-making tasks in which reward values available were either independent of or dependent on the previous sequence of choices made. The choice-independent task involved learning and exploiting the options that gave the highest rewards on each trial. In this task, the stability of the expected reward for each option was not influenced by the previous choices participants made. The choice-dependent task involved learning how each choice influenced future rewards for two options and making the best decisions based on that knowledge. Younger adults performed better when rewards were independent of choice, whereas older adults performed better when rewards were dependent on choice. These findings suggest a fundamental difference in the way in which younger adults and older adults approach decision-making situations. We discuss the results in the context of prominent decision-making theories and offer possible explanations based on neurobiological and behavioral changes associated with aging.

Stress modulates reinforcement learning in younger and older adults.

Animal research and human neuroimaging studies indicate that stress increases dopamine levels in brain regions involved in reward processing, and stress also appears to increase the attractiveness of addictive drugs. The current study tested the hypothesis that stress increases reward salience, leading to more effective learning about positive than negative outcomes in a probabilistic selection task. Changes to dopamine pathways with age raise the question of whether stress effects on incentive-based learning differ by age. Thus, the present study also examined whether effects of stress on reinforcement learning differed for younger (age 18-34) and older participants (age 65-85). Cold pressor stress was administered to half of the participants in each age group, and salivary cortisol levels were used to confirm biophysiological response to cold stress. After the manipulation, participants completed a probabilistic learning task involving positive and negative feedback. In both younger and older adults, stress enhanced learning about cues that predicted positive outcomes. In addition, during the initial learning phase, stress diminished sensitivity to recent feedback across age groups. These results indicate that stress affects reinforcement learning in both younger and older adults and suggests that stress exerts different effects on specific components of reinforcement learning depending on their neural underpinnings.

Differential Interference Effects of Negative Emotional States on Subsequent Semantic and Perceptual Processing

Past studies have revealed that encountering negative events interferes with cognitive processing of subsequent stimuli. The present study investigates whether negative events affect semantic and perceptual processing differently. Presentation of negative pictures produced slower reaction times than neutral or positive pictures in tasks that require semantic processing, such as natural or man-made judgments about drawings of objects, commonness judgments about objects, and categorical judgments about pairs of words. In contrast, negative picture presentation did not slow down judgments in subsequent perceptual processing (e.g., color judgments about words, size judgments about objects). The subjective arousal level of negative pictures did not modulate the interference effects on semantic or perceptual processing. These findings indicate that encountering negative emotional events interferes with semantic processing of subsequent stimuli more strongly than perceptual processing, and that not all types of subsequent cognitive processing are impaired by negative events.

State-based versus reward-based motivation in younger and older adults.

Recent decision-making work has focused on a distinction between a habitual, model-free neural system that is motivated toward actions that lead directly to reward and a more computationally demanding goal-directed, model-based system that is motivated toward actions that improve one’s future state. In this article, we examine how aging affects motivation toward reward-based versus state-based decision making. Participants performed tasks in which one type of option provided larger immediate rewards but the alternative type of option led to larger rewards on future trials, or improvements in state. We predicted that older adults would show a reduced preference for choices that led to improvements in state and a greater preference for choices that maximized immediate reward. We also predicted that fits from a hybrid reinforcement-learning model would indicate greater model-based strategy use in younger than in older adults. In line with these predictions, older adults selected the options that maximized reward more often than did younger adults in three of the four tasks, and modeling results suggested reduced model-based strategy use. In the task where older adults showed similar behavior to younger adults, our model-fitting results suggested that this was due to the utilization of a win-stay–lose-shift heuristic rather than a more complex model-based strategy. Additionally, within older adults, we found that model-based strategy use was positively correlated with memory measures from our neuropsychological test battery. We suggest that this shift from state-based to reward-based motivation may be due to age related declines in the neural structures needed for more computationally demanding model-based decision making.

Scaffolding Across the Lifespan in History-Dependent Decision-Making

We examined the relationship between pressure and age-related changes in decision-making using a task for which currently available rewards depend on the participants previous history of choices. Optimal responding in this task requires the participant to learn how his or her current choices affect changes in the future rewards given for each option. Building on the scaffolding theory of aging and cognition, we predicted that when additional frontal resources are available, compensatory recruitment leads to increased monitoring and increased use of heuristic-based strategies, ultimately leading to better performance. Specifically, we predicted that scaffolding would result in an age-related performance advantage under no pressure conditions. We also predicted that, although younger adults would engage in scaffolding under pressure, older adults would not have additional resources available for increased scaffolding under pressure-packed conditions, leading to an age-related performance deficit. Both predictions were supported by the data. In addition, computational models were used to evaluate decision-making strategies employed by each participant group. As expected, older adults under no pressure conditions and younger adults under pressure conditions showed increased use of heuristic-based strategies relative to older adults under pressure and younger adults under no pressure, respectively. These results are consistent with the notion that scaffolding can occur across the life span in the face of an environmental challenge.

Negative emotional outcomes impair older adults' reversal learning.

In a typical reversal-learning experiment, one learns stimulus–outcome contingencies that then switch without warning. For instance, participants might have to repeatedly choose between two faces, one of which yields points whereas the other does not, with a reversal at some point in which face yields points. The current study examined age differences in the effects of outcome type on reversal learning. In the first experiment, the participants’ task was either to select the person who would be in a better mood or to select the person who would yield more points. Reversals in which face was the correct option occurred several times. Older adults did worse in blocks in which the correct response was to select the person who would not be angry than in blocks in which the correct response was to select the person who would smile. Younger adults did not show a difference by emotional valence. In the second study, the negative condition was switched to have the same format as the positive condition (to select who will be angry). Again, older adults did worse with negative than positive outcomes, whereas younger adults did not show a difference by emotional valence. A third experiment replicated the lack of valence effects in younger adults with a harder probabilistic reversal-learning task. In the first two experiments, older adults performed about as well as younger adults in the positive conditions but performed worse in the negative conditions. These findings suggest that negative emotional outcomes selectively impair older adults’ reversal learning.

Training attention improves decision making in individuals with elevated self-reported depressive symptoms

Depression is often characterized by attentional biases toward negative items and away from positive items, which likely affects reward and punishment processing. Recent work has reported that training attention away from negative stimuli reduced this bias and reduced depressive symptoms. However, the effect of attention training on subsequent learning has yet to be explored. In the present study, participants were required to learn to maximize reward during decision making. Undergraduates with elevated self-reported depressive symptoms received attention training toward positive stimuli prior to performing the decision-making task (n = 20; active training). The active-training group was compared to two other groups: undergraduates with elevated self-reported depressive symptoms who received placebo training (n = 22; placebo training) and a control group with low levels of depressive symptoms (n = 33; nondepressive control). The placebo-training depressive group performed worse and switched between options more than did the nondepressive controls on the reward maximization task. However, depressives that received active training performed as well as the nondepressive controls. Computational modeling indicated that the placebo-trained group learned more from negative than from positive prediction errors, leading to more frequent switching. The nondepressive control and active-training depressive groups showed similar learning from positive and negative prediction errors, leading to less-frequent switching and better performance. Our results indicate that individuals with elevated depressive symptoms are impaired at reward maximization, but that the deficit can be improved with attention training toward positive stimuli.

Attenuating Age-Related Learning Deficits: Emotional Valenced Feedback Interacts with Task Complexity

Previous research reveals that older adults sometimes show enhanced processing of emotionally positive stimuli relative to negative stimuli, but that this positivity bias reverses to become a negativity bias when cognitive control resources are less available. In this study, we test the hypothesis that emotionally positive feedback will attenuate well-established age-related deficits in rule learning whereas emotionally negative feedback will amplify age deficits-but that this pattern will reverse when the task involves a high cognitive load. Experiment 1 used emotional face feedback and revealed an interaction among age, valence of the feedback, and task load. When the task placed minimal load on cognitive control resources, happy-face feedback attenuated age-related deficits in initial rule learning and angry-face feedback led to age-related deficits in initial rule learning and set shifting. However, when the task placed a high load on cognitive control resources, we found that angry-face feedback attenuated age-related deficits in initial rule learning and set shifting whereas happy-face feedback led to age-related deficits in initial rule learning and set shifting. Experiment 2 used less emotional point feedback and revealed age-related deficits in initial rule learning and set shifting under low and high cognitive load for point-gain and point-loss conditions. The research presented here demonstrates that emotional feedback can attenuate age-related learning deficits-but only positive feedback for tasks with a low cognitive load and negative feedback for tasks with high cognitive load.