Peter H. Rudebeck

Separate neural pathways process different decision costs

Behavioral ecologists and economists emphasize that potential costs, as well as rewards, influence decision making. Although neuroscientists assume that frontal areas are central to decision making, the evidence is contradictory and the critical region remains unclear. Here it is shown that frontal lobe contributions to cost-benefit decision making can be understood by positing the existence of two independent systems that make decisions about delay and effort costs. Anterior cingulate cortex lesions affected how much effort rats decided to invest for rewards. Orbitofrontal cortical lesions affected how long rats decided to wait for rewards. The pattern of disruption suggested the deficit could be related to impaired associative learning. Impairments of the two systems may underlie apathetic and impulsive choice patterns in neurological and psychiatric illnesses. Although the existence of two systems is not predicted by economic accounts of decision making, our results suggest that delay and effort may exert distinct influences on decision making.

Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour.

There is general acknowledgement that both the anterior cingulate and orbitofrontal cortex are implicated in reinforcement-guided decision making, and emotion and social behaviour. Despite the interest that these areas generate in both the cognitive neuroscience laboratory and the psychiatric clinic, ideas about the distinctive contributions made by each have only recently begun to emerge. This reflects an increasing understanding of the component processes that underlie reinforcement-guided decision making, such as the representation of reinforcement expectations, the exploration, updating and representation of action values, and the appreciation that choices are guided not just by the prospect of reward but also by the costs that action entails. Evidence is emerging to suggest that the anterior cingulate and orbitofrontal cortex make distinct contributions to each of these aspects of decision making.

Frontal Cortex Subregions Play Distinct Roles in Choices between Actions and Stimuli

The orbitofrontal cortex (OFC) has been implicated in reinforcement-guided decision making, error monitoring, and the reversal of behavior in response to changing circumstances. The anterior cingulate cortex sulcus (ACCS), however, has also been implicated in similar aspects of behavior. Dissociating the unique functions of these areas would improve our understanding of the decision-making process. The effect of selective OFC lesions on how monkeys used the history of reinforcement to guide choices of either particular actions or particular stimuli was studied and compared with the effects of ACCS lesions. Both lesions disrupted decision making, but their effects were differentially modulated by the dependence on action– or stimulus–value contingencies. OFC lesions caused a deficit in stimulus but not action selection, whereas ACCS lesions had the opposite effect, disrupting action but not stimulus selection. Furthermore, OFC lesions that have previously been found to impair decision making when deterministic stimulus–reward contingencies are switched were found to cause a more general learning impairment in more naturalistic situations in which reward was stochastic. Both OFC and ACCS are essential for reinforcement-guided decision making rather than just error monitoring or behavioral reversal. The OFC and ACCS are both, however, more concerned with learning and making decisions, but their roles in selecting between stimulus and action values are distinct.

A Role for the Macaque Anterior Cingulate Gyrus in Social Valuation

Complex human social interaction is disrupted when the frontal lobe is damaged in disease, and in extreme cases patients are described as having acquired sociopathy. We compared, in macaques, the effects of lesions in subdivisions of the anterior cingulate and the orbitofrontal cortices believed to be anatomically homologous to those damaged in such patients. We show that the anterior cingulate gyrus in male macaques is critical for normal patterns of social interest in other individual male or female macaques. Conversely, the orbitofrontal cortex lesion had a marked effect only on responses to mildly fear-inducing stimuli. These results suggest that damage to the anterior cingulate gyrus may be the cause of changes in social interaction seen after frontal lobe damage.

Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating

Two ideas have dominated neuropsychology concerning the orbitofrontal cortex (OFC). One holds that OFC regulates emotion and enhances behavioral flexibility through inhibitory control. The other ascribes to OFC a role in updating valuations on the basis of current motivational states. Neuroimaging, neurophysiological and clinical observations are consistent with either or both hypotheses. Although these hypotheses are compatible in principle, we present results supporting the latter view of OFC function and arguing against the former. We found that excitotoxic, fiber-sparing lesions confined to OFC in monkeys did not alter either behavioral flexibility, as measured by object reversal learning, or emotion regulation, as assessed by fear of snakes. A follow-up experiment indicated that a previously reported loss of inhibitory control resulted from damage to nearby fiber tracts and not from OFC dysfunction. Thus, OFC has a more specialized role in reward-guided behavior and emotion than has been thought, a function that includes value updating.

The Orbitofrontal Oracle: Cortical Mechanisms for the Prediction and Evaluation of Specific Behavioral Outcomes

The orbitofrontal cortex (OFC) has long been associated with the flexible control of behavior and concepts such as behavioral inhibition, self-control, and emotional regulation. These ideas emphasize the suppression of behaviors and emotions, but OFCs affirmative functions have remained enigmatic. Here we review recent work that has advanced our understanding of this prefrontal area and how its functions are shaped through interaction with subcortical structures such as the amygdala. Recent findings have overturned theories emphasizing behavioral inhibition as OFCs fundamental function. Instead, new findings indicate that OFC provides predictions about specific outcomes associated with stimuli, choices, and actions, especially their moment-to-moment value based on current internal states. OFC function thereby encompasses a broad representation or model of an individuals sensory milieu and potential actions, along with their relationship to likely behavioral outcomes.

The contribution of distinct subregions of the ventromedial frontal cortex to emotion, social behavior, and decision making.

Damage to the ventromedial frontal cortex (VMFC) in humans is associated with deficits in decision making. Decision making, however, often happens while people are interacting with others, where it is important to take the social consequences of a course of action into account. It is well known that VMFC lesions also lead to marked alterations in patients’ emotions and ability to interact socially; however, it has not been clear which parts of the VMFC are critical for these changes. Recently, there has been considerable interest in the role of the VMFC in choice behavior during interpersonal exchanges. Here, we highlight recent research that suggests that two areas within or adjacent to the VMFC, the orbitofrontal cortex (OFC) and the anterior cingulate cortex (ACC), may play distinct but complementary roles in mediating normal patterns of emotion and social behavior. Converging lines of evidence from human, macaque, and rat studies now suggest that the OFC may be more specialized for simple emotional responses, such as fear and aggression, through its role in representing primary reinforcement or punishment. By contrast, the ACC may play a distinct role in more complex aspects of emotion, such as social interaction, by virtue of its connections with the discrete parts of the temporal lobe and subcortical structures that control autonomic responses.

Dissociable Effects of Subtotal Lesions within the Macaque Orbital Prefrontal Cortex on Reward-Guided Behavior

The macaque orbital prefrontal cortex (PFo) has been implicated in a wide range of reward-guided behaviors essential for efficient foraging. The PFo, however, is not a homogeneous structure. Two major subregions, distinct by their cytoarchitecture and connections to other brain structures, compose the PFo. One subregion encompasses Walkers areas 11 and 13 and the other centers on Walkers area 14. Although it has been suggested that these subregions play dissociable roles in reward-guided behavior, direct neuropsychological evidence for this hypothesis is limited. To explore the independent contributions of PFo subregions to behavior, we studied rhesus monkeys (Macaca mulatta) with restricted excitotoxic lesions targeting either Walkers areas 11/13 or area 14. The performance of these two groups was compared to that of a group of unoperated controls on a series of reward-based tasks that has been shown to be sensitive to lesions of the PFo as a whole (Walkers areas 11, 13, and 14). Lesions of areas 11/13, but not area 14, disrupted the rapid updating of object value during selective satiation. In contrast, lesions targeting area 14, but not areas 11/13, impaired the ability of monkeys to learn to stop responding to a previously rewarded object. Somewhat surprisingly, neither lesion disrupted performance on a serial object reversal learning task, although aspiration lesions of the entire PFo produce severe deficits on this task. Our data indicate that anatomically defined subregions within macaque PFo make dissociable contributions to reward-guided behavior.

Amygdala and Orbitofrontal Cortex Lesions Differentially Influence Choices during Object Reversal Learning

In nonhuman primates, interaction between the orbitofrontal cortex (OFC) and the amygdala (AMG) has been seen as critical for learning and subsequently changing associations between stimuli and reinforcement. However, it is still unclear what the precise role of the OFC is in altering these stimulus–reward associations, and recent research has questioned whether the AMG makes an essential contribution at all. To gain a better understanding of the role of these two structures in flexibly associating stimuli with reinforcement, we reanalyzed a set of previously published data from groups of monkeys with either OFC or AMG lesions that had been tested on an object reversal learning task. Based on trial-by-trial analyses of rewarded and unrewarded choices, we report two new findings. First, monkeys with OFC lesions were, compared with both control and AMG groups, unable to use correctly performed trials to optimally guide subsequent choices. Second, monkeys with AMG lesions showed the opposite pattern of behavior. This group benefited more than controls from correctly performed trials that followed an error. Finally, as has been reported by others, after a change in reward contingencies, monkeys with OFC lesions also showed a slightly greater tendency to choose the previously rewarded object. These findings demonstrate that the OFC and AMG make different contributions to object reversal learning not highlighted previously.

Impulsive choice in hippocampal but not orbitofrontal cortex-lesioned rats on a nonspatial decision-making maze task

Orbitofrontal cortical (OFC) and hippocampal (HPC) lesions in primates and rodents have been associated with impulsive behaviour. We showed previously that OFC‐ or HPC‐lesioned rats chose the immediate low‐reward (LR) option in preference to the delayed high‐reward (HR) option, where LR and HR were associated with different spatial responses in a uniform grey T‐maze. We now report that on a novel nonspatial T‐maze task in which the HR and LR options are associated with patterned goal arms (black‐and‐white stripes vs. gray), OFC‐lesioned rats did not show impulsive behaviour, choosing the delayed HR option, and were indistinguishable from controls. In contrast, HPC‐lesioned rats exhibited impulsive choice in the nonspatial decision‐making task, although they chose the HR option on the majority of trials when there was a 10‐s delay associated with both goal arms. The previously reported impairment in OFC‐lesioned rats on the spatial version of the intertemporal choice task is unlikely to reflect a general problem with spatial learning, because OFC lesions were without effect on acquisition of the standard reference memory water‐maze task and spatial working memory performance (nonmatching‐to‐place) on the T‐maze. The differential effect of OFC lesions on the two versions of the intertemporal choice task may be explained instead in terms of the putative role of OFC in using associative information to represent expected outcomes and generate predictions. The impulsivity in HPC‐lesioned rats may reflect impaired temporal information processing, and emphasizes a role for the hippocampus beyond the spatial domain.