MaryAnn P. Noonan

Frontal Cortex and Reward-Guided Learning and Decision-Making

Reward-guided decision-making and learning depends on distributed neural circuits with many components. Here we focus on recent evidence that suggests four frontal lobe regions make distinct contributions to reward-guided learning and decision-making: the lateral orbitofrontal cortex, the ventromedial prefrontal cortex and adjacent medial orbitofrontal cortex, anterior cingulate cortex, and the anterior lateral prefrontal cortex. We attempt to identify common themes in experiments with human participants and with animal models, which suggest roles that the areas play in learning about reward associations, selecting reward goals, choosing actions to obtain reward, and monitoring the potential value of switching to alternative courses of action.

Diffusion-Weighted Imaging Tractography-Based Parcellation of the Human Parietal Cortex and Comparison with Human and Macaque Resting-State Functional Connectivity

Despite the prominence of parietal activity in human neuroimaging investigations of sensorimotor and cognitive processes, there remains uncertainty about basic aspects of parietal cortical anatomical organization. Descriptions of human parietal cortex draw heavily on anatomical schemes developed in other primate species, but the validity of such comparisons has been questioned by claims that there are fundamental differences between the parietal cortex in humans and other primates. A scheme is presented for parcellation of human lateral parietal cortex into component regions on the basis of anatomical connectivity and the functional interactions of the resulting clusters with other brain regions. Anatomical connectivity was estimated using diffusion-weighted magnetic resonance image (MRI)-based tractography, and functional interactions were assessed by correlations in activity measured with functional MRI at rest. Resting-state functional connectivity was also assessed directly in the rhesus macaque lateral parietal cortex in an additional experiment, and the patterns found reflected known neuroanatomical connections. Cross-correlation in the tractography-based connectivity patterns of parietal voxels reliably parcellated human lateral parietal cortex into 10 component clusters. The resting-state functional connectivity of human superior parietal and intraparietal clusters with frontal and extrastriate cortex suggested correspondences with areas in macaque superior and intraparietal sulcus. Functional connectivity patterns with parahippocampal cortex and premotor cortex again suggested fundamental correspondences between inferior parietal cortex in humans and macaques. In contrast, the human parietal cortex differs in the strength of its interactions between the central inferior parietal lobule region and the anterior prefrontal cortex.

Social network size affects neural circuits in macaques.

Executing social cognition successfully requires more brain power. It has been suggested that variation in brain structure correlates with the sizes of individuals’ social networks. Whether variation in social network size causes variation in brain structure, however, is unknown. To address this question, we neuroimaged 23 monkeys that had been living in social groups set to different sizes. Subject comparison revealed that living in larger groups caused increases in gray matter in mid-superior temporal sulcus and rostral prefrontal cortex and increased coupling of activity in frontal and temporal cortex. Social network size, therefore, contributes to changes both in brain structure and function. The changes have potential implications for an animal’s success in a social context; gray matter differences in similar areas were also correlated with each animal’s dominance within its social network.

On the relationship between the “default mode network” and the “social brain”

The default mode network (DMN) of the brain consists of areas that are typically more active during rest than during active task performance. Recently however, this network has been shown to be activated by certain types of tasks. Social cognition, particularly higher-order tasks such as attributing mental states to others, has been suggested to activate a network of areas at least partly overlapping with the DMN. Here, we explore this claim, drawing on evidence from meta-analyses of functional MRI data and recent studies investigating the structural and functional connectivity of the social brain. In addition, we discuss recent evidence for the existence of a DMN in non-human primates. We conclude by discussing some of the implications of these observations.

Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex.

Uncertainty about the function of orbitofrontal cortex (OFC) in guiding decision-making may be a result of its medial (mOFC) and lateral (lOFC) divisions having distinct functions. Here we test the hypothesis that the mOFC is more concerned with reward-guided decision making, in contrast with the lOFCs role in reward-guided learning. Macaques performed three-armed bandit tasks and the effects of selective mOFC lesions were contrasted against lOFC lesions. First, we present analyses that make it possible to measure reward-credit assignment—a crucial component of reward-value learning—independently of the decisions animals make. The mOFC lesions do not lead to impairments in reward-credit assignment that are seen after lOFC lesions. Second, we examined how the reward values of choice options were compared. We present three analyses, one of which examines reward-guided decision making independently of reward-value learning. Lesions of the mOFC, but not the lOFC, disrupted reward-guided decision making. Impairments after mOFC lesions were a function of the multiple option contexts in which decisions were made. Contrary to axiomatic assumptions of decision theory, the mOFC-lesioned animals’ value comparisons were no longer independent of irrelevant alternatives.

The Organization of Dorsal Frontal Cortex in Humans and Macaques

The human dorsal frontal cortex has been associated with the most sophisticated aspects of cognition, including those that are thought to be especially refined in humans. Here we used diffusion-weighted magnetic resonance imaging (DW-MRI) and functional MRI (fMRI) in humans and macaques to infer and compare the organization of dorsal frontal cortex in the two species. Using DW-MRI tractography-based parcellation, we identified 10 dorsal frontal regions lying between the human inferior frontal sulcus and cingulate cortex. Patterns of functional coupling between each area and the rest of the brain were then estimated with fMRI and compared with functional coupling patterns in macaques. Areas in human medial frontal cortex, including areas associated with high-level social cognitive processes such as theory of mind, showed a surprising degree of similarity in their functional coupling patterns with the frontal pole, medial prefrontal, and dorsal prefrontal convexity in the macaque. We failed to find evidence for “new” regions in human medial frontal cortex. On the lateral surface, comparison of functional coupling patterns suggested correspondences in anatomical organization distinct from those that are widely assumed. A human region sometimes referred to as lateral frontal pole more closely resembled area 46, rather than the frontal pole, of the macaque. Overall the pattern of results suggest important similarities in frontal cortex organization in humans and other primates, even in the case of regions thought to carry out uniquely human functions. The patterns of interspecies correspondences are not, however, always those that are widely assumed.

Re-evaluating the role of the orbitofrontal cortex in reward and reinforcement.

The orbitofrontal cortex and adjacent ventromedial prefrontal cortex carry reward representations and mediate flexible behaviour when circumstances change. Here we review how recent experiments in humans and macaques have confirmed the existence of a major difference between the functions of the ventromedial prefrontal cortex and adjacent medial orbitofrontal cortex (mOFC) on the one hand and the lateral orbitofrontal cortex (lOFC) on the other. These differences, however, may not be best accounted for in terms of specializations for reward and error/punishment processing as is commonly assumed. Instead we argue that both lesion and functional magnetic resonance imaging studies reveal that the lOFC is concerned with the assignment of credit for both reward and error outcomes to the choice of specific stimuli and with the linking of specific stimulus representations to representations of specific types of reward outcome. By contrast, we argue that the ventromedial prefrontal cortex/mOFC is concerned with evaluation, value‐guided decision‐making and maintenance of a choice over successive decisions. Despite the popular view that they cause perseveration of behaviour and inability to inhibit repetition of a previously made choice, we found that lesions in neither orbitofrontal subdivision caused perseveration. On the contrary, lesions in the lOFC made animals switch more rapidly between choices when they were finding it difficult to assign reward values to choices. Lesions in the mOFC caused animals to lose their normal predisposition to repeat previously successful choices, suggesting that the mOFC does not just mediate value comparison in choice but also facilitates maintenance of the same choice if it has been successful.

Causal effect of disconnection lesions on interhemispheric functional connectivity in rhesus monkeys

In the absence of external stimuli or task demands, correlations in spontaneous brain activity (functional connectivity) reflect patterns of anatomical connectivity. Hence, resting-state functional connectivity has been used as a proxy measure for structural connectivity and as a biomarker for brain changes in disease. To relate changes in functional connectivity to physiological changes in the brain, it is important to understand how correlations in functional connectivity depend on the physical integrity of brain tissue. The causal nature of this relationship has been called into question by patient data suggesting that decreased structural connectivity does not necessarily lead to decreased functional connectivity. Here we provide evidence for a causal but complex relationship between structural connectivity and functional connectivity: we tested interhemispheric functional connectivity before and after corpus callosum section in rhesus monkeys. We found that forebrain commissurotomy severely reduced interhemispheric functional connectivity, but surprisingly, this effect was greatly mitigated if the anterior commissure was left intact. Furthermore, intact structural connections increased their functional connectivity in line with the hypothesis that the inputs to each node are normalized. We conclude that functional connectivity is likely driven by corticocortical white matter connections but with complex network interactions such that a near-normal pattern of functional connectivity can be maintained by just a few indirect structural connections. These surprising results highlight the importance of network-level interactions in functional connectivity and may cast light on various paradoxical findings concerning changes in functional connectivity in disease states.

Distinct Roles of Three Frontal Cortical Areas in Reward-Guided Behavior

Functional magnetic resonance imaging was used to measure activity in three frontal cortical areas, the lateral orbitofrontal cortex (lOFC), medial orbitofrontal cortex (mOFC)/ventromedial frontal cortex (vmPFC), and anterior cingulate cortex (ACC), when expectations about type of reward, and not just reward presence or absence, could be learned. Two groups of human subjects learned 12 stimulus–response pairings. In one group (Consistent), correct performances of a given pairing were always reinforced with a specific reward outcome, whereas in the other group (Inconsistent), correct performances were reinforced with randomly selected rewards. The mOFC/vmPFC and lOFC were not distinguished by simple differences in relative preference for positive and negative outcomes. Instead lOFC activity reflected updating of reward-related associations specific to reward type; lOFC was active whenever informative outcomes allowed updating of reward-related associations, regardless of whether the outcomes were positive or negative, and the effects were greater when consistent stimulus-outcome and response-outcome mappings were present. A psychophysiological interaction analysis demonstrated changed coupling between lOFC and brain areas for visual object representation, such as perirhinal cortex, and reward-guided learning, such as the amygdala, ventral striatum, and habenula/mediodorsal thalamus. In contrast, mOFC/vmPFC activity reflected expected values of outcomes and occurrence of positive outcomes, regardless of consistency of outcome mappings. The third frontal cortical region, the ACC, reflected the use of reward type information to guide response selection. ACC activity reflected the probability of selecting the correct response, was greater when consistent outcome mappings were present, and was related to individual differences in propensity to select the correct response.

A neural circuit covarying with social hierarchy in macaques.

A neural circuit that covaries with social hierarchy A neuroimaging study reveals that individual variation in brain circuits in structures below the cerebral cortex of macaques is associated with experience at different ends of the social hierarchy.