Benjamin Y. Hayden

Posterior cingulate cortex: adapting behavior to a changing world.

When has the world changed enough to warrant a new approach? The answer depends on current needs, behavioral flexibility and prior knowledge about the environment. Formal approaches solve the problem by integrating the recent history of rewards, errors, uncertainty and context via Bayesian inference to detect changes in the world and alter behavioral policy. Neuronal activity in posterior cingulate cortex - a key node in the default network - is known to vary with learning, memory, reward and task engagement. We propose that these modulations reflect the underlying process of change detection and motivate subsequent shifts in behavior.

Neuronal basis of sequential foraging decisions in a patchy environment

Deciding when to leave a depleting resource to exploit another is a fundamental problem for all decision makers. The neuronal mechanisms mediating patch-leaving decisions remain unknown. We found that neurons in primate (Macaca mulatta) dorsal anterior cingulate cortex, an area that is linked to reward monitoring and executive control, encode a decision variable signaling the relative value of leaving a depleting resource for a new one. Neurons fired during each sequential decision to stay in a patch and, for each travel time, these responses reached a fixed threshold for patch-leaving. Longer travel times reduced the gain of neural responses for choosing to stay in a patch and increased the firing rate threshold mandating patch-leaving. These modulations more closely matched behavioral decisions than any single task variable. These findings portend an understanding of the neural basis of foraging decisions and endorse the unification of theoretical and experimental work in ecology and neuroscience.

Surprise Signals in Anterior Cingulate Cortex: Neuronal Encoding of Unsigned Reward Prediction Errors Driving Adjustment in Behavior

In attentional models of learning, associations between actions and subsequent rewards are stronger when outcomes are surprising, regardless of their valence. Despite the behavioral evidence that surprising outcomes drive learning, neural correlates of unsigned reward prediction errors remain elusive. Here we show that in a probabilistic choice task, trial-to-trial variations in preference track outcome surprisingness. Concordant with this behavioral pattern, responses of neurons in macaque (Macaca mulatta) dorsal anterior cingulate cortex (dACC) to both large and small rewards were enhanced when the outcome was surprising. Moreover, when, on some trials, probabilities were hidden, neuronal responses to rewards were reduced, consistent with the idea that the absence of clear expectations diminishes surprise. These patterns are inconsistent with the idea that dACC neurons track signed errors in reward prediction, as dopamine neurons do. Our results also indicate that dACC neurons do not signal conflict. In the context of other studies of dACC function, these results suggest a link between reward-related modulations in dACC activity and attention and motor control processes involved in behavioral adjustment. More speculatively, these data point to a harmonious integration between reward and learning accounts of ACC function on one hand, and attention and cognitive control accounts on the other.

Distinct Value Signals in Anterior and Posterior Ventromedial Prefrontal Cortex

The core feature of an economic exchange is a decision to trade one good for another, based on a comparison of relative value. Economists have long recognized, however, that the value an individual ascribes to a good during decision making (i.e., their relative willingness to trade for that good) does not always map onto the reward they actually experience. Here, we show that experienced value and decision value are represented in distinct regions of ventromedial prefrontal cortex (VMPFC) during the passive consumption of rewards. Participants viewed two categories of rewards—images of faces that varied in their attractiveness and monetary gains and losses—while being scanned using functional magnetic resonance imaging. An independent market task, in which participants exchanged some of the money that they had earned for brief views of attractive faces, determined the relative decision value associated with each category. We found that activation of anterior VMPFC increased with increasing experienced value, but not decision value, for both reward categories. In contrast, activation of posterior VMPFC predicted each individuals relative decision value for face and monetary stimuli. These results indicate not only that experienced value and decision value are represented in distinct regions of VMPFC, but also that decision value signals are evident even in the absence of an overt choice task. We conclude that decisions are made by comparing neural representations of the value of different goods encoded in posterior VMPFC in a common, relative currency.

Posterior Cingulate Cortex Mediates Outcome-Contingent Allocation of Behavior

Adaptive decision making requires selecting an action and then monitoring its consequences to improve future decisions. The neuronal mechanisms supporting action evaluation and subsequent behavioral modification, however, remain poorly understood. To investigate the contribution of posterior cingulate cortex (CGp) to these processes, we recorded activity of single neurons in monkeys performing a gambling task in which the reward outcome of each choice strongly influenced subsequent choices. We found that CGp neurons signaled reward outcomes in a nonlinear fashion and that outcome-contingent modulations in firing rate persisted into subsequent trials. Moreover, firing rate on any one trial predicted switching to the alternative option on the next trial. Finally, microstimulation in CGp following risky choices promoted a preference reversal for the safe option on the following trial. Collectively, these results demonstrate that CGp directly contributes to the evaluative processes that support dynamic changes in decision making in volatile environments.

Attention to Stimulus Features Shifts Spectral Tuning of V4 Neurons during Natural Vision

Previous neurophysiological studies suggest that attention can alter the baseline or gain of neurons in extrastriate visual areas but that it cannot change tuning. This suggests that neurons in visual cortex function as labeled lines whose meaning does not depend on task demands. To test this common assumption, we used a system identification approach to measure spatial frequency and orientation tuning in area V4 during two attentionally demanding visual search tasks, one that required fixation and one that allowed free viewing during search. We found that spatial attention modulates response baseline and gain but does not alter tuning, consistent with previous reports. In contrast, feature-based attention often shifts neuronal tuning. These tuning shifts are inconsistent with the labeled-line model and tend to enhance responses to stimulus features that distinguish the search target. Our data suggest that V4 neurons behave as matched filters that are dynamically tuned to optimize visual search.

Neurons in Anterior Cingulate Cortex Multiplex Information about Reward and Action

The dorsal anterior cingulate cortex (dACC) is thought to play a critical role in forming associations between rewards and actions. Currently available physiological data, however, remain inconclusive regarding the question of whether dACC neurons carry information linking particular actions to reward or, instead, encode abstract reward information independent of specific actions. Here we show that firing rates of a majority of dACC neurons in a population studied in an eight-option variably rewarded choice task were sensitive to both saccade direction and reward value. Furthermore, the influences of reward and saccade direction on neuronal activity were approximately equal in magnitude over the range of rewards tested and were statistically independent. Our results indicate that dACC neurons multiplex information about both reward and action, endorsing the idea that this area links motivational outcomes to behavior and undermining the notion that its neurons solely contribute to reward processing in the abstract.

Electrophysiological correlates of default-mode processing in macaque posterior cingulate cortex

During the course of daily activity, our level of engagement with the world varies on a moment-to-moment basis. Although these fluctuations in vigilance have critical consequences for our thoughts and actions, almost nothing is known about the neuronal substrates governing such dynamic variations in task engagement. We investigated the hypothesis that the posterior cingulate cortex (CGp), a region linked to default-mode processing by hemodynamic and metabolic measures, controls such variations. We recorded the activity of single neurons in CGp in 2 macaque monkeys performing simple tasks in which their behavior varied from vigilant to inattentive. We found that firing rates were reliably suppressed during task performance and returned to a higher resting baseline between trials. Importantly, higher firing rates predicted errors and slow behavioral responses, and were also observed during cued rest periods when monkeys were temporarily liberated from exteroceptive vigilance. These patterns of activity were not observed in the lateral intraparietal area, an area linked to the frontoparietal attention network. Our findings provide physiological confirmation that CGp mediates exteroceptive vigilance and are consistent with the idea that CGp is part of the “default network” of brain areas associated with control of task engagement.

Temporal discounting predicts risk sensitivity in rhesus macaques.

Humans and animals tend both to avoid uncertainty and to prefer immediate over future rewards. The comorbidity of psychiatric disorders such as impulsivity, problem gambling, and addiction suggests that a common mechanism may underlie risk sensitivity and temporal discounting. Nonetheless, the precise relationship between these two traits remains largely unknown. To examine whether risk sensitivity and temporal discounting reflect a common process, we recorded choices made by two rhesus macaques in a visual gambling task while we varied the delay between trials. We found that preference for the risky option declined with increasing delay between sequential choices in the task, even when all other task parameters were held constant. These results were quantitatively predicted by a model that assumed that the subjective expected utility of the risky option is evaluated based on the expected time of the larger payoff. The importance of the larger payoff in this model suggests that the salience of larger payoffs played a critical role in determining the value of risky options. These data suggest that risk sensitivity may be a product of other cognitive processes, and specifically that myopia for the future and the salience of jackpots control the propensity to take a gamble.

Economic principles motivating social attention in humans

We know little about the processes by which we evaluate the opportunity to look at another person. We propose that behavioural economics provides a powerful approach to understanding this basic aspect of social attention. We hypothesized that the decision process culminating in attention to another person follows the same economic principles that govern choices about rewards such as food, drinks and money. Specifically, such rewards are discounted as a function of time, are tradable for other rewards, and reinforce work. Behavioural and neurobiological evidence suggests that looking at other people can also be described as rewarding, but to what extent these economic principles apply to social orienting remains unknown. Here, we show that the opportunity to view pictures of the opposite sex is discounted by delay to viewing, substitutes for money and reinforces work. The reward value of photos of the opposite sex varied with physical attractiveness and was greater in men, suggesting differential utility of acquiring visual information about the opposite sex in men and women. Together, these results demonstrate that choosing whom to look at follows a general set of economic principles, implicating shared neural mechanisms in both social and non-social decision making.