Andrew S. Kayser

Frontal cortex and the discovery of abstract action rules

Although we often encounter circumstances with which we have no prior experience, we rapidly learn how to behave in these novel situations. Such adaptive behavior relies on abstract behavioral rules that are generalizable, rather than concrete rules mapping specific cues to specific responses. Although the frontal cortex is known to support concrete rule learning, less well understood are the neural mechanisms supporting the acquisition of abstract rules. Here, we use a reinforcement learning paradigm to demonstrate that more anterior regions along the rostro-caudal axis of frontal cortex support rule learning at higher levels of abstraction. Moreover, these results indicate that when humans confront new rule learning problems, this rostro-caudal division of labor supports the search for relationships between context and action at multiple levels of abstraction simultaneously.

Dopamine, corticostriatal connectivity, and intertemporal choice.

Value-based decisions optimize behavioral outcomes. Because delayed rewards are discounted, an increased tendency to choose smaller, immediate rewards can lead to suboptimal choice. Steep discounting of delayed rewards (impulsivity) characterizes subjects with frontal lobe damage and behavioral disorders including substance abuse. Correspondingly, animal studies and indirect evidence in humans suggest that lower dopamine in the frontal cortex contributes to steeper discounting by impairing corticostriatal function. To test this hypothesis directly, we performed a randomized, double-blind, counterbalanced, placebo-controlled study in which we administered the brain penetrant catechol-O-methyltransferase inhibitor tolcapone or placebo to healthy subjects performing a delay discounting task. Tolcapone significantly increased choice of delayed monetary rewards, and this tolcapone-induced increase covaried with increased BOLD activity in the left ventral putamen and anterior insula. Tolcapone also changed corticostriatal connectivity: specifically, by inducing a decrease in the coherence between ventral putamen and pregenual cingulate cortex. These results indicate that raising cortical dopamine levels attenuates impulsive choice by changing corticostriatal function.

IS THE DEVELOPMENT OF ORIENTATION SELECTIVITY INSTRUCTED BY ACTIVITY

Is the development of orientation selectivity in visual cortex instructed by the patterns of neural activity of input neurons? We review evidence as to the role of activity, review models of activity-instructed development, and discuss how these models can be tested. The models can explain the normal development of simple cells with binocularly matched orientation preferences, the effects of monocular deprivation and reverse suture on the orientation map, and the development of a full intracortical circuit sufficient to explain mature response properties including the contrast-invariance of orientation tuning. Existing experiments are consistent with the models, in that (a) selective blockade of ON-center ganglion cells, which will degrade or eliminate the information predicted to drive development of orientation selectivity, in fact prevents development of orientation selectivity; and (b) the spontaneous activities of inputs serving the two eyes are correlated in the lateral geniculate nucleus at appropriate developmental times, as was predicted to be required to achieve binocular matching of preferred orientations. However, definitive tests remain to be done to firmly establish the instructive rather than simply permissive role of activity and determine whether the retinotopically and center type-specific patterns of activity predicted by the models actually exist. We conclude by critically examining alternative scenarios for the development of orientation selectivity and maps, including the idea that maps are genetically prespecified.

Oscillatory dynamics coordinating human frontal networks in support of goal maintenance

Humans have a capacity for hierarchical cognitive control—the ability to simultaneously control immediate actions while holding more abstract goals in mind. Neuropsychological and neuroimaging evidence suggests that hierarchical cognitive control emerges from a frontal architecture whereby prefrontal cortex coordinates neural activity in the motor cortices when abstract rules are needed to govern motor outcomes. We utilized the improved temporal resolution of human intracranial electrocorticography to investigate the mechanisms by which frontal cortical oscillatory networks communicate in support of hierarchical cognitive control. Responding according to progressively more abstract rules resulted in greater frontal network theta phase encoding (4–8 Hz) and increased prefrontal local neuronal population activity (high gamma amplitude, 80–150 Hz), which predicts trial-by-trial response times. Theta phase encoding coupled with high gamma amplitude during inter-regional information encoding, suggesting that inter-regional phase encoding is a mechanism for the dynamic instantiation of complex cognitive functions by frontal cortical subnetworks.

Neural Representations of Relevant and Irrelevant Features in Perceptual Decision Making

Although perceptual decision making activates a network of brain areas involved in sensory, integrative, and motor functions, circuit activity can clearly be modulated by factors beyond the stimulus. Of particular interest is to understand how the network is modulated by top-down factors such as attention. Here, we demonstrate in a motion coherence task that selective attention produces marked changes in the blood oxygen level-dependent (BOLD) response in a subset of regions within a human perceptual decision-making circuit. Specifically, when motion is attended, the BOLD response decreases with increasing motion coherence in many regions, including the motion-sensitive area MT+, the intraparietal sulcus, and the inferior frontal sulcus. However, when motion is ignored, the negative parametric response in a subset of this circuit becomes positive. Through both modeling and connectivity analyses, we demonstrate that this inversion both reflects a top-down influence and segregates attentional from accumulation regions, thereby permitting us to further delineate the contributions of different regions to the perceptual decision.

A comparison of Granger causality and coherency in fMRI-based analysis of the motor system.

The ability of functional MRI to acquire data from multiple brain areas has spurred developments not only in voxel‐by‐voxel analyses, but also in multivariate techniques critical to quantifying the interactions between brain areas. As the number of multivariate techniques multiplies, however, few studies in any modality have directly compared different connectivity measures, and fewer still have done so in the context of well‐characterized neural systems. To focus specifically on the temporal dimension of interactions between brain regions, we compared Granger causality and coherency (Sun et al., 2004 , 2005 : Neuroimage 21:647–658, Neuroimage 28:227–237) in a well‐studied motor system (1) to gain further insight into the convergent and divergent results expected from each technique, and (2) to investigate the leading and lagging influences between motor areas as subjects performed a motor task in which they produced different learned series of eight button presses. We found that these analyses gave convergent but not identical results: both techniques, for example, suggested an anterior‐to‐posterior temporal gradient of activity from supplemental motor area through premotor and motor cortices to the posterior parietal cortex, but the techniques were differentially sensitive to the coupling strength between areas. We also found practical reasons that might argue for the use of one technique over another in different experimental situations. Ultimately, the ideal approach to fMRI data analysis is likely to involve a complementary combination of methods, possibly including both Granger causality and coherency. Hum Brain Mapp, 2009.

Error-Monitoring and Post-Error Compensations: Dissociation between Perceptual Failures and Motor Errors with and without Awareness

Whether humans adjust their behavior in response to unaware errors remains a controversial issue relevant to insight in neuropsychiatric conditions. Initial error awareness studies found that the error-related negativity (ERN), an event-related potential (ERP) originating in the medial prefrontal cortex after errors, activated equally for aware and unaware errors, suggesting a candidate preconscious mechanism. However, recent studies demonstrate that the ERN decreases after unaware errors. We hypothesized that the ERN is dependent upon awareness, and predicted that previous discrepancies might be due to unaware errors not being differentiated from perceptually uncertain, low-confidence responses that might increase the ERN amplitude. Here we addressed this hypothesis by distinguishing between aware errors, unaware errors, and uncertain responses, and using stimuli (faces) associated with well established sensory ERPs to evaluate the degree of stimulus processing for each trial type. We found that while aware and unaware errors were related to failures at the time of response, uncertain responses were due to failures at the time of stimulus processing indexed by lower amplitude sensory ERPs. Moreover, uncertain responses showed similar ERN activity as aware errors, in comparison with decreased activity for unaware errors. Finally, compared with aware errors, uncertain responses and unaware errors showed reduced neural compensations, such as alpha suppression. Together these findings suggest that the ERN is activated by aware motor errors as well as sensory failures, and that both awareness and certainty are necessary for neural adaptations after errors.

Opponent Inhibition: A Developmental Model of Layer 4 of the Neocortical Circuit

We model the development of the functional circuit of layer 4 (the input-recipient layer) of cat primary visual cortex. The observed thalamocortical and intracortical circuitry codevelop under Hebb-like synaptic plasticity. Hebbian development yields opponent inhibition: inhibition evoked by stimuli anticorrelated with those that excite a cell. Strong opponent inhibition enables recognition of stimulus orientation in a manner invariant to stimulus contrast. These principles may apply to cortex more generally: Hebb-like plasticity can guide layer 4 of any piece of cortex to create opposition between anticorrelated stimulus pairs, and this enables recognition of specific stimulus patterns in a manner invariant to stimulus magnitude. Properties that are invariant across a cortical column are predicted to be those shared by opponent stimulus pairs; this contrasts with the common idea that a column represents cells with similar response properties.

Dopamine Modulates Egalitarian Behavior in Humans

Egalitarian motives form a powerful force in promoting prosocial behavior and enabling large-scale cooperation in the human species [1]. At the neural level, there is substantial, albeit correlational, evidence suggesting a link between dopamine and such behavior [2, 3]. However, important questions remain about the specific role of dopamine in setting or modulating behavioral sensitivity to prosocial concerns. Here, using a combination of pharmacological tools and economic games, we provide critical evidence for a causal involvement of dopamine in human egalitarian tendencies. Specifically, using the brain penetrant catechol-O-methyl transferase (COMT) inhibitor tolcapone [4, 5], we investigated the causal relationship between dopaminergic mechanisms and two prosocial concerns at the core of a number of widely used economic games: (1) the extent to which individuals directly value the material payoffs of others, i.e., generosity, and (2) the extent to which they are averse to differences between their own payoffs and those of others, i.e., inequity. We found that dopaminergic augmentation via COMT inhibition increased egalitarian tendencies in participants who played an extended version of the dictator game [6]. Strikingly, computational modeling of choice behavior [7] revealed that tolcapone exerted selective effects on inequity aversion, and not on other computational components such as the extent to which individuals directly value the material payoffs of others. Together, these data shed light on the causal relationship between neurochemical systems and human prosocial behavior and have potential implications for our understanding of the complex array of social impairments accompanying neuropsychiatric disorders involving dopaminergic dysregulation.

Dopamine, locus of control, and the exploration-exploitation tradeoff.

Whether to continue to exploit a source of reward, or to search for a new one of potentially greater value, is a fundamental and underconstrained decision. Recent computational studies of this exploration-exploitation tradeoff have found that variability in exploration across individuals is influenced by a functional polymorphism (Val158Met) in the catechol-O-methyltransferase (COMT) gene, whose protein product degrades synaptically released dopamine. However, these and other genotype–phenotype associations have rarely been causally tested. To directly test this association and to evaluate additional behavioral characteristics, including perceived locus of control (LOC), here we used the COMT inhibitor tolcapone in a randomized, double-blind, counterbalanced, within-subject study of 66 subjects genotyped for the Val158Met allele to assess the hypothesis that reducing COMT enzymatic activity interacts with genotype to increase uncertainty-driven exploration. In keeping with our initial hypothesis, tolcapone led to an increase in exploratory, but not exploitative, behavior in Met/Met rather than Val/Val subjects. Independent of genotype, those subjects with a more external LOC also showed increases in uncertainty-driven exploration on tolcapone relative to placebo. However, we did not replicate our previous finding that Met/Met subjects show greater exploration at baseline. Together these findings support a model in which exploration is hypothesized to have a dopaminergic basis. Moreover, in keeping with findings in other behavioral and cognitive domains, the response to an increase in presumptively frontal dopamine is dependent upon baseline dopamine tone.