Matthew T. Kaufman

Distributed Neural Representation of Expected Value

Anticipated reward magnitude and probability comprise dual components of expected value (EV), a cornerstone of economic and psychological theory. However, the neural mechanisms that compute EV have not been characterized. Using event-related functional magnetic resonance imaging, we examined neural activation as subjects anticipated monetary gains and losses that varied in magnitude and probability. Group analyses indicated that, although the subcortical nucleus accumbens (NAcc) activated proportional to anticipated gain magnitude, the cortical mesial prefrontal cortex (MPFC) additionally activated according to anticipated gain probability. Individual difference analyses indicated that, although NAcc activation correlated with self-reported positive arousal, MPFC activation correlated with probability estimates. These findings suggest that mesolimbic brain regions support the computation of EV in an ascending and distributed manner: whereas subcortical regions represent an affective component, cortical regions also represent a probabilistic component, and, furthermore, may integrate the two.

Neural population dynamics during reaching

Most theories of motor cortex have assumed that neural activity represents movement parameters. This view derives from what is known about primary visual cortex, where neural activity represents patterns of light. Yet it is unclear how well the analogy between motor and visual cortex holds. Single-neuron responses in motor cortex are complex, and there is marked disagreement regarding which movement parameters are represented. A better analogy might be with other motor systems, where a common principle is rhythmic neural activity. Here we find that motor cortex responses during reaching contain a brief but strong oscillatory component, something quite unexpected for a non-periodic behaviour. Oscillation amplitude and phase followed naturally from the preparatory state, suggesting a mechanistic role for preparatory neural activity. These results demonstrate an unexpected yet surprisingly simple structure in the population response. This underlying structure explains many of the confusing features of individual neural responses.

An optogenetic toolbox designed for primates.

Optogenetics is a technique for controlling subpopulations of neurons in the intact brain using light. This technique has the potential to enhance basic systems neuroscience research and to inform the mechanisms and treatment of brain injury and disease. Before launching large-scale primate studies, the method needs to be further characterized and adapted for use in the primate brain. We assessed the safety and efficiency of two viral vector systems (lentivirus and adeno-associated virus), two human promoters (human synapsin (hSyn) and human thymocyte-1 (hThy-1)) and three excitatory and inhibitory mammalian codon-optimized opsins (channelrhodopsin-2, enhanced Natronomonas pharaonis halorhodopsin and the step-function opsin), which we characterized electrophysiologically, histologically and behaviorally in rhesus monkeys (Macaca mulatta). We also introduced a new device for measuring in vivo fluorescence over time, allowing minimally invasive assessment of construct expression in the intact brain. We present a set of optogenetic tools designed for optogenetic experiments in the non-human primate brain.

A high-performance neural prosthesis enabled by control algorithm design

Neural prostheses translate neural activity from the brain into control signals for guiding prosthetic devices, such as computer cursors and robotic limbs, and thus offer individuals with disabilities greater interaction with the world. However, relatively low performance remains a critical barrier to successful clinical translation; current neural prostheses are considerably slower, with less accurate control, than the native arm. Here we present a new control algorithm, the recalibrated feedback intention–trained Kalman filter (ReFIT-KF) that incorporates assumptions about the nature of closed-loop neural prosthetic control. When tested in rhesus monkeys implanted with motor cortical electrode arrays, the ReFIT-KF algorithm outperformed existing neural prosthetic algorithms in all measured domains and halved target acquisition time. This control algorithm permits sustained, uninterrupted use for hours and generalizes to more challenging tasks without retraining. Using this algorithm, we demonstrate repeatable high performance for years after implantation in two monkeys, thereby increasing the clinical viability of neural prostheses.

Long-term stability of neural prosthetic control signals from silicon cortical arrays in rhesus macaque motor cortex

Cortically-controlled prosthetic systems aim to help disabled patients by translating neural signals from the brain into control signals for guiding prosthetic devices. Recent reports have demonstrated reasonably high levels of performance and control of computer cursors and prosthetic limbs, but to achieve true clinical viability, the long-term operation of these systems must be better understood. In particular, the quality and stability of the electrically-recorded neural signals require further characterization. Here, we quantify action potential changes and offline neural decoder performance over 382 days of recording from four intracortical arrays in three animals. Action potential amplitude decreased by 2.4% per month on average over the course of 9.4, 10.4, and 31.7 months in three animals. During most time periods, decoder performance was not well correlated with action potential amplitude (p > 0.05 for three of four arrays). In two arrays from one animal, action potential amplitude declined by an average of 37% over the first 2 months after implant. However, when using simple threshold-crossing events rather than well-isolated action potentials, no corresponding performance loss was observed during this time using an offline decoder. One of these arrays was effectively used for online prosthetic experiments over the following year. Substantial short-term variations in waveforms were quantified using a wireless system for contiguous recording in one animal, and compared within and between days for all three animals. Overall, this study suggests that action potential amplitude declines more slowly than previously supposed, and performance can be maintained over the course of multiple years when decoding from threshold-crossing events rather than isolated action potentials. This suggests that neural prosthetic systems may provide high performance over multiple years in human clinical trials.

A category-free neural population supports evolving demands during decision-making

The posterior parietal cortex (PPC) receives diverse inputs and is involved in a dizzying array of behaviors. These many behaviors could rely on distinct categories of neurons specialized to represent particular variables or could rely on a single population of PPC neurons that is leveraged in different ways. To distinguish these possibilities, we evaluated rat PPC neurons recorded during multisensory decisions. Newly designed tests revealed that task parameters and temporal response features were distributed randomly across neurons, without evidence of categories. This suggests that PPC neurons constitute a dynamic network that is decoded according to the animals present needs. To test for an additional signature of a dynamic network, we compared moments when behavioral demands differed: decision and movement. Our new state-space analysis revealed that the network explored different dimensions during decision and movement. These observations suggest that a single network of neurons can support the evolving behavioral demands of decision-making.

A neural network that finds a naturalistic solution for the production of muscle activity

It remains an open question how neural responses in motor cortex relate to movement. We explored the hypothesis that motor cortex reflects dynamics appropriate for generating temporally patterned outgoing commands. To formalize this hypothesis, we trained recurrent neural networks to reproduce the muscle activity of reaching monkeys. Models had to infer dynamics that could transform simple inputs into temporally and spatially complex patterns of muscle activity. Analysis of trained models revealed that the natural dynamical solution was a low-dimensional oscillator that generated the necessary multiphasic commands. This solution closely resembled, at both the single-neuron and population levels, what was observed in neural recordings from the same monkeys. Notably, data and simulations agreed only when models were optimized to find simple solutions. An appealing interpretation is that the empirically observed dynamics of motor cortex may reflect a simple solution to the problem of generating temporally patterned descending commands.

A dynamical systems view of motor preparation: implications for neural prosthetic system design.

Neural prosthetic systems aim to help disabled patients suffering from a range of neurological injuries and disease by using neural activity from the brain to directly control assistive devices. This approach in effect bypasses the dysfunctional neural circuitry, such as an injured spinal cord. To do so, neural prostheses depend critically on a scientific understanding of the neural activity that drives them. We review here several recent studies aimed at understanding the neural processes in premotor cortex that precede arm movements and lead to the initiation of movement. These studies were motivated by hypotheses and predictions conceived of within a dynamical systems perspective. This perspective concentrates on describing the neural state using as few degrees of freedom as possible and on inferring the rules that govern the motion of that neural state. Although quite general, this perspective has led to a number of specific predictions that have been addressed experimentally. It is hoped that the resulting picture of the dynamical role of preparatory and movement-related neural activity will be particularly helpful to the development of neural prostheses, which can themselves be viewed as dynamical systems under the control of the larger dynamical system to which they are attached.

Posterior parietal cortex guides visual decisions in rats

Neurons in putative decision-making structures can reflect both sensory and decision signals, making their causal role in decisions unclear. Here, we tested whether rat posterior parietal cortex (PPC) is causal for processing visual sensory signals or instead for accumulating evidence for decision alternatives. We disrupted PPC activity optogenetically during decision making and compared effects on decisions guided by auditory versus visual evidence. Deficits were largely restricted to visual decisions. To further test for visual dominance in PPC, we evaluated electrophysiological responses after individual sensory events and observed much larger response modulation after visual stimuli than auditory stimuli. Finally, we measured trial-to-trial spike count variability during stimulus presentation and decision formation. Variability decreased sharply, suggesting that the network is stabilized by inputs, unlike what would be expected if sensory signals were locally accumulated. Our findings suggest that PPC plays a causal role in processing visual signals that are accumulated elsewhere. SIGNIFICANCE STATEMENT Defining the neural circuits that support decision making bridges a gap between our understanding of simple sensorimotor reflexes and our understanding of truly complex behavior. However, identifying brain areas that play a causal role in decision making has proved challenging. We tested the causal role of a candidate component of decision circuits, the rat posterior parietal cortex (PPC). Our interpretation of the data benefited from our use of animals trained to make decisions guided by either visual or auditory evidence. Our results suggest that PPC plays a causal role specifically in visual decision making and may support sensory aspects of the decision, such as interpreting the visual signals so that evidence for a decision can be accumulated elsewhere.

Reorganization between preparatory and movement population responses in motor cortex.

Neural populations can change the computation they perform on very short timescales. Although such flexibility is common, the underlying computational strategies at the population level remain unknown. To address this gap, we examined population responses in motor cortex during reach preparation and movement. We found that there exist exclusive and orthogonal population-level subspaces dedicated to preparatory and movement computations. This orthogonality yielded a reorganization in response correlations: the set of neurons with shared response properties changed completely between preparation and movement. Thus, the same neural population acts, at different times, as two separate circuits with very different properties. This finding is not predicted by existing motor cortical models, which predict overlapping preparation-related and movement-related subspaces. Despite orthogonality, responses in the preparatory subspace were lawfully related to subsequent responses in the movement subspace. These results reveal a population-level strategy for performing separate but linked computations.