Jeff A. Beeler

Exercise-enhanced neuroplasticity targeting motor and cognitive circuitry in Parkinson's disease

Exercise interventions in individuals with Parkinsons disease incorporate goal-based motor skill training to engage cognitive circuitry important in motor learning. With this exercise approach, physical therapy helps with learning through instruction and feedback (reinforcement) and encouragement to perform beyond self-perceived capability. Individuals with Parkinsons disease become more cognitively engaged with the practice and learning of movements and skills that were previously automatic and unconscious. Aerobic exercise, regarded as important for improvement of blood flow and facilitation of neuroplasticity in elderly people, might also have a role in improvement of behavioural function in individuals with Parkinsons disease. Exercises that incorporate goal-based training and aerobic activity have the potential to improve both cognitive and automatic components of motor control in individuals with mild to moderate disease through experience-dependent neuroplasticity. Basic research in animal models of Parkinsons disease is beginning to show exercise-induced neuroplastic effects at the level of synaptic connections and circuits.

Dopamine Scales Performance in the Absence of New Learning

Learning and motivation are integral in shaping an organisms adaptive behavior. The dopamine system has been implicated in both processes; however, dissociating the two, both experimentally and conceptually, has posed significant challenges. We have developed an animal model that dissociates expression or scaling of a learned behavior from learning itself. An inducible dopamine transporter (DAT) knockdown mouse line has been generated, which exhibits significantly slower reuptake of released dopamine and increased tonic firing of dopamine neurons without altering phasic burst firing. Mice were trained in experimental tasks prior to inducing a hyperdopaminergic tone and then retested. Elevated dopamine enhanced performance in goal-directed operant responses. These data demonstrate that alterations in dopaminergic tone can scale the performance of a previously learned behavior in the absence of new learning.

Tonic Dopamine Modulates Exploitation of Reward Learning

The impact of dopamine on adaptive behavior in a naturalistic environment is largely unexamined. Experimental work suggests that phasic dopamine is central to reinforcement learning whereas tonic dopamine may modulate performance without altering learning per se; however, this idea has not been developed formally or integrated with computational models of dopamine function. We quantitatively evaluate the role of tonic dopamine in these functions by studying the behavior of hyperdopaminergic DAT knockdown mice in an instrumental task in a semi-naturalistic homecage environment. In this “closed economy” paradigm, subjects earn all of their food by pressing either of two levers, but the relative cost for food on each lever shifts frequently. Compared to wild-type mice, hyperdopaminergic mice allocate more lever presses on high-cost levers, thus working harder to earn a given amount of food and maintain their body weight. However, both groups show a similarly quick reaction to shifts in lever cost, suggesting that the hyperdominergic mice are not slower at detecting changes, as with a learning deficit. We fit the lever choice data using reinforcement learning models to assess the distinction between acquisition and expression the models formalize. In these analyses, hyperdopaminergic mice displayed normal learning from recent reward history but diminished capacity to exploit this learning: a reduced coupling between choice and reward history. These data suggest that dopamine modulates the degree to which prior learning biases action selection and consequently alters the expression of learned, motivated behavior.

Dopamine-Dependent Motor Learning Insight into Levodopa’s Long-Duration Response

Dopamine (DA) is critical for motor performance, motor learning, and corticostriatal plasticity. The relationship between motor performance and learning, and the role of DA in the mediation of them, however, remain unclear.

Adenylyl Cyclase Type 5 Contributes to Corticostriatal Plasticity and Striatum-Dependent Learning

Dopamine (DA)-dependent corticostriatal plasticity is thought to underlie incremental procedural learning. A primary effector of striatal DA signaling is cAMP, yet its role in corticostriatal plasticity and striatum-dependent learning remains unclear. Here, we show that genetic deletion of a striatum-enriched isoform of adenylyl cyclase, AC5 knock-out (AC5KO), impairs two forms of striatum-dependent learning and corticostriatal synaptic plasticity. AC5KO mice were severely impaired in acquisition of a response strategy in the cross maze, a striatum-dependent task requiring a correct body turn to find a goal arm. In addition, AC5KO mice were impaired in acquisition of a motor skill, as assessed by the accelerated rotarod. Slice electrophysiology revealed a deficit in corticostriatal long-term depression (LTD) after high-frequency stimulation of tissue from AC5KO mice. LTD was rescued by activation of either presynaptic cannabinoid type 1 (CB1) receptors or postsynaptic metabotropic glutamate receptors (mGluRs), suggesting a postsynaptic role of AC5–cAMP, upstream of endocannabinoid release. In striatopallidal-projecting medium spiny neurons, DA D2 receptors are negatively coupled to cAMP production, and activation of these receptors is required for endocannabinoid release and corticostriatal LTD. Recordings from striatopallidal neurons indicated that this is mediated by AC5, because coactivation of D2 and mGluRs could induce LTD in wild-type but not in AC5KO neurons. To further examine the role of cAMP in corticostriatal plasticity, we elevated cAMP in striatal neurons of wild-type mice via the recording electrode. Under these conditions, corticostriatal LTD was eliminated. Together, these data suggest an AC5–cAMP–endocannabinoid–CB1 signaling pathway in corticostriatal plasticity and striatum-dependent learning.

Sucrose-predictive cues evoke greater phasic dopamine release than saccharin-predictive cues.

Cues that have been paired with food evoke dopamine in nucleus accumbens (NAc) and drive approach behavior. This cue‐evoked dopamine signaling could contribute to overconsumption of food. One manner in which individuals try to restrict caloric intake is through the consumption of foods containing artificial (non‐nutritive) sweeteners. We were interested in whether cues paired with a non‐nutritive sweetener (saccharin) would evoke similar dopamine release as cues paired with a nutritive sweetener (sucrose). We trained food‐restricted rats to associate distinct cues with sucrose or saccharin pellets. In the first group of rats, training sessions with each pellet took place on different days, maximizing the opportunity for rats to detect nutritional differences. After training, voltammetry recordings in NAc core revealed that sucrose cues evoked greater phasic dopamine release than saccharin cues. In a second group of rats, on each training day, sucrose and saccharin pellets were presented in pseudorandom order within the same session, to mask nutritional differences. In this condition, the difference in dopamine between sucrose and saccharin cues was attenuated, but not abolished. These results suggest that sucrose‐paired cues will more powerfully motivate behavior than saccharin‐paired cues. The differing responses to each cue seem to be driven by overall preference with both the nutritional value that the pellets predict as well as other factors, such as taste, contributing. Synapse 2012.

Putting desire on a budget: dopamine and energy expenditure, reconciling reward and resources

Accumulating evidence indicates integration of dopamine function with metabolic signals, highlighting a potential role for dopamine in energy balance, frequently construed as modulating reward in response to homeostatic state. Though its precise role remains controversial, the reward perspective of dopamine has dominated investigation of motivational disorders, including obesity. In the hypothesis outlined here, we suggest instead that the primary role of dopamine in behavior is to modulate activity to adapt behavioral energy expenditure to the prevailing environmental energy conditions, with the role of dopamine in reward and motivated behaviors derived from its primary role in energy balance. Dopamine has long been known to modulate activity, exemplified by psychostimulants that act via dopamine. More recently, there has been nascent investigation into the role of dopamine in modulating voluntary activity, with some investigators suggesting that dopamine may serve as a final common pathway that couples energy sensing to regulated voluntary energy expenditure. We suggest that interposed between input from both the internal and external world, dopamine modulates behavioral energy expenditure along two axes: a conserve-expend axis that regulates generalized activity and an explore-exploit axes that regulates the degree to which reward value biases the distribution of activity. In this view, increased dopamine does not promote consumption of tasty food. Instead increased dopamine promotes energy expenditure and exploration while decreased dopamine favors energy conservation and exploitation. This hypothesis provides a mechanistic interpretation to an apparent paradox: the well-established role of dopamine in food seeking and the findings that low dopaminergic functions are associated with obesity. Our hypothesis provides an alternative perspective on the role of dopamine in obesity and reinterprets the “reward deficiency hypothesis” as a perceived energy deficit. We propose that dopamine, by facilitating energy expenditure, should be protective against obesity. We suggest the apparent failure of this protective mechanism in Western societies with high prevalence of obesity arises as a consequence of sedentary lifestyles that thwart energy expenditure.

Taste uncoupled from nutrition fails to sustain the reinforcing properties of food

Recent findings suggest the reward system encodes metabolic value independent of taste, provoking speculation that the hedonic value of taste could be derived from nutritional value as a secondary appetitive property. We therefore dissociated and compared the impact of nutrition and taste on appetitive behavior in several paradigms. Though taste alone induces preference and increased consumption, in the absence of nutritional value its reinforcing properties are greatly diminished and it does not, like sucrose, induce increased responding over time. In agreement with behavioral data, saccharin‐evoked (but not sucrose‐evoked) dopamine release is greatly attenuated following pre‐exposure, suggesting that nutritional value is critical for dopamine‐mediated reward and reinforcement. Further supporting the primacy of nutrition over taste, genetically increased dopaminergic tone enhances incentive associated with nutritional value with minimal impact on taste‐based, hedonic incentive. Overall, we suggest that the sensory‐hedonic incentive value associated with taste functions as a conditioned stimulus that requires nutritional value to sustainably organize appetitive behavior.

A Role for Dopamine-Mediated Learning in the Pathophysiology and Treatment of Parkinson’s Disease

Dopamine contributes to corticostriatal plasticity and motor learning. Dopamine denervation profoundly alters motor performance, as in Parkinsons disease (PD); however, the extent to which these symptoms reflect impaired motor learning is unknown. Here, we demonstrate a D2 receptor blockade-induced aberrant learning that impedes future motor performance when dopamine signaling is restored, an effect diminished by coadministration of adenosine antagonists during blockade. We hypothesize that an inappropriate corticostriatal potentiation in striatopallidal cells of the indirect pathway underlies aberrant learning. We demonstrate synaptic potentiation in striatopallidal neurons induced by D2 blockade and diminished by application of an adenosine antagonist, consistent with behavioral observations. A neurocomputational model of the basal ganglia recapitulates the behavioral pattern and further links aberrant learning to plasticity in the indirect pathway. Thus, D2-mediated aberrant learning may contribute to motor deficits in PD, suggesting new avenues for the development of therapeutics.

Sucrose Exposure in Early Life Alters Adult Motivation and Weight Gain

The cause of the current increase in obesity in westernized nations is poorly understood but is frequently attributed to a ‘thrifty genotype,’ an evolutionary predisposition to store calories in times of plenty to protect against future scarcity. In modern, industrialized environments that provide a ready, uninterrupted supply of energy-rich foods at low cost, this genetic predisposition is hypothesized to lead to obesity. Children are also exposed to this ‘obesogenic’ environment; however, whether such early dietary experience has developmental effects and contributes to adult vulnerability to obesity is unknown. Using mice, we tested the hypothesis that dietary experience during childhood and adolescence affects adult obesity risk. We gave mice unlimited or no access to sucrose for a short period post-weaning and measured sucrose-seeking, food consumption, and weight gain in adulthood. Unlimited access to sucrose early in life reduced sucrose-seeking when work was required to obtain it. When high-sugar/high-fat dietary options were made freely-available, however, the sucrose-exposed mice gained more weight than mice without early sucrose exposure. These results suggest that early, unlimited exposure to sucrose reduces motivation to acquire sucrose but promotes weight gain in adulthood when the cost of acquiring palatable, energy dense foods is low. This study demonstrates that early post-weaning experience can modify the expression of a ‘thrifty genotype’ and alter an adult animals response to its environment, a finding consistent with evidence of pre- and peri-natal programming of adult obesity risk by maternal nutritional status. Our findings suggest the window for developmental effects of diet may extend into childhood, an observation with potentially important implications for both research and public policy in addressing the rising incidence of obesity.