Bertram Gerber

Light-induced activation of distinct modulatory neurons triggers appetitive or aversive learning in Drosophila larvae

During classical conditioning, a positive or negative value is assigned to a previously neutral stimulus, thereby changing its significance for behavior. If an odor is associated with a negative stimulus, it can become repulsive. Conversely, an odor associated with a reward can become attractive. By using Drosophila larvae as a model system with minimal brain complexity, we address the question of which neurons attribute these values to odor stimuli. In insects, dopaminergic neurons are required for aversive learning, whereas octopaminergic neurons are necessary and sufficient for appetitive learning. However, it remains unclear whether two independent neuronal populations are sufficient to mediate such antagonistic values. We report the use of transgenically expressed channelrhodopsin-2, a light-activated cation channel, as a tool for optophysiological stimulation of genetically defined neuronal populations in Drosophila larvae. We demonstrate that distinct neuronal populations can be activated simply by illuminating the animals with blue light. Light-induced activation of dopaminergic neurons paired with an odor stimulus induces aversive memory formation, whereas activation of octopaminergic/tyraminergic neurons induces appetitive memory formation. These findings demonstrate that antagonistic modulatory subsystems are sufficient to substitute for aversive and appetitive reinforcement during classical conditioning.

An engram found? Evaluating the evidence from fruit flies

Is it possible to localize a memory trace to a subset of cells in the brain? If so, it should be possible to show: first, that neuronal plasticity occurs in these cells. Second, that neuronal plasticity in these cells is sufficient for memory. Third, that neuronal plasticity in these cells is necessary for memory. Fourth, that memory is abolished if these cells cannot provide output during testing. And fifth, that memory is abolished if these cells cannot receive input during training. With regard to olfactory learning in flies, we argue that the notion of the olfactory memory trace being localized to the Kenyon cells of the mushroom bodies is a reasonable working hypothesis.

Experimental psychology: event timing turns punishment to reward.

Can relief from pain be a pleasure? If so, noxious events should — despite their typically aversive effects — also have a ‘rewarding’ after-effect. Through training fruitflies by using an electric shock paired with an odour, we show here that the shock can condition either avoidance of this odour or approach to it. These opposing behaviours depend on the relative timing of the shock and odour presentations during training, and indicate that a shock can act as either an aversive reinforcer or an appetitive one.

A rift between implicit and explicit conditioned valence in human pain relief learning

Pain is aversive, but does the cessation of pain (‘relief’) have a reward-like effect? Indeed, fruitflies avoid an odour previously presented before a painful event, but approach an odour previously presented after a painful event. Thus, event-timing may turn punishment to reward. However, is event-timing also crucial in humans who can have explicit cognitions about associations? Here, we show that stimuli associated with pain-relief acquire positive implicit valence but are explicitly rated as aversive. Specifically, the startle response, an evolutionarily conserved defence reflex, is attenuated by stimuli that had previously followed a painful event, indicating implicit positive valence of the conditioned stimulus; nevertheless, participants explicitly evaluate these stimuli as ‘emotionally negative’. These results demonstrate a rift between the implicit and explicit conditioned valence induced by pain relief. They might explain why humans in some cases are attracted by conditioned stimuli despite explicitly judging them as negative.

Behavioral Analyses of Sugar Processing in Choice, Feeding, and Learning in Larval Drosophila

Gustatory stimuli have at least 2 kinds of function: They can support immediate, reflexive responses (such as substrate choice and feeding) and they can drive internal reinforcement. We provide behavioral analyses of these functions with respect to sweet taste in larval Drosophila. The idea is to use the dose–effect characteristics as behavioral “fingerprints” to dissociate reflexive and reinforcing functions. For glucose and trehalose, we uncover relatively weak preference. In contrast, for fructose and sucrose, preference responses are strong and the effects on feeding pronounced. Specifically, larvae are attracted to, and feeding is stimulated most strongly for, intermediate concentrations of either sugar: Using very high concentrations (4 M) results in weakened preference and suppression of feeding. In contrast to such an optimum function regarding choice and feeding, an asymptotic dose–effect function is found for reinforcement learning: Learning scores reach asymptote at 2 M and remain stable for a 4-M concentration. A similar parametric discrepancy between the reflexive (choice and feeding) and reinforcing function is also seen for sodium chloride (Niewalda T, Singhal S, Fiala A, Saumweber T, Wegener S, Gerber B, in preparation). We discuss whether these discrepancies are based either on inhibition from high-osmolarity sensors upon specifically the reflexive pathways or whether different sensory pathways, with different effective dose–response characteristics, may have preferential access to drive either reflex responses or modulatory neurons mediating internal reinforcement, respectively.

The complete connectome of a learning and memory centre in an insect brain

Associating stimuli with positive or negative reinforcement is essential for survival, but a complete wiring diagram of a higher-order circuit supporting associative memory has not been previously available. Here we reconstruct one such circuit at synaptic resolution, the Drosophila larval mushroom body. We find that most Kenyon cells integrate random combinations of inputs but that a subset receives stereotyped inputs from single projection neurons. This organization maximizes performance of a model output neuron on a stimulus discrimination task. We also report a novel canonical circuit in each mushroom body compartment with previously unidentified connections: reciprocal Kenyon cell to modulatory neuron connections, modulatory neuron to output neuron connections, and a surprisingly high number of recurrent connections between Kenyon cells. Stereotyped connections found between output neurons could enhance the selection of learned behaviours. The complete circuit map of the mushroom body should guide future functional studies of this learning and memory centre.

Salt Processing in Larval Drosophila: Choice, Feeding, and Learning Shift from Appetitive to Aversive in a Concentration-Dependent Way

Sodium and chloride need to be ingested and cannot be stored. Therefore, choice of habitat and diet as related to NaCl needs to be tightly regulated. We thus expect that the behavioral effects of salt are organized according to its concentration. Here, we comparatively “fingerprint” the reflex releasing (in choice and feeding experiments) versus the reinforcing effects of sodium chloride (“salt”) in terms of their concentration dependencies, using larval Drosophila. Qualitatively, we find that the behavioral effects of salt in all 3 assays are similar: choice, feeding, and reinforcing effect all change from appetitive to aversive as concentration is increased. Quantitatively, however, the appetitive effects for choice and feeding share their optimum at around 0.02 M, whereas the dose–response curve for the reinforcing effect is shifted by more than one order of magnitude toward higher concentrations. Interestingly, a similar shift between these 2 kinds of behavioral effect is also found for sugars (Schipanski et al. 2008). Thus, for salt and for sugar, the sensory-to-motor system is more sensitive regarding immediate, reflexive behavior than regarding reinforcement. We speculate that this may partially be due to a dissociation of the sensory pathways signaling toward either reflexive behavior or internal reinforcement.

Synapsin is selectively required for anesthesia-sensitive memory

Odor-shock memory in Drosophila melanogaster consists of heterogeneous components each with different dynamics. We report that a null mutant for the evolutionarily conserved synaptic protein Synapsin entails a memory deficit selectively in early memory, leaving later memory as well as sensory motor function unaffected. Notably, a consolidated memory component remaining after cold-anesthesia is not impaired, suggesting that only anesthesia-sensitive memory [ASM] depends on Synapsin. The lack of Synapsin does not further impair the memory deficit of mutants for the rutabaga gene encoding the type I adenylyl cyclase. This suggests that cAMP signaling, through a Synapsin-dependent mechanism, may underlie the formation of a labile memory component.

Maggot learning and Synapsin function.

Summary Drosophila larvae are focused on feeding and have few neurons. Within these bounds, however, there still are behavioural degrees of freedom. This review is devoted to what these elements of flexibility are, and how they come about. Regarding odour–food associative learning, the emerging working hypothesis is that when a mushroom body neuron is activated as a part of an odour-specific set of mushroom body neurons, and coincidently receives a reinforcement signal carried by aminergic neurons, the AC-cAMP-PKA cascade is triggered. One substrate of this cascade is Synapsin, and therefore this review features a general and comparative discussion of Synapsin function. Phosphorylation of Synapsin ensures an alteration of synaptic strength between this mushroom body neuron and its target neuron(s). If the trained odour is encountered again, the pattern of mushroom body neurons coding this odour is activated, such that their modified output now allows conditioned behaviour. However, such an activated memory trace does not automatically cause conditioned behaviour. Rather, in a process that remains off-line from behaviour, the larvae compare the value of the testing situation (based on gustatory input) with the value of the odour-activated memory trace (based on mushroom body output). The circuit towards appetitive conditioned behaviour is closed only if the memory trace suggests that tracking down the learned odour will lead to a place better than the current one. It is this expectation of a positive outcome that is the immediate cause of appetitive conditioned behaviour. Such conditioned search for reward corresponds to a view of aversive conditioned behaviour as conditioned escape from punishment, which is enabled only if there is something to escape from – much in the same way as we only search for things that are not there, and run for the emergency exit only when there is an emergency. One may now ask whether beyond ‘value’ additional information about reinforcement is contained in the memory trace, such as information about the kind and intensity of the reinforcer used. The Drosophila larva may allow us to develop satisfyingly detailed accounts of such mnemonic richness – if it exists.

Genetic Distortion of the Balance between Punishment and Relief Learning in Drosophila

Abstract: An experience with electric shock can support two opposing kinds of behavioral effects: Stimuli that precede shock during training are subsequently avoided as predictors for punishment, whereas stimuli that follow shock during training are later on approached, as they predict relief. We show here, for the fruit fly Drosophila, that upon the loss of white-function, the balance between these two kinds of learning is distorted in favor of punishment learning: white1118 mutants show stronger punishment learning and weaker relief learning, as compared to wild type flies. Thus, white1118 mutants establish, overall, more “negative” memories for the shock experience. This only concerns the mnemonic effects of the shock; the immediate, reflexive responsiveness to shock remains unaltered. Also, learning about reward is apparently unaffected, both in adult and larval Drosophila. Prompted by the proposed function of the White protein as the transporter for biogenic amine precursors, we probed the brains of white1118 mutants for the amounts of biogenic amines (octopamine, tyramine, dopamine, and serotonin) by using high-perssure liquid chromatography coupled to mass spectrometry. Using this method, we found, however, no difference between white1118 and wild type files for any of the probed amines. In any event, analyses of how the white1118 mutation affects the balance between punishment and relief learning should provide a study case of how heritable distortions of such balance can come about. Finally, the effects of the white1118 mutation should be considered as a source of confound when using white as the “marker gene” in behavior-genetic analyses of any sort.