Ayse Yarali

A rift between implicit and explicit conditioned valence in human pain relief learning

Pain is aversive, but does the cessation of pain (‘relief’) have a reward-like effect? Indeed, fruitflies avoid an odour previously presented before a painful event, but approach an odour previously presented after a painful event. Thus, event-timing may turn punishment to reward. However, is event-timing also crucial in humans who can have explicit cognitions about associations? Here, we show that stimuli associated with pain-relief acquire positive implicit valence but are explicitly rated as aversive. Specifically, the startle response, an evolutionarily conserved defence reflex, is attenuated by stimuli that had previously followed a painful event, indicating implicit positive valence of the conditioned stimulus; nevertheless, participants explicitly evaluate these stimuli as ‘emotionally negative’. These results demonstrate a rift between the implicit and explicit conditioned valence induced by pain relief. They might explain why humans in some cases are attracted by conditioned stimuli despite explicitly judging them as negative.

Behavioral Analyses of Sugar Processing in Choice, Feeding, and Learning in Larval Drosophila

Gustatory stimuli have at least 2 kinds of function: They can support immediate, reflexive responses (such as substrate choice and feeding) and they can drive internal reinforcement. We provide behavioral analyses of these functions with respect to sweet taste in larval Drosophila. The idea is to use the dose–effect characteristics as behavioral “fingerprints” to dissociate reflexive and reinforcing functions. For glucose and trehalose, we uncover relatively weak preference. In contrast, for fructose and sucrose, preference responses are strong and the effects on feeding pronounced. Specifically, larvae are attracted to, and feeding is stimulated most strongly for, intermediate concentrations of either sugar: Using very high concentrations (4 M) results in weakened preference and suppression of feeding. In contrast to such an optimum function regarding choice and feeding, an asymptotic dose–effect function is found for reinforcement learning: Learning scores reach asymptote at 2 M and remain stable for a 4-M concentration. A similar parametric discrepancy between the reflexive (choice and feeding) and reinforcing function is also seen for sodium chloride (Niewalda T, Singhal S, Fiala A, Saumweber T, Wegener S, Gerber B, in preparation). We discuss whether these discrepancies are based either on inhibition from high-osmolarity sensors upon specifically the reflexive pathways or whether different sensory pathways, with different effective dose–response characteristics, may have preferential access to drive either reflex responses or modulatory neurons mediating internal reinforcement, respectively.

Genetic Distortion of the Balance between Punishment and Relief Learning in Drosophila

Abstract: An experience with electric shock can support two opposing kinds of behavioral effects: Stimuli that precede shock during training are subsequently avoided as predictors for punishment, whereas stimuli that follow shock during training are later on approached, as they predict relief. We show here, for the fruit fly Drosophila, that upon the loss of white-function, the balance between these two kinds of learning is distorted in favor of punishment learning: white1118 mutants show stronger punishment learning and weaker relief learning, as compared to wild type flies. Thus, white1118 mutants establish, overall, more “negative” memories for the shock experience. This only concerns the mnemonic effects of the shock; the immediate, reflexive responsiveness to shock remains unaltered. Also, learning about reward is apparently unaffected, both in adult and larval Drosophila. Prompted by the proposed function of the White protein as the transporter for biogenic amine precursors, we probed the brains of white1118 mutants for the amounts of biogenic amines (octopamine, tyramine, dopamine, and serotonin) by using high-perssure liquid chromatography coupled to mass spectrometry. Using this method, we found, however, no difference between white1118 and wild type files for any of the probed amines. In any event, analyses of how the white1118 mutation affects the balance between punishment and relief learning should provide a study case of how heritable distortions of such balance can come about. Finally, the effects of the white1118 mutation should be considered as a source of confound when using white as the “marker gene” in behavior-genetic analyses of any sort.

A Neurogenetic Dissociation between Punishment-, Reward-, and Relief-Learning in Drosophila

What is particularly worth remembering about a traumatic experience is what brought it about, and what made it cease. For example, fruit flies avoid an odor which during training had preceded electric shock punishment; on the other hand, if the odor had followed shock during training, it is later on approached as a signal for the relieving end of shock. We provide a neurogenetic analysis of such relief learning. Blocking, using UAS-shibirets1, the output from a particular set of dopaminergic neurons defined by the TH-Gal4 driver partially impaired punishment learning, but left relief learning intact. Thus, with respect to these particular neurons, relief learning differs from punishment learning. Targeting another set of dopaminergic/serotonergic neurons defined by the DDC-Gal4 driver on the other hand affected neither punishment nor relief learning. As for the octopaminergic system, the tbhM18 mutation, compromising octopamine biosynthesis, partially impaired sugar-reward learning, but not relief learning. Thus, with respect to this particular mutation, relief learning, and reward learning are dissociated. Finally, blocking output from the set of octopaminergic/tyraminergic neurons defined by the TDC2-Gal4 driver affected neither reward, nor relief learning. We conclude that regarding the used genetic tools, relief learning is neurogenetically dissociated from both punishment and reward learning. This may be a message relevant also for analyses of relief learning in other experimental systems including man.

Olfactory learning and behaviour are ‘insulated’ against visual processing in larval Drosophila

We investigate the organization of behaviour across sensory modalities, using larval Drosophila melanogaster. We ask whether olfactory learning and behaviour are affected by visual processing. We find that: (1) Visual choice does not affect concomitant odour choice. (2) Visual context does not influence odour learning, nor do changes of visual context between training and test affect retrieval of odour memory. (3) Larvae cannot solve a biconditional discrimination task, despite generally permissive conditions. In this task, larvae are required to establish conditional associations: in light, one odour is rewarded and the other one is not, whereas in dark the opposite contingency is established. After such training, choice between the two odours is equal under light and dark testing conditions, suggesting that larvae do not establish odour memories specifically for one visual context only. Together, these data suggest that, in larval Drosophila, olfactory learning and behaviour are ‘insulated’ against visual processing.

Event Timing in Associative Learning: From Biochemical Reaction Dynamics to Behavioural Observations

Associative learning relies on event timing. Fruit flies for example, once trained with an odour that precedes electric shock, subsequently avoid this odour (punishment learning); if, on the other hand the odour follows the shock during training, it is approached later on (relief learning). During training, an odour-induced Ca++ signal and a shock-induced dopaminergic signal converge in the Kenyon cells, synergistically activating a Ca++-calmodulin-sensitive adenylate cyclase, which likely leads to the synaptic plasticity underlying the conditioned avoidance of the odour. In Aplysia, the effect of serotonin on the corresponding adenylate cyclase is bi-directionally modulated by Ca++, depending on the relative timing of the two inputs. Using a computational approach, we quantitatively explore this biochemical property of the adenylate cyclase and show that it can generate the effect of event timing on associative learning. We overcome the shortage of behavioural data in Aplysia and biochemical data in Drosophila by combining findings from both systems.

Reversing Stimulus Timing in Visual Conditioning Leads to Memories with Opposite Valence in Drosophila

Animals need to associate different environmental stimuli with each other regardless of whether they temporally overlap or not. Drosophila melanogaster displays olfactory trace conditioning, where an odor is followed by electric shock reinforcement after a temporal gap, leading to conditioned odor avoidance. Reversing the stimulus timing in olfactory conditioning results in the reversal of memory valence such that an odor that follows shock is later on approached (i.e. relief conditioning). Here, we explored the effects of stimulus timing on memory in another sensory modality, using a visual conditioning paradigm. We found that flies form visual memories of opposite valence depending on stimulus timing and can associate a visual stimulus with reinforcement despite being presented with a temporal gap. These results suggest that associative memories with non-overlapping stimuli and the effect of stimulus timing on memory valence are shared across sensory modalities.

Olfactory memories are intensity specific in larval Drosophila

SUMMARY Learning can rely on stimulus quality, stimulus intensity, or a combination of these. Regarding olfaction, the coding of odour quality is often proposed to be combinatorial along the olfactory pathway, and working hypotheses are available concerning short-term associative memory trace formation of odour quality. However, it is less clear how odour intensity is coded, and whether olfactory memory traces include information about the intensity of the learnt odour. Using odour–sugar associative conditioning in larval Drosophila, we first describe the dose–effect curves of learnability across odour intensities for four different odours (n-amyl acetate, 3-octanol, 1-octen-3-ol and benzaldehyde). We then chose odour intensities such that larvae were trained at an intermediate odour intensity, but were tested for retention with either that trained intermediate odour intensity, or with respectively higher or lower intensities. We observed a specificity of retention for the trained intensity for all four odours used. This adds to the appreciation of the richness in ‘content’ of olfactory short-term memory traces, even in a system as simple as larval Drosophila, and to define the demands on computational models of associative olfactory memory trace formation. We suggest two kinds of circuit architecture that have the potential to accommodate intensity learning, and discuss how they may be implemented in the insect brain.

Memory decay and susceptibility to amnesia dissociate punishment- from relief-learning

Painful events shape future behaviour in two ways: stimuli associated with pain onset subsequently support learned avoidance (i.e. punishment-learning) because they signal future, upcoming pain. Stimuli associated with pain offset in turn signal relief and later on support learned approach (i.e. relief-learning). The relative strengths of such punishment- and relief-learning can be crucial for the adaptive organization of behaviour in the aftermath of painful events. Using Drosophila, we compare punishment- and relief-memories in terms of their temporal decay and sensitivity to retrograde amnesia. During the first 75 min following training, relief-memory is stable, whereas punishment-memory decays to half of the initial score. By 24 h after training, however, relief-memory is lost, whereas a third of punishment-memory scores still remain. In accordance with such rapid temporal decay from 75 min on, retrograde amnesia erases relief-memory but leaves a half of punishment-memory scores intact. These findings suggest differential mechanistic bases for punishment- and relief-memory, thus offering possibilities for separately interfering with either of them.

Genome-Wide Association Analyses Point to Candidate Genes for Electric Shock Avoidance in Drosophila melanogaster.

Electric shock is a common stimulus for nociception-research and the most widely used reinforcement in aversive associative learning experiments. Yet, nothing is known about the mechanisms it recruits at the periphery. To help fill this gap, we undertook a genome-wide association analysis using 38 inbred Drosophila melanogaster strains, which avoided shock to varying extents. We identified 514 genes whose expression levels and/ or sequences co-varied with shock avoidance scores. We independently scrutinized 14 of these genes using mutants, validating the effect of 7 of them on shock avoidance. This emphasizes the value of our candidate gene list as a guide for follow-up research. In addition, by integrating our association results with external protein-protein interaction data we obtained a shock avoidance-associated network of 38 genes. Both this network and the original candidate list contained a substantial number of genes that affect mechanosensory bristles, which are hair-like organs distributed across the fly’s body. These results may point to a potential role for mechanosensory bristles in shock sensation. Thus, we not only provide a first list of candidate genes for shock avoidance, but also point to an interesting new hypothesis on nociceptive mechanisms.