Yukihisa Matsumoto

Participation of octopaminergic reward system and dopaminergic punishment system in insect olfactory learning revealed by pharmacological study

Biogenic amines play major roles in the regulation of behavior in vertebrates and invertebrates. Previous studies in honey bees and fruit‐flies Drosophila suggested that octopamine (OA, invertebrate counterpart of noradrenaline) and dopamine (DA) participate in appetitive olfactory conditioning with sucrose reward and aversive olfactory conditioning with electric shock punishment, respectively. In order to determine whether the effects of the two chatecholamines on electric shock and sugar learning can be generalized to other kinds of appetitive and aversive reinforcers, we studied the effects of OA and DA receptor antagonists on appetitive olfactory learning with water reward, and aversive olfactory learning with saline punishment in the cricket Gryllus bimaculatus. Crickets injected with epinastine or mianserin, OA receptor antagonists, into the hemolymph exhibited an impairment of appetitive learning with water reward, while aversive learning with saline punishment remained intact. In contrast, fluphenazine, chlorpromazine or spiperone, DA receptor antagonists, impaired aversive learning without affecting appetitive learning. This finding, combined with findings in previous studies, suggests that the octopaminergic reward system and dopaminergic punishment system participate in insect olfactory learning with various appetitive and aversive reinforcements.

Roles of octopaminergic and dopaminergic neurons in mediating reward and punishment signals in insect visual learning

Insects, like vertebrates, have considerable ability to associate visual, olfactory or other sensory signals with reward or punishment. Previous studies in crickets, honey bees and fruit‐flies have suggested that octopamine (OA, invertebrate counterpart of noradrenaline) and dopamine (DA) mediate various kinds of reward and punishment signals in olfactory learning. However, whether the roles of OA and DA in mediating positive and negative reinforcing signals can be generalized to learning of sensory signals other than odors remained unknown. Here we first established a visual learning paradigm in which to associate a visual pattern with water reward or saline punishment for crickets and found that memory after aversive conditioning decayed much faster than that after appetitive conditioning. Then, we pharmacologically studied the roles of OA and DA in appetitive and aversive forms of visual learning. Crickets injected with epinastine or mianserin, OA receptor antagonists, into the hemolymph exhibited a complete impairment of appetitive learning to associate a visual pattern with water reward, but aversive learning with saline punishment was unaffected. By contrast, fluphenazine, chlorpromazine or spiperone, DA receptor antagonists, completely impaired aversive learning without affecting appetitive learning. The results demonstrate that OA and DA participate in reward and punishment conditioning in visual learning. This finding, together with results of previous studies on the roles of OA and DA in olfactory learning, suggests ubiquitous roles of the octopaminergic reward system and dopaminergic punishment system in insect learning.

Revisiting olfactory classical conditioning of the proboscis extension response in honey bees: A step toward standardized procedures

The honey bee Apis mellifera has emerged as a robust and influential model for the study of classical conditioning thanks to the existence of a powerful Pavlovian conditioning protocol, the olfactory conditioning of the proboscis extension response (PER). In 2011, the olfactory PER conditioning protocol celebrated its 50 years since it was first introduced by Kimihisa Takeda in 1961. In this protocol, individually harnessed honey bees are trained to associate an odor with sucrose solution. The resulting olfactory learning is fast and induces robust olfactory memories that have been characterized at the behavioral, neuronal and molecular levels. Despite the success of this protocol for studying the bases of learning and memory at these different levels, innumerable procedural variants have arisen throughout the years, which render comparative analyses of behavioral performances difficult. Moreover, because even slight variations in conditioning procedures may introduce significant differences in acquisition and retention performances, we revisit olfactory PER conditioning and define here a standardized framework for experiments using this behavioral protocol. To this end, we present and discuss all the methodological steps and details necessary for successful implementation of olfactory PER conditioning.

Classical Olfactory Conditioning in the Cockroach Periplaneta americana

Abstract We established a classical conditioning procedure for the cockroach, Periplaneta americana, by which odors were associated with reward or punishment. Cockroaches underwent differential conditioning trials in which peppermint odor was associated with sucrose solution and vanilla odor was associated with saline solution. Odor preference of cockroaches was tested by allowing them to choose between peppermint and vanilla sources. Cockroaches that had undergone one set of differential conditioning trials exhibited a significantly greater preference for peppermint odor than did untrained cockroaches. Memory formed by three sets of differential conditioning trials, with an inter-trial interval of 5 min, was retained at least 4 days after conditioning. This conditioning procedure was effective even for cockroaches that had been harnessed in plastic tubes. This study shows, for the first time in hemimetaborous insects, that both freely moving and harnessed insects are capable of forming olfactory memory by classical conditioning procedure. This procedure may be useful for future electrophysiological and pharmacological studies aimed at elucidation of neural mechanisms underlying olfactory learning and memory.

Why the carrot is more effective than the stick: different dynamics of punishment memory and reward memory and its possible biological basis.

One of the most extensively debated topics in educational psychology is whether punishment or reward is more effective for producing short-term and long-term behavioral changes, and it has been proposed that the effect of punishment is less durable than the effect of reward. However, no conclusive evidence to support this proposal has been obtained in any animals. We recently found that punishment memory decayed much faster than reward memory in olfactory learning and visual pattern learning in crickets. We also found that neurotransmitters conveying punishment and reward signals differ in crickets: dopaminergic and octopaminergic neurons play critical roles in conveying punishment and reward signals, respectively. In this study, we investigated whether these features are general features of cricket learning or are specific to olfactory and visual pattern learning. We found that crickets have the capability of color learning and that their color learning has the same features. Based on our findings in crickets and those reported in other species of insects, we conclude that these two features are conserved in many forms of insect learning. In mammals, aminergic neurons are known to convey reward and punishment signals in learning of a variety of sensory stimuli. We propose that the faster decay of punishment memory than reward memory observed in insects and humans reflects different cellular and biochemical processes after activation of receptors for amines conveying punishment and reward signals. The possible adaptive significance of relatively limited durability of punishment memory is proposed.

Systemic RNA interference for the study of learning and memory in an insect.

RNA interference (RNAi) is a powerful technique for the study of molecular mechanisms underlying many biological processes, including brain functions. Among methods for RNAi, systemic administration of double-stranded RNA (systemic RNAi) is the most convenient for basic research as well as medical application, but it has yielded only limited success. To our knowledge, systemic RNAi has not been achieved for the study of learning and memory in any animals. Here we demonstrate successful systemic RNAi of the NOS gene coding for nitric oxide synthase, which, as we previously suggested, plays a critical role in the formation of olfactory long-term memory (LTM), in the nymphal cricket Gryllus bimaculatus. In situ hybridization demonstrated a high level of expression of NOS in a subset of Kenyon cells of the mushroom body, which is known to participate in olfactory learning and memory, in addition to some neurons around the antenna lobe and the base of the optic lobe. Injection of NOS double-stranded RNA (dsRNA) into the haemolymph completely impaired 1-day memory retention, although 30 min retention was unaffected. This impairment was fully rescued by injection of an NO donor, NOR3, thus suggesting that the effect of NOS dsRNA is through inhibition of NOS. Inhibition of NOS had no effects on recall of LTM. The results demonstrate that silencing of NOS expression by systemic RNAi impairs LTM formation. Systemic RNAi will become a useful method for study of the molecular mechanisms of learning and memory.

Time Course of Protein Synthesis-Dependent Phase of Olfactory Memory in the Cricket Gryllus bimaculatus

Abstract The cricket Gryllus bimaculatus forms a stable olfactory memory that lasts for practically a lifetime. As a first step to elucidate the cellular mechanisms of olfactory learning and memory retention in crickets, we studied the dependency of memory retention on the de novo brain protein synthesis by injecting the protein synthesis inhibitor cycloheximide (CHX) into the head capsule. Injection of CHX inhibited 3H-leucine incorporation into brain proteins by > 90% for 3 hr. Crickets were trained to associate peppermint odor with water (reward) and vanilla odor with saline solution (non-reward) and were injected with CHX before or at different times after training. Their odor preferences were tested at 2 hr, 1 day and 4 days after training. Memory retention at 2 hr after training was unaffected by CHX injection. However, the level of retention at 1 day and 4 days after training was lowered when CHX was injected 1 hour before training or at 1 hr or 6 hr after training. To study the time course of the development of CHX-sensitive memory phase, crickets that had been injected with CHX at 1 hr after training were tested at different times from 2 to 12 hr after training. The level of retention was unaffected up to 4 hr after training but significantly lowered at 5 hr after training, and the CHX-sensitive memory phase developed gradually during the next several hours. CHX dissociates two phases of olfactory memory in crickets: earlier protein synthesis-independent phase (< 4 hr) and later (> 5 hr) protein synthesis-dependent phase.

Early calcium increase triggers the formation of olfactory long-term memory in honeybees

BackgroundSynaptic plasticity associated with an important wave of gene transcription and protein synthesis underlies long-term memory processes. Calcium (Ca2+) plays an important role in a variety of neuronal functions and indirect evidence suggests that it may be involved in synaptic plasticity and in the regulation of gene expression correlated to long-term memory formation. The aim of this study was to determine whether Ca2+ is necessary and sufficient for inducing long-term memory formation. A suitable model to address this question is the Pavlovian appetitive conditioning of the proboscis extension reflex in the honeybee Apis mellifera, in which animals learn to associate an odor with a sucrose reward.ResultsBy modulating the intracellular Ca2+ concentration ([Ca2+]i) in the brain, we show that: (i) blocking [Ca2+]i increase during multiple-trial conditioning selectively impairs long-term memory performance; (ii) conversely, increasing [Ca2+]i during single-trial conditioning triggers long-term memory formation; and finally, (iii) as was the case for long-term memory produced by multiple-trial conditioning, enhancement of long-term memory performance induced by a [Ca2+]i increase depends on de novo protein synthesis.ConclusionAltogether our data suggest that during olfactory conditioning Ca2+ is both a necessary and a sufficient signal for the formation of protein-dependent long-term memory. Ca2+ therefore appears to act as a switch between short- and long-term storage of learned information.

Roles of aminergic neurons in formation and recall of associative memory in crickets.

We review recent progress in the study of roles of octopaminergic (OA-ergic) and dopaminergic (DA-ergic) signaling in insect classical conditioning, focusing on our studies on crickets. Studies on olfactory learning in honey bees and fruit-flies have suggested that OA-ergic and DA-ergic neurons convey reinforcing signals of appetitive unconditioned stimulus (US) and aversive US, respectively. Our work suggested that this is applicable to olfactory, visual pattern, and color learning in crickets, indicating that this feature is ubiquitous in learning of various sensory stimuli. We also showed that aversive memory decayed much faster than did appetitive memory, and we proposed that this feature is common in insects and humans. Our study also suggested that activation of OA- or DA-ergic neurons is needed for appetitive or aversive memory recall, respectively. To account for this finding, we proposed a model in which it is assumed that two types of synaptic connections are strengthened by conditioning and are activated during memory recall, one type being connections from neurons representing conditioned stimulus (CS) to neurons inducing conditioned response and the other being connections from neurons representing CS to OA- or DA-ergic neurons representing appetitive or aversive US, respectively. The former is called stimulus–response (S–R) connection and the latter is called stimulus–stimulus (S–S) connection by theorists studying classical conditioning in vertebrates. Results of our studies using a second-order conditioning procedure supported our model. We propose that insect classical conditioning involves the formation of S–S connection and its activation for memory recall, which are often called cognitive processes.

Stimulation of the cAMP system by the nitric oxide-cGMP system underlying the formation of long-term memory in an insect

The nitric oxide (NO)-cGMP signaling system and cAMP system play critical roles in the formation of multiple-trial induced, protein synthesis-dependent long-term memory (LTM) in many vertebrates and invertebrates. The relationship between the NO-cGMP system and cAMP system, however, remains controversial. In honey bees, the two systems have been suggested to converge on protein kinase A (PKA), based on the finding in vitro that cGMP activates PKA when sub-optimal dose of cAMP is present. In crickets, however, we have suggested that NO-cGMP pathway operates on PKA via activation of adenylyl cyclase and production of cAMP for LTM formation. To resolve this issue, we compared the effect of multiple-trial conditioning against the effect of an externally applied cGMP analog for LTM formation in crickets, in the presence of sub-optimal dose of cAMP analog and in condition in which adenylyl cyclase was inhibited. The obtained results suggest that an externally applied cGMP analog activates PKA when sub-optimal dose of cAMP analog is present, as is suggested in honey bees, but cGMP produced by multiple-trial conditioning cannot activate PKA even when sub-optimal dose of cAMP analog is present, thus indicating that cGMP produced by multiple-trial conditioning is not accessible to PKA. We conclude that the NO-cGMP system stimulates the cAMP system for LTM formation. We propose that LTM is formed by an interplay of two classes of neurons, namely, NO-producing neurons regulating LTM formation and NO-receptive neurons that are more directly involved in the formation of long-term synaptic plasticity underlying LTM formation.