Kimberly M. Fenn

Recursive syntactic pattern learning by songbirds

Humans regularly produce new utterances that are understood by other members of the same language community. Linguistic theories account for this ability through the use of syntactic rules (or generative grammars) that describe the acceptable structure of utterances. The recursive, hierarchical embedding of language units (for example, words or phrases within shorter sentences) that is part of the ability to construct new utterances minimally requires a ‘context-free’ grammar that is more complex than the ‘finite-state’ grammars thought sufficient to specify the structure of all non-human communication signals. Recent hypotheses make the central claim that the capacity for syntactic recursion forms the computational core of a uniquely human language faculty. Here we show that European starlings (Sturnus vulgaris) accurately recognize acoustic patterns defined by a recursive, self-embedding, context-free grammar. They are also able to classify new patterns defined by the grammar and reliably exclude agrammatical patterns. Thus, the capacity to classify sequences from recursive, centre-embedded grammars is not uniquely human. This finding opens a new range of complex syntactic processing mechanisms to physiological investigation.

Consolidation during sleep of perceptual learning of spoken language

Memory consolidation resulting from sleep has been seen broadly: in verbal list learning, spatial learning, and skill acquisition in visual and motor tasks. These tasks do not generalize across spatial locations or motor sequences, or to different stimuli in the same location. Although episodic rote learning constitutes a large part of any organisms learning, generalization is a hallmark of adaptive behaviour. In speech, the same phoneme often has different acoustic patterns depending on context. Training on a small set of words improves performance on novel words using the same phonemes but with different acoustic patterns, demonstrating perceptual generalization. Here we show a role of sleep in the consolidation of a naturalistic spoken-language learning task that produces generalization of phonological categories across different acoustic patterns. Recognition performance immediately after training showed a significant improvement that subsequently degraded over the span of a days retention interval, but completely recovered following sleep. Thus, sleep facilitates the recovery and subsequent retention of material learned opportunistically at any time throughout the day. Performance recovery indicates that representations and mappings associated with generalization are refined and stabilized during sleep.

Perceptual learning of Cantonese lexical tones by tone and non-tone language speakers

Abstract Two groups of listeners, one of native speakers of a tone language (Mandarin Chinese) and one of native speakers of a non-tone language (English) were trained to recognize Cantonese lexical tones. Performance before and after training was measured using closed response-set identification and pairwise difference rating tasks. Difference ratings were submitted to multidimensional scaling (MDS) analyses to investigate training-related changes in listeners’ perceptual space. Both groups showed comparable initial performance and significant improvement in tone identification following training. However, the two groups differed in terms of the tones they found most difficult to identify, and in terms of the tones that were learned best. Differences between the two groups’ training-induced changes in identification (confusions) and perceptual spaces demonstrated that listeners’ native language experience with intonational as well as tone categories affects the perception and acquisition of non-native suprasegmental categories.

Consolidating the Effects of Waking and Sleep on Motor-Sequence Learning

Sleep is widely believed to play a critical role in memory consolidation. Sleep-dependent consolidation has been studied extensively in humans using an explicit motor-sequence learning paradigm. In this task, performance has been reported to remain stable across wakefulness and improve significantly after sleep, making motor-sequence learning the definitive example of sleep-dependent enhancement. Recent work, however, has shown that enhancement disappears when the task is modified to reduce task-related inhibition that develops over a training session, thus questioning whether sleep actively consolidates motor learning. Here we use the same motor-sequence task to demonstrate sleep-dependent consolidation for motor-sequence learning and explain the discrepancies in results across studies. We show that when training begins in the morning, motor-sequence performance deteriorates across wakefulness and recovers after sleep, whereas performance remains stable across both sleep and subsequent waking with evening training. This pattern of results challenges an influential model of memory consolidation defined by a time-dependent stabilization phase and a sleep-dependent enhancement phase. Moreover, the present results support a new account of the behavioral effects of waking and sleep on explicit motor-sequence learning that is consistent across a wide range of tasks. These observations indicate that current theories of memory consolidation that have been formulated to explain sleep-dependent performance enhancements are insufficient to explain the range of behavioral changes associated with sleep.

Consolidation and Transfer of Learning After Observing Hand Gesture

Children who observe gesture while learning mathematics perform better than children who do not, when tested immediately after training. How does observing gesture influence learning over time? Children (n = 184, ages = 7-10) were instructed with a videotaped lesson on mathematical equivalence and tested immediately after training and 24 hr later. The lesson either included speech and gesture or only speech. Children who saw gesture performed better overall and performance improved after 24 hr. Children who only heard speech did not improve after the delay. The gesture group also showed stronger transfer to different problem types. These findings suggest that gesture enhances learning of abstract concepts and affects how learning is consolidated over time.

Reduced False Memory after Sleep.

Several studies have shown that sleep contributes to the successful maintenance of previously encoded information. This research has focused exclusively on memory for studied events, as opposed to false memories. Here we report three experiments showing that sleep reduces false memories in the Deese-Roediger-McDermott (DRM) memory illusion. False recognition of nonstudied words was reduced after sleep, relative to an equal retention interval of wakefulness, with no change in correct recognition of studied words. These experiments are the first to show that false memories can be reduced following sleep, and they extend the benefits of sleep to include increased accuracy of episodic memory.

Consolidation of sensorimotor learning during sleep

Consolidation of nondeclarative memory is widely believed to benefit from sleep. However, evidence is mainly limited to tasks involving rote learning of the same stimulus or behavior, and recent findings have questioned the extent of sleep-dependent consolidation. We demonstrate consolidation during sleep for a multimodal sensorimotor skill that was trained and tested in different visual-spatial virtual environments. Participants performed a task requiring the production of novel motor responses in coordination with continuously changing audio-visual stimuli. Performance improved with training, decreased following waking retention, but recovered and stabilized following sleep. These results extend the domain of sleep-dependent consolidation to more complex, adaptive behaviors.

When less is heard than meets the ear: Change deafness in a telephone conversation

During a conversation, we hear the sound of the talker as well as the intended message. Traditional models of speech perception posit that acoustic details of a talkers voice are not encoded with the message whereas more recent models propose that talker identity is automatically encoded. When shadowing speech, listeners often fail to detect a change in talker identity. The present study was designed to investigate whether talker changes would be detected when listeners are actively engaged in a normal conversation, and visual information about the speaker is absent. Participants were called on the phone, and during the conversation the experimenter was surreptitiously replaced by another talker. Participants rarely noticed the change. However, when explicitly monitoring for a change, detection increased. Voice memory tests suggested that participants remembered only coarse information about both voices, rather than fine details. This suggests that although listeners are capable of change detection, voice information is not continuously monitored at a fine-grain level of acoustic representation during natural conversation and is not automatically encoded. Conversational expectations may shape the way we direct attention to voice characteristics and perceive differences in voice.

Sleep Deprivation and False Memories

Many studies have investigated factors that affect susceptibility to false memories. However, few have investigated the role of sleep deprivation in the formation of false memories, despite overwhelming evidence that sleep deprivation impairs cognitive function. We examined the relationship between self-reported sleep duration and false memories and the effect of 24 hr of total sleep deprivation on susceptibility to false memories. We found that under certain conditions, sleep deprivation can increase the risk of developing false memories. Specifically, sleep deprivation increased false memories in a misinformation task when participants were sleep deprived during event encoding, but did not have a significant effect when the deprivation occurred after event encoding. These experiments are the first to investigate the effect of sleep deprivation on susceptibility to false memories, which can have dire consequences.

What drives sleep-dependent memory consolidation: Greater gain or less loss?

When memory is tested after a delay, performance is typically better if the retention interval includes sleep. However, it is unclear what accounts for this well-established effect. It is possible that sleep enhances the retrieval of information, but it is also possible that sleep protects against memory loss that normally occurs during waking activity. We developed a new research approach to investigate these possibilities. Participants learned a list of paired-associate items and were tested on the items after a 12-h interval that included waking or sleep. We analyzed the number of items gained versus the number of items lost across time. The sleep condition showed more items gained and fewer items lost than did the wake condition. Furthermore, the difference between the conditions (favoring sleep) in lost items was greater than the difference in gain, suggesting that loss prevention may primarily account for the effect of sleep on declarative memory consolidation. This finding may serve as an empirical constraint on theories of memory consolidation.