Victoria Leong

Assessment of rhythmic entrainment at multiple timescales in dyslexia: Evidence for disruption to syllable timing

Developmental dyslexia is associated with rhythmic difficulties, including impaired perception of beat patterns in music and prosodic stress patterns in speech. Spoken prosodic rhythm is cued by slow (<10 Hz) fluctuations in speech signal amplitude. Impaired neural oscillatory tracking of these slow amplitude modulation (AM) patterns is one plausible source of impaired rhythm tracking in dyslexia. Here, we characterise the temporal profile of the dyslexic rhythm deficit by examining rhythmic entrainment at multiple speech timescales. Adult dyslexic participants completed two experiments aimed at testing the perception and production of speech rhythm. In the perception task, participants tapped along to the beat of 4 metrically-regular nursery rhyme sentences. In the production task, participants produced the same 4 sentences in time to a metronome beat. Rhythmic entrainment was assessed using both traditional rhythmic indices and a novel AM-based measure, which utilised 3 dominant AM timescales in the speech signal each associated with a different phonological grain-sized unit (0.9–2.5 Hz, prosodic stress; 2.5–12 Hz, syllables; 12–40 Hz, phonemes). The AM-based measure revealed atypical rhythmic entrainment by dyslexic participants to syllable patterns in speech, in perception and production. In the perception task, both groups showed equally strong phase-locking to Syllable AM patterns, but dyslexic responses were entrained to a significantly earlier oscillatory phase angle than controls. In the production task, dyslexic utterances showed shorter syllable intervals, and differences in Syllable:Phoneme AM cross-frequency synchronisation. Our data support the view that rhythmic entrainment at slow (∼5 Hz, Syllable) rates is atypical in dyslexia, suggesting that neural mechanisms for syllable perception and production may also be atypical. These syllable timing deficits could contribute to the atypical development of phonological representations for spoken words, the central cognitive characteristic of developmental dyslexia across languages. This article is part of a Special Issue entitled .

Acoustic-Emergent Phonology in the Amplitude Envelope of Child-Directed Speech

When acquiring language, young children may use acoustic spectro-temporal patterns in speech to derive phonological units in spoken language (e.g., prosodic stress patterns, syllables, phonemes). Children appear to learn acoustic-phonological mappings rapidly, without direct instruction, yet the underlying developmental mechanisms remain unclear. Across different languages, a relationship between amplitude envelope sensitivity and phonological development has been found, suggesting that children may make use of amplitude modulation (AM) patterns within the envelope to develop a phonological system. Here we present the Spectral Amplitude Modulation Phase Hierarchy (S-AMPH) model, a set of algorithms for deriving the dominant AM patterns in child-directed speech (CDS). Using Principal Components Analysis, we show that rhythmic CDS contains an AM hierarchy comprising 3 core modulation timescales. These timescales correspond to key phonological units: prosodic stress (Stress AM, ~2 Hz), syllables (Syllable AM, ~5 Hz) and onset-rime units (Phoneme AM, ~20 Hz). We argue that these AM patterns could in principle be used by naïve listeners to compute acoustic-phonological mappings without lexical knowledge. We then demonstrate that the modulation statistics within this AM hierarchy indeed parse the speech signal into a primitive hierarchically-organised phonological system comprising stress feet (proto-words), syllables and onset-rime units. We apply the S-AMPH model to two other CDS corpora, one spontaneous and one deliberately-timed. The model accurately identified 72–82% (freely-read CDS) and 90–98% (rhythmically-regular CDS) stress patterns, syllables and onset-rime units. This in-principle demonstration that primitive phonology can be extracted from speech AMs is termed Acoustic-Emergent Phonology (AEP) theory. AEP theory provides a set of methods for examining how early phonological development is shaped by the temporal modulation structure of speech across languages. The S-AMPH model reveals a crucial developmental role for stress feet (AMs ~2 Hz). Stress feet underpin different linguistic rhythm typologies, and speech rhythm underpins language acquisition by infants in all languages.

Differential entrainment of neuroelectric delta oscillations in developmental dyslexia.

Oscillatory entrainment to the speech signal is important for language processing, but has not yet been studied in developmental disorders of language. Developmental dyslexia, a difficulty in acquiring efficient reading skills linked to difficulties with phonology (the sound structure of language), has been associated with behavioural entrainment deficits. It has been proposed that the phonological ‘deficit’ that characterises dyslexia across languages is related to impaired auditory entrainment to speech at lower frequencies via neuroelectric oscillations (<10 Hz, ‘temporal sampling theory’). Impaired entrainment to temporal modulations at lower frequencies would affect the recovery of the prosodic and syllabic structure of speech. Here we investigated event-related oscillatory EEG activity and contingent negative variation (CNV) to auditory rhythmic tone streams delivered at frequencies within the delta band (2 Hz, 1.5 Hz), relevant to sampling stressed syllables in speech. Given prior behavioural entrainment findings at these rates, we predicted functionally atypical entrainment of delta oscillations in dyslexia. Participants performed a rhythmic expectancy task, detecting occasional white noise targets interspersed with tones occurring regularly at rates of 2 Hz or 1.5 Hz. Both groups showed significant entrainment of delta oscillations to the rhythmic stimulus stream, however the strength of inter-trial delta phase coherence (ITC, ‘phase locking’) and the CNV were both significantly weaker in dyslexics, suggestive of weaker entrainment and less preparatory brain activity. Both ITC strength and CNV amplitude were significantly related to individual differences in language processing and reading. Additionally, the instantaneous phase of prestimulus delta oscillation predicted behavioural responding (response time) for control participants only.

Awareness of Rhythm Patterns in Speech and Music in Children with Specific Language Impairments

Children with specific language impairments (SLIs) show impaired perception and production of language, and also show impairments in perceiving auditory cues to rhythm [amplitude rise time (ART) and sound duration] and in tapping to a rhythmic beat. Here we explore potential links between language development and rhythm perception in 45 children with SLI and 50 age-matched controls. We administered three rhythmic tasks, a musical beat detection task, a tapping-to-music task, and a novel music/speech task, which varied rhythm and pitch cues independently or together in both speech and music. Via low-pass filtering, the music sounded as though it was played from a low-quality radio and the speech sounded as though it was muffled (heard “behind the door”). We report data for all of the SLI children (N = 45, IQ varying), as well as for two independent subgroupings with intact IQ. One subgroup, “Pure SLI,” had intact phonology and reading (N = 16), the other, “SLI PPR” (N = 15), had impaired phonology and reading. When IQ varied (all SLI children), we found significant group differences in all the rhythmic tasks. For the Pure SLI group, there were rhythmic impairments in the tapping task only. For children with SLI and poor phonology (SLI PPR), group differences were found in all of the filtered speech/music AXB tasks. We conclude that difficulties with rhythmic cues in both speech and music are present in children with SLIs, but that some rhythmic measures are more sensitive than others. The data are interpreted within a “prosodic phrasing” hypothesis, and we discuss the potential utility of rhythmic and musical interventions in remediating speech and language difficulties in children.

Speaker gaze increases information coupling between infant and adult brains

Significance During communication, social ostensive signals (like gaze) are exchanged in a temporally contingent manner. Synchronized behavior creates social connectedness within human dyads, and even infants synchronize behaviorally with adults. However, the neural mechanisms that support infant–adult synchronization are unknown. Here, we provide evidence that infants up-regulate neural synchronization with adult partners when offered direct ostensive gaze, as compared with gaze aversion. Gaze therefore brings infant–adult neural activity into mutual alignment, creating a joint-networked state that may facilitate communicative success. Further, infants’ own communicative attempts were positively associated with adults’ neural synchronization to them, indicating mutual regulation of synchronization within infant–adult dyads. Thus, interpersonal neural synchronization may provide a mechanism by which infants construct their own earliest social networks. When infants and adults communicate, they exchange social signals of availability and communicative intention such as eye gaze. Previous research indicates that when communication is successful, close temporal dependencies arise between adult speakers’ and listeners’ neural activity. However, it is not known whether similar neural contingencies exist within adult–infant dyads. Here, we used dual-electroencephalography to assess whether direct gaze increases neural coupling between adults and infants during screen-based and live interactions. In experiment 1 (n = 17), infants viewed videos of an adult who was singing nursery rhymes with (i) direct gaze (looking forward), (ii) indirect gaze (head and eyes averted by 20°), or (iii) direct-oblique gaze (head averted but eyes orientated forward). In experiment 2 (n = 19), infants viewed the same adult in a live context, singing with direct or indirect gaze. Gaze-related changes in adult–infant neural network connectivity were measured using partial directed coherence. Across both experiments, the adult had a significant (Granger) causal influence on infants’ neural activity, which was stronger during direct and direct-oblique gaze relative to indirect gaze. During live interactions, infants also influenced the adult more during direct than indirect gaze. Further, infants vocalized more frequently during live direct gaze, and individual infants who vocalized longer also elicited stronger synchronization from the adult. These results demonstrate that direct gaze strengthens bidirectional adult–infant neural connectivity during communication. Thus, ostensive social signals could act to bring brains into mutual temporal alignment, creating a joint-networked state that is structured to facilitate information transfer during early communication and learning.

The Temporal Modulation Structure of Infant-Directed Speech

The temporal modulation structure of adult-directed speech (ADS) is thought to be encoded by neuronal oscillations in the auditory cortex that fluctuate at different temporal rates. Oscillatory activity is thought to phase-align to amplitude modulations in speech at corresponding rates, thereby supporting parsing of the signal into linguistically relevant units. The temporal modulation structure of infant-directed speech (IDS) is unexplored. Here we compare the amplitude modulation (AM) structure of IDS recorded from mothers speaking, over three occasions, to their 7-, 9-, and 11-month-old infants, and the same mothers speaking ADS. Analysis of the modulation spectrum in each case revealed that modulation energy in the theta band was significantly greater in ADS than in IDS, whereas in the delta band, modulation energy was significantly greater for IDS than ADS. Furthermore, phase alignment between delta- and theta-band AMs was stronger in IDS compared to ADS. This remained the case when IDS and ADS were rate-normalized to control for differences in speech rate. These data indicate stronger rhythmic synchronization and acoustic temporal regularity in IDS compared to ADS, structural acoustic differences that may be important for early language learning.

Prosodic Similarity Effects in Short-term Memory in Developmental Dyslexia

Children with developmental dyslexia are characterized by phonological difficulties across languages. Classically, this ‘phonological deficit’ in dyslexia has been investigated with tasks using single‐syllable words. Recently, however, several studies have demonstrated difficulties in prosodic awareness in dyslexia. Potential prosodic effects in short‐term memory have not yet been investigated. Here we create a new instrument based on three‐syllable words that vary in stress patterns, to investigate whether prosodic similarity (the same prosodic pattern of stressed and unstressed syllables) exerts systematic effects on short‐term memory. We study participants with dyslexia and age‐matched and younger reading‐level‐matched typically developing controls. We find that all participants, including dyslexic participants, show prosodic similarity effects in short‐term memory. All participants exhibited better retention of words that differed in prosodic structure, although participants with dyslexia recalled fewer words accurately overall compared to age‐matched controls. Individual differences in prosodic memory were predicted by earlier vocabulary abilities, by earlier sensitivity to syllable stress and by earlier phonological awareness. To our knowledge, this is the first demonstration of prosodic similarity effects in short‐term memory. The implications of a prosodic similarity effect for theories of lexical representation and of dyslexia are discussed.

New Meanings of Thin-Skinned: The Contrasting Attentional Profiles of Typical 12-Month-Olds Who Show High, and Low, Stress Reactivity.

Previous research is inconsistent as to whether a more labile (faster-changing) autonomic system confers performance advantages, or disadvantages, in infants and children. To examine this, we presented a stimulus battery consisting of mixed static and dynamic viewing materials to a cohort of 63 typical 12-month-old infants. While viewing the battery, infants’ spontaneous visual attention (looks to and away from the screen) was measured. Concurrently, arousal was recorded via heart rate (HR), electrodermal activity, head velocity, and peripheral movement levels. In addition, stress reactivity was assessed using a mild behavioral stressor (watching a video of another infant crying). We found that infants who were generally more attentive showed smaller HR increases to the stressor. However, they also showed greater phasic autonomic changes to attractive, attention-getting stimulus events, a faster rate of change of both look duration and of arousal, and more general oscillatory activity in arousal. Finally, 4 sessions of attention training were applied to a subset of the infants (24 trained, 24 active controls), which had the effect of increasing visual sustained attention. No changes in HR responses to stressor were observed as a result of training, but concomitant increases in arousal lability were observed. Our results point to 2 contrasting autonomic profiles: infants with high autonomic reactivity to stressors show short attention durations, whereas infants with lower autonomic reactivity show longer attention durations and greater arousal lability.

Difficulties in auditory organization as a cause of reading backwardness? An auditory neuroscience perspective

Abstract Over 30 years ago, it was suggested that difficulties in the ‘auditory organization’ of word forms in the mental lexicon might cause reading difficulties. It was proposed that children used parameters such as rhyme and alliteration to organize word forms in the mental lexicon by acoustic similarity, and that such organization was impaired in developmental dyslexia. This literature was based on an ‘oddity’ measure of childrens sensitivity to rhyme (e.g. wood, book, good) and alliteration (e.g. sun, sock, rag). The ‘oddity’ task revealed that children with dyslexia were significantly poorer at identifying the ‘odd word out’ than younger children without reading difficulties. Here we apply a novel modelling approach drawn from auditory neuroscience to study the possible sensory basis of the auditory organization of rhyming and non‐rhyming words by children. We utilize a novel Spectral‐Amplitude Modulation Phase Hierarchy (S‐AMPH) approach to analysing the spectro‐temporal structure of rhyming and non‐rhyming words, aiming to illuminate the potential acoustic cues used by children as a basis for phonological organization. The S‐AMPH model assumes that speech encoding depends on neuronal oscillatory entrainment to the amplitude modulation (AM) hierarchy in speech. Our results suggest that phonological similarity between rhyming words in the oddity task depends crucially on slow (delta band) modulations in the speech envelope. Contrary to linguistic assumptions, therefore, auditory organization by children may not depend on phonemic information for this task. Linguistically, it is assumed that ‘book’ does not rhyme with ‘wood’ and ‘good’ because the final phoneme differs. However, our auditory analysis suggests that the acoustic cues to this phonological dissimilarity depend primarily on the slower amplitude modulations in the speech envelope, thought to carry prosodic information. Therefore, the oddity task may help in detecting reading difficulties because phonological similarity judgements about rhyme reflect sensitivity to slow amplitude modulation patterns. Slower amplitude modulations are known to be detected less efficiently by children with dyslexia.

Developmental Psychology: How Social Context Influences Infants’ Attention

A recent study shows that changes in the focus of a social partners attention associate, on a second-by-second scale, with changes in how much attention infants pay to objects.