Amy S. Desroches

Investigating the time course of spoken word recognition: Electrophysiological evidence for the influences of phonological similarity

Behavioral and modeling evidence suggests that words compete for recognition during auditory word identification, and that phonological similarity is a driving factor in this competition. The present study used event-related potentials (ERPs) to examine the temporal dynamics of different types of phonological competition (i.e., cohort and rhyme). ERPs were recorded during a novel picture–word matching task, where a target picture was followed by an auditory word that either matched the target (CONE–cone), or mismatched in one of three ways: rhyme (CONE–bone), cohort (CONE–comb), and unrelated (CONE–fox). Rhymes and cohorts differentially modulated two distinct ERP components, the phonological mismatch negativity and the N400, revealing the influences of prelexical and lexical processing components in speech recognition. Cohort mismatches resulted in late increased negativity in the N400, reflecting disambiguation of the later point of miscue and the combined influences of top–down expectations and misleading bottom–up phonological information on processing. In contrast, we observed a reduction in the N400 for rhyme mismatches, reflecting lexical activation of rhyme competitors. Moreover, the observed rhyme effects suggest that there is an interaction between phoneme-level and lexical-level information in the recognition of spoken words. The results support the theory that both levels of information are engaged in parallel during auditory word recognition in a way that permits both bottom–up and top–down competition effects.

Distinct representations of subtraction and multiplication in the neural systems for numerosity and language.

It has been proposed that recent cultural inventions such as symbolic arithmetic recycle evolutionary older neural mechanisms. A central assumption of this hypothesis is that the degree to which a preexisting mechanism is recycled depends on the degree of similarity between its initial function and the novel task. To test this assumption, we investigated whether the brain region involved in magnitude comparison in the intraparietal sulcus (IPS), localized by a numerosity comparison task, is recruited to a greater degree by arithmetic problems that involve number comparison (single‐digit subtractions) than by problems that involve retrieving number facts from memory (single‐digit multiplications). Our results confirmed that subtractions are associated with greater activity in the IPS than multiplications, whereas multiplications elicit greater activity than subtractions in regions involved in verbal processing including the middle temporal gyrus (MTG) and inferior frontal gyrus (IFG) that were localized by a phonological processing task. Pattern analyses further indicated that the neural mechanisms more active for subtraction than multiplication in the IPS overlap with those involved in numerosity comparison and that the strength of this overlap predicts interindividual performance in the subtraction task. These findings provide novel evidence that elementary arithmetic relies on the cooption of evolutionary older neural circuits. Hum Brain Mapp, 2011.

Specific phonological impairments in dyslexia revealed by eyetracking

Phonological deficits in dyslexia are typically assessed using metalinguistic tasks vulnerable to extraneous factors such as attention and memory. The present work takes the novel approach of measuring phonology using eyetracking. Eye movements of dyslexic children were monitored during an auditory word recognition task in which target items in a display (e.g., candle) were accompanied by distractors sharing a cohort (candy) or rhyme (sandal). Like controls, dyslexics showed slower recognition times when a cohort distractor was present than in a baseline condition with only phonologically unrelated distractors. However, unlike controls, dyslexic children did not show slowed recognition of targets with a rhyme distractor, suggesting they had not encoded rhyme relationships. This was further explored in an overt phonological awareness test of cohort and rhyme. Surprisingly, dyslexics showed normal rhyme performance but poorer judgment of initial sounds on these overt tests. The results implicate impaired knowledge of rhyme information in dyslexia; however they also indicate that testing methodology plays a critical role in how such problems are identified.

Learning Rule-Described and Non-Rule-Described Categories : A Comparison of Children and Adults

Three experiments investigated the ability of 3-, 5-, and 8-year-old children as well as adults to learn sets of perceptual categories. Adults and children performed comparably on categories that could be learned by either a single-dimensional rule or by associative learning mechanisms. However, children showed poorer performance relative to adults in learning categories defined by a disjunctive rule and categories that were nonlinearly separable. Increasing the task demands for adults resulted in child-like performance on the disjunctive categories. Decreasing the task demands for children resulted in more adult-like performance on the disjunctive categories. The authors interpret these results within a multiple-systems approach to category learning and suggest that children have not fully developed the same explicit category learning system as adults.

Children with Reading Difficulties Show Differences in Brain Regions Associated with Orthographic Processing During Spoken Language Processing

We explored the neural basis of spoken language deficits in children with reading difficulty, specifically focusing on the role of orthography during spoken language processing. We used functional magnetic resonance imaging (fMRI) to examine differences in brain activation between children with reading difficulties (aged 9-to-15 years) and age-matched children with typical achievement during an auditory rhyming task. Both groups showed activation in bilateral superior temporal gyri (BA 42 and 22), a region associated with phonological processing, with no significant between-group differences. Interestingly, typically achieving children, but not children with reading difficulties, showed activation of left fusiform cortex (BA 37), a region implicated in orthographic processing. Furthermore, this activation was significantly greater for typically achieving children compared to those with reading difficulties. These findings suggest that typical children automatically activate orthographic representations during spoken language processing, while those with reading difficulties do not. Follow-up analyses revealed that the intensity of the activation in the fusiform gyrus was associated with significantly stronger behavioral conflict effects in typically achieving children only (i.e., longer latencies to rhyming pairs with orthographically dissimilar endings than to those with identical orthographic endings; jazz-has vs. cat-hat). Finally, for reading disabled children, a positive correlation between left fusiform activation and nonword reading was observed, such that greater access to orthography was related to decoding ability. Taken together, the results suggest that the integration of orthographic and phonological processing is directly related to reading ability.

The role of the ventral and dorsal pathways in reading Chinese characters and English words

Previous literature in alphabetic languages suggests that the occipital-temporal region (the ventral pathway) is specialized for automatic parallel word recognition, whereas the parietal region (the dorsal pathway) is specialized for serial letter-by-letter reading (Cohen et al., 2008; Ho et al., 2002). However, few studies have directly examined the role of the ventral and dorsal pathways in Chinese reading compared to English reading. To investigate this issue, we adopted the degraded word processing paradigm used by Cohen et al. (2008) and compared brain regions involved in the processing of degraded Chinese characters and English words during lexical decision, using functional magnetic resonance imaging (fMRI). The degraded characters/words were created by inserting blank spaces between radicals of Chinese characters or syllables of English polysyllabic words. Generally, the current study replicated the effects of Cohen et al. (2008), showing that in Chinese - like in alphabetic languages - character spacing modulates both ventral (bilateral cuneus, left middle occipital gyrus) and dorsal (left superior parietal lobule and middle frontal gyrus) pathways. In addition, the current study showed greater activation in bilateral cuneus and right lingual gyrus for Chinese versus English when comparing spaced to normal stimuli, suggesting that Chinese character recognition relies more on ventral visual-spatial processing than English word recognition. Interestingly, bilateral cuneus showed monotonic patterns in response to increasing spacing, while the rest of the regions of interest showed non-monotonic patterns, indicating different profiles for these regions in visual-spatial processing.

Past-Tense Morphology and Phonological Deficits in Children With Dyslexia and Children With Language Impairment

The authors investigated past-tense morphology problems in children with dyslexia compared to those classically observed in children with oral language impairment (LI). Children were tested on a past-tense elicitation task involving regulars (look-looked), irregulars (take-took), and nonwords (murn-murned). Phonological skills were also assessed, using tests of nonsense word reading and phoneme elision. Analyses focused on whether children with dyslexia and LI showed overlapping patterns of morphological and phonological difficulties compared to controls with typical reading and language levels. Both the groups with LI and dyslexia had difficulty generating past tenses overall, although the deficit was less pronounced in dyslexia. Both groups also showed similar problems with phonological processing. The results have important implications for the theory that both language and reading problems involve oral language processing deficits. Specifically, our data support the theory that the phonological deficits observed in both dyslexia and LI are related to deficits in morphological processing. However, some important differences between dyslexia and LI are also discussed.

Multimodal Lexical Processing in Auditory Cortex Is Literacy Skill Dependent

Literacy is a uniquely human cross-modal cognitive process wherein visual orthographic representations become associated with auditory phonological representations through experience. Developmental studies provide insight into how experience-dependent changes in brain organization influence phonological processing as a function of literacy. Previous investigations show a synchrony-dependent influence of letter presentation on individual phoneme processing in superior temporal sulcus; others demonstrate recruitment of primary and associative auditory cortex during cross-modal processing. We sought to determine whether brain regions supporting phonological processing of larger lexical units (monosyllabic words) over larger time windows is sensitive to cross-modal information, and whether such effects are literacy dependent. Twenty-two children (age 8-14 years) made rhyming judgments for sequentially presented word and pseudoword pairs presented either unimodally (auditory- or visual-only) or cross-modally (audiovisual). Regression analyses examined the relationship between literacy and congruency effects (overlapping orthography and phonology vs. overlapping phonology-only). We extend previous findings by showing that higher literacy is correlated with greater congruency effects in auditory cortex (i.e., planum temporale) only for cross-modal processing. These skill effects were specific to known words and occurred over a large time window, suggesting that multimodal integration in posterior auditory cortex is critical for fluent reading.

ERPs reveal the temporal dynamics of auditory word recognition in specific language impairment.

We used event-related potentials (ERPs) to compare auditory word recognition in children with specific language impairment (SLI group; N=14) to a group of typically developing children (TD group; N=14). Subjects were presented with pictures of items and heard auditory words that either matched or mismatched the pictures. Mismatches overlapped expected words in word-onset (cohort mismatches; see: DOLL, hear: dog), rhyme (CONE -bone), or were unrelated (SHELL -mug). In match trials, the SLI group showed a different pattern of N100 responses to auditory stimuli compared to the TD group, indicative of early auditory processing differences in SLI. However, the phonological mapping negativity (PMN) response to mismatching items was comparable across groups, suggesting that just like TD children, children with SLI are capable of establishing phonological expectations and detecting violations of these expectations in an online fashion. Perhaps most importantly, we observed a lack of attenuation of the N400 for rhyming words in the SLI group, which suggests that either these children were not as sensitive to rhyme similarity as their typically developing peers, or did not suppress lexical alternatives to the same extent. These findings help shed light on the underlying deficits responsible for SLI.

Theta-gamma coupling reflects the interaction of bottom-up and top-down processes in speech perception in children.

This study investigates how the interaction of different brain oscillations (particularly theta-gamma coupling) modulates the bottom-up and top-down processes during speech perception. We employed a speech perception paradigm that manipulated the congruency between a visually presented picture and an auditory stimulus and asked participants to judge whether they matched or mismatched. A group of children (mean age 10 years, 5 months) participated in this study and their electroencephalographic (EEG) data were recorded while performing the experimental task. It was found that in comparison with mismatch condition, match condition facilitated speech perception by eliciting greater theta-gamma coupling in the frontal area and smaller theta-gamma coupling in the left temporal area. These findings suggested that a top-down facilitation effect from congruent visual pictures engaged different mechanisms in low-level sensory (temporal) regions and high-level linguistic and decision (frontal) regions. Interestingly, hemispheric asymmetry is with higher theta-gamma coupling in the match condition in the right hemisphere and higher theta-gamma coupling in the mismatch condition in the left hemisphere. This indicates that a fast global processing strategy and a slow detailed processing strategy were differentially adopted in the match and mismatch conditions. This study provides new insight into the mechanisms of speech perception from the interaction of different oscillatory activities and provides neural evidence for theories of speech perception allowing for top-down feedback connections. Furthermore, it sheds light on childrens speech perception development by showing a similar pattern of integration of bottom-up and top-down information during speech perception as previous studies have revealed in adults.