Llorenç Andreu

Perception of audio-visual speech synchrony in Spanish-speaking children with and without specific language impairment*

Speech perception involves the integration of auditory and visual articulatory information, and thus requires the perception of temporal synchrony between this information. There is evidence that children with specific language impairment (SLI) have difficulty with auditory speech perception but it is not known if this is also true for the integration of auditory and visual speech. Twenty Spanish-speaking children with SLI, twenty typically developing age-matched Spanish-speaking children, and twenty Spanish-speaking children matched for MLU-w participated in an eye-tracking study to investigate the perception of audiovisual speech synchrony. Results revealed that children with typical language development perceived an audiovisual asynchrony of 666 ms regardless of whether the auditory or visual speech attribute led the other one. Children with SLI only detected the 666 ms asynchrony when the auditory component preceded [corrected] the visual component. None of the groups perceived an audiovisual asynchrony of 366 ms. These results suggest that the difficulty of speech processing by children with SLI would also involve difficulties in integrating auditory and visual aspects of speech perception.

Narrative comprehension and production in children with SLI: An eye movement study

This study investigates narrative comprehension and production in children with specific language impairment (SLI). Twelve children with SLI (mean age 5;8 years) and 12 typically developing children (mean age 5;6 years) participated in an eye-tracking experiment designed to investigate online narrative comprehension and production in Catalan- and Spanish-speaking children with SLI. The comprehension task involved the recording of eye movements during the visual exploration of successive scenes in a story, while listening to the associated narrative. With regard to production, the children were asked to retell the story, while once again looking at the scenes, as their eye movements were monitored. During narrative production, children with SLI look at the most semantically relevant areas of the scenes fewer times than their age-matched controls, but no differences were found in narrative comprehension. Moreover, the analyses of speech productions revealed that children with SLI retained less information and made more semantic and syntactic errors during retelling. Implications for theories that characterize SLI are discussed.

La relación entre el aprendizaje léxico y el desarrollo gramatical

Resumen El presente trabajo se centra en estudiar la relación que existe entre el desarrollo de léxico y el de la morfosintaxis. Concretamente pretendemos explorar el tipo de vocabulario que mejor predice el desarrollo de la morfología verbal y el de la complejidad gramatical, así como establecer el tipo de relación entre desarrollo léxico y desarrollo morfosintáctico. La muestra comprende 517 niños de edades comprendidas entre los 18 meses y los 30 meses. Los datos se han recogido a partir de la adaptación al catalán del instrumento MacArthur-Bates Communicative Development Inventories (CDI). Los resultados muestran que el mejor predictor del desarrollo morfológico y gramatical es el vocabulario de clase cerrada, conjuntamente con el vocabulario general. Por otra parte, se observa una relación predominantemente lineal entre el desarrollo del léxico y el desarrollo morfosintáctico.

The formulation of argument structure in SLI: an eye-movement study

This study investigated the formulation of verb argument structure in Catalan- and Spanish-speaking children with specific language impairment (SLI) and typically developing age-matched controls. We compared how language production can be guided by conceptual factors, such as the organization of the entities participating in an event and knowledge regarding argument structure. Eleven children with SLI (aged 3;8 to 6;6) and eleven control children participated in an eye-tracking experiment in which participants had to describe events with different argument structure in the presence of visual scenes. Picture descriptions, latency time and eye movements were recorded and analyzed. The picture description results showed that the percentage of responses in which children with SLI substituted a non-target verb for the target verb was significantly different from that for the control group. Children with SLI made more omissions of obligatory arguments, especially of themes, as the verb argument complexity increased. Moreover, when the number of arguments of the verb increased, the children took more time to begin their descriptions, but no differences between groups were found. For verb type latency, all children were significantly faster to start describing one-argument events than two- and three-argument events. No differences in latency time were found between two- and three-argument events. There were no significant differences between the groups. Eye-movement showed that children with SLI looked less at the event zone than the age-matched controls during the first two seconds. These differences between the groups were significant for three-argument verbs, and only marginally significant for one- and two-argument verbs. Children with SLI also spent significantly less time looking at the theme zones than their age-matched controls. We suggest that both processing limitations and deficits in the semantic representation of verbs may play a role in these difficulties.

Effect of verb argument structure on picture naming in children with and without specific language impairment (SLI)

BACKGROUND This study investigated verb argument structure effects in children with specific language impairment (SLI). AIMS A picture-naming paradigm was used to compare the response times and naming accuracy for nouns and verbs with differing argument structure between Spanish-speaking children with and without language impairment. METHODS & PROCEDURES Twenty-four children with SLI (ages 5;3-8;2 [years;months]), 24 age-matched controls (ages 5;3-8;2), 24 MLU-w controls (ages 3;3-7;1 years), and 31 adults participated in a picture-naming study. OUTCOMES & RESULTS The results show all groups produced more correct responses and were faster for nouns than all verbs together. As regards verb type accuracy, there were no differences between groups in naming one-argument verbs. However, for both two- and three-argument verbs, children with SLI were less accurate than adults and age-matched controls, but similar to the MLU-matched controls. For verb type latency, children with SLI were slower than both the age-matched controls and adults for one- and two-argument verbs, while no differences were found in three-argument verbs. No differences were found between children with SLI and MLU-matched controls for any verb type. CONCLUSIONS & IMPLICATIONS It has been shown that the naming of verbs is delayed in Spanish children with SLI. It is suggested that children with SLI may have problems encoding semantic representations.

Anticipatory Sentence Processing in Children with Specific Language Impairment: Evidence from Eye Movements during Listening.

Twenty-five children with specific language impairment (SLI; age 5 years, 3 months [5;3]–8;2), 50 typically developing children (3;3–8;2), and 31 normal adults participated in three eye-tracking experiments of spoken language comprehension that were designed to investigate the use of verb information during real-time sentence comprehension in Spanish. In Experiment 1, participants heard sentences like El ni˜ no recorta con cuidado el papel (The boy trims carefully the paper) in the presence of four depicted objects, only one of which satisfied the semantic restrictions of the verb recorta (e.g., paper, clock, fox, and dinosaur). Eye movements revealed that children with SLI, like other groups, were able to recognize and retrieve the meaning of the verb rapidly enough to anticipate the upcoming semantically appropriate referent, prior to actually hearing the noun phrase el papel (the paper). Experiments 2 and 3 revealed that for all groups of participants, anticipatory eye movements were also modulated by the semantic fit of the object serving as the patient/theme of the verb. Relatively fine-grained semantic information of a verb was computed fast enough even by children with SLI to result in anticipatory eye movements to semantically appropriate referents. Children with SLI did differ from age-matched controls, but only slightly in terms of overall anticipatory looking at target objects; the time course of looking between these groups was quite similar. In addition, no differences were found between children with SLI and control children matched for mean length of utterance. Implications for theories that characterize SLI are discussed.

Do Children with SLI Use Verbs to Predict Arguments and Adjuncts: Evidence from Eye Movements During Listening

Different psycholinguistic theories have suggested the importance of verb semantics in rapidly anticipating upcoming information during real-time sentence comprehension. To date, no study has examined if children use verbs to predict arguments and adjuncts in sentence comprehension using children with specific language impairment (SLI). Twenty-five children with SLI (aged 5 years and 3 months to 8 years and 2 months), 25 age-matched controls (aged 5 years and 3 months to 8 years and 2 months), 25 MLU-w controls (aged 3 years and 3 months to 7 years and 1 month), and 31 adults took part in the study. The eye movements of participants were monitored while they heard 24 sentences, such as El hombre lee con atención un cuento en la cama (translation: The man carefully reads a storybook in bed), in the presence of four depicted objects, one of which was the target (storybook), another, the competitor (bed), and another two, distracters (wardrobe and grape). The proportion of looks revealed that, when the meaning of the verb was retrieved, the upcoming argument and adjunct referents were rapidly anticipated. However, the proportion of looks at the theme, source/goal and instrument referents were significantly higher than the looks at the locatives. This pattern was found in adults as well as children with and without language impairment. The present results suggest that, in terms of sentence comprehension, the ability to understand verb information is not severely impaired in children with SLI.

Verb Argument Structure in Children with SLI: Evidence from Eye-Tracking.

Many studies have shown that one special characteristic of children with Specific Language Impairment (SLI) is that they exhibit developmental delays in verbal abilities (Bishop 1997; Leonard 1998). Children with SLI show deficits in their use and understanding of inflectional morphology such as verb tense and agreement and have special difficulties in specifying obligatory arguments relative to age-matched peers (e.g., Bishop 1997; Conti-Ramsden & Jones 1997; Leonard 1998; Sanz-Torrent et al. 2008; Sanz-Torrent et al. 2011). Despite the problems found in relation to verbs, to date there have been few studies on the online processing of verb argument structure in children with SLI. This work explores the role of verb semantics and specifically verb argument structure in language comprehension and language production. To carry out our research, we selected four different groups to sample: adults, children with SLI (ages 5;03–8;02), age-matched controls, and mlu-w controls (ages 3;03–7;01). The work comprises six studies based on the Visual World Paradigm (Tanenhaus et al. 1995) that includes the recording of eye movements while people watch different visual scenes with the aim of understanding or producing different words or simple associated sentences. Four of the studies explore language comprehension and the other two language production. In the first study, we analyzed the auditory word recognition of nouns and verbs with different argument structures and the dynamics of spoken word recognition for nouns and verbs in adults. We recorded listeners’ eye movements as they searched through an array of pictures

Argument structure and the representation of abstract semantics.

According to the dual coding theory, differences in the ease of retrieval between concrete and abstract words are related to the exclusive dependence of abstract semantics on linguistic information. Argument structure can be considered a measure of the complexity of the linguistic contexts that accompany a verb. If the retrieval of abstract verbs relies more on the linguistic codes they are associated to, we could expect a larger effect of argument structure for the processing of abstract verbs. In this study, sets of length- and frequency-matched verbs including 40 intransitive verbs, 40 transitive verbs taking simple complements, and 40 transitive verbs taking sentential complements were presented in separate lexical and grammatical decision tasks. Half of the verbs were concrete and half were abstract. Similar results were obtained in the two tasks, with significant effects of imageability and transitivity. However, the interaction between these two variables was not significant. These results conflict with hypotheses assuming a stronger reliance of abstract semantics on linguistic codes. In contrast, our data are in line with theories that link the ease of retrieval with availability and robustness of semantic information.

Auditory word recognition of verbs: Effects of verb argument structure on referent identification

Word recognition includes the activation of a range of syntactic and semantic knowledge that is relevant to language interpretation and reference. Here we explored whether or not the number of arguments a verb takes impinges negatively on verb processing time. In this study, three experiments compared the dynamics of spoken word recognition for verbs with different preferred argument structure. Listeners’ eye movements were recorded as they searched an array of pictures in response to hearing a verb. Results were similar in all the experiments. The time to identify the referent increased as a function of the number of arguments, above and beyond any effects of label appropriateness (and other controlled variables, such as letter, phoneme and syllable length, phonological neighborhood, oral and written lexical frequencies, imageability and rated age of acquisition). The findings indicate that the number of arguments a verb takes, influences referent identification during spoken word recognition. Representational complexity and amount of information generated by the lexical item that aids target identification are discussed as possible sources of this finding.