Jutta L. Mueller

Morphological Processing in a Second Language: Behavioral and Event-related Brain Potential Evidence for Storage and Decomposition

This study reports the results of two behavioral and two event-related brain potential experiments examining the processing of inflected words in second-language (L2) learners with Russian as their native language. Two different subsystems of German inflection were studied, participial inflection and noun plurals. For participial forms, L2 learners were found to widely generalize the -t suffixation rule in a nonce-word elicitation task, and in the event-related brain potential experiment, they showed an anterior negativity followed by a P600-both results resembling previous findings from native speakers of German on the same materials. For plural formation, the L2 learners displayed different preference patterns for regular and irregular forms in an off-line plural judgment task. Regular and irregular plural forms also differed clearly with regard to their brain responses. Whereas overapplications of the -s plural rule produced a P600 component, overapplications of irregular patterns elicited an N400. In contrast to native speakers of German, however, the L2 learners did not show an anterior negativity for -s plural overapplications. Taken together, the results show clear dissociations between regular and irregular inflection for both morphological subsystems. We argue that the two processing routes posited by dual-mechanism models of inflection (lexical storage and morphological decomposition) are also employed by L2 learners.

Native and Nonnative Speakers' Processing of a Miniature Version of Japanese as Revealed by ERPs

Several event-related potential (ERP) studies in second language (L2) processing have revealed a differential vulnerability of syntax-related ERP effects in contrast to purely semantic ERP effects. However, it is still debated to what extent a potential critical period for L2 acquisition, as opposed to the attained proficiency level in the L2, contributes to the pattern of results reported in previous ERP studies. We studied L2 processing within the model of a miniature version of a natural language, namely Japanese, specifically constructed to assure high proficiency of the learners. In an auditory ERP experiment, we investigated sentence processing of the Mini-Japanese in Japanese native speakers and German volunteers before and after training. By making use of three different types of violation, namely, word category, case, and classifier violations, native and nonnative ERP patterns were compared. The three types of violation elicited three characteristic ERP patterns in Japanese native speakers. The word category violation elicited an anteriorly focused, broadly distributed early negativity followed by a P600, whereas the case violation evoked a P600 which was preceded by an N400. The classifier violation led solely to a late left distributed negativity with an anterior focus. Although the P600 was similar for Japanese natives and learners, the N400 and the anterior negativities were not present in the learner group. The differences across groups suggest deviant neural processes in on-line syntactic and thematic processing in the L2 learners despite high behavioral skills.

Electrophysiological correlates of second language processing

The aim of this article is to provide a selective review of event-related potential (ERP) research on second language processing. As ERPs have been used in the investigation of a variety of linguistic domains, the reported studies cover different paradigms assessing processing mechanisms in the second language at various levels, ranging from phoneme discrimination to complex sentence processing. Differences between ERP patterns of first language (L1) and second language (L2) speakers can help to specify and to test predictions derived from models of L2 processing or hypotheses concerning critical periods for some aspects of second language acquisition. The studies currently available suggest that ERPs are indeed sensitive to qualitative and quantitative differences in L2 speakers with regard to on-line processing.

Neural circuits of hierarchical visuo-spatial sequence processing

Sequence processing has been investigated in a number of studies using serial reaction time tasks or simple artificial grammar tasks. Little, however, is known about higher-order sequence processing entailing the hierarchical organization of events. Here, we manipulated the regularities within sequentially occurring, non-linguistic visual symbols by applying two types of prediction rules. In one rule (the adjacent dependency rule), the sequences consisted of alternating items from two different categories. In the second rule (the hierarchical dependency rule), a hierarchical structure was generated using the same set of item types. Thus, predictions about non-adjacent elements were required for the latter rule. Functional Magnetic Resonance Imaging (fMRI) was used to investigate the neural correlates of the application of the two prediction rules. We found that the hierarchical dependency rule correlated with activity in the pre-supplementary motor area, and the head of the caudate nucleus. In addition, in a hypothesis-driven ROI analysis in Brocas area (BA 44), we found a significantly higher hemodynamic response to the hierarchical dependency rule than to the adjacent dependency rule. These results suggest that this neural network supports hierarchical sequencing, possibly contributing to the integration of sequential elements into higher-order structural events. Importantly, the findings suggest that Brocas area is also engaged in hierarchical sequencing in domains other than language.

Auditory perception at the root of language learning

Learning a spoken language presupposes efficient auditory functions. In the present event-related potential study, we tested whether and how basic auditory processes are related to online learning of a linguistic rule in infants and adults. Participants listened to frequent standard stimuli, which were interspersed with infrequent pitch deviants and rule deviants, violating a nonadjacent dependency between two syllables. Only infants who showed the more mature mismatch response for the pitch deviants (i.e., a negativity) showed a mismatch response to the rule deviants. Concordantly, the small group of adults who showed evidence of rule learning showed larger mismatch effects for pitch processing. We conclude that the ability to extract linguistic rules develops in early infancy and is tightly linked to functional aspects of basic auditory mechanisms.

Precursors to natural grammar learning: preliminary evidence from 4-month-old infants.

When learning a new language, grammar—although difficult—is very important, as grammatical rules determine the relations between the words in a sentence. There is evidence that very young infants can detect rules determining the relation between neighbouring syllables in short syllable sequences. A critical feature of all natural languages, however, is that many grammatical rules concern the dependency relation between non-neighbouring words or elements in a sentence i.e. between an auxiliary and verb inflection as in is singing. Thus, the issue of when and how children begin to recognize such non-adjacent dependencies is fundamental to our understanding of language acquisition. Here, we use brain potential measures to demonstrate that the ability to recognize dependencies between non-adjacent elements in a novel natural language is observable by the age of 4 months. Brain responses indicate that 4-month-old German infants discriminate between grammatical and ungrammatical dependencies in auditorily presented Italian sentences after only brief exposure to correct sentences of the same type. As the grammatical dependencies are realized by phonologically distinct syllables the present data most likely reflect phonologically based implicit learning mechanisms which can serve as a precursor to later grammar learning.

ERP evidence for different strategies in the processing of case markers in native speakers and non-native learners

BackgroundThe present experiments were designed to test how the linguistic feature of case is processed in Japanese by native and non-native listeners. We used a miniature version of Japanese as a model to compare sentence comprehension mechanisms in native speakers and non-native learners who had received training until they had mastered the system. In the first experiment we auditorily presented native Japanese speakers with sentences containing incorrect double nominatives and incorrect double accusatives, and with correct sentences. In the second experiment we tested trained non-natives with the same material. Based on previous research in German we expected an N400-P600 biphasic ERP response with specific modulations depending on the violated case and whether the listeners were native or non-native.ResultsFor native Japanese participants the general ERP response to the case violations was an N400-P600 pattern. Double accusatives led to an additional enhancement of the P600 amplitude. For the learners a native-like P600 was present for double accusatives and for double nominatives. The additional negativity, however, was present in learners only for double nominative violations, and it was characterized by a different topographical distribution.ConclusionThe results indicate that native listeners use case markers for thematic as well as syntactic structure building during incremental sentence interpretation. The modulation of the P600 component for double accusatives possibly reflects case specific syntactic restrictions in Japanese. For adult language learners later processes, as reflected in the P600, seem to be more native-like compared to earlier processes. The anterior distribution of the negativity and its selective emergence for canonical sentences were taken to suggest that the non-native learners resorted to a rather formal processing strategy whereby they relied to a large degree on the phonologically salient nominative case marker.

Learnability of Embedded Syntactic Structures Depends on Prosodic Cues

The ability to process center-embedded structures has been claimed to represent a core function of the language faculty. Recently, several studies have investigated the learning of center-embedded dependencies in artificial grammar settings. Yet some of the results seem to question the learnability of these structures in artificial grammar tasks. Here, we tested under which exposure conditions learning of center-embedded structures in an artificial grammar is possible. We used naturally spoken syllable sequences and varied the presence of prosodic cues. The results suggest that mere distributional information does not suffice for successful learning. Prosodic cues marking the boundaries of the major relevant units, however, can lead to learning success. Thus, our data are consistent with the hypothesis that center-embedded syntactic structures can be learned in artificial grammar tasks if language-like acoustic cues are provided.

Syntactic learning by mere exposure An ERP study in adult learners

BackgroundArtificial language studies have revealed the remarkable ability of humans to extract syntactic structures from a continuous sound stream by mere exposure. However, it remains unclear whether the processes acquired in such tasks are comparable to those applied during normal language processing. The present study compares the ERPs to auditory processing of simple Italian sentences in native and non-native speakers after brief exposure to Italian sentences of a similar structure. The sentences contained a non-adjacent dependency between an auxiliary and the morphologically marked suffix of the verb. Participants were presented four alternating learning and testing phases. During learning phases only correct sentences were presented while during testing phases 50 percent of the sentences contained a grammatical violation.ResultsThe non-native speakers successfully learned the dependency and displayed an N400-like negativity and a subsequent anteriorily distributed positivity in response to rule violations. The native Italian group showed an N400 followed by a P600 effect.ConclusionThe presence of the P600 suggests that native speakers applied a grammatical rule. In contrast, non-native speakers appeared to use a lexical form-based processing strategy. Thus, the processing mechanisms acquired in the language learning task were only partly comparable to those applied by competent native speakers.

The role of pause cues in language learning: The emergence of event-related potentials related to sequence processing

Humans can derive sequential dependencies from unfamiliar artificial speech within several of minutes of exposure. However, there is an ongoing debate about the nature of the underlying learning processes. In a widely discussed study Pea et al. [Pea, M., Bonatti, L. L., Nespor, M., & Mehler, J. Signal-driven computations in speech processing. Science, 298, 604607, 2002] argued for the importance of subtle acoustic cues in the signal, such as pauses, in order to switch between two computational mechanisms, which are conceptualized as rule-based versus statistical. The present study was aimed to approach this problem by recording event-related potentials in response to correct and incorrect phrases consisting of bisyllabics after short exposure to either rule-based or random artificial speech streams. Rule-based streams contained dependencies of the form AXC, whereby A elements reliably predicted the C elements and X elements were variable. Participants were exposed to four input and test phases. Two of the input streams were rule-based and contained either only probabilistic information related to the distribution of the AXC stimuli or an additional acoustic cue indicating the boundaries of relevant units. The other two streams were random variations of the rule-based streams. During the test phase in the condition with pause cues, an early negativity and a later positivity emerged for correct and incorrect items in comparison to their acoustically identical counterparts, which were presented after the random control condition. In the noncued condition, only negativities were seen. The timing and the scalp distribution of the negativities were different for correct and incorrect sequences in both the cued and the noncued conditions. The results are interpreted in support of a view of grammatical learning in which both distributional and acoustic cues may contribute to different aspects of syntactic learning.