Thomas P. Urbach

Mass univariate analysis of event-related brain potentials/fields I: A critical tutorial review

Event-related potentials (ERPs) and magnetic fields (ERFs) are typically analyzed via ANOVAs on mean activity in a priori windows. Advances in computing power and statistics have produced an alternative, mass univariate analyses consisting of thousands of statistical tests and powerful corrections for multiple comparisons. Such analyses are most useful when one has little a priori knowledge of effect locations or latencies, and for delineating effect boundaries. Mass univariate analyses complement and, at times, obviate traditional analyses. Here we review this approach as applied to ERP/ERF data and four methods for multiple comparison correction: strong control of the familywise error rate (FWER) via permutation tests, weak control of FWER via cluster-based permutation tests, false discovery rate control, and control of the generalized FWER. We end with recommendations for their use and introduce free MATLAB software for their implementation.

The intractability of scaling scalp distributions to infer neuroelectric sources.

ERP researchers use differences in scalp distributions to infer differences in spatial configurations of neuroelectric generators. Since McCarthy and Wood (1985) demonstrated that a spatially fixed current source varying only in strength can yield a significant Condition x Electrode interaction in ANOVA, the recommended approach has been to normalize ERP amplitudes, for example, by vector length, prior to testing for interactions. The assumptions of this procedure are examined and it is shown via simulations that this application of vector scaling is both conceptually flawed and unsound in experimental practice. Because different spatial configurations of neural generators cannot reliably be inferred from different scalp topographies even after amplitude normalization, it is recommended that the procedure no longer be used for this purpose.

Mass univariate analysis of event-related brain potentials/fields II: Simulation studies

Mass univariate analysis is a relatively new approach for the study of ERPs/ERFs. It consists of many statistical tests and one of several powerful corrections for multiple comparisons. Multiple comparison corrections differ in their power and permissiveness. Moreover, some methods are not guaranteed to work or may be overly sensitive to uninteresting deviations from the null hypothesis. Here we report the results of simulations assessing the accuracy, permissiveness, and power of six popular multiple comparison corrections (permutation-based control of the familywise error rate [FWER], weak control of FWER via cluster-based permutation tests, permutation-based control of the generalized FWER, and three false discovery rate control procedures) using realistic ERP data. In addition, we look at the sensitivity of permutation tests to differences in population variance. These results will help researchers apply and interpret these procedures.

Interpreting event-related brain potential (ERP) distributions: Implications of baseline potentials and variability with application to amplitude normalization by vector scaling

Recent proposals regarding the purpose and validity of amplitude normalization by vector scaling including mitigation of baseline and noise problems in between-condition difference analyses are critically evaluated. In so doing, we elaborate on some of the points raised in regarding baselines and noise, especially as these impact amplitude normalization by vector scaling and discuss the motivation for measuring event-related brain potential (ERP) amplitudes relative to a pre-stimulus baseline and the implications of this for certain (but not all) inferences. Throughout, our focus is on the logic of interpreting ERP measurements with an emphasis on the importance of specific assumptions and consideration of what conclusions are and are not supported.

Combined perception of emotion in pictures and musical sounds

Evaluation of emotional scenes requires integration of information from different modality channels, most frequently from audition and vision. Neither the psychological nor neural basis of auditory-visual interactions during the processing of affect is well understood. In this study, possible interactions in affective processing were investigated via event-related potential (ERP) recordings during simultaneous presentation of affective pictures (from IAPS) and affectively sung notes that either matched or mismatched each other in valence. To examine the role of attention in multisensory affect-integration ERPs were recorded in two different rating tasks (voice affect rating, picture affect rating) as participants evaluated the affect communicated in one of the modalities, while that in the other modality was ignored. Both the behavioral and ERP data revealed some, although non-identical, patterns of cross-modal influences; modulation of the ERP-component P2 suggested a relatively early integration of affective information in the attended picture condition, though only for happy picture-voice pairs. In addition, congruent pairing of sad pictures and sad voice stimuli affected the late positive potential (LPP). Responses in the voice affect rating task were overall more likely to be modulated by the concomitant pictures affective valence than vice versa.

Thinking ahead or not? Natural aging and anticipation during reading.

Despite growing evidence of young adults neurally pre-activating word features during sentence comprehension, less clear is the degree to which this generalizes to older adults. Using ERPs, we tested for linguistic prediction in younger and older readers by means of indefinite articles (as and ans) preceding more and less probable noun continuations. Although both groups exhibited cloze probability-graded noun N400s, only the young showed significant article effects, indicating probabilistic sensitivity to the phonology of anticipated upcoming nouns. Additionally, both age groups exhibited prolonged increased frontal positivities to less probable nouns, although in older adults this effect was prominent only in a subset with high verbal fluency (VF). This ERP positivity to contextual constraint violations offers additional support for prediction in the young. For high VF older adults, the positivity may indicate they, too, engage in some form of linguistic pre-processing when implicitly cued, as may have occurred via the articles.

Comprehending how visual context influences incremental sentence processing: Insights from ERPs and picture-sentence verification

To re-establish picture-sentence verification-discredited possibly for its over-reliance on post-sentence response time (RT) measures-as a task for situated comprehension, we collected event-related brain potentials (ERPs) as participants read a subject-verb-object sentence, and RTs indicating whether or not the verb matched a previously depicted action. For mismatches (vs. matches), speeded RTs were longer, verb N400s over centro-parietal scalp larger, and ERPs to the object noun more negative. RTs (congruence effect) correlated inversely with the centro-parietal verb N400s, and positively with the object ERP congruence effects. Verb N400s, object ERPs, and verbal working memory scores predicted more variance in RT effects (50%) than N400s alone. Thus, (1) verification processing is not all post-sentence; (2) simple priming cannot account for these results; and (3) verification tasks can inform studies of situated comprehension.

Neural processing of vocal emotion and identity

The voice is a marker of a persons identity which allows individual recognition even if the person is not in sight. Listening to a voice also affords inferences about the speakers emotional state. Both these types of personal information are encoded in characteristic acoustic feature patterns analyzed within the auditory cortex. In the present study 16 volunteers listened to pairs of non-verbal voice stimuli with happy or sad valence in two different task conditions while event-related brain potentials (ERPs) were recorded. In an emotion matching task, participants indicated whether the expressed emotion of a target voice was congruent or incongruent with that of a (preceding) prime voice. In an identity matching task, participants indicated whether or not the prime and target voice belonged to the same person. Effects based on emotion expressed occurred earlier than those based on voice identity. Specifically, P2 (approximately 200 ms)-amplitudes were reduced for happy voices when primed by happy voices. Identity match effects, by contrast, did not start until around 300 ms. These results show an early task-specific emotion-based influence on the early stages of auditory sensory processing.

The phonemic restoration effect reveals pre-N400 effect of supportive sentence context in speech perception.

The phonemic restoration effect refers to the tendency for people to hallucinate a phoneme replaced by a non-speech sound (e.g., a tone) in a word. This illusion can be influenced by preceding sentential context providing information about the likelihood of the missing phoneme. The saliency of the illusion suggests that supportive context can affect relatively low (phonemic or lower) levels of speech processing. Indeed, a previous event-related brain potential (ERP) investigation of the phonemic restoration effect found that the processing of coughs replacing high versus low probability phonemes in sentential words differed from each other as early as the auditory N1 (120-180 ms post-stimulus); this result, however, was confounded by physical differences between the high and low probability speech stimuli, thus it could have been caused by factors such as habituation and not by supportive context. We conducted a similar ERP experiment avoiding this confound by using the same auditory stimuli preceded by text that made critical phonemes more or less probable. We too found the robust N400 effect of phoneme/word probability, but did not observe the early N1 effect. We did however observe a left posterior effect of phoneme/word probability around 192-224 ms-clear evidence of a relatively early effect of supportive sentence context in speech comprehension distinct from the N400.

Perceptual and motor attribute ratings for 559 object concepts

To understand how and when object knowledge influences the neural underpinnings of language comprehension and linguistic behavior, it is critical to determine the specific kinds of knowledge that people have. To extend the normative data currently available, we report a relatively more comprehensive set of object attribute rating norms for 559 concrete object nouns, each rated on seven attributes corresponding to sensory and motor modalities—color, motion, sound, smell, taste, graspability, and pain—in addition to familiarity (376 raters, M = 23 raters per item). The mean ratings were subjected to principal-components analysis, revealing two primary dimensions plausibly interpreted as relating to survival. We demonstrate the utility of these ratings in accounting for lexical and semantic decision latencies. These ratings should prove useful for the design and interpretation of experimental tests of conceptual and perceptual object processing.