Eric Halgren

Dynamic Statistical Parametric Mapping: Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity

Functional magnetic resonance imaging (fMRI) can provide maps of brain activation with millimeter spatial resolution but is limited in its temporal resolution to the order of seconds. Here, we describe a technique that combines structural and functional MRI with magnetoencephalography (MEG) to obtain spatiotemporal maps of human brain activity with millisecond temporal resolution. This new technique was used to obtain dynamic statistical parametric maps of cortical activity during semantic processing of visually presented words. An initial wave of activity was found to spread rapidly from occipital visual cortex to temporal, parietal, and frontal areas within 185 ms, with a high degree of temporal overlap between different areas. Repetition effects were observed in many of the same areas following this initial wave of activation, providing evidence for the involvement of feedback mechanisms in repetition priming.

Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature

Precise localization of sulco-gyral structures of the human cerebral cortex is important for the interpretation of morpho-functional data, but requires anatomical expertise and is time consuming because of the brains geometric complexity. Software developed to automatically identify sulco-gyral structures has improved substantially as a result of techniques providing topologically correct reconstructions permitting inflated views of the human brain. Here we describe a complete parcellation of the cortical surface using standard internationally accepted nomenclature and criteria. This parcellation is available in the FreeSurfer package. First, a computer-assisted hand parcellation classified each vertex as sulcal or gyral, and these were then subparcellated into 74 labels per hemisphere. Twelve datasets were used to develop rules and algorithms (reported here) that produced labels consistent with anatomical rules as well as automated computational parcellation. The final parcellation was used to build an atlas for automatically labeling the whole cerebral cortex. This atlas was used to label an additional 12 datasets, which were found to have good concordance with manual labels. This paper presents a precisely defined method for automatically labeling the cortical surface in standard terminology.

Generators of the late cognitive potentials in auditory and visual oddball tasks

Recordings directly within the brain can establish local evoked potential generation without the ambiguities always associated with extracranial electromagnetic measures. Depth recordings have found that sensory stimuli activate primary cortex and then material-specific encoders. Sensory-specific areas remain active for long periods, but by about 200 ms are joined by activation in widespread brain systems. One system is related to the orientation of attention. It is centered in paralimbic and attentional frontoparietocingular cortex, and associated with the P3a. A second system associated with P3b envelopes cognitive contextual integration. It engages the ventral temporofrontal event-encoding cortices (inferotemporal, perirhinal, and ventrolateral prefrontal), association cortices (superior temporal sulcal and posterior parietal), and the hippocampus. Thus, even in simple tasks, activation is widespread but concentrated in particular multilobar systems. With this information, the late cognitive potentials can be used to monitor the probable location, timing and intensity of brain activation during cognitive tasks.

Intracerebral potentials to rare target and distractor auditory and visual stimuli. III. Frontal cortex

Evoked potentials (EPs) were recorded from 991 frontal and peri-rolandic sites (106 electrodes) in 36 patients during an auditory discrimination task with target and non-target (distractor) rare stimuli. Variants of this task explored the effects of attention, dishabituation and stimulus characteristics (including modality). Rare stimuli evoked a widespread triphasic waveform with negative, positive and negative peaks at about 210, 280 and 390 msec, respectively. This waveform was identified with the scalp EP complex termed the N2a/P3a/slow wave and associated with orienting. It was evoked by rare target and distractor auditory and visual stimuli, as well as by rare stimulus repetitions or omissions. Across most frontal trajectories, N2a/P3a/SW amplitudes changed only slowly with distance. However, large (120 microV) P3as with steep voltage gradients were observed laterally, especially near the inferior frontal sulcus, and clear inversions of the P3a were noted in the orbito-frontal and the anterior cingulate cortices. The frontal P3a was earlier to distractor than to target stimuli, but only in some sites and with a latency difference much smaller than that observed at the scalp. Frontal P3a latencies were significantly shorter than those recorded simultaneously at the scalp and often were also shorter than P3a latency in the parietal or temporal lobes. In summary, this study demonstrates an early P3a-like activity that polarity inverts over short distances in the medial frontal lobe, and that it has a significantly shorter latency than similar potentials recorded in the temporal and parietal cortices.

Intracerebral potentials to rare target and distractor auditory and visual stimuli. II. Medial, lateral and posterior temporal lobe.

Event-related potentials were recorded from 1221 sites in the medial, lateral and posterior aspects of the temporal lobe in 39 patients. Depth electrodes were implanted for about 4 days in order to localize seizure origin prior to surgical treatment. Subjects received an auditory discrimination task with target and non-target rare stimuli. In some cases, the target, distracting and frequent tones were completely balanced across blocks for pitch and volume. Some subjects also received an analogous visual discrimination task, or auditory tasks in which the rare target event was the omission of a tone, or the repetition of a tone within a series of alternating tones. In some subjects, the same auditory stimuli were delivered but the patient ignored them while reading. A complex field was recorded, indicating multiple components with overlapping time-courses, task correlates and generators. Two general patterns could be distinguished on the basis of their waveforms, latencies and task correlates. In the temporal pole and some middle temporal, posterior parahippocampal and fusiform gyrus sites, a sharp triphasic negative-positive-negative waveform with peaks at about 220-320-420 msec was usually observed. This wave was of relatively small amplitude and diffuse, and seldom inverted in polarity. It was multimodal but most prominent to auditory stimuli, appeared to remain when the stimuli were ignored, and was not apparent to repeated words and faces. A second broad, often monophasic, waveform peaking at about 380 msec was generated in the hippocampus, a limited region of the superior temporal sulcus, and (by inference) in the anterobasal temporal lobe (possible rhinal cortex). This waveform was of large amplitude, often highly focal, and could invert over short distances. It was equal to visual and auditory stimuli, was greatly diminished when the stimuli were ignored, and was also evoked by repeating words and faces. Preceding this waveform was a non-modality-specific negativity, possibly generated in rhinal cortex, and a visual-specific negativity in inferotemporal cortex. The early triphasic pattern may embody a diffuse non-specific orienting response that is also reflected in the scalp P3a. The late monophasic pattern may embody the cognitive closure that is also reflected in the scalp P3b or late positive component.

The intracranial topography of the P3 event-related potential elicited during auditory oddball

In order to isolate the anatomical locus of neural activity primarily responsible for generating the scalp-recorded P3 (or P300), the topography of event-related potentials (ERPs) elicited during an auditory oddball task was compared between medial-to-lateral aspects of the frontal, parietal, and temporal lobes in 10 epileptic patients undergoing stereoelectroencephalography for seizure localization. Evidence of local ERP generation was obtained from each of these areas. Small amplitude P3-type potentials were sometimes observed to invert polarity across recording contacts in the frontal lobe. Large amplitude positive polarity P3-type components were observed in the lateral neocortex of the inferior parietal lobule (IPL), that rapidly attenuated in amplitude at more anterior, posterior, superior, inferior, and medial recording contacts. Large amplitude polarity inverting P3-type components were also observed to be highly localized to hippocampal contacts of temporal lobe electrodes. These data are discussed in the context of other recent studies of lesion effects, scalp topography, and intracranial recordings, and it is concluded that activity generated in the IPL is likely to make the major contribution to the scalp-recorded P3, with smaller contributions from these other sources. Finally, salient topographical differences between the intracranial distribution of the P3 and those of the N2 (or N200) and slow wave (SW) suggest that the generators of these components are not identical.

Spatiotemporal Dynamics of Modality-Specific and Supramodal Word Processing

The ability of written and spoken words to access the same semantic meaning provides a test case for the multimodal convergence of information from sensory to associative areas. Using anatomically constrained magnetoencephalography (aMEG), the present study investigated the stages of word comprehension in real time in the auditory and visual modalities, as subjects participated in a semantic judgment task. Activity spread from the primary sensory areas along the respective ventral processing streams and converged in anterior temporal and inferior prefrontal regions, primarily on the left at around 400 ms. Comparison of response patterns during repetition priming between the two modalities suggest that they are initiated by modality-specific memory systems, but that they are eventually elaborated mainly in supramodal areas.

N400-like Magnetoencephalography Responses Modulated by Semantic Context, Word Frequency, and Lexical Class in Sentences

Words have been found to elicit a negative potential at the scalp peaking at approximately 400 ms that is strongly modulated by semantic context. The current study used whole-head magnetoencephalography (MEG) as male subjects read sentences ending with semantically congruous or incongruous words. Compared with congruous words, sentence-terminal incongruous words consistently evoked a large magnetic field over the left hemisphere, peaking at approximately 450 ms. Source modeling at this latency with conventional equivalent current dipoles (ECDs) placed the N400 m generator in or near the left superior temporal sulcus. A distributed solution constrained to the cortical surface suggested a sequence of differential activation, beginning in Wernickes area at approximately 250 ms, spreading to anterior temporal sites at approximately 270 ms, to Brocas area by approximately 300 ms, to dorsolateral prefrontal cortices by approximately 320 ms, and to anterior orbital and frontopolar cortices by approximately 370 ms. Differential activity was exclusively left-sided until >370 ms, and then involved right anterior temporal and orbital cortices. At the peak of the N400 m, activation in the left hemisphere was estimated to be widespread in the anterior temporal, perisylvian, orbital, frontopolar, and dorsolateral prefrontal cortices. In the right hemisphere, the orbital, as well as, weakly, the right anterior temporal cortices were activated. Similar but weaker field patterns were evoked by intermediate words in the sentences, especially to low-frequency words occurring in early sentence positions where there is little preceding context. The locations of the N400 m sources identified with the distributed solution correspond well with those previously demonstrated with direct intracranial recordings, and suggested by functional magnetic resonance imaging (fMRI). These results help identify a distributed cortical network that supports online semantic processing.

Spatio-temporal stages in face and word processing. 1. Depth recorded potentials in the human occipital and parietal lobes

Abstract Evoked potentials (EPs) were used to help identify the timing, location, and intensity of the information-processing stages applied to faces and words in humans. EP generators were localized using intracranial recordings in 33 patients with depth electrodes implanted in order to direct surgical treatment of drug-resistant epilepsy. While awaiting spontaneous seizure onset, the patients gave their fully informed consent to perform cognitive tasks. Depth recordings were obtained from 1198 sites in the occipital, temporal and parietal cortices, and in the limbic system (amygdala, hippocampal formation and posterior cingulate gyrus). Twenty-three patients received a declarative memory recognition task in which faces of previously unfamiliar young adults without verbalizable distinguishing features were exposed for 300 ms every 3 s; 25 patients received an analogous task using words. For component identification, some patients also received simple auditory (21 patients) or visual (12 patients) discrimination tasks. Eight successive EP stages preceding the behavioral response (at about 600 ms) could be distinguished by latency, and each of 14 anatomical structures was found to participate in 2–8 of these stages. The earliest response, an N75-P105, focal in the most medial and posterior of the leads implanted in the occipital lobe (lingual g), was probably generated in visual cortical areas 17 and 18. These components were not visible in response to words, presumably because words were presented foveally. A focal evoked alpha rhythm to both words and faces was also noted in the lingual g. This was followed by an N130-P180-N240 focal and polarity-inverting in the basal occipitotemporal cortex (fusiform g, probably areas 19 and 37). In most cases, the P180 was evoked only by faces, and not by words, letters or symbols. Although largest in the fusiform g this sequence of potentials (especially the N240) was also observed in the supramarginal g, posterior superior and middle temporal g, posterior cingulate g, and posterior hippocampal formation. The N130, but not later components of this complex, was observed in the anterior hippocampus and amygdala. Faces only also evoked longer-latency potentials up to 600 ms in the right fusiform g. Words only evoked a series of potentials beginning at 190 ms and extending to 600 ms in the fusiform g and near the angular g (especially left). Both words and faces evoked a N150-P200-PN260 in the lingual g, and posterior inferior and middle temporal g. A N310-N430-P630 sequence to words and faces was largest and polarity-inverted in the hippocampal formation and amygdala, but was also probably locally-generated in many sites including the lingual g, lateral occipitotemporal cortex, middle and superior temporal g, temporal pole, supramarginal g, and posterior cingulate g. The P660 had the same distribution as has been noted for the P3b to rare target simple auditory and visual stimuli in ‘oddball’ tasks, with inversions in the hippocampus. In several sites, the N310 and N430 were smaller to repeated faces, and the P630 was larger. Putative information-processing functions were tentatively assigned to successive EP components based upon their cognitive correlates, as well as the functions and connections of their generating structures. For the N75-P105, this putative function is simple feature detection in primary visual cortex (V1 and V2). The N130-P180-N240 may embody structural face encoding in posterobasal inferotemporal cortex (homologous to V4?), with the results being spread widely to inferotemporal, multimodal and paralimbic cortices. For words, similar visual-form encoding (in fusiform g) or visual-phonemic encoding (in angular g) may occur between 150 and 280 ms. During the N310, faces and words may be multiply encoded for form and identity (inferotemporal), emotional (amygdala), recent declarative mnestic (hippocampal formation), and semantic (supramarginal and superior temporal sulcal supramodal cortices) characteristics. These multiple characteristics may be contextually integrated across inferotemporal, supramodal association, and limbic cortices during the N430, with cognitive closure following in the P630. In sum, visual information arrives at area 17 by about 75 ms, and is structurally-encoded in occipito-temporal cortex during the next 110 ms. By 150–200 ms after stimulus onset, activation has spread to parietal, lateral temporal, and limbic cortices, all of which continue to participate with the more posterior areas for the next 500 ms of event-encoding. Thus, face and word processing is serial in the sense that it can be divided into successive temporal stages, but highly parallel in that (after the initial stages where visual primitives are extracted) multiple anatomical areas with distinct perceptual, mnestic and emotional functions are engaged simultaneously. Consequently, declarative memory and emotional encoding can participate in early stages of perceptual, as well as later stages of cognitive integration. Conversely, occipitotemporal cortex is involved both early in processing (immediately after V1), as well as later, in the N430. That is, most stages of face and word processing appear to take advantage of the rich ‘upstream’ and ‘downstream’ anatomical connections in the ventral visual processing stream to link the more strictly perceptual networks with semantic, emotional, and mnestic networks.

Spatiotemporal mapping of brain activity by integration of multiple imaging modalities

Functional magnetic resonance imaging (fMRI) and positron emission tomography measure local changes in brain hemodynamics induced by cognitive or perceptual tasks. These measures have a uniformly high spatial resolution of millimeters or less, but poor temporal resolution (about 1s). Conversely, electroencephalography (EEG) and magnetoencephalography (MEG) measure instantaneously the current flows induced by synaptic activity, but the accurate localization of these current flows based on EEG and MEG data alone remains an unsolved problem. Recently, techniques have been developed that, in the context of brain anatomy visualized with structural MRI, use both hemodynamic and electromagnetic measures to arrive at estimates of brain activation with high spatial and temporal resolution. These methods range from simple juxtaposition to simultaneous integrated techniques. Their application has already led to advances in our understanding of the neural bases of perception, attention, memory and language. Further advances in multi-modality integration will require an improved understanding of the coupling between the physiological phenomena underlying the different signal modalities.