Shimin Fu

Testing for Dual Brain Processing Routes in Reading: A Direct Contrast of Chinese Character and Pinyin Reading Using fMRI

Chinese offers a unique tool for testing the effects of word form on language processing during reading. The processes of letter-mediated grapheme-to-phoneme translation and phonemic assembly (assembled phonology) critical for reading and spelling in any alphabetic orthography are largely absent when reading nonalphabetic Chinese characters. In contrast, script-to-sound translation based on the script as a whole (addressed phonology) is absent when reading the Chinese alphabetic sound symbols known as pinyin, for which the script-to-sound translation is based exclusively on assembled phonology. The present study aims to contrast patterns of brain activity associated with the different cognitive mechanisms needed for reading the two scripts. fMRI was used with a block design involving a phonological and lexical task in which subjects were asked to decide whether visually presented, paired Chinese characters or pinyin sounded like a word. Results demonstrate that reading Chinese characters and pinyin activate a common brain network including the inferior frontal, middle, and inferior temporal gyri, the inferior and superior parietal lobules, and the extrastriate areas. However, some regions show relatively greater activation for either pinyin or Chinese reading. Reading pinyin led to a greater activation in the inferior parietal cortex bilaterally, the precuneus, and the anterior middle temporal gyrus. In contrast, activation in the left fusiform gyrus, the bilateral cuneus, the posterior middle temporal, the right inferior frontal gyrus, and the bilateral superior frontal gyrus were greater for nonalphabetic Chinese reading. We conclude that both alphabetic and nonalphabetic scripts activate a common brain network for reading. Overall, there are no differences in terms of hemispheric specialization between alphabetic and nonalphabetic scripts. However, differences in language surface form appear to determine relative activation in other regions. Some of these regions (e.g., the inferior parietal cortex for pinyin and fusiform gyrus for Chinese characters) are candidate regions for specialized processes associated with reading via predominantly assembled (pinyin) or addressed (Chinese character) procedures.

Effects of Word Form on Brain Processing of Written Chinese

Both logographic characters and alphabetic pinyins can be used to write words in Chinese. Here we use fMRI to address the question of whether the written form affects brain processing of a word. Fifteen healthy, right-handed, native Chinese-reading volunteers participated in our study and were asked to read silently either Chinese characters (8 subjects) or pinyins (7 subjects). The stimulus presentation rate was varied for both tasks to allow us to identify brain regions with word-load-dependent activation. Rate effects (fast minus slow presentations) for Chinese character reading were observed in striate and extrastriate visual cortex, superior parietal lobule, left posterior middle temporal gyrus, bilateral inferior temporal gyri, and bilateral superior frontal gyri. Rate effects for pinyin reading were observed in bilateral fusiform, lingual, and middle occipital gyri, bilateral superior parietal lobule/precuneus, left inferior parietal lobule, bilateral inferior temporal gyrus, left middle temporal gyrus, and left superior temporal gyrus. These results demonstrate that common regions of the brain are involved in reading both Chinese characters and pinyins, activated apparently independently of the surface form of the word. There also appear to be brain regions in which activation is dependent on word form. However, it is unlikely that these are entirely specific for a given word form; their activation more likely reflects relative functional specializations within broader networks for processing written language.

The attentional effects of peripheral cueing as revealed by two event-related potential studies

OBJECTIVE The mechanism of visual spatial attention elicited by peripheral cueing was investigated in two studies. METHOD Event-related potentials (ERPs) were recorded when the subjects were performing a spatial frequency discrimination task and a location discrimination task. Stimuli were randomly flashed in the left or right visual field. Prior to each stimulus a peripheral cue was presented with a validity of 75%. RESULTS The subjects responded faster to valid trials than to invalid trials. The earliest visual ERP component, C1, was not modulated by the cue validity, suggesting that visual spatial attention elicited by peripheral cueing does not involve striate cortex. Valid trials elicited larger contralateral P1 but a smaller contralateral N1 than invalid trials. The early onsets of these attentional effects show that spatial attention affects stimulus processing at early sensory/perceptual stages. The latencies of contralateral P1 and contralateral N1 were shorter for invalid trials, however. The ipsilateral N1 was enhanced by valid trials in the spatial frequency discrimination task but was not in the location discrimination task, whereas the contralateral N1 was larger for invalid trials than for valid trials in both tasks. CONCLUSION The results indicate that involuntary allocation of attention involves different mechanisms from voluntary allocation of attention.

Brain mechanisms of involuntary visuospatial attention: an event-related potential study.

The brain mechanisms mediating visuospatial attention were investigated by recording event‐related potentials (ERPs) during a line‐orientation discrimination task. Nonpredictive peripheral cues were used to direct participants attention involuntarily to a spatial location. The earliest attentional modulation was observed in the P1 component (peak latency about 130 ms), with the valid trials eliciting larger P1 than invalid trials. Moreover, the attentional modulations on both the amplitude and latency of the P1 and N1 components had a different pattern as compared to previous studies with voluntary attention tasks. In contrast, the earliest visual ERP component, C1 (peak latency about 80 ms), was not modulated by attention. Low‐resolution brain electromagnetic tomography (LORETA) showed that the earliest attentional modulation occurred in extrastriate cortex (middle occipital gyrus, BA 19) but not in the primary visual cortex. Later attention‐related reactivations in the primary visual cortex were found at about 110 ms after stimulus onset. The results suggest that involuntary as well as voluntary attention modulates visual processing at the level of extrastriate cortex; however, at least some different processes are involved by involuntary attention compared to voluntary attention. In addition, the possible feedback from higher visual cortex to the primary visual cortex is faster and occurs earlier in involuntary relative to voluntary attention task. Hum Brain Mapp, 2005.

Dissociation of visual C1 and P1 components as a function of attentional load: An event-related potential study

The earliest cortical location at which attention influences visual processing is controversial. To address this issue, the C1 and P1 components of cue-elicited ERPs were examined in a spatially-cued task under high and low levels of attentional load (active vs. passive viewing). Cues were presented either to the left or to the right visual field in separate trials (unilateral presentation), or to both visual fields simultaneously (bilateral presentation). For the unilateral presentation, C1 (peak latency approximately 80 ms) was not modulated by attentional load, whereas P1 (peak latency approximately 120-140 ms) was larger for high-relative to low-load condition. Bilateral presentation of the stimuli enhanced the amplitude of the C1 component relative to unilateral presentation; however, the increase of signal/noise ratio of C1 revealed no attentional load effect on C1. Results show that attentional load modulates visual processing in the P1, but not in the C1 time range, regardless of the increased signal/noise ratio by bilateral presentation. While it remains unclear about the conditions under which a C1 attentional effect is reliably elicited, the present results suggest that the direct manipulation of attentional load under a voluntary attention task seems not crucial for eliciting C1 attentional effect.

When and where perceptual load interacts with voluntary visuospatial attention: An event-related potential and dipole modeling study

Perceptual load is recognized to affect visual selective attention, but at an unknown spatiotemporal locus in the brain. To examine this issue, event-related potentials (ERPs) were recorded while participants performed an orientation discrimination task, under conditions of low or high perceptual load. Participants were required to respond to targets (10% of trials) presented in the attended visual field while ignoring all stimuli in the unattended visual field. The interaction between voluntary attention and perceptual load was significant for the posterior N1 component (190 ms) but not for the earlier C1 (84 ms) or P1 (100 ms) components. This load by attention interaction for N1 was localized to the temporoparietal-occipital (TPO) gyrus by dipole modeling analysis. Dipole modeling also showed that a reversed attentional effect in the C1 time range was due to ERP overlap from the subsequent attention-sensitive P1 component. Results suggest that perceptual load affects voluntary visuospatial attention at an early (but not the earliest) processing stage and that the TPO gyrus mediates target selection at the discrimination stage.

Perceptual load interacts with involuntary attention at early processing stages: Event-related potential studies

Perceptual load is known to influence the locus of attentional selection in the brain but through an unknown underlying mechanism. We used event-related potentials (ERPs) to investigate how perceptual load interacts with cue-driven involuntary attention. Perceptual load was manipulated in a line orientation discrimination task in which target location was cued involuntarily by means of peripheral cues. Attentional modulation was observed for P1m (the posterior midline P1 component with peak latency between 108 and 140 ms) with invalid trials eliciting larger P1m than valid trials. This attentional effect on P1m increased as a function of perceptual load, suggesting an early temporal locus for the interaction of perceptual load and involuntary attention. Attentional modulation for the C1 component (peak latency at approximately 80 ms) was also observed, but only for high-load stimuli that were presented intermixed with low-load stimuli. Results suggest that (a) perceptual load affects attentional selection at early processing stages; (b) perceptual load interacts with involuntary attention earlier and with different brain mechanisms relative to voluntary attention; and (c) attentional modulation in the C1 time range is possible under optimal experimental conditions.

Towards understanding language organisation in the brain using fMRI.

Functional magnetic resonance imaging (fMRI), which allows non‐invasive mapping of human cognitive functions, has become an important tool for understanding language function. An understanding of component processes and sources of noise in the images is contributing to increased confidence in the reproductability of studies. This allows clinical applications, e.g., for pre‐surgical lateralisation of language functions in patients with temporal lobe epilepsy. fMRI is a sensitive method for mapping regions involved in language functions. We recently have applied it to study the effect of word surface form on reading with a comparison of responses to Chinese characters or alphabetical Pinyin. Interpretation of fMRI activations must be made with caution; fMRI suggests task‐associated activation, but does not independently confirm that such activity is necessary. However, complementary studies can be performed using transcranial magnetic stimulation (TMS), which can be used to interfere with brain activity in a specific region transiently for characterisation of the behavioural effects. We describe how TMS combined with fMRI has confirmed a role for the left inferior frontal cortex in semantic processing. Hum. Brain Mapping 18:239–247, 2003.

Early interaction between perceptual load and involuntary attention: an event-related potential study

Whether selective attention affects C1, the first (earliest) visual cortical component of the event-related potential (ERP), remains controversial. We used a cued, involuntary attention task requiring discrimination of targets under low and high levels of perceptual load to examine early attentional modulation in visual cortex. Potential confounds due to physical stimulus differences between load conditions and cue-target sensory interaction were minimized. An interaction between perceptual load and involuntary attention was observed for the P1m component (peak latency between 100 and 140 ms). Furthermore, the parieto-central C1 component (peak latency 80 ms) was modulated by attention, but only under the high-load condition. Thus, whereas attention typically modulates the later P1 component, attentional modulation of C1 is possible under optimal conditions. Specifically, a high perceptual load is necessary for eliciting this earliest attentional effect on cortical processing.

Neural adaptation provides evidence for categorical differences in processing of faces and Chinese characters: an ERP study of the N170.

Whether face perception involves domain-specific or domain-general processing is an extensively debated issue. Relative to non-face objects and alphabetical scripts, Chinese characters provide a good contrast to faces because of their structural configuration, requirement for high level of visual expertise to literate Chinese people, and unique appearance and identity for each individual stimulus. To examine potential categorical differences in their neural processing, event-related potentials (ERPs) were recorded to blocked face and Chinese character stimuli. Fast adaptation method was applied to better control for the low-level stimulus difference between faces and Chinese characters. Participants were required to respond to the color of the outer frame in which these stimuli were presented, at either a fast (ISI 650 ms) or slow (ISI 1300 ms) rate, and with an orientation that was either the same or alternated between upright and inverted. Faces elicited a larger and later N170 relative to characters, but the N170 was more left-lateralized for characters relative to the faces. Adaptation-by-rate and adaptation-by-orientation effects were observed on the amplitude of N170, and both were more pronounced for faces relative to characters. Inverted stimuli elicited a later N170 relative to upright stimuli, without amplitude change, and this inversion effect was more pronounced for faces relative to characters. Moreover, faces elicited a larger and later P1 and a larger adaptation-by-rate effect on P1 relative to characters. The adaptation-by-orientation effect was illustrated by a larger P1 under the same relative to the alternated orientation condition. Therefore, evidence from the amplitude and the lateralization of N170, the stimulus inversion effect on N170 latency, and the neural adaptation between faces and Chinese characters on P1 and N170 components support the notion that the processing of faces and Chinese characters involve categorically different neural mechanisms.