Nicole K. Speer

Reading Stories Activates Neural Representations of Visual and Motor Experiences

To understand and remember stories, readers integrate their knowledge of the world with information in the text. Here we present functional neuroimaging evidence that neural systems track changes in the situation described by a story. Different brain regions track different aspects of a story, such as a characters physical location or current goals. Some of these regions mirror those involved when people perform, imagine, or observe similar real-world activities. These results support the view that readers understand a story by simulating the events in the story world and updating their simulation when features of that world change.

Neural substrates of narrative comprehension and memory

When reading a narrative, comprehension and retention of information benefit considerably from the use of situation models--coherent representations of the characters, locations, and activities described in the text. Here we used functional magnetic resonance imaging (fMRI) to explore the neural mechanisms supporting situation model processing. Participants read blocks of sentences that were either unrelated to one another or formed coherent narratives. A timecourse-based approach was used to identify regions that differentiated narrative-level comprehension from sentence-level comprehension. Most brain regions that showed modulation of activation during narrative-level comprehension were also modulated to a lesser extent during sentence-level comprehension, suggesting a shared reliance on general coherence-building mechanisms. However, tentative evidence was found for narrative-specific activation in dorsomedial prefrontal cortex. Additional analyses identified spatiotemporally distinct neural contributions to situation model processing, with posterior parietal regions supporting situation model construction and frontotemporal regions supporting situation model maintenance. Finally, a set of subsequent memory analyses demonstrated that the boost in comprehension and memory performance observed for coherent materials was attributable to the use of integrative situation models rather than lower-level differences in sentence-level or word-level encoding. These results clarify the functional contributions of distinct brain systems to situation model processing and their mapping onto existing psychological models of narrative comprehension.

The brain's cutting-room floor: segmentation of narrative cinema

Observers segment ongoing activity into meaningful events. Segmentation is a core component of perception that helps determine memory and guide planning. The current study tested the hypotheses that event segmentation is an automatic component of the perception of extended naturalistic activity, and that the identification of event boundaries in such activities results in part from processing changes in the perceived situation. Observers may identify boundaries between events as a result of processing changes in the observed situation. To test this hypothesis and study this potential mechanism, we measured brain activity while participants viewed an extended narrative film. Large transient responses were observed when the activity was segmented, and these responses were mediated by changes in the observed activity, including characters and their interactions, interactions with objects, spatial location, goals, and causes. These results support accounts that propose event segmentation is automatic and depends on processing meaningful changes in the perceived situation; they are the first to show such effects for extended naturalistic human activity.

Activation of human motion processing areas during event perception

Observers are able to segment continuous everyday activity into meaningful parts. This ability may be related to processing low-level visual cues, such as changes in motion. To address this issue, the present study combined measurement of evoked responses to event boundaries with functional identification of the extrastriate motion complex (MT+) and the frontal eye field (FEF), two regions related to motion perception and eye movements. The results provided strong evidence that MT+ is activated by event boundaries: Individuals’ MT+ regions showed strong responses to event boundaries, and MT+ was collocated with a lateral posterior region that responded at event boundaries. The evidence regarding the FEF was less conclusive: The FEF showed reliable but relatively reduced responses to event boundaries, but the FEF was medial and superior to a frontal area that responded at event boundaries. These results suggest that motion cues, and possibly eye movements, may play key roles in event structure perception.

Reliability of functional localization using fMRI

Neuroimaging researchers increasingly take advantage of the known functional properties of brain regions to localize them and probe changes in their activity under different conditions. The utility of this approach depends in part on the reliability of the methods used to define these regions of interest. Two operations may affect the reliability of functionally identified regions: spatially normalizing data to a stereotactic atlas and statistically combining data across participants to form a composite region (as opposed to identifying individual regions for each participant). The effect of these two operations on reliability was evaluated for two functionally identifiable regions: the MT complex and the frontal eye fields. Spatial normalization had almost no effect on within-subject reliability, while grouping across participants negatively affected retest measures of the activation and location of regions defined on separate occasions. We conclude that, for typical sample sizes and numbers of observations per subject, functional localization is most reliable when performed for each individual using data in atlas space.

Strategy-dependent changes in memory: Effects on behavior and brain activity

In the present study, an implicit strategy manipulation was used to explore the contribution of memory strategy to brain activation and behavioral performance. Participants were biased to use either a shortterm (maintenance-focused) or long-term (retrieval-focused) memory strategy within a single memory task through manipulation of task context. In comparing directly matched trials across the different task contexts, we observed clear changes in both behavioral performance and brain activity across a network of regions located primarily within lateral and medial frontal cortex. These effects of the memory strategy manipulation suggest that when a retrieval-focused strategy is induced, mnemonic processes are preferentially engaged during the encoding period. In contrast, when a maintenance-focused strategy is induced, mnemonic processes are preferentially engaged during the delay and response periods. Taken together, the results imply that covert cognitive strategies play an important role in modulating brain activation and behavior during memory tasks.

Pictures of a thousand words: Investigating the neural mechanisms of reading with extremely rapid event-related fMRI

Reading is one of the most important skills human beings can acquire, but has proven difficult to study naturalistically using functional magnetic resonance imaging (fMRI). We introduce a novel Event-Related Reading (ERR) fMRI approach that enables reliable estimation of the neural correlates of single-word processing during reading of rapidly presented narrative text (200-300 ms/word). Application to an fMRI experiment in which subjects read coherent narratives and made no overt responses revealed widespread effects of orthographic, phonological, contextual, and semantic variables on brain activation. Word-level variables predicted activity in classical language areas as well as the inferotemporal visual word form area, specifically supporting a role for the latter in mapping visual forms onto articulatory or acoustic representations. Additional analyses demonstrated that ERR results replicate across experiments and predict reading comprehension. The ERR approach represents a powerful and extremely flexible new approach for studying reading and language behavior with fMRI.