Lily Riggs

Worth a Glance: Using Eye Movements to Investigate the Cognitive Neuroscience of Memory

Results of several investigations indicate that eye movements can reveal memory for elements of previous experience. These effects of memory on eye movement behavior can emerge very rapidly, changing the efficiency and even the nature of visual processing without appealing to verbal reports and without requiring conscious recollection. This aspect of eye movement based memory investigations is particularly useful when eye movement methods are used with special populations (e.g., young children, elderly individuals, and patients with severe amnesia), and also permits use of comparable paradigms in animals and humans, helping to bridge different memory literatures and permitting cross-species generalizations. Unique characteristics of eye movement methods have produced findings that challenge long-held views about the nature of memory, its organization in the brain, and its failures in special populations. Recently, eye movement methods have been successfully combined with neuroimaging techniques such as fMRI, single-unit recording, and magnetoencephalography, permitting more sophisticated investigations of memory. Ultimately, combined use of eye-tracking with neuropsychological and neuroimaging methods promises to provide a more comprehensive account of brain–behavior relationships and adheres to the “converging evidence” approach to cognitive neuroscience.

The hippocampus supports multiple cognitive processes through relational binding and comparison.

It has been well established that the hippocampus plays a pivotal role in explicit long-term recognition memory. However, findings from amnesia, lesion and recording studies with non-human animals, eye-movement recording studies, and functional neuroimaging have recently converged upon a similar message: the functional reach of the hippocampus extends far beyond explicit recognition memory. Damage to the hippocampus affects performance on a number of cognitive tasks including recognition memory after short and long delays and visual discrimination. Additionally, with the advent of neuroimaging techniques that have fine spatial and temporal resolution, findings have emerged that show the elicitation of hippocampal responses within the first few 100 ms of stimulus/task onset. These responses occur for novel and previously viewed information during a time when perceptual processing is traditionally thought to occur, and long before overt recognition responses are made. We propose that the hippocampus is obligatorily involved in the binding of disparate elements across both space and time, and in the comparison of such relational memory representations. Furthermore, the hippocampus supports relational binding and comparison with or without conscious awareness for the relational representations that are formed, retrieved and/or compared. It is by virtue of these basic binding and comparison functions that the reach of the hippocampus extends beyond long-term recognition memory and underlies task performance in multiple cognitive domains.

Immediate memory consequences of the effect of emotion on attention to pictures

Emotionally arousing stimuli are at once both highly attention grabbing and memorable. We examined whether emotional enhancement of memory (EEM) reflects an indirect effect of emotion on memory, mediated by enhanced attention to emotional items during encoding. We tested a critical prediction of the mediation hypothesis-that regions conjointly activated by emotion and attention would correlate with subsequent EEM. Participants were scanned with fMRI while they watched emotional or neutral pictures under instructions to attend to them a lot or a little, and were then given an immediate recognition test. A region in the left fusiform gyrus was activated by emotion, voluntary attention, and subsequent EEM. A functional network, different for each attention condition, connected this region and the amygdala, which was associated with emotion and EEM, but not with voluntary attention. These findings support an indirect cortical mediation account of immediate EEM that may complement a direct modulation model.

A complementary analytic approach to examining medial temporal lobe sources using magnetoencephalography

Neuropsychological and neuroimaging findings reveal that the hippocampus is important for recognition memory. However, it is unclear when and whether the hippocampus contributes differentially to recognition of previously studied items (old) versus novel items (new), or contributes to a general processing requirement that is necessary for recognition of both types of information. To address this issue, we examined the temporal dynamics and spectral frequency underlying hippocampal activity during recognition of old/new complex scenes using magnetoencephalography (MEG). In order to provide converging evidence to existing literature in support of the potential of MEG to localize the hippocampus, we reconstructed brain source activity using the beamformer method and analyzed three types of processing-related signal changes by applying three different analysis methods: (1) Synthetic aperture magnetometry (SAM) revealed event related and non-event-related spectral power changes; (2) Inter-trial coherence (ITC) revealed time-locked changes in neural synchrony; and (3) Event-related SAM (ER-SAM) revealed averaged event-related responses over time. Hippocampal activity was evident for both old and new information within the theta frequency band and during the first 250 ms following stimulus onset. The early onset of hippocampal responses suggests that general comparison processes related to recognition of new/old information may occur obligatorily.

The Role of Overt Attention in Emotion-Modulated Memory

The presence of emotional stimuli results in a central/peripheral tradeoff effect in memory: memory for central details is enhanced at the cost of peripheral items. It has been assumed that emotion-modulated differences in memory are the result of differences in attention, but this has not been tested directly. The present experiment used eye movement monitoring as an index of overt attention allocation and mediation analysis to determine whether differences in attention were related to subsequent memory. Participants viewed negative and neutral scenes surrounded by three neutral objects and were then given a recognition memory test. The results revealed evidence in support of a central/peripheral tradeoff in both attention and memory. However, contrary with previous assumptions, whereas attention partially mediated emotion-enhanced memory for central pictures, it did not explain the entire relationship. Further, although centrally presented emotional stimuli led to decreased number of eye fixations toward the periphery, these differences in viewing did not contribute to emotion-impaired memory for specific details pertaining to the periphery. These findings suggest that the differential influence of negative emotion on central versus peripheral memory may result from other cognitive influences in addition to overt visual attention or on postencoding processes.

Hippocampal and neocortical oscillatory contributions to visuospatial binding and comparison.

Over 50 years of research has revealed a critical role for the hippocampus in the formation of long-term declarative memories. More recent evidence has specified the functions of the hippocampus as the binding and comparison of memory representations that may be used under shorter, as well as longer, delays (Olsen, Moses, Riggs, & Ryan, 2012). Hippocampal neural oscillations (e.g., theta rhythm) have been studied extensively in animals; however, the oscillations that underlie binding, comparison, and their relationship to memory performance remain to be fully explored in humans. Here magnetoencephalography was used to examine theta oscillations within the hippocampus and cortex to address this critical gap in the literature. The task consisted of (a) an encoding phase in which participants had to integrate the relative spatial positions among 3 sequentially presented objects, (b) a delay phase, and (c) a test phase in which all study objects were presented simultaneously in novel locations, and participants had to indicate whether the relative positions had changed. Theta power in the hippocampus and medial prefrontal cortex (PFC) increased across encoding and delay periods during which binding and maintenance processes dominate, while comparison of spatial relations at test was associated with greater theta power in right lateral PFC and intraparietal sulcus for manipulated versus intact trials. Critically, relational memory was positively related to hippocampal theta power increases across the encoding period. These findings provide novel evidence for the role of hippocampal theta in the incremental formation and retention of relations across space and time.

Eye Movement Monitoring Reveals Differential Influences of Emotion on Memory

Research shows that memory for emotional aspects of an event may be enhanced at the cost of impaired memory for surrounding peripheral details. However, this has only been assessed directly via verbal reports which reveal the outcome of a long stream of processing but cannot shed light on how/when emotion may affect the retrieval process. In the present experiment, eye movement monitoring (EMM) was used as an indirect measure of memory as it can reveal aspects of online memory processing. For example, do emotions modulate the nature of memory representations or the speed with which such memories can be accessed? Participants viewed central negative and neutral scenes surrounded by three neutral objects and after a brief delay, memory was assessed indirectly via EMM and then directly via verbal reports. Consistent with the previous literature, emotion enhanced central and impaired peripheral memory as indexed by eye movement scanning and verbal reports. This suggests that eye movement scanning may contribute and/or is related to conscious access of memory. However, the central/peripheral tradeoff effect was not observed in an early measure of eye movement behavior, i.e., participants were faster to orient to a critical region of change in the periphery irrespective of whether it was previously studied in a negative or neutral context. These findings demonstrate emotions differential influences on different aspects of retrieval. In particular, emotion appears to affect the detail within, and/or the evaluation of, stored memory representations, but it may not affect the initial access to those representations.

Association with emotional information alters subsequent processing of neutral faces.

The processing of emotional as compared to neutral information is associated with different patterns in eye movement and neural activity. However, the ‘emotionality’ of a stimulus can be conveyed not only by its physical properties, but also by the information that is presented with it. There is very limited work examining the how emotional information may influence the immediate perceptual processing of otherwise neutral information. We examined how presenting an emotion label for a neutral face may influence subsequent processing by using eye movement monitoring (EMM) and magnetoencephalography (MEG) simultaneously. Participants viewed a series of faces with neutral expressions. Each face was followed by a unique negative or neutral sentence to describe that person, and then the same face was presented in isolation again. Viewing of faces paired with a negative sentence was associated with increased early viewing of the eye region and increased neural activity between 600 and 1200 ms in emotion processing regions such as the cingulate, medial prefrontal cortex, and amygdala, as well as posterior regions such as the precuneus and occipital cortex. Viewing of faces paired with a neutral sentence was associated with increased activity in the parahippocampal gyrus during the same time window. By monitoring behavior and neural activity within the same paradigm, these findings demonstrate that emotional information alters subsequent visual scanning and the neural systems that are presumably invoked to maintain a representation of the neutral information along with its emotional details.