Naohide Yamamoto

Visual and proprioceptive representations in spatial memory

It has been shown that spatial information can be acquired from both visual and nonvisual modalities. The present study explored how spatial information from vision and proprioception was represented in memory, investigating orientation dependence of spatial memories acquired through visual and proprioceptive spatial learning. Experiment 1 examined whether visual learning alone and proprioceptive learning alone yielded orientation-dependent spatial memory. Results showed that spatial memories from both types of learning were orientation dependent. Experiment 2 explored how different orientations of the same environment were represented when they were learned visually and proprioceptively. Results showed that both visually and proprioceptively learned orientations were represented in spatial memory, suggesting that participants established two different reference systems based on each type of learning experience and interpreted the environment in terms of these two reference systems. The results provide some initial clues to how different modalities make unique contributions to spatial representations.

Differential effects of aging on spatial learning through exploratory navigation and map reading

It has been shown that abilities in spatial learning and memory are adversely affected by aging. The present study was conducted to investigate whether increasing age has equal consequences for all types of spatial learning or impacts certain types of spatial learning selectively. Specifically, two major types of spatial learning, exploratory navigation and map reading, were contrasted. By combining a neuroimaging finding that the medial temporal lobe (MTL) is especially important for exploratory navigation and a neurological finding that the MTL is susceptible to age-related atrophy, it was hypothesized that spatial learning through exploratory navigation would exhibit a greater decline in later life than spatial learning through map reading. In an experiment, young and senior participants learned locations of landmarks in virtual environments either by navigating in them in the first-person perspective or by seeing aerial views of the environments. Results showed that senior participants acquired less accurate memories of the layouts of landmarks than young participants when they navigated in the environments, but the two groups did not differ in spatial learning performance when they viewed the environments from the aerial perspective. These results suggest that spatial learning through exploratory navigation is particularly vulnerable to adverse effects of aging, whereas elderly adults may be able to maintain their map reading skills relatively well.

Medial Temporal Lobe Roles in Human Path Integration

Path integration is a process in which observers derive their location by integrating self-motion signals along their locomotion trajectory. Although the medial temporal lobe (MTL) is thought to take part in path integration, the scope of its role for path integration remains unclear. To address this issue, we administered a variety of tasks involving path integration and other related processes to a group of neurosurgical patients whose MTL was unilaterally resected as therapy for epilepsy. These patients were unimpaired relative to neurologically intact controls in many tasks that required integration of various kinds of sensory self-motion information. However, the same patients (especially those who had lesions in the right hemisphere) walked farther than the controls when attempting to walk without vision to a previewed target. Importantly, this task was unique in our test battery in that it allowed participants to form a mental representation of the target location and anticipate their upcoming walking trajectory before they began moving. Thus, these results put forth a new idea that the role of MTL structures for human path integration may stem from their participation in predicting the consequences of ones locomotor actions. The strengths of this new theoretical viewpoint are discussed.

Orientation dependence of spatial memory acquired from auditory experience

The present study investigated whether memory for a room-sized spatial layout learned through auditory localization of sounds exhibits orientation dependence similar to that observed for spatial memory acquired from stationary viewing of the environment. Participants learned spatial layouts by viewing objects or localizing sounds and then performed judgments of relative direction among remembered locations. The results showed that direction judgments following auditory learning were performed most accurately at a particular orientation in the same way as were those following visual learning, indicating that auditorily encoded spatial memory is orientation dependent. In combination with previous findings that spatial memories derived from haptic and proprioceptive experiences are also orientation dependent, the present finding suggests that orientation dependence is a general functional property of human spatial memory independent of learning modality.

Intrinsic frames of reference in haptic spatial learning

It has been proposed that spatial reference frames with which object locations are specified in memory are intrinsic to a to-be-remembered spatial layout (intrinsic reference theory). Although this theory has been supported by accumulating evidence, it has only been collected from paradigms in which the entire spatial layout was simultaneously visible to observers. The present study was designed to examine the generality of the theory by investigating whether the geometric structure of a spatial layout (bilateral symmetry) influences selection of spatial reference frames when object locations are sequentially learned through haptic exploration. In two experiments, participants learned the spatial layout solely by touch and performed judgments of relative direction among objects using their spatial memories. Results indicated that the geometric structure can provide a spatial cue for establishing reference frames as long as it is accentuated by explicit instructions (Experiment 1) or alignment with an egocentric orientation (Experiment 2). These results are entirely consistent with those from previous studies in which spatial information was encoded through simultaneous viewing of all object locations, suggesting that the intrinsic reference theory is not specific to a type of spatial memory acquired by the particular learning method but instead generalizes to spatial memories learned through a variety of encoding conditions. In particular, the present findings suggest that spatial memories that follow the intrinsic reference theory function equivalently regardless of the modality in which spatial information is encoded.

Integrating object locations in the memory representation of a spatial layout

The present study investigated how object locations learned separately are integrated and represented as a single spatial layout in memory. Two experiments were conducted in which participants learned a room-sized spatial layout that was divided into two sets of five objects. Results suggested that integration across sets was performed efficiently when it was done during initial encoding of the environment but entailed cost in accuracy when it was attempted at the time of memory retrieval. These findings suggest that, once formed, spatial representations in memory generally remain independent and integrating them into a single representation requires additional cognitive processes.

A Reverse Stroop Task with Mouse Tracking

In a reverse Stroop task, observers respond to the meaning of a color word irrespective of the color in which the word is printed—for example, the word red may be printed in the congruent color (red), an incongruent color (e.g., blue), or a neutral color (e.g., white). Although reading of color words in this task is often thought to be neither facilitated by congruent print colors nor interfered with incongruent print colors, this interference has been detected by using a response method that does not give any bias in favor of processing of word meanings or processing of print colors. On the other hand, evidence for the presence of facilitation in this task has been scarce, even though this facilitation is theoretically possible. By modifying the task such that participants respond to a stimulus color word by pointing to a corresponding response word on a computer screen with a mouse, the present study investigated the possibility that not only interference but also facilitation would take place in a reverse Stroop task. Importantly, in this study, participants’ responses were dynamically tracked by recording the entire trajectories of the mouse. Arguably, this method provided richer information about participants’ performance than traditional measures such as reaction time and accuracy, allowing for more detailed (and thus potentially more sensitive) investigation of facilitation and interference in the reverse Stroop task. These trajectories showed that the mouse’s approach toward correct response words was significantly delayed by incongruent print colors but not affected by congruent print colors, demonstrating that only interference, not facilitation, was present in the current task. Implications of these findings are discussed within a theoretical framework in which the strength of association between a task and its response method plays a critical role in determining how word meanings and print colors interact in reverse Stroop tasks.

Practice makes it better: A psychophysical study of visual perceptual learning and its transfer effects on aging.

Previous studies on perceptual learning, acquiring a new skill through practice, appear to stimulate brain plasticity and enhance performance (Fiorentini & Berardi, 1981). The present study aimed to determine (a) whether perceptual learning can be used to compensate for age-related declines in perceptual abilities, and (b) whether the effect of perceptual learning can be transferred to untrained stimuli and subsequently improve capacity of visual working memory (VWM). We tested both healthy younger and older adults in a 3-day training session using an orientation discrimination task. A matching-to-sample psychophysical method was used to measure improvements in orientation discrimination thresholds and reaction times (RTs). Results showed that both younger and older adults improved discrimination thresholds and RTs with similar learning rates and magnitudes. Furthermore, older adults exhibited a generalization of improvements to 3 untrained orientations that were close to the training orientation and benefited more compared with younger adults from the perceptual learning as they transferred learning effects to the VWM performance. We conclude that through perceptual learning, older adults can partially counteract age-related perceptual declines, generalize the learning effect to other stimulus conditions, and further overcome the limitation of using VWM capacity to perform a perceptual task.

Detection of object onsets and offsets: Does the primacy of onset persist even with bias for detecting offset?

Onset primacy is a robust visual phenomenon in which appearance of new objects (onsets) in a scene more effectively captures observers’ attention compared with disappearance of previously viewed objects (offsets). We hypothesized that the human attentional system is programmed by default to prioritize the processing of onsets, because quick detection of them is advantageous in most situations. However, the attentional priority may be able to flexibly adapt to the detection of object offsets depending on observers’ behavioral goals. To test these hypotheses, two experiments were conducted in which participants were biased toward finding offset of an existing object through top-down and bottom-up manipulations. Results showed that although onset primacy was reduced to some degree under strong offset bias, in general participants continued to detect onsets efficiently. These findings did not eliminate the possibility of attentional flexibility, but they do demonstrate the robustness of onset primacy, suggesting that environmental demands or motivational factors would need to be sufficiently strong for people to switch to an adaptive attentional mode.

Effects of Orientation Change during Environmental Learning on Age-Related Difference in Spatial Memory

It has been suggested that older adults suffer a greater degree of decline in environmental learning when navigating in an environment than when reading a map of the environment. However, the two types of spatial learning differ not only in perspectives (i.e., navigation is done with a ground-level perspective; a map is read from an aerial perspective) but also in orientations (i.e., orientations vary during navigation; spatial information is drawn from a single orientation in a map), making it unclear which factor critically affects older adults’ spatial learning. The present study addressed this issue by having younger and older participants learn the layout of a large-scale environment through an aerial movie that contained changes in orientations from which the environment was depicted. Results showed that older participants’ memories for the environmental layout were as distorted as those created through a ground-level movie (which involved the same orientation changes), whereas they formed more accurate memories through another aerial movie in which an orientation was fixed. By contrast, younger participants learned the environment equally well from the three movies. Taken together, these findings suggest that there is age-related alteration specifically in the ability to process multiple orientations of an environment while encoding its layout in memory. It is inferred that this alteration stems from functional deterioration of the medial temporal lobe, and possibly that of posterior cingulate areas as well (e.g., the retrosplenial cortex), in late adulthood.