Hubert D. Zimmer

Visual and spatial working memory: From boxes to networks

It is shown that visuo-spatial working memory is better characterized as processes operating on sensory information (visual appearance) and on spatial location (environmental coordinates) in a distributed network than as unitary slave system. Results from passive (short-term) and active memory tasks (imagery) disclose the properties (capacity, content) and the components of this network. The prefrontal cortex is a control structure (dorsal prefers active, ventral passive tasks) and it contributes to spatial memory by a prospective spatial code (eye movements). Visual appearance (including dynamic aspects) is represented as features and object files (bound features) within content-specific areas in the ventral occipital cortex. Spatial coordinates are represented in the parietal cortex (modality-unspecific), when used in spatio-temporal tasks (Corsi) they are closely related to attention. Imagery of objects activates occipito-temporal structures, spatial transformations and mental rotation the parietal cortex (specifically the intraparietal sulcus). Perception, working memory, and imagery use the same neural network. Differences between the tasks are explained by different demands and states of the neural network, and differences in the configuration of the anterior-posterior neural circuits.

Has the butcher on the bus dyed his hair? When color changes modulate ERP correlates of familiarity and recollection.

Recognition memory is usually thought of as comprising two distinct memory processes, namely familiarity and recollection. This distinction is reflected in specific event-related potential (ERP) components associated with both subprocesses. A mid-frontal attenuated negativity for correctly recognized old items relative to new ones around 400 ms has been typically linked to familiarity, whereas a parietally accentuated, more pronounced positivity for old items from 500 to 800 ms has been connected with recollection. Recently, this classification has been challenged by relating the mid-frontal old/new effect to conceptual priming mechanisms. Moreover, the perceptual sensitivity of both old/new effects is still under debate. The present study used a recognition memory task for visual objects and nonsense figures in order to investigate the functional significance of both ERP old/new effects. With respect to study presentation, all items were either presented in a perceptually identical or a color-modified version at test. Old nonsense figures, despite being meaningless, elicited a reliable mid-frontal old/new effect, thereby strongly suggesting a close relationship to familiarity processes rather than conceptual priming. Additionally, both the mid-frontal and the parietal old/new effect for real objects were graded with respect to the perceptual similarity between study and test. We argue that not only recollection, but also familiarity processes can provide information about perceptual atttributes, which is used in the course of recognition memory decisions.

Motor programme information as a separable memory unit

SummaryTwo experiments produced further evidence for the claim that motor programme information may be considered as a separate memory unit, partially independent of other memory representations. In Experiment 1, it was shown that for the comparison of shared movement components in two actions such as “turning the handle” and “stirring the ingredients”, the activation of their motor programmes is required. This is demonstrated by the finding that the execution of the first action, which preactivates its motor programmes, leads to shorter reaction times than under control conditions in which the verbally described action is only spoken. In Experiment 2, it was further shown that the execution of the action does not in every case expedite the assessment of a connection between a prime item and a target item vis à vis verbal repetition, but only where the task requires the activation of motor programmes.

Memory of self-performed tasks: Self-performing during recognition

Two experiments focused on whether performing actions described by to-be-remembered phrases during recognition enhances recognition compared with results of a standard verbal recognition test. The enhancement was predicted when the actions described by the phrases had been performed during study, but not when the phrases were verbally encoded by simply listening to and memorizing the material. Both experiments showed that enactment prior to recognition improved memory performance, but only when subjects had encoded by enactment. Experiment 1 also demonstrated that this test-procedure effect was independent of a bizarreness effect, which was observed only with the verbal encoding task. Experiment 2 showed that the effect of enactment during recognition was reduced when subjects used different hands for performing the actions during study and recognition- The findings support the assumption that some kind of motor memory record underlies the enactment effect that occurs when actions are performed during recognition.

Sensory factors in memory for subject-performed tasks

Abstract Action phrases such as “lift the pen” are recalled better when they are enacted by subjects in subject-performed tasks (SPTs) than when only listened to during verbal tasks (VTs). This SPT effect is usually attributed to the good item-specific information provided by enactment. A series of experiments investigated what role the use of real objects and the perception of the action play in the good recall of SPTs. For this purpose, recall of action phrases with and without using real objects was studied in VTs, EPTs (experimenter-performed tasks) and SPTs. It was found that the perception of real objects improved recall equally in EPTs and SPTs, but more so in VTs. Furthermore there was a recall advantage of SPTs over EPTs. However, with short lists, this advantage depended on whether the encoding condition was varied within subjects or between subjects. It was concluded that perceiving the objects used as well as perceiving the action proper does not play a decisive role in the good SPT recall. It was further concluded that EPTs and SPTs differentially depend on item-specific and relational encoding, and that relational encoding suffers from using a within-subjects mixed list design.

Color and context: An ERP study on intrinsic and extrinsic feature binding in episodic memory

Episodic memory for intrinsic item and extrinsic context information is postulated to rely on two distinct types of representation: object and episodic tokens. These provide the basis for familiarity and recollection, respectively. Electrophysiological indices of these processes (ERPold-new effects) were used together with behavioral data to test these assumptions. We manipulated an intrinsic object feature (color; Experiment 1) and a contextual feature (background; Experiments 1 and 2). In an inclusion task (Experiment 1), the study—test manipulation of color affected object recognition performance and modulated ERPold—new effects associated with both familiarity and recollection. In contrast, a contextual manipulation had no effect, although both intrinsic and extrinsic information was available in a direct feature (source memory) test. When made task relevant (exclusion task; Experiment 2), however, context affected the ERP recollection effect, while still leaving the ERP familiarity effect uninfluenced. We conclude that intrinsic features bound in object tokens are involuntarily processed during object recognition, thus influencing familiarity, whereas context features bound in episodic tokens are voluntarily accessed, exclusively influencing recollection. Figures depicting all the electrodes analyzed are available in an online supplement at www.psychonomic.org/archive.

Recall and recognition of self-performed acts

SummaryIn Experiment 1, recall and recognition of 80 action phrases were compared under two encoding conditions: verbal and motor (performing the denoted acts). Memory performance was better under motor encoding than under verbal encoding, and more so in recognition than in recall. We assume that this finding is due to the item-specific effect of a specific motor component in the memory trace after enacting. In Experiments 2 and 3 we further investigated whether false-alarm rates are dependent on the motoric similarity of distractor items. The rate of false alarms was lower under motor encoding than under verbal encoding, but the motoric similarity of distractor items to list items did not influence the false alarms. The results were interpreted as support for the assumption that motor encoding enhances item-specific information in relation to verbal encoding, but that during verbal recognition the motoric quality of the depicted movement is not processed.

What people believe about memory.

Two representative samples of adult Norwegians (n=2000) were asked a set of general and specific questions regarding their beliefs and opinions about human memory. The results indicate that on many questions, such as time of the earliest memories, inhibiting effects of collaboration, and memory for dramatic versus ordinary events, the views of the general public concurred with current research findings, and people in general had realistic views about their own memory performance. On other questions, such as the reliability of olfactory as compared with visual and auditory memory, the memory of small children in comparison with that of adults, the likelihood of repression of adult traumatic memories, and on more general questions such as the possibility of training memory and the capacity limitations of long-term memory, a large proportion of the participants expressed views that are less supported by scientific evidence. Implications of these findings are briefly discussed.

Does motor encoding enhance relational information

SummaryThree experiments investigated whether learning action phrases by enacting the denoted action enhances organization or not. In the first experiment it was shown that, compared to a standard learning instruction, enacting did not enhance the clustering of episodic and taxonomic lists, but it did enhance memory performance. Furthermore, the enacting effect was strongest with an unrelated list; in all lists, organization and recall correlated only under a verbal instruction and not under an enacting instruction. In the second experiment, subjects were also informed about the categories of the lists and instructed to use them to learn the items. The organization was enhanced in all cases by this procedure, but the recall performance was enhanced only with a standard learning instruction. Under enacting, information about the categories had no influence. In the third experiment this effect was replicated for a taxonomic list and could be generalized for a motor list, in which categories were in accordance with the similarities of the movement pattern. Here too the explicit category information had an effect only under a standard learning instruction, but not with enacting. We interpret these effects as support for the assumption that enacting does not enhance memory performance by better relational information. Relational information is, on the contrary, less important for recall under enacting than under a standard learning instruction.

Remembering perceptual features unequally bound in object and episodic tokens: Neural mechanisms and their electrophysiological correlates

We present a neurocognitive model of long-term object memory. We propose that perceptual priming and episodic recognition are phenomena based on three distinct kinds of representations. We label these representations types and tokens. Types are prototypical representations needed for object identification. The network of non-arbitrary features necessary for object categorization is sharpened in the course of repeated identification, an effect that we call type trace and which causes perceptual priming. Tokens, on the other hand, support episodic recognition. Perirhinal structures are proposed to bind intrinsic within-object features into an object token that can be thought of as a consolidated perceptual object file. Hippocampal structures integrate object- with contextual information in an episodic token. The reinstatement of an object token is assumed to generate a feeling of familiarity, whereas recollection occurs when the reinstatement of an episodic token occurs. Retrieval mode and retrieval orientation dynamically modulate access to these representations. In this review, we apply the model to recent empirical research (behavioral, fMRI, and ERP data) including a series of studies from our own lab. We put specific emphasis on the effects that sensory features and their study-test match have on familiarity. The type-token approach fits the data and additionally provides a framework for the analysis of concepts like unitization and associative reinstatement.