Elger L. Abrahamse

Control of automated behavior: insights from the discrete sequence production task

Work with the discrete sequence production (DSP) task has provided a substantial literature on discrete sequencing skill over the last decades. The purpose of the current article is to provide a comprehensive overview of this literature and of the theoretical progress that it has prompted. We start with a description of the DSP task and the phenomena that are typically observed with it. Then we propose a cognitive model, the dual processor model (DPM), which explains performance of (skilled) discrete key-press sequences. Key features of this model are the distinction between a cognitive processor and a motor system (i.e., motor buffer and motor processor), the interplay between these two processing systems, and the possibility to execute familiar sequences in two different execution modes. We further discuss how this model relates to several related sequence skill research paradigms and models, and we outline outstanding questions for future research throughout the paper. We conclude by sketching a tentative neural implementation of the DPM.

Representing Serial Action and Perception

This article presents a review on the representational base of sequence learning in the serial reaction time task. The first part of the article addresses the major questions and challenges that underlie the debate on implicit and explicit learning. In the second part, the informational content that underlies sequence representations is reviewed. The latter issue has produced a rich and equivocal literature. A taxonomy illustrates that substantial support exists for associations between successive stimulus features, between successive response features, and between successive response-to-stimulus compounds. We suggest that sequence learning is not predetermined with respect to one particular type of information but, rather, develops according to an overall principle of activation contingent on task characteristics. Moreover, substantiating such an integrative approach is proposed by a synthesis with the dual-system model (Keele, Ivry, Mayr, Hazeltine, & Heuer, 2003).

Spatial Attention Interacts With Serial-Order Retrieval From Verbal Working Memory

The ability to maintain the serial order of events is recognized as a major function of working memory. Although general models of working memory postulate a close link between working memory and attention, such a link has so far not been proposed specifically for serial-order working memory. The present study provided the first empirical demonstration of a direct link between serial order in verbal working memory and spatial selective attention. We show that the retrieval of later items of a sequence stored in working memory—compared with that of earlier items—produces covert attentional shifts toward the right. This observation suggests the conceptually surprising notion that serial-order working memory, even for nonspatially defined verbal items, draws on spatial attention.

The heterogeneous world of congruency sequence effects: an update

Congruency sequence effects (CSEs) refer to the observation that congruency effects in conflict tasks are typically smaller following incongruent compared to following congruent trials. This measure has long been thought to provide a unique window into top-down attentional adjustments and their underlying brain mechanisms. According to the renowned conflict monitoring theory, CSEs reflect enhanced selective attention following conflict detection. Still, alternative accounts suggested that bottom-up associative learning suffices to explain the pattern of reaction times and error rates. A couple of years ago, a review by Egner (2007) pitted these two rivalry accounts against each other, concluding that both conflict adaptation and feature integration contribute to the CSE. Since then, a wealth of studies has further debated this issue, and two additional accounts have been proposed, offering intriguing alternative explanations. Contingency learning accounts put forward that predictive relationships between stimuli and responses drive the CSE, whereas the repetition expectancy hypothesis suggests that top-down, expectancy-driven control adjustments affect the CSE. In the present paper, we build further on the previous review (Egner, 2007) by summarizing and integrating recent behavioral and neurophysiological studies on the CSE. In doing so, we evaluate the relative contribution and theoretical value of the different attentional and memory-based accounts. Moreover, we review how all of these influences can be experimentally isolated, and discuss designs and procedures that can critically judge between them.

A working memory account of the interaction between numbers and spatial attention

Rather than reflecting the long-term memory construct of a mental number line, it has been proposed that the relation between numbers and space is of a more temporary nature and constructed in working memory during task execution. In three experiments we further explored the viability of this working memory account. Participants performed a speeded dot detection task with dots appearing left or right, while maintaining digits or letters in working memory. Just before presentation of the dot, these digits or letters were used as central cues. These experiments show that the “attentional SNARC-effect” (where SNARC is the spatial–numerical association of response codes) is not observed when only the lastly perceived number cue—and no serially ordered sequence of cues—is maintained in working memory (Experiment 1). It is only when multiple items (numbers in Experiment 2; letters in Experiment 3) are stored in working memory in a serially organized way that the attentional cueing effect is observed as a function of serial working memory position. These observations suggest that the “attentional SNARC-effect” is strongly working memory based. Implications for theories on the mental representation of numbers are discussed.

Finding the answer in space: the mental whiteboard hypothesis on serial order in working memory

Various prominent models on serial order coding in working memory (WM) build on the notion that serial order is achieved by binding the various items to-be-maintained to fixed position markers. Despite being relatively successful in accounting for empirical observations and some recent neuro-imaging support, these models were largely formulated on theoretical grounds and few specifications have been provided with respect to the cognitive and/or neural nature of these position markers. Here we outline a hypothesis on a novel candidate mechanism to substantiate the notion of serial position markers. Specifically, we propose that serial order WM is grounded in the spatial attention system: (I) The position markers that provide multi-item WM with a serial context should be understood as coordinates within an internal, spatially defined system; (II) internal spatial attention is involved in searching through the resulting serial order representation; and (III) retrieval corresponds to selection by spatial attention. We sketch the available empirical support and discuss how the hypothesis may provide a parsimonious framework from which to understand a broad range of observations across behavioral, neural and neuropsychological domains. Finally, we pinpoint what we believe are major questions for future research inspired by the hypothesis.

Segmentation of short keying sequences does not spontaneously transfer to other sequences

Previous research suggested that highly practiced discrete 6-key sequences are spontaneously segmented, sometimes even differently for different persons. This suggests there is some limit in the length of motor chunks that are assumed to underlie the segments in the sequence. The present experiment examined whether a segmentation pattern induced in one 6-key sequence (the prestructured sequence) determines segmentation in other 6-key sequences. The results are in line with segmentation, but showed neither transfer from the prestructured to a concurrently practiced unstructured sequence, nor to two new sequences that were carried out in a subsequent phase. Moreover, segmentation of these two new sequences was mutually different. Hence, while segmentation seems a phenomenon affecting all 6-element keying sequences, the exact segmentation pattern is not determined by that of a familiar keying sequence. Another result of the present research is that using different fingers of the same hand did slow execution rate (thus indicating effector-specific sequence learning), but the rate reduction was clearly smaller than in a previous study in which transfer to fingers of the other hand was assessed (Verwey & Wright, 2004). This is more in line with effector-specific learning being a result of sequence learning in terms of a hand-based reference frame than learning to directly trigger particular effectors (i.e., the fingers).

What determines the specificity of conflict adaptation? A review, critical analysis, and proposed synthesis

Over the past decade, many cognitive control researchers have studied to what extent adaptations to conflict are domain-general or rather specific, mostly by testing whether or not the congruency sequence effect (CSE) transfers across different conditions (e.g., conflict type, task sets, contexts, et cetera). The CSE refers to the observation that congruency effects in conflict tasks tend to be reduced following incongruent relative to following congruent trials, and is considered a prime measure of cognitive control. By investigating the transfer of this CSE across different conflict types, tasks, or contexts, researchers made several inferences about the scope of cognitive control. This method gained popularity during the last few years, spawning an interesting, yet seemingly inconsistent set of results. Consequently, these observations gave rise to a number of equally divergent theories about the determinants and scope of conflict adaptation. In this review, we offer a systematic overview of these past studies, as well as an evaluation of the theories that have been put forward to account for the results. Finally, we propose an integration of these various theoretical views in a unifying framework that centers on the role of context (dis)similarity. This framework allows us to generate new predictions about the relation between task or context similarity and the scope of cognitive control. Specifically, while most theories imply that increasing contextual differences will result in reduced transfer of the CSE, we propose that context similarity and across-context control follow a U-shaped function instead.

Grounding cognitive control in associative learning.

Cognitive control covers a broad range of cognitive functions, but its research and theories typically remain tied to a single domain. Here we outline and review an associative learning perspective on cognitive control in which control emerges from associative networks containing perceptual, motor, and goal representations. Our review identifies 3 trending research themes that are shared between the domains of conflict adaptation, task switching, response inhibition, and attentional control: Cognitive control is context-specific, can operate in the absence of awareness, and is modulated by reward. As these research themes can be envisaged as key characteristics of learning, we propose that their joint emergence across domains is not coincidental but rather reflects a (latent) growth of interest in learning-based control. Associative learning has the potential for providing broad-scaled integration to cognitive control theory, and offers a promising avenue for understanding cognitive control as a self-regulating system without postulating an ill-defined set of homunculi. We discuss novel predictions, theoretical implications, and immediate challenges that accompany an associative learning perspective on cognitive control. (PsycINFO Database Record

Distinct modes of executing movement sequences: Reacting, associating, and chunking

Responding to individual key-specific stimuli in entirely unfamiliar keying sequences is said to involve a reaction mode. With practice, short keying sequences can be executed in the chunking mode. This is indicated by the first stimulus sufficing for rapid execution of the entire sequence. The present study explored whether an associative mode develops also in participants who practice short keying sequences. This associative mode would involve priming by earlier events of responses to external stimuli, and is believed to be responsible for skill in the Serial Reaction Time task. In the present study participants practiced two discrete 6-key sequences. In the ensuing test phase, participants were prevented from using the chunking mode by including two deviant stimuli in most sequences. The results from the remaining - unchanged - familiar sequences confirmed that participants no longer used the chunking mode, but as predicted by associative learning these sequences were executed faster than unfamiliar sequences.