James A. Grange

Response to Comment on "Estimating the reproducibility of psychological science"

Gilbert et al. conclude that evidence from the Open Science Collaboration’s Reproducibility Project: Psychology indicates high reproducibility, given the study methodology. Their very optimistic assessment is limited by statistical misconceptions and by causal inferences from selectively interpreted, correlational data. Using the Reproducibility Project: Psychology data, both optimistic and pessimistic conclusions about reproducibility are possible, and neither are yet warranted.

The Role of Cue-Target Translation in Backward Inhibition of Attentional Set.

Backward inhibition (BI) refers to a reaction time cost incurred when returning to a recently abandoned task compared to returning to a task not recently performed. The effect has been proposed to reflect an inhibitory mechanism that aids transition from one task to another. The question arises as to precisely what aspects of a task may be inhibited and when the process takes place. Recent work has suggested a crucial role for response-related components of the task, which occur late in the typical trial structure (cue-target-response). In contrast to this suggestion, the authors present evidence that the way in which the task is cued can also modulate BI. Specifically, they find that the less transparent the cue-target relationship, the greater the level of BI. This also demonstrates that BI can be triggered at early stages of the trial structure, specifically during task preparation and prior to response processes. The authors conclude that BI is not tied to any particular component of the task structure but arises from whatever component generates the greatest intertrial conflict.

Temporal cue–target overlap is not essential for backward inhibition in task switching

Lag 2 repetition costs are a performance cost observed when participants return to a task after just one intervening trial of a different task, compared to returning after a longer interval (AB A vs. CB A sequences, where A, B, C are tasks). This effect is known as backward inhibition (BI) and is thought to reflect the need to overcome inhibition applied specifically to Task “A” during disengagement at trial n – 1. Druey and Hübner (2007) have suggested that employment of such a specific inhibitory mechanism relies upon the cue and the target of the task overlapping temporally. We provide evidence across three experiments (including a direct replication attempt) that this is not the case, and that the presence of task-specific BI relies to some extent on the need to translate the cue–target relationship into working memory. Additionally, we provide evidence that faster responses in no overlap conditions are driven by low-level perceptual differences between target displays across overlap conditions. We conclude that BI is an effective sequential control mechanism, employed equally in cases of temporally overlapping and temporally separated cues and targets.

Heightened Conflict in Cue-Target Translation Increases Backward Inhibition in Set Switching.

Backward inhibition (BI) is a performance cost that occurs when an individual returns to a task after 1 (vs. more than 1) intervening trial, and it may reflect the inhibition of task-set components during switching. In 3 experiments, we support the theory that inhibition can target cue-based preparatory stages of a task. Participants performed a cued target-localization task that had been previously shown to produce BI. In Experiment 1, reassignment of arbitrary cue-target pairings midway through the experiment doubled the size of BI, though cue, target, and response sets remained unchanged. In Experiment 2, we controlled for effects of order of conditions or simple change of cue meaning. In Experiment 3, we demonstrated that the effect depends on re-pairing members of the same cue and target sets. The results are attributed to heightened conflict (and hence greater inhibition) during cue-target translation when a previously learned cue-target mapping is remapped.

On costs and benefits of n−2 repetitions in task switching: towards a behavioural marker of cognitive inhibition

Inhibition in task switching is inferred from slower reaction times returning to a recently performed task after one intervening trial (i.e. an ABA sequence) compared to returning to a task not recently performed (CBA sequence). These n−2 repetition costs are thought to reflect the persisting inhibition of a task after its disengagement. As such, the n−2 repetition cost is an attractive tool for the researcher interested in inhibitory functioning in clinical/neurological/neuroscience disciplines. In the literature, an absence of this cost is often interpreted as an absence of inhibition, an assumption with strong implications for researchers. The current paper argues that this is not necessarily an accurate interpretation, as an absence of inhibition should lead to an n−2 repetition benefit as a task’s activation level will prime performance. This argument is supported by three instances of a computational cognitive model varying the degree of inhibition present. An inhibition model fits human n−2 repetition costs well. Removal of the inhibition—the activation-only model—predicts an n−2 repetition benefit. For the model to produce a null n−2 repetition cost, small amounts of inhibition were required—the reduced-inhibition model. The authors also demonstrate that a lateral-inhibition locus of the n−2 repetition cost cannot account for observed human data. The authors conclude that a null n−2 repetition cost provides no evidence on its own for an absence of inhibition, and propose reporting of a significant n−2 repetition benefit to be the best evidence for a lack of inhibition. Implications for theories on task switching are discussed.

A critical analysis of alcohol hangover research methodology for surveys or studies of effects on cognition

RationaleAlcohol hangover may be defined as an adverse effect of heavy alcohol consumption present after sufficient time has elapsed for the alcohol to have been eliminated from the blood. Understanding how hangover may impair performance is important for public safety; yet, there is relatively little hangover research. This paper outlines good practice for future studies.ObjectivesThis paper presents a critical analysis of hangover methodology for surveys or studies of effects on cognition with human subjects and provides suggestions for optimum research practice for laboratory-based and naturalistic alcohol hangover studies.ResultsFour hangover symptom scales have been developed and subjected to psychometric testing. For retrospective assessment, we recommend the Hangover Symptoms Scale (HSS) or the Alcohol Hangover Severity Scale (AHSS). For concurrent assessment of hangover symptoms, we recommend either the Acute Hangover Scale (AHS), the five-item version of the HSS, or the AHSS. In research aiming to assess the cognitive effects of alcohol hangover, we suggest focusing on the cognitive domains of attention, memory and executive function, and we specify a number of tests within these cognitive domains that are likely to be sensitive to any decrements due to hangover. Finally, we argue that naturalistic studies should assess biological markers to improve the accuracy of estimates of alcohol consumption. Specifically, we recommend the assessment of ethyl glucuronide (EtG) for this purpose.ConclusionsRecommendations are made with respect to assessing hangover symptoms, cognitive effects of hangover and biological markers of alcohol consumption.

Cue-switch costs in task-switching: cue priming or control processes?

In the explicitly cued task-switching paradigm, two cues per task allow separation of costs associated with switching cues from costs of switching tasks. Whilst task-switch costs have become controversial, cue-switch costs are robust. The processes that contribute to cue-switch costs are under-specified in the literature: they could reflect perceptual priming of cue properties, or priming of control processes that form relevant working memory (WM) representations of task demands. Across two experiments we manipulated cue-transparency in an attention-switching design to test the contrasting hypotheses of cue-switch costs, and show that such costs emerge from control processes of establishing relevant WM representations, rather than perceptual priming of the cue itself. When the cues were maximally transparent, cue-switch costs were eradicated. We discuss the results in terms of recent theories of cue encoding, and provide a formal definition of cue-transparency in switching designs and its relation to WM representations that guide task performance.

Justify your alpha

In response to recommendations to redefine statistical significance to P ≤ 0.005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.

Task preparation and task inhibition: a comment on Koch, Gade, Schuch, & Philipp (2010)

In their recent review article, Koch, Gade, Schuch, & Philipp, (Psychonomic Bulletin & Review, 17, 1–14, 2010) present compelling evidence for the role of inhibition in task switching, as measured by n-2 repetition costs. They promote the view that inhibition targets response-related processes of task performance rather than cue-based preparatory stages. In support of this distinction, they cite the finding in the literature that n-2 repetition costs are not reduced given longer preparation intervals. In this article, we advocate the analysis of whole reaction time distributions for investigating the influence of task preparation on task inhibition. We present such analyses from two of our published experiments that support the view that n-2 repetition costs can be reduced given sufficient preparation. The results suggest that cue-based processes do contribute to inhibition in task switching.

A deficit in familiarity-driven recognition in a right-sided mediodorsal thalamic lesion patient.

OBJECTIVE According to a still-controversial view of recognition, projections between the perirhinal cortex and the medial subdivision of the mediodorsal thalamic nucleus (mMDT) support the mnemonic processes underlying familiarity, whereas a separate extended hippocampal system is critical for the recollection of episodic details during recognition. METHOD In this study, we examined item recognition, familiarity, and recollection for faces and words in a patient (OG) with a right-sided lesion centered on the mMDT, which encroached on the central medial midline nucleus and may have resulted in partial disconnection of the mammillothalamic tract. On the basis of OGs neuropathology, the dual-process signal-detection (DPSD) high-threshold theory and the material-specific hypothesis of long-term memory together predicted a material-specific impairment in familiarity for novel facial memoranda, with a lesser decline in recollection of novel faces at short retention intervals. No abnormalities in either familiarity- or recollection-driven recognition of verbal memoranda were expected. RESULTS Comparing the performance of OG and that of a group of 10 age-, sex-, and IQ-matched healthy controls, the remember-know procedure revealed the dissociations predicted by the material-specific and DPSD hypotheses: With recognition of previously novel faces, OG showed a deficit in familiarity-driven recognition that was significantly greater than the insignificant reduction in his recollection. All components of his word recognition were, however, preserved. CONCLUSION A memory profile, marked by a dissociation between familiarity and recollection, fits naturally with the DPSD model and is incompatible with the idea that these kinds of memories reflect different degrees of trace strength.