Jeremy K. Miller

Response to Comment on "Estimating the reproducibility of psychological science"

Gilbert et al. conclude that evidence from the Open Science Collaboration’s Reproducibility Project: Psychology indicates high reproducibility, given the study methodology. Their very optimistic assessment is limited by statistical misconceptions and by causal inferences from selectively interpreted, correlational data. Using the Reproducibility Project: Psychology data, both optimistic and pessimistic conclusions about reproducibility are possible, and neither are yet warranted.

Non-replication of an association of Apolipoprotein E2 with sinistrality.

A recent report found that left-handed adolescents were more than three times more likely to have an Apolipoprotein (APOE) ϵ2 allele. This study was unable to replicate this association in young adults (N=166). A meta-analysis of nine other datasets (N=360 to 7559, Power > 0.999) including that of National Alzheimers Coordinating Center also failed to find an over-representation of ϵ2 among left-handers indicating that this earlier outcome was most likely a statistical artefact.

Familiarity from orthographic information: Extensions of the recognition without identification effect

Two experiments were conducted to investigate the effect of letter location information in recognition memory judgments. The experiments used the recognition without identification paradigm (Peynircioğlu, 1990), in which participants first attempt to identify the test item and then make a recognition decision as to whether or not the item was studied. In these studies, items that are not identified but that correspond to items that were presented are typically still rated as more likely to have been studied than those that were not presented. The present experiments demonstrated this finding with a variant of the conjunction lure paradigm. In Experiments 1 and 2, participants were tested with word fragments that were made from the letters of two words. When the letters were from studied items, fragments were rated higher than when the test items were derived from two unstudied items, or one studied item and one unstudied item, suggesting that recognition without identification is prone to the same types of errors as recognition with identification. Results are discussed in terms of familiarity effects in recognition memory.

Reliability and validity of neurobehavioral function on the Psychology Experimental Building Language test battery in young adults

Background. The Psychology Experiment Building Language (PEBL) software consists of over one-hundred computerized tests based on classic and novel cognitive neuropsychology and behavioral neurology measures. Although the PEBL tests are becoming more widely utilized, there is currently very limited information about the psychometric properties of these measures. Methods. Study I examined inter-relationships among nine PEBL tests including indices of motor-function (Pursuit Rotor and Dexterity), attention (Test of Attentional Vigilance and Time-Wall), working memory (Digit Span Forward), and executive-function (PEBL Trail Making Test, Berg/Wisconsin Card Sorting Test, Iowa Gambling Test, and Mental Rotation) in a normative sample (N = 189, ages 18–22). Study II evaluated test–retest reliability with a two-week interest interval between administrations in a separate sample (N = 79, ages 18–22). Results. Moderate intra-test, but low inter-test, correlations were observed and ceiling/floor effects were uncommon. Sex differences were identified on the Pursuit Rotor (Cohen’s d = 0.89) and Mental Rotation (d = 0.31) tests. The correlation between the test and retest was high for tests of motor learning (Pursuit Rotor time on target r = .86) and attention (Test of Attentional Vigilance response time r = .79), intermediate for memory (digit span r = .63) but lower for the executive function indices (Wisconsin/Berg Card Sorting Test perseverative errors = .45, Tower of London moves = .15). Significant practice effects were identified on several indices of executive function. Conclusions. These results are broadly supportive of the reliability and validity of individual PEBL tests in this sample. These findings indicate that the freely downloadable, open-source PEBL battery (http://pebl.sourceforge.net) is a versatile research tool to study individual differences in neurocognitive performance.

Not enough familiarity for fluency: Definitional encoding increases familiarity but does not lead to fluency attribution in associative recognition

Five experiments were conducted to test whether encoding manipulations thought to encourage unitization would affect fluency attribution in associative recognition memory. Experiments 1a and 1b, which utilized a speeded recognition memory test, demonstrated that definitional encoding increased reliance on familiarity during the recognition memory test. Experiments 2a, 2b, and 3, however, replicated previous research that had shown that fluency is unlikely to be attributed as evidence of previous occurrence in associative recognition (Westerman, Journal of Experimental Psychology: Learning, Memory, and Cognition 27:723–732, 2001). The results put limits on the degree to which fluency can influence recognition memory judgments, even in cases of enhanced familiarity, and are consistent with previous work suggesting that participants have preexperimental expectations about fluency that are difficult to change (e.g., Miller, Lloyd, & Westerman, Journal of Memory and Language 58:1080–1094, 2008), as well as with work suggesting that fluency has less of an influence on recognition memory decisions that are conceptual in nature (Parks, Journal of Experimental Psychology: Learning, Memory, and Cognition 39:1280–1286, 2013).

Are two heuristics better than one? The fluency and distinctiveness heuristics in recognition memory

Four experiments were conducted to test the impact of having multiple heuristics (distinctiveness and fluency) available during a recognition test. Recent work by Gallo, Perlmutter, Moore, and Schacter (Memory & Cognition 36:461–466, 2008) suggested that fluency effects are reduced when the distinctiveness heuristic can be applied to a recognition decision. In Experiment 1, we used a response reversal paradigm (Van Zandt & Maldonado-Molina Journal of Experimental Psychology: Learning, Memory, and Cognition 30:1147–1166, 2004) to demonstrate that participants transitioned from an early response strategy that was largely reliant on fluency to a later strategy in which the influences of fluency and distinctiveness were both observable. Experiments 2a, 2b, and 3 showed no evidence for reduction of the fluency heuristic after picture study when the test required a delayed response (Exp. 2a), confidence ratings (Exp. 2b), or the application of conceptual fluency (Exp. 3). The results are consistent with models of memory that assume that familiarity and recollection influence individual memory decisions Wixted (Psychological Review, 114:152–176, 2007).

Learning about frequency on the fly: Recent experience changes strategies regarding linguistic frequency in recognition memory.

ABSTRACT In the present study, the author examines whether participants can adjust recognition response strategies to account for the effects of linguistic frequency. Experiment 1 used a counterfeit-list technique to replicate findings that indicate that participants exhibit a bias toward choosing high-frequency lures. Experiment 2 demonstrates that when participants are exposed to a training phase that includes an opportunity to recognize high- and low-frequency words, participants no longer demonstrate a significant bias toward choosing high-frequency items on the counterfeit list task. Experiments 3 and 4 examine how participants learn to adjust for linguistic frequency by manipulating the information available during training. The results demonstrate that participants use information from the training phase indicating that high word frequency is a good cue to oldness to guide their memory decisions during the counterfeit list task, but do not use training phase information indicating that low frequency is the best cue to oldness in a similar fashion.

Selective attention meets spontaneous recognition memory: Evidence for effects at retrieval

Previous research on the effects of Divided Attention on recognition memory have shown consistent impairments during encoding but more variable effects at retrieval. The present study explored whether effects of Selective Attention at retrieval and subsequent testing were parallel to those of Divided Attention. Participants studied a list of pictures and then had a recognition memory test that included both full attention and selective attention (the to be responded to object was overlaid atop a blue outlined object) trials. All participants then completed a second recognition memory test. The results of 2 experiments suggest that subsequent tests consistently show impacts of the status of the ignored stimulus, and that having an initial test changes performance on a later test. The results are discussed in relation to effect of attention on memory more generally as well as spontaneous recognition memory research.

Self-projection in younger and older adults: a study of episodic memory, prospection, and theory of mind

ABSTRACT Self-projection is the ability to orient the self in different places in time and space. Episodic memory, prospection, and theory of mind (ToM) are all cognitive abilities that share an element of self-projection. Previous research has posited that each of these abilities stems from the same neural network. The current study compared performance of cognitively healthy older adults and younger adults on several self-projection tasks to examine the relatedness of these constructs behaviorally. Episodic memory and prospection were measured using an episodic interview task where the participants were asked to remember or imagine events that either had happened in the past or could happen in the future and then gave ratings describing the extent to which they were mentally experiencing the event and from what perspective they viewed it. ToM was measured by asking participants to make judgments regarding the intentions of characters described in stories that involved cognitive, affective, or ironic components. Our results demonstrate that aging influences episodic memory, prospection, and ToM similarly: older adult participants showed declines on each of these measures compared to younger adults. Further, we observed correlations between performance on the measures of episodic memory and prospection as well as between episodic memory and ToM, although no correlation between prospection and ToM was observed after controlling for chronological age. We discuss these results in the light of theories suggesting that each of these abilities is governed by a common brain system.

Revelation effects in remembering, forecasting, and perspective taking

The revelation effect is a robust phenomenon in episodic memory whereby stimuli that immediately follow a simple cognitive task are more likely to garner positive responses on a variety of memory tests, including autobiographical memory judgments. Six experiments investigated the revelation effect for judgments of past and future events as well as judgments made from others’ perspectives. The purpose of this work was to determine whether these subjectively distinct judgments are subject to the same decision-making biases, as might be expected if they are governed by similar processes (e.g., Schacter, Addis, & Buckner 2007). College-aged participants were asked to rate a variety of life events according to whether the events had occurred during their childhoods or would occur during the next 10 years. Events that followed an anagram task were judged as more likely to have happened in the past and more likely to occur in the future. We also showed a revelation effect when participants were asked to adopt the perspective of others when making judgments about past and future events. When the task was reworded to be non-episodic (participants judged how common the events were during childhood and adulthood), no revelation effect was found for either past or future time frames, which suggests common boundary conditions for both types of judgments. The results are consistent with studies showing strong parallels between remembering and other forms of self-projection but not with semantic memory judgments.