David I. Donaldson

Evidence Accumulation and the Moment of Recognition: Dissociating Perceptual Recognition Processes Using fMRI

Decision making can be conceptualized as the culmination of an integrative process in which evidence supporting different response options accumulates gradually over time. We used functional magnetic resonance imaging to investigate brain activity leading up to and during decisions about perceptual object identity. Pictures were revealed gradually and subjects signaled the time of recognition (TR) with a button press. We examined the time course of TR-dependent activity to determine how brain regions tracked the timing of recognition. In several occipital regions, activity increased primarily as stimulus information increased, suggesting a role in lower-level sensory processing. In inferior temporal, frontal, and parietal regions, a gradual buildup in activity peaking in correspondence with TR suggested that these regions participated in the accumulation of evidence supporting object identity. In medial frontal cortex, anterior insula/frontal operculum, and thalamus, activity remained near baseline until TR, suggesting a relation to the moment of recognition or the decision itself. The findings dissociate neural processes that function in concert during perceptual recognition decisions.

Mixed blocked/event-related designs separate transient and sustained activity in fMRI.

Recent functional magnetic resonance imaging (fMRI) studies using mixed blocked/event-related designs have shown activity consistent with separable sustained task-related processes and transient trial-related processes. In the mixed design, control blocks are intermixed with task blocks, during which trials are presented at varying intervals. Two studies were conducted to assess the ability of this design to detect and dissociate sustained task-related from transient trial-related activity. Analyses on both simulated and empirical data were performed by using the general linear model with a shape assumed for sustained effects, but not transient effects. In the first study, simulated data were produced with sustained time courses, transient time courses, and the sum of both together. Analyses of these data showed appropriate parsing of sustained and transient activity in all three cases. For the empirical fMRI experiment, counterphase-flickering checkerboard stimuli were constructed to produce sustained, transient, and combined sustained and transient responses in visual cortex. As with the simulation, appropriate parsing of sustained and transient activity was seen in all three cases; i.e., sustained stimuli produced sustained time courses and transient stimuli produced transient time courses. Combined stimuli produced both transient and sustained time courses. Critically, transient stimuli alone did not produce spurious positive sustained responses; sustained stimuli alone produced negligible spurious transient time courses. The results of these two studies along with supplemental simulations provide strong evidence that mixed designs are an effective tool for separating transient, trial-related activity from sustained activity in fMRI experiments. Mixed designs can allow researchers a means to examine brain activity associated with sustained processes, potentially related to task-level control signals.

It's the way that you, er, say it: hesitations in speech affect language comprehension.

Everyday speech is littered with disfluency, often correlated with the production of less predictable words (e.g., Beattie & Butterworth [Beattie, G., & Butterworth, B. (1979). Contextual probability and word frequency as determinants of pauses in spontaneous speech. Language and Speech, 22, 201-211.]). But what are the effects of disfluency on listeners? In an ERP experiment which compared fluent to disfluent utterances, we established an N400 effect for unpredictable compared to predictable words. This effect, reflecting the difference in ease of integrating words into their contexts, was reduced in cases where the target words were preceded by a hesitation marked by the word er. Moreover, a subsequent recognition memory test showed that words preceded by disfluency were more likely to be remembered. The study demonstrates that hesitation affects the way in which listeners process spoken language, and that these changes are associated with longer-term consequences for the representation of the message.

Remember the source: Dissociating frontal and parietal contributions to episodic memory

Event-related fMRI studies reveal that episodic memory retrieval modulates lateral and medial parietal cortices, dorsal middle frontal gyrus (MFG), and anterior PFC. These regions respond more for recognized old than correctly rejected new words, suggesting a neural correlate of retrieval success. Despite significant efforts examining retrieval success regions, their role in retrieval remains largely unknown. Here we asked the question, to what degree are the regions performing memory-specific operations? And if so, are they all equally sensitive to successful retrieval, or are other factors such as error detection also implicated? We investigated this question by testing whether activity in retrieval success regions was associated with task-specific contingencies (i.e., perceived targetness) or mnemonic relevance (e.g., retrieval of source context). To do this, we used a source memory task that required discrimination between remembered targets and remembered nontargets. For a given region, the modulation of neural activity by a situational factor such as target status would suggest a more domain-general role; similarly, modulations of activity linked to error detection would suggest a role in monitoring and control rather than the accumulation of evidence from memory per se. We found that parietal retrieval success regions exhibited greater activity for items receiving correct than incorrect source responses, whereas frontal retrieval success regions were most active on error trials, suggesting that posterior regions signal successful retrieval whereas frontal regions monitor retrieval outcome. In addition, perceived targetness failed to modulate fMRI activity in any retrieval success region, suggesting that these regions are retrieval specific. We discuss the different functions that these regions may support and propose an accumulator model that captures the different pattern of responses seen in frontal and parietal retrieval success regions.

Item- and task-level processes in the left inferior prefrontal cortex: positive and negative correlates of encoding

Activity in the left inferior prefrontal cortex (LIPC) is often thought to reflect processes that support episodic encoding. Functional magnetic resonance imaging (fMRI) was used to test whether processes subserved by LIPC could be negatively related to subsequent memory performance. Specifically, the current experiment explicitly tested the hypothesis that LIPC processing would positively impact encoding when primarily focused towards specific target items (item-level processing), whereas it would negatively impact encoding when primarily focused on the retrieval and instantiation of current task instructions (task-level processing). Two methods were used to identify regions that were sensitive to the two types of processes: a block-level manipulation of encoding task that influenced subsequent memory, and a back-sort procedure. LIPC was sensitive to item- and task-level processing, but not in a way that always facilitates encoding. LIPC was more active for subsequently remembered words than subsequently forgotten words, but it was also more active in a task that emphasized task-level processing relative to a task that emphasized item-level processing, although this former condition led to poorer subsequent memory performance. This pattern indicates that processes subserved by LIPC are not always positively correlated with episodic encoding. Rather, LIPC processes can support both the controlled semantic processing of items and the controlled retrieval of relevant semantic task context. When devoted to the latter, the diversion of LIPC processes to the task level can have a negative consequence for item-level analysis and encoding.

Making the case for mobile cognition: EEG and sports performance

In the high stakes world of International sport even the smallest change in performance can make the difference between success and failure, leading sports professionals to become increasingly interested in the potential benefits of neuroimaging. Here we describe evidence from EEG studies that either identify neural signals associated with expertise in sport, or employ neurofeedback to improve performance. Evidence for the validity of neurofeedback as a technique for enhancing sports performance remains limited. By contrast, progress in characterizing the neural correlates of sporting behavior is clear: frequency domain studies link expert performance to changes in alpha rhythms, whilst time-domain studies link expertise in response evaluation and motor output with modulations of P300 effects and readiness potentials. Despite early promise, however, findings have had relatively little impact for sports professionals, at least in part because there has been a mismatch between lab tasks and real sporting activity. After selectively reviewing existing findings and outlining limitations, we highlight developments in mobile EEG technology that offer new opportunities for sports neuroscience.

Listening to the sound of silence: disfluent silent pauses in speech have consequences for listeners

Silent pauses are a common form of disfluency in speech yet little attention has been paid to them in the psycholinguistic literature. The present paper investigates the consequences of such silences for listeners, using an Event-Related Potential (ERP) paradigm. Participants heard utterances ending in predictable or unpredictable words, some of which included a disfluent silence before the target. In common with previous findings using er disfluencies, the N400 difference between predictable and unpredictable words was attenuated for the utterances that included silent pauses, suggesting a reduction in the relative processing benefit for predictable words. An earlier relative negativity, topographically distinct from the N400 effect and identifiable as a Phonological Mismatch Negativity (PMN), was found for fluent utterances only. This suggests that only in the fluent condition did participants perceive the phonology of unpredictable words to mismatch with their expectations. By contrast, for disfluent utterances only, unpredictable words gave rise to a late left frontal positivity, an effect previously observed following ers and disfluent repetitions. We suggest that this effect reflects the engagement of working memory processes that occurs when fluent speech is resumed. Using a surprise recognition memory test, we also show that listeners were more likely to recognise words which had been encountered after silent pauses, demonstrating that silence affects not only the process of language comprehension but also its eventual outcome. We argue that, from a listeners perspective, one critical feature of disfluency is the temporal delay which it adds to the speech signal.

A common neural system mediating two different forms of social judgement

BACKGROUND A wide range of neuropsychiatric conditions, including schizophrenia and autistic spectrum disorder (ASD), are associated with impairments in social function. Previous studies have shown that individuals with schizophrenia and ASD have deficits in making a wide range of social judgements from faces, including decisions related to threat (such as judgements of approachability) and decisions not related to physical threat (such as judgements of intelligence). We have investigated healthy control participants to see whether there is a common neural system activated during such social decisions, on the basis that deficits in this system may contribute to the impairments seen in these disorders. METHOD We investigated the neural basis of social decision making during judgements of approachability and intelligence from faces in 24 healthy participants using functional magnetic resonance imaging (fMRI). We used conjunction analysis to identify common brain regions activated during both tasks. RESULTS Activation of the amygdala, medial prefrontal cortex, inferior prefrontal cortex and cerebellum was seen during performance of both social tasks, compared to simple gender judgements from the same stimuli. Task-specific activations were present in the dorsolateral prefrontal cortex in the intelligence task and in the inferior and middle temporal cortex in the approachability task. CONCLUSIONS The present study identified a common network of brain regions activated during the performance of two different forms of social judgement from faces. Dysfunction of this network is likely to contribute to the broad-ranging deficits in social function seen in psychiatric disorders such as schizophrenia and ASD.

Source accuracy data reveal the thresholded nature of human episodic memory

Episodic recollection supports conscious retrieval of past events. It is unknown why recollected memories are often vivid, but at other times we struggle to remember. Such experiences might reflect a recollection threshold: Either the threshold is exceeded and information is retrieved, or recollection fails completely. Alternatively, retrieval failure could reflect weak memory: Recollection could behave as a continuous signal, always yielding some variable degree of information. Here we reconcile these views, using a novel source memory task that measures retrieval accuracy directly. We show that recollection is thresholded, such that retrieval sometimes simply fails. Our technique clarifies a fundamental property of memory and allows responses to be accurately measured, without recourse to subjective introspection. These findings raise new questions about how successful retrieval is determined and why it declines with age and disease.

A single-trace dual-process model of episodic memory: A novel computational account of familiarity and recollection

Dual‐process theories of episodic memory state that retrieval is contingent on two independent processes: familiarity (providing a sense of oldness) and recollection (recovering events and their context). A variety of studies have reported distinct neural signatures for familiarity and recollection, supporting dual‐process theory. One outstanding question is whether these signatures reflect the activation of distinct memory traces or the operation of different retrieval mechanisms on a single memory trace. We present a computational model that uses a single neuronal network to store memory traces, but two distinct and independent retrieval processes access the memory. The model is capable of performing familiarity and recollection‐based discrimination between old and new patterns, demonstrating that dual‐process models need not to rely on multiple independent memory traces, but can use a single trace. Importantly, our putative familiarity and recollection processes exhibit distinct characteristics analogous to those found in empirical data; they diverge in capacity and sensitivity to sparse and correlated patterns, exhibit distinct ROC curves, and account for performance on both item and associative recognition tests. The demonstration that a single‐trace, dual‐process model can account for a range of empirical findings highlights the importance of distinguishing between neuronal processes and the neuronal representations on which they operate.