David I. Shore

Multisensory prior entry

Despite 2 centuries of research, the question of whether attending to a sensory modality speeds the perception of stimuli in that modality has yet to be resolved. The authors highlight weaknesses inherent in this previous research and report the results of 4 experiments in which a novel methodology was used to investigate the effects on temporal order judgments (TOJs) of attending to a particular sensory modality or spatial location. Participants were presented with pairs of visual and tactile stimuli from the left and/or right at varying stimulus onset asynchronies and were required to make unspeeded TOJs regarding which stimulus appeared first. The results provide the strongest evidence to date for the existence of multisensory prior entry and support previous claims for attentional biases toward the visual modality and toward the right side of space. These findings have important implications for studies in many areas of human and animal cognition.

Visual Prior Entry

It has long been claimed that attended stimuli are perceived prior to unattended stimuli—the doctrine of prior entry. Most, if not all, studies on which such claims have been based, however, are open to a nonattentional interpretation involving response bias, leading some researchers to assert that prior entry may not exist. Given this controversy, we introduce a novel methodology to minimize the effect of response bias by manipulating attention and response demands in orthogonal dimensions. Attention was oriented to the left or right (i.e., spatially), but instead of reporting on the basis of location, observers reported the order (first or second) of vertical versus horizontal line segments. Although second-order response biases were demonstrated, effects of attention in accordance with the law of prior entry were clearly obtained following both exogenous and endogenous attentional cuing.

Audio-visual simultaneity judgments

The relative spatiotemporal correspondence between sensory events affects multisensory integration across a variety of species; integration is maximal when stimuli in different sensory modalities are presented from approximately the same position at about the same time. In the present study, we investigated the influence of spatial and temporal factors on audio-visual simultaneity perception in humans. Participants made unspeeded simultaneous versus successive discrimination responses to pairs of auditory and visual stimuli presented at varying stimulus onset asynchronies from either the same or different spatial positions using either the method of constant stimuli (Experiments 1 and 2) or psychophysical staircases (Experiment 3). The participants in all three experiments were more likely to report the stimuli as being simultaneous when they originated from the same spatial position than when they came from different positions, demonstrating that the apparent perception of multisensory simultaneity is dependent on the relative spatial position from which stimuli are presented.

Multisensory representation of limb position in human premotor cortex

Using functional magnetic resonance imaging (fMRI) in humans, we identified regions of cortex involved in the encoding of limb position. Tactile stimulation of the right hand, across the body midline, activated the right parietal cortex when the eyes were closed; activation shifted to a left parietofrontal network when the eyes were open. These data reveal important similarities between human and non-human primates in the network of brain areas involved in the multisensory representation of limb position.

Appraising the ANT: Psychometric and theoretical considerations of the Attention Network Test

OBJECTIVE The Attention Network Test (ANT) is a tool used to assess the efficiency of the 3 attention networks-alerting, orienting, and executive control. The ANT has become popular in the neuropsychological literature since its first description in 2002, with some form of the task currently appearing in no less than 65 original research papers. Although several general reviews of the ANT exist, none provide an analysis of its psychometric properties. METHOD Data from 15 unique studies were collected, resulting in a large sample (N = 1,129) of healthy individuals. Split-half reliability, variance structure, distribution shape, and independence of measurement of the 3 attention network scores were analyzed, considering both reaction time and accuracy as dependent variables. RESULTS Split-half reliabilities of reaction time based attention network scores were low for alerting (rweighted = .20, CI 95%weighted [.14, .27], Spearman-Brown r = .38) and orienting (rweighted = .32, CI 95%weighted [.26, .38], Spearman-Brown r = .55), and moderate high for executive control (rweighted = .65, CI 95%weighted [.61, .71], Spearman-Brown r = .81). Analysis of the variance structure of the ANT indicated that power to find significant effects was variable across networks and dependent on the statistical analysis being used. Both analysis of variance (significant interaction observed in 100% of 15 studies) and correlational analyses (multiple-significant inter-network correlations observed) suggest that the networks measured by the ANT are not independent. CONCLUSIONS In the collection, analysis and interpretation of any test data, psychometric properties, such as those reported here for the ANT, must be carefully considered.

Inhibition and Interference in Selective Attention: Some Tests of a Neural Network Model

We describe a neural network system that models selective action—that is, how an organism selectively responds to an object when other objects evoke competing responses. Performance of the model during simulations of various selective action situations reveals a number of interesting patterns of data. Specifically, the model shows a complex relationship between how much a distractor interferes with response to a target and how much inhibition is associated with the distractor. Subsequent experiments with human subjects reveal that the paradoxical behaviour of the model is also observed in human behaviour. We conclude that the similar performance characteristics of the model and human subjects in a variety of situations suggest that the model has captured some of the essential properties of mammalian selective action mechanisms.

Multisensory temporal order judgments: When two locations are better than one

In Experiment 1, participants were presented with pairs of stimuli (one visual and the other tactile) from the left and/or right of fixation at varying stimulus onset asynchronies and were required to make unspeeded temporal order judgments (TOJs) regarding which modality was presented first. When the participants adopted an uncrossed-hands posture, just noticeable differences (JNDs) were lower (i.e., multisensory TOJs were more precise) when stimuli were presented from different positions, rather than from the same position. This spatial redundancy benefit was reduced when the participants adopted a crossed-hands posture, suggesting a failure to remap visuotactile space appropriately. In Experiment 2, JNDs were also lower when pairs of auditory and visual stimuli were presented from different positions, rather than from the same position. Taken together, these results demonstrate that people can use redundant spatial cues to facilitate their performance on multisensory TOJ tasks and suggest that previous studies may have systematically overestimated the precision with which people can make such judgments. These results highlight the intimate link between spatial and temporal factors in determining our perception of the multimodal objects and events in the world around us.

On the manifestations of memory in visual search.

Evidence is presented supporting the thesis that performance in visual search tasks is affected by the contribution of memory processes. Three levels of analysis, corresponding to the various time scales present in a typical search experiment, are discussed. Perceptual learning involves the task and stimulus specific improvement seen across blocks of training. Trial-to-trial priming has an influence which extends over 5-8 trials and lasts on the order of 30 s. Within-trial tagging prevents the re-inspection of already attended (or fixated) items. Also at the within-trial level of analysis, parallel accumulation of evidence for target presence/absence or target location inherently involves memory mechanisms. Organizing the various phenomena in this way makes it apparent that the various mechanisms may interact in a causal way. Within-trial tagging may contribute to priming which may contribute to perceptual learning. Recent proposals that visual search is memoryless (amnesic) are discussed and dismissed.

The attentional blink is immune to masking-induced data limits

The attentional blink is the robust finding that processing a masked item (T1) hinders the subsequent identification of a backwards masked second item (T2), which follows soon after the first one. There has been some debate about the theoretically important relation between the difficulty of T1 processing and the ensuing blink. In Experiment 1 we manipulated the difficulty of T1 in such a way as to affect the quality of data without altering the amount of resources allocated to its identification. We found no relation between the accuracy of T1 identification and the blink. In Experiment 2, the same difficulty manipulation was applied to T2, and we observed an additive pattern with the blink. Together, this pattern of results indicates that a data-limited difficulty manipulation does not affect the blink, whether applied to T1 or T2. In Experiment 3 we used an individual differences methodology to show that performance in the traditional “stream”-like presentation (rapid serial visual presentation) was highly correlated with performance in our modified “target mask, target mask” paradigm, thus allowing for comparisons beyond the present methodology to much of the previous literature that has used the stream paradigm.

Audiovisual prior entry

It is almost one hundred years since Titchener [E.B. Titchener, Lectures on the Elementary Psychology of Feeling and Attention, Macmillan, New York, 1908] published his influential claim that attending to a particular sensory modality (or location) can speed up the relative time of arrival of stimuli presented in that modality (or location). However, the evidence supporting the existence of prior entry is, to date, mixed. In the present study, we used an audiovisual simultaneity judgment task in an attempt to circumvent the potential methodological confounds inherent in previous research in this area. Participants made simultaneous versus successive judgment responses regarding pairs of auditory and visual stimuli at varying stimulus onset asynchronies (SOAs) using the method of constant stimuli. In different blocks of trials, the participants were instructed to attend either to the auditory or to the visual modality, or else to divide their attention equally between the two modalities. The probability of trials containing intramodal stimulus pairs (e.g., vision-vision or audition-audition) was increased in the focused attention blocks to encourage participants to follow the instructions. The perception of simultaneity was modulated by this attentional manipulation: Visual stimuli had to lead auditory stimuli by a significantly smaller interval for simultaneity to be perceived when attention was directed to vision than when it was directed to audition. These results provide the first unequivocal evidence for the existence of audiovisual prior entry.