Peter U. Tse

Attention and the subjective expansion of time

During brief, dangerous events, such as car accidents and robberies, many people report that events seem to pass in slow motion, as if time had slowed down. We have measured a similar, although less dramatic, effect in response to unexpected, nonthreatening events. We attribute the subjective expansion of time to the engagement of attention and its influence on the amount of perceptual information processed. We term the effecttime’s subjective expansion (TSE) and examine here the objective temporal dynamics of these distortions. When a series of stimuli are shown in succession, the lowprobabilityoddball stimulus in the series tends to last subjectively longer than the high-probability stimulus even when they last the same objective duration. In particular, (1) there is a latency of at least 120 msec between stimulus onset and the onset of TSE, which may be preceded by subjective temporal contraction; (2) there is a peak in TSE at which subjective time is particularly distorted at a latency of 225 msec after stimulus onset; and (3) the temporal dynamics of TSE are approximately the same in the visual and the auditory domains. Two control experiments (in which the methods of magnitude estimation and stimulus reproduction were used) replicated the temporal dynamics of TSE revealed by the method of constant stimuli, although the initial peak was not apparent with these methods. In addition, a third, control experiment (in which the method of single stimuli was used) showed that TSE in the visual domain can occur because of semantic novelty, rather than image novelty per se. Overall, the results support the view that attentional orienting underlies distortions in perceived duration.

Time and the Brain: How Subjective Time Relates to Neural Time

Most of the actions our brains perform on a daily basis, such as perceiving, speaking, and driving a car, require timing on the scale of tens to hundreds of milliseconds. New discoveries in psychophysics, electrophysiology, imaging, and computational modeling are contributing to an emerging picture of how the brain processes, learns, and perceives time.

White matter structure changes as adults learn a second language

Traditional models hold that the plastic reorganization of brain structures occurs mainly during childhood and adolescence, leaving adults with limited means to learn new knowledge and skills. Research within the last decade has begun to overturn this belief, documenting changes in the brains gray and white matter as healthy adults learn simple motor and cognitive skills [Lövdén, M., Bodammer, N. C., Kühn, S., Kaufmann, J., Schütze, H., Tempelmann, C., et al. Experience-dependent plasticity of white-matter microstructure extends into old age. Neuropsychologia, 48, 3878–3883, 2010; Taubert, M., Draganski, B., Anwander, A., Müller, K., Horstmann, A., Villringer, A., et al. Dynamic properties of human brain structure: Learning-related changes in cortical areas and associated fiber connections. The Journal of Neuroscience, 30, 11670–11677, 2010; Scholz, J., Klein, M. C., Behrens, T. E. J., & Johansen-Berg, H. Training induces changes in white-matter architecture. Nature Neuroscience, 12, 1370–1371, 2009; Draganski, B., Gaser, C., Busch, V., Schuirer, G., Bogdahn, U., & May, A. Changes in grey matter induced by training. Nature, 427, 311–312, 2004]. Although the significance of these changes is not fully understood, they reveal a brain that remains plastic well beyond early developmental periods. Here we investigate the role of adult structural plasticity in the complex, long-term learning process of foreign language acquisition. We collected monthly diffusion tensor imaging scans of 11 English speakers who took a 9-month intensive course in written and spoken Modern Standard Chinese as well as from 16 control participants who did not study a language. We show that white matter reorganizes progressively across multiple sites as adults study a new language. Language learners exhibited progressive changes in white matter tracts associated with traditional left hemisphere language areas and their right hemisphere analogs. Surprisingly, the most significant changes occurred in frontal lobe tracts crossing the genu of the corpus callosum—a region not generally included in current neural models of language processing. These results indicate that plasticity of white matter plays an important role in adult language learning and additionally demonstrate the potential of longitudinal diffusion tensor imaging as a new tool to yield insights into cognitive processes.

Knowing Who's Boss: fMRI and ERP Investigations of Social Dominance Perception

Humans use facial cues to convey social dominance and submission. Despite the evolutionary importance of this social ability, how the brain recognizes social dominance from the face is unknown. We used event-related brain potentials (ERP) and functional magnetic resonance imaging (fMRI) to examine the neural mechanisms underlying social dominance perception from facial cues. Participants made gender judgments while viewing aggression-related facial expressions as well as facial postures conveying dominance or submission. ERP evidence indicates that the perception of dominance from aggression-related emotional expressions occurs early in neural processing while the perception of social dominance from facial postures arises later. Brain imaging results show that activity in the fusiform gyrus, superior temporal gyrus and lingual gyrus, is associated with the perception of social dominance from facial postures and the magnitude of neural response in these regions differentiates between perceived dominance and perceived submissiveness.

Voluntary attention modulates the brightness of overlapping transparent surfaces

A new class of brightness illusions is introduced that cannot be entirely accounted for by bottom-up models of neuronal processing. In these new illusions, brightness can be modulated by the location of voluntary attention in the absence of eye movements. These effects may arise from top-down or mid-level mechanisms that determine how 3D surfaces and transparent layers are constructed, which in turn influence perceived brightness. Attention is not the only factor that influences perceived brightness in overlapping transparent surfaces. For example, grouping procedures may favor the minimal number of transparent layers necessary to account for the geometry of the stimulus, causing surfaces on a common layer to change brightness together. Attentional modulation of brightness places constraints on possible future models of filling-in, transparent surface formation, brightness perception, and attentional processing.

Fixational eye movements are not affected by abrupt onsets that capture attention

Recent work shows that abrupt onsets reflexively capture attention and trigger saccades that compete with voluntary saccades. To test whether oculomotor capture occurs when no saccade is being planned, we measured fixational eye movements in the absence or presence of an abrupt onset at peripheral locations. We found no effect of abrupt onset location on the average pattern of eye movements during fixation. We conclude that the capture of eye movements by an abrupt onset only happens when the oculomotor system has been preset to make a saccade. This implies that the oculomotor system is not obligatorily driven by events in the visual array.

The duration of 3-D form analysis in transformational apparent motion

Transformational apparent motion (TAM) occurs when a figure changes discretely from one configuration to another overlapping configuration. Rather than an abrupt shape change, the initial shape is perceived to transform smoothly into the final shape as if animated by a series of intermediate shapes. We find that TAM follows an analysis of form that takes 80-140 msec. Form analysis can function both at and away from equiluminance and can occur over contours defined by uniform regions as well as outlines. Moreover, the forms analyzed can be 3-D, resulting in motion paths that appear to smoothly project out from or into the stimulus plane. The perceived transformation is generally the one that involves the least change in the shape or location of the initial figure in a 3-D sense. We conclude that perception of TAM follows an analysis of 3-D form that takes ≈100msec. This stage of form analysis may be common to both TAM and second-order motion.

Microsaccade Rate Varies with Subjective Visibility during Motion-Induced Blindness

Motion-induced blindness (MIB) occurs when a dot embedded in a motion field subjectively vanishes. Here we report the first psychophysical data concerning effects of microsaccade/eyeblink rate upon perceptual switches during MIB. We find that the rate of microsaccades/eyeblink rises before and after perceptual transitions from not seeing to seeing the dot, and decreases before perceptual transitions from seeing it to not seeing it. In addition, event-related fMRI data reveal that, when a dot subjectively reappears during MIB, the blood oxygen-level dependent (BOLD) signal increases in V1v and V2v and decreases in contralateral hMT+. These BOLD signal changes observed upon perceptual state changes in MIB could be driven by the change of perceptual states and/or a confounding factor, such as the microsaccade/eyeblink rate.

Event-related functional MRI of cortical activity evoked by microsaccades, small visually-guided saccades, and eyeblinks in human visual cortex

We used event-related functional magnetic resonance imaging (fMRI) to determine blood oxygen-level-dependent (BOLD) signal changes following microsaccades, visually-guided saccades, and eyeblinks in retinotopically mapped visual cortical areas V1-V3 and hMT+. A deconvolution analysis revealed a similar pattern of BOLD activation following a microsaccade, 0.16 degrees voluntary saccade, and 0.16 degrees displacement of the image under conditions of fixation. In all areas, an initial increase in BOLD signal peaking at approximately 4.5 s after the event was followed by a decline and decrease below baseline. This modulation appears most pronounced for microsaccades and small voluntary saccades in V1, diminishing in strength from V1 to V3. In contrast, 0.16 degrees real motion under conditions of fixation yields the same level of BOLD signal increase in V1 through V3. BOLD signal modulates parametrically with the size of voluntary saccades (0.16 degrees , 0.38 degrees , 0.82 degrees , 1.64 degrees , and 3.28 degrees ) in V1-V3, but not in hMT+. Eyeblinks generate larger modulation that peaks by 6.5 s, and dips below baseline by 10 s post-event, and also exhibits diminishing modulation from V1 to V3. Our results are consistent with the occurrence of transient neural excitation driven by changes in input to retinal ganglion cell receptive fields that are induced by microsaccades, visually-guided saccades, or small image shifts. The pattern of results in area hMT+ exhibits no significant modulation by microsaccades, relatively small modulation by eyeblinks, and substantial responses to saccades and background jumps, suggesting that spurious image motion signal arising from microsaccades and eyeblinks is relatively diminished by hMT+.

Unconscious neural processing differs with method used to render stimuli invisible

Visual stimuli can be kept from awareness using various methods. The extent of processing that a given stimulus receives in the absence of awareness is typically used to make claims about the role of consciousness more generally. The neural processing elicited by a stimulus, however, may also depend on the method used to keep it from awareness, and not only on whether the stimulus reaches awareness. Here we report that the method used to render an image invisible has a dramatic effect on how category information about the unseen stimulus is encoded across the human brain. We collected fMRI data while subjects viewed images of faces and tools, that were rendered invisible using either continuous flash suppression (CFS) or chromatic flicker fusion (CFF). In a third condition, we presented the same images under normal fully visible viewing conditions. We found that category information about visible images could be extracted from patterns of fMRI responses throughout areas of neocortex known to be involved in face or tool processing. However, category information about stimuli kept from awareness using CFS could be recovered exclusively within occipital cortex, whereas information about stimuli kept from awareness using CFF was also decodable within temporal and frontal regions. We conclude that unconsciously presented objects are processed differently depending on how they are rendered subjectively invisible. Caution should therefore be used in making generalizations on the basis of any one method about the neural basis of consciousness or the extent of information processing without consciousness.