Raymond van Ee

Multi-timescale perceptual history resolves visual ambiguity

When visual input is inconclusive, does previous experience aid the visual system in attaining an accurate perceptual interpretation? Prolonged viewing of a visually ambiguous stimulus causes perception to alternate between conflicting interpretations. When viewed intermittently, however, ambiguous stimuli tend to evoke the same percept on many consecutive presentations. This perceptual stabilization has been suggested to reflect persistence of the most recent percept throughout the blank that separates two presentations. Here we show that the memory trace that causes stabilization reflects not just the latest percept, but perception during a much longer period. That is, the choice between competing percepts at stimulus reappearance is determined by an elaborate history of prior perception. Specifically, we demonstrate a seconds-long influence of the latest percept, as well as a more persistent influence based on the relative proportion of dominance during a preceding period of at least one minute. In case short-term perceptual history and long-term perceptual history are opposed (because perception has recently switched after prolonged stabilization), the long-term influence recovers after the effect of the latest percept has worn off, indicating independence between time scales. We accommodate these results by adding two positive adaptation terms, one with a short time constant and one with a long time constant, to a standard model of perceptual switching.

General validity of Levelt's propositions reveals common computational mechanisms for visual rivalry

The mechanisms underlying conscious visual perception are often studied with either binocular rivalry or perceptual rivalry stimuli. Despite existing research into both types of rivalry, it remains unclear to what extent their underlying mechanisms involve common computational rules. Computational models of binocular rivalry mechanisms are generally tested against Levelts four propositions, describing the psychophysical relation between stimulus strength and alternation dynamics in binocular rivalry. Here we use a bistable rotating structure-from-motion sphere, a generally studied form of perceptual rivalry, to demonstrate that Levelts propositions also apply to the alternation dynamics of perceptual rivalry. Importantly, these findings suggest that bistability in structure-from-motion results from active cross-inhibition between neural populations with computational principles similar to those present in binocular rivalry. Thus, although the neural input to the computational mechanism of rivalry may stem from different cortical neurons and different cognitive levels the computational principles just prior to the production of visual awareness appear to be common to the two types of rivalry.

Multisensory Congruency as a Mechanism for Attentional Control over Perceptual Selection

The neural mechanisms underlying attentional selection of competing neural signals for awareness remains an unresolved issue. We studied attentional selection, using perceptually ambiguous stimuli in a novel multisensory paradigm that combined competing auditory and competing visual stimuli. We demonstrate that the ability to select, and attentively hold, one of the competing alternatives in either sensory modality is greatly enhanced when there is a matching cross-modal stimulus. Intriguingly, this multimodal enhancement of attentional selection seems to require a conscious act of attention, as passively experiencing the multisensory stimuli did not enhance control over the stimulus. We also demonstrate that congruent auditory or tactile information, and combined auditory–tactile information, aids attentional control over competing visual stimuli and visa versa. Our data suggest a functional role for recently found neurons that combine voluntarily initiated attentional functions across sensory modalities. We argue that these units provide a mechanism for structuring multisensory inputs that are then used to selectively modulate early (unimodal) cortical processing, boosting the gain of task-relevant features for willful control over perceptual awareness.

Distributions of alternation rates in various forms of bistable perception

Studying the temporal dynamics of bistable perception can be useful for understanding neural mechanisms underlying the phenomenon. We take a closer look at those temporal dynamics, using data from four different ambiguous stimuli. We focus our analyses on two recurrent themes in bistable perception literature. First, we address the question whether percept durations follow a gamma distribution, as is commonly assumed. We conclude that this assumption is not justified by the gamma distributions approximate resemblance to distributions of percept durations. We instead present two straightforward distributions of reciprocal percept durations (i.e., rates) that both easily surpass the classic gamma distribution in terms of resemblance to empirical data. Second, we compare the distributions arising from binocular rivalry with those from other forms of bistable perception. Parallels in temporal dynamics between those classes of stimuli are often mentioned as an indication of a similar neural basis, but have never been studied in detail. Our results demonstrate that the distributions arising from binocular rivalry and other forms of bistable perception are indeed similar up to a high level of detail.

Dynamics of perceptual bi-stability for stereoscopic slant rivalry and a comparison with grating, house-face, and Necker cube rivalry

A way to study conscious perception is to expose the visual system to an ambiguous stimulus that instigates bi-stable perception. This provides the opportunity to study neural underpinnings related to the percepts rather than to the stimulus. We have recently developed a slant-rivalry paradigm that has beneficial metrical (quantitative) aspects and that exhibits temporal aspects of perceptual reversals that seemed to be under considerable voluntary control of the observer. Here we examined a range of different aspects of the temporal dynamics of the perceptual reversals of slant rivalry and we compared these with the dynamics of orthogonal grating rivalry, house-face rivalry, and Necker cube rivalry. We found that slant rivalry exhibits a qualitatively similar pattern of dynamics. The drift of the perceptual reversal rate, both across successive experimental repetitions, and across successive 35-s portions of data were similar. The sequential dependence of the durations of perceptual phases, too, revealed very similar patterns. The main quantitative difference, which could make slant rivalry a useful stimulus for future neurophysiological studies, is that the percept durations are relatively long compared to the other rivalry stimuli. In the paper that accompanies this paper [van Ee, R., van Dam, L. C. J., Brouwer, G. J. (2005). Voluntary control and the dynamics of perceptual bi-stability. Vision Research] we focused on the role of voluntary control in the dynamics of perceptual reversals. � 2004 Elsevier Ltd. All rights reserved.

Visual cortex allows prediction of perceptual states during ambiguous structure-from-motion.

We investigated the role of retinotopic visual cortex and motion-sensitive areas in representing the content of visual awareness during ambiguous structure-from-motion (SFM), using functional magnetic resonance imaging (fMRI) and multivariate statistics (support vector machines). Our results indicate that prediction of perceptual states can be very accurate for data taken from dorsal visual areas V3A, V4D, V7, and MT+ and for parietal areas responsive to SFM, but to a lesser extent for other visual areas. Generalization of prediction was possible, because prediction accuracy was significantly better than chance for both an unambiguous stimulus and a different experimental design. Detailed analysis of eye movements revealed that strategic and even encouraged beneficial eye movements were not the cause of the prediction accuracy based on cortical activation. We conclude that during perceptual rivalry, neural correlates of visual awareness can be found in retinotopic visual cortex, MT+, and parietal cortex. We argue that the organization of specific motion-sensitive neurons creates detectable biases in the preferred direction selectivity of voxels, allowing prediction of perceptual states. During perceptual rivalry, retinotopic visual cortex, in particular higher-tier dorsal areas like V3A and V7, actively represents the content the visual awareness.

Bayesian modeling of cue interaction: bistability in stereoscopic slant perception

Our two eyes receive different views of a visual scene, and the resulting binocular disparities enable us to reconstruct its three-dimensional layout. However, the visual environment is also rich in monocular depth cues. We examined the resulting percept when observers view a scene in which there are large conflicts between the surface slant signaled by binocular disparities and the slant signaled by monocular perspective. For a range of disparity-perspective cue conflicts, many observers experience bistability: They are able to perceive two distinct slants and to flip between the two percepts in a controlled way. We present a Bayesian model that describes the quantitative aspects of perceived slant on the basis of the likelihoods of both perspective and disparity slant information combined with prior assumptions about the shape and orientation of objects in the scene. Our Bayesian approach can be regarded as an overarching framework that allows researchers to study all cue integration aspects-including perceptual decisions--in a unified manner.

The role of saccades in exerting voluntary control in perceptual and binocular rivalry

We have investigated the role of saccades and fixation positions in two perceptual rivalry paradigms (slant rivalry and Necker cube) and in two binocular rivalry paradigms (grating and house-face rivalry), and we compared results obtained from two different voluntary control conditions (natural viewing and hold percept). We found that for binocular rivalry, rather than for perceptual rivalry, there is a marked positive temporal correlation between saccades and perceptual flips at about the moment of the flip. Across different voluntary control conditions the pattern of temporal correlation did not change (although the amount of correlation did frequently, but not always, change), indicating that subjects do not use different temporal eye movement schemes to exert voluntary control. Analysis of the fixation positions at about the moment of the flips indicates that the fixation position by itself does not determine the percept but that subjects prefer to fixate at different positions when asked to hold either of the different percepts.

Adaptation to three-dimensional distortions in human vision

When people get new glasses, they often experience distortions in the apparent three-dimensional layout of the environment; the distortions fade away in a week or so. Here we asked observers to wear a horizontal magnifier in front of one eye for several days, causing them to initially perceive large three-dimensional distortions. We found that adaptation to the magnifier was not caused by changes in the weights given to disparity and texture, or by monocular adaptation, but rather by a change in the mapping between retinal disparity and perceived slant.

Flash suppression and flash facilitation in binocular rivalry

We show that previewing one half image of a binocular rivalry pair can cause it to gain initial dominance when the other half is added, a novel phenomenon we term flash facilitation. This is the converse of a known effect called flash suppression, where the previewed image becomes suppressed upon rivalrous presentation. The exact effect of previewing an image depends on both the duration and the contrast of the prior stimulus. Brief, low-contrast prior stimuli facilitate, whereas long, high-contrast ones suppress. These effects have both an eye-based component and a pattern-based component. Our results suggest that, instead of reflecting two unrelated mechanisms, both facilitation and suppression are manifestations of a single process that occurs progressively during presentation of the prior stimulus. The distinction between the two phenomena would then lie in the extent to which the process has developed during prior stimulation. This view is consistent with a neural model previously proposed to account for perceptual stabilization of ambiguous stimuli, suggesting a relation between perceptual stabilization and the present phenomena.