Christian H. Poth

Effects of monitoring for visual events on distinct components of attention

Monitoring the environment for visual events while performing a concurrent task requires adjustment of visual processing priorities. By use of Bundesen’s (1990) Theory of Visual Attention, we investigated how monitoring for an object-based brief event affected distinct components of visual attention in a concurrent task. The perceptual salience of the event was varied. Monitoring reduced the processing speed in the concurrent task, and the reduction was stronger when the event was less salient. The monitoring task neither affected the temporal threshold of conscious perception nor the storage capacity of visual short-term memory nor the efficiency of top-down controlled attentional selection.

Breaking Object Correspondence Across Saccadic Eye Movements Deteriorates Object Recognition.

Visual perception is based on information processing during periods of eye fixations that are interrupted by fast saccadic eye movements. The ability to sample and relate information on task-relevant objects across fixations implies that correspondence between presaccadic and postsaccadic objects is established. Postsaccadic object information usually updates and overwrites information on the corresponding presaccadic object. The presaccadic object representation is then lost. In contrast, the presaccadic object is conserved when object correspondence is broken. This helps transsaccadic memory but it may impose attentional costs on object recognition. Therefore, we investigated how breaking object correspondence across the saccade affects postsaccadic object recognition. In Experiment 1, object correspondence was broken by a brief postsaccadic blank screen. Observers made a saccade to a peripheral object which was displaced during the saccade. This object reappeared either immediately after the saccade or after the blank screen. Within the postsaccadic object, a letter was briefly presented (terminated by a mask). Observers reported displacement direction and letter identity in different blocks. Breaking object correspondence by blanking improved displacement identification but deteriorated postsaccadic letter recognition. In Experiment 2, object correspondence was broken by changing the object’s contrast-polarity. There were no object displacements and observers only reported letter identity. Again, breaking object correspondence deteriorated postsaccadic letter recognition. These findings identify transsaccadic object correspondence as a key determinant of object recognition across the saccade. This is in line with the recent hypothesis that breaking object correspondence results in separate representations of presaccadic and postsaccadic objects which then compete for limited attentional processing resources (Schneider, 2013). Postsaccadic object recognition is then deteriorated because less resources are available for processing postsaccadic objects.

Using the virtual reality device Oculus Rift for neuropsychological assessment of visual processing capabilities

Neuropsychological assessment of human visual processing capabilities strongly depends on visual testing conditions including room lighting, stimuli, and viewing-distance. This limits standardization, threatens reliability, and prevents the assessment of core visual functions such as visual processing speed. Increasingly available virtual reality devices allow to address these problems. One such device is the portable, light-weight, and easy-to-use Oculus Rift. It is head-mounted and covers the entire visual field, thereby shielding and standardizing the visual stimulation. A fundamental prerequisite to use Oculus Rift for neuropsychological assessment is sufficient test-retest reliability. Here, we compare the test-retest reliabilities of Bundesen’s visual processing components (visual processing speed, threshold of conscious perception, capacity of visual working memory) as measured with Oculus Rift and a standard CRT computer screen. Our results show that Oculus Rift allows to measure the processing components as reliably as the standard CRT. This means that Oculus Rift is applicable for standardized and reliable assessment and diagnosis of elementary cognitive functions in laboratory and clinical settings. Oculus Rift thus provides the opportunity to compare visual processing components between individuals and institutions and to establish statistical norm distributions.

Episodic Short-Term Recognition Requires Encoding into Visual Working Memory: Evidence from Probe Recognition after Letter Report

Human vision is organized in discrete processing episodes (e.g., eye fixations or task-steps). Object information must be transmitted across episodes to enable episodic short-term recognition: recognizing whether a current object has been seen in a previous episode. We ask whether episodic short-term recognition presupposes that objects have been encoded into capacity-limited visual working memory (VWM), which retains visual information for report. Alternatively, it could rely on the activation of visual features or categories that occurs before encoding into VWM. We assessed the dependence of episodic short-term recognition on VWM by a new paradigm combining letter report and probe recognition. Participants viewed displays of 10 letters and reported as many as possible after a retention interval (whole report). Next, participants viewed a probe letter and indicated whether it had been one of the 10 letters (probe recognition). In Experiment 1, probe recognition was more accurate for letters that had been encoded into VWM (reported letters) compared with non-encoded letters (non-reported letters). Interestingly, those letters that participants reported in their whole report had been near to one another within the letter displays. This suggests that the encoding into VWM proceeded in a spatially clustered manner. In Experiment 2, participants reported only one of 10 letters (partial report) and probes either referred to this letter, to letters that had been near to it, or far from it. Probe recognition was more accurate for near than for far letters, although none of these letters had to be reported. These findings indicate that episodic short-term recognition is constrained to a small number of simultaneously presented objects that have been encoded into VWM.

Object discrepancy modulates feature prediction across eye movements

Object perception across saccadic eye movements is assumed to result from integrating two information sources: incoming peripheral object information and information from a foveal prediction (Herwig and Schneider, J Exp Psychol Gen 143(5):1903–1922, 2014 , Herwig, J Vis 15(16), 7, 2015 ). Predictions are supposed to be based on transsaccadic associations of peripheral and foveal object information. The main function of these predictions may be to conceal discrepancies in resolution and locations across saccades. Here we ask how predictions are affected by discrepancies between peripheral and foveal objects. Participants learned unfamiliar transsaccadic associations by making saccades to objects whose shape systematically changed during the saccade. Importantly, we manipulated the size of this change between participants to induce different magnitudes of object discrepancy. In a subsequent test, we found that judgment shifts of peripheral shape perception toward the predicted foveal input depended on change size during acquisition. Specifically, the contribution of prediction decreased for large changes but did not reach zero, showing that even for large changes (i.e., square to circle or vice versa) the prediction was not ignored completely. These findings indicate that object discrepancy during learning determines how much the resulting foveal prediction contributes to perception in the periphery.

Ultrahigh temporal resolution of visual presentation using gaming monitors and G-Sync

Vision unfolds as an intricate pattern of information processing over time. Studying vision and visual cognition therefore requires precise manipulations of the timing of visual stimulus presentation. Although standard computer display technologies offer great accuracy and precision of visual presentation, their temporal resolution is limited. This limitation stems from the fact that the presentation of rendered stimuli has to wait until the next refresh of the computer screen. We present a novel method for presenting visual stimuli with ultrahigh temporal resolution (<1 ms) on newly available gaming monitors. The method capitalizes on the G-Sync technology, which allows for presenting stimuli as soon as they have been rendered by the computer’s graphics card, without having to wait for the next screen refresh. We provide software implementations in the three programming languages C++, Python (using PsychoPy2), and Matlab (using Psychtoolbox3). For all implementations, we confirmed the ultrahigh temporal resolution of visual presentation with external measurements by using a photodiode. Moreover, a psychophysical experiment revealed that the ultrahigh temporal resolution impacts on human visual performance. Specifically, observers’ object recognition performance improved over fine-grained increases of object presentation duration in a theoretically predicted way. Taken together, the present study shows that the G-Sync-based presentation method enables researchers to investigate visual processes whose data patterns were concealed by the low temporal resolution of previous technologies. Therefore, this new presentation method may be a valuable tool for experimental psychologists and neuroscientists studying vision and its temporal characteristics.

Perturbing object stability across saccadic eye movements facilitates displacement detection but hinders object recognition

By making saccadic eye movements, we can bring interesting peripheral objects into the fovea for high-acuity examination. Every saccade abruptly displaces and alters the retinal image of objects. Nevertheless, we perceive objects as stable in their locations. The visual system seems to deal with the retinal image displacement by actively assuming object stability across saccades. This assumption seems to be responsible for concealing actual object displacements across the saccade, rendering them hard to detect (cf. Bridgeman et al., 1975, Vis Res). Pre-saccadic object representations are updated with post-saccadic information, leaving only the latter one accessible and impairing displacement detection. In contrast, briefly showing a post-saccadic blank screen prior to the shifted object improves displacement detection (Deubel & Schneider, 1994, BBS). Such blanking may violate the assumption of object stability. Pre-saccadic object representations should then be maintained separately from post-saccadic ones. Here, we investigated whether perturbing object stability during saccadic eye movements affects the recognition of post-saccadic objects. Observers saccaded to an abruptly appearing peripheral ellipse. The ellipse was displaced during the saccade to the left or right. After the saccade, the ellipse was either blanked for 100 ms (blank condition) or immediately shown (no-blank condition). Then a letter appeared within the ellipse (80 ms), followed by a pattern mask (300 ms). In two different blocks of trials, observers either reported displacement direction or letter identity. Reports of displacement direction were more accurate in the blank compared to the no-blank condition. Strikingly, this was reversed for reports of the post-saccadic letter, for which accuracy was lower in the blank than in the no-blank condition. Blanking may improve displacement detection by preventing updating of pre-saccadic object representations so that these are separately maintained (Schneider, 2013, Phil Trans B). This extra pre-saccadic and non-updated object representation interferes with competitive post-saccadic object recognition. Meeting abstract presented at VSS 2015.