Matthias Ihrke

3D unsharp masking for scene coherent enhancement

We present a new approach for enhancing local scene contrast by unsharp masking over arbitrary surfaces under any form of illumination. Our adaptation of a well-known 2D technique to 3D interactive scenarios is designed to aid viewers in tasks like understanding complex or detailed geometric models, medical visualization and navigation in virtual environments. Our holistic approach enhances the depiction of various visual cues, including gradients from surface shading, surface reflectance, shadows, and highlights, to ease estimation of viewpoint, lighting conditions, shapes of objects and their world-space organization. Motivated by recent perceptual findings on 3D aspects of the Cornsweet illusion, we create scene coherent enhancements by treating cues in terms of their 3D context; doing so has a stronger effect than approaches that operate in a 2D image context and also achieves temporal coherence. We validate our unsharp masking in 3D with psychophysical experiments showing that the enhanced images are perceived to have better contrast and are preferred over unenhanced originals. Our operator runs at real-time rates on a GPU and the effect is easily controlled interactively within the rendering pipeline.

Temporal Glare: Real-Time Dynamic Simulation of the Scattering in the Human Eye

Glare is a consequence of light scattered within the human eye when looking at bright light sources. This effect can be exploited for tone mapping since adding glare to the depiction of high‐dynamic range (HDR) imagery on a low‐dynamic range (LDR) medium can dramatically increase perceived contrast. Even though most, if not all, subjects report perceiving glare as a bright pattern that fluctuates in time, up to now it has only been modeled as a static phenomenon. We argue that the temporal properties of glare are a strong means to increase perceived brightness and to produce realistic and attractive renderings of bright light sources. Based on the anatomy of the human eye, we propose a model that enables real‐time simulation of dynamic glare on a GPU. This allows an improved depiction of HDR images on LDR media for interactive applications like games, feature films, or even by adding movement to initially static HDR images. By conducting psychophysical studies, we validate that our method improves perceived brightness and that dynamic glare‐renderings are often perceived as more attractive depending on the chosen scene.

A computational approach to negative priming

Priming is characterized by a sensitivity of reaction times to the sequence of stimuli in psychophysical experiments. The reduction of the reaction time observed in positive priming is well-known and experimentally understood (Scarborough et al., J. Exp. Psycholol: Hum. Percept. Perform., 3, pp. 1–17, 1977). Negative priming—the opposite effect—is experimentally less tangible (Fox, Psychonom. Bull. Rev., 2, pp. 145–173, 1995). The dependence on subtle parameter changes (such as response-stimulus interval) usually varies. The sensitivity of the negative priming effect bears great potential for applications in research in fields such as memory, selective attention, and ageing effects. We develop and analyse a computational realization, CISAM, of a recent psychological model for action decision making, the ISAM (Kabisch, PhD thesis, Friedrich-Schiller-Universität, 2003), which is sensitive to priming conditions. With the dynamical systems approach of the CISAM, we show that a single adaptive threshold mechanism is sufficient to explain both positive and negative priming effects. This is achieved by comparing results obtained by the computational modelling with experimental data from our laboratory. The implementation provides a rich base from which testable predictions can be derived, e.g. with respect to hitherto untested stimulus combinations (e.g. single-object trials).

Response-retrieval and negative priming: Encoding- and Retrieval-Specific Effects

The existence of across-notation automatic numerical processing of two-digit (2D) numbers was explored using size comparisons tasks. Participants were Arabic speakers, who use two sets of numerical symbols—Arabic and Indian. They were presented with pairs of 2D numbers in the same or in mixed notations. Responses for a numerical comparison task were affected by decade difference and unit-decade compatibility and global distance in both conditions, extending previous findings with Arabic digits (Nuerk, Weger, & Willmes, 2001). Responses for a physical comparison task were affected by congruency with the numerical size, as indicated by the size congruency effect (SiCE). The SiCE was affected by unit-decade compatibility but not by global distance, thus suggesting that the units and decades digits of the 2D numbers, but not the whole number value were automatically translated into a common representation of magnitude. The presence of similar results for same- and mixed-notation pairs supports the idea of an abstract representation of magnitude.

Brightness of the glare illusion

The glare illusion is commonly used in CG rendering, especially in game engines, to achieve a higher brightness than that of the maximum luminance of a display. In this work, we measure the perceived luminance of the glare illusion in a psychophysical experiment. To evoke the illusion, an image is convolved with either a point spread function (PSF) of the eye or a Gaussian kernel. It is found that 1) the Gaussian kernel evokes an illusion of the same or higher strength than that produced by the PSF while being computationally much less expensive, 2) the glare illusion can raise the perceived luminance by 20 -- 35%, 3) some convolution kernels can produce undesirable Mach-band effects and thereby reduce the brightness boost of the glare illusion. The reported results have practical implications for glare rendering in computer graphics.

Event-related brain potential correlates of identity negative priming from overlapping pictures.

Event-related potentials (ERPs) were obtained from an identity priming task, where a green target had to be selected against a superimposed red distractor. Several priming conditions were realized in a mix of control (CO), negative priming (NP), and positive priming (PP) trials. PP and NP effects in reaction times (RTs) were significant. ERP results conceptually replicate earlier findings of left-posterior P300 reduction in PP and NP trials compared to CO. This ERP effect may reflect the detection of prime-probe similarity corresponding to the concept of a retrieval cue. A novel finding concerned amplitude increase of the frontal late positive complex (LPC) in the order NP, CO, and PP. NP therefore seemed to induce brain activity related to cognitive control and/or memory processes, with reduced LPC amplitude indicating effortful processing. Overall, retrieval-based explanations of identity NP are supported.

Recurrence-Based Estimation of Time-Distortion Functions for ERP Waveform Reconstruction

We introduce an approach to compensate for temporal distortions of repeated measurements in event-related potential research. The algorithm uses a combination of methods from nonlinear time-series analysis and is based on the construction of pairwise registration functions from cross-recurrence plots of the phase-space representations of ERP signals. The globally optimal multiple-alignment path is approximated by hierarchical cluster analysis, i.e. by iteratively combining pairs of trials according to similarity. By the inclusion of context information in form of externally acquired time markers (e.g. reaction time) into a regularization scheme, the extracted warping functions can be guided near paths that are implied by the experimental procedure. All parameters occurring in the algorithm can be optimized based on the properties of the data and there is a broad regime of parameter configurations where the algorithm produces good results. Simulations on artificial data and the analysis of ERPs from a psychophysical study demonstrate the robustness and applicability of the algorithm.

Denoising and Averaging Techniques for Electrophysiological Data

Neurophysiological signals are often corrupted by noise that is significantly stronger than the signal itself. In electroencephalographic (EEG) data this may amount to figures of −25 dB (Flexer, 2000), for electromyography (EMG) or functional magnetic resonance imaging (fMRI) the situation is similar. The problem of the recovery of information under noise has been dealt with extensively in the literature of signal and image processing (Whalen, 1971; Castleman, 1996).

A perceptual evaluation of 3D unsharp masking

Much research has gone into developing methods for enhancing the contrast of displayed 3D scenes. In the current study, we investigated the perceptual impact of an algorithm recently proposed by Ritschel et al.1 that provides a general technique for enhancing the perceived contrast in synthesized scenes. Their algorithm extends traditional image-based Unsharp Masking to a 3D scene, achieving a scene-coherent enhancement. We conducted a standardized perceptual experiment to test the proposition that a 3D unsharp enhanced scene was superior to the original scene in terms of perceived contrast and preference. Furthermore, the impact of different settings of the algorithms main parameters enhancement-strength (λ) and gradient size (σ) were studied in order to provide an estimate of a reasonable parameter space for the method. All participants preferred a clearly visible enhancement over the original, non-enhanced scenes and the setting for objectionable enhancement was far above the preferred settings. The effect of the gradient size σ was negligible. The general pattern found for the parameters provides a useful guideline for designers when making use of 3D Unsharp Masking: as a rule of thumb they can easily determine the strength for which they start to perceive an enhancement and use twice this value for a good effect. Since the value for objectionable results was twice as large again, artifacts should not impose restrictions on the applicability of this rule.

Identity Negative Priming: A Phenomenon of Perception, Recognition or Selection?

The present study addresses the problem whether negative priming (NP) is due to information processing in perception, recognition or selection. We argue that most NP studies confound priming and perceptual similarity of prime-probe episodes and implement a color-switch paradigm in order to resolve the issue. In a series of three identity negative priming experiments with verbal naming response, we determined when NP and positive priming (PP) occur during a trial. The first experiment assessed the impact of target color on priming effects. It consisted of two blocks, each with a different fixed target color. With respect to target color no differential priming effects were found. In Experiment 2 the target color was indicated by a cue for each trial. Here we resolved the confounding of perceptual similarity and priming condition. In trials with coinciding colors for prime and probe, we found priming effects similar to Experiment 1. However, trials with a target color switch showed such effects only in trials with role-reversal (distractor-to-target or target-to-distractor), whereas the positive priming (PP) effect in the target-repetition trials disappeared. Finally, Experiment 3 split trial processing into two phases by presenting the trial-wise color cue only after the stimulus objects had been recognized. We found recognition in every priming condition to be faster than in control trials. We were hence led to the conclusion that PP is strongly affected by perception, in contrast to NP which emerges during selection, i.e., the two effects cannot be explained by a single mechanism.