Udo Ernst

Intracortical origin of visual maps

Previous experiments indicate that the shape of maps of preferred orientation in the primary visual cortex does not depend on visual experience. We propose a network model that demonstrates that the orientation and direction selectivity of individual units and the structure of the corresponding angle maps could emerge from local recurrent connections. Our model reproduces the structure of preferred orientation and direction maps, and explains the origin of their interrelationship. The model also provides an explanation for the correlation between position shifts of receptive fields and changes of preferred orientations of single neurons across the surface of the cortex.

Local interactions in neural networks explain global effects in Gestalt processing and masking

One of the fundamental and puzzling questions in vision research is how objects are segmented from their backgrounds and how object formation evolves in time. The recently discovered shine-through effect allows one to study object segmentation and object formation of a masked target depending on the spatiotemporal Gestalt of the masking stimulus (Herzog & Koch, 2001). In the shine-through effect, a vernier (two abutting lines) precedes a grating for a very short time. For small gratings, the vernier remains invisible while it regains visibility as a shine-through element for extended and homogeneous gratings. However, even subtle deviations from the homogeneity of the grating diminish or even abolish shinethrough. At first glance, these results suggest that explanations of these effects have to rely on high-level Gestalt terminology such as homogeneity rather than on low-level properties such as luminance (Herzog, Fahle, & Koch, 2001). Here, we show that a simple neural network model of the Wilson-Cowan type qualitatively and quantitatively explains the basic effects in the shine-through paradigm, although the model does not contain any explicit, global Gestalt processing. Visibility of the target vernier corresponds to transient activation of neural populations resulting from the dynamics of local lateral interactions of excitatory and inhibitory layers of neural populations.

Modeling spatial and temporal aspects of visual backward masking

Visual backward masking is a versatile tool for understanding principles and limitations of visual information processing in the human brain. However, the mechanisms underlying masking are still poorly understood. In the current contribution, the authors show that a structurally simple mathematical model can explain many spatial and temporal effects in visual masking, such as spatial layout effects on pattern masking and B-type masking. Specifically, the authors show that lateral excitation and inhibition on different length scales, in combination with the typical time scales, are capable of producing a rich, dynamic behavior that explains this multitude of masking phenomena in a single, biophysically motivated model.

Optimality of human contour integration.

For processing and segmenting visual scenes, the brain is required to combine a multitude of features and sensory channels. It is neither known if these complex tasks involve optimal integration of information, nor according to which objectives computations might be performed. Here, we investigate if optimal inference can explain contour integration in human subjects. We performed experiments where observers detected contours of curvilinearly aligned edge configurations embedded into randomly oriented distractors. The key feature of our framework is to use a generative process for creating the contours, for which it is possible to derive a class of ideal detection models. This allowed us to compare human detection for contours with different statistical properties to the corresponding ideal detection models for the same stimuli. We then subjected the detection models to realistic constraints and required them to reproduce human decisions for every stimulus as well as possible. By independently varying the four model parameters, we identify a single detection model which quantitatively captures all correlations of human decision behaviour for more than 2000 stimuli from 42 contour ensembles with greatly varying statistical properties. This model reveals specific interactions between edges closely matching independent findings from physiology and psychophysics. These interactions imply a statistics of contours for which edge stimuli are indeed optimally integrated by the visual system, with the objective of inferring the presence of contours in cluttered scenes. The recurrent algorithm of our model makes testable predictions about the temporal dynamics of neuronal populations engaged in contour integration, and it suggests a strong directionality of the underlying functional anatomy.

Attention Improves Object Representation in Visual Cortical Field Potentials

Selective attention improves perception and modulates neuronal responses, but how attention-dependent changes of cortical activity improve the processing of attended objects is an open question. Changes in total signal strength or enhancements in signal-to-noise ratio have been proposed as putative mechanisms. However, it is still not clear whether, and to what extent, these processes contribute to the large perceptual improvements. We studied the ability to discriminate states of activity in visual cortex evoked by differently shaped objects depending on selective attention in monkeys. We found that gamma-band activity from V4 and V1 contains a high amount of information about stimulus shape, which increases for V4 recordings considerably with attention in successful trials, but not in case of behavioral errors. This effect resulted from enhanced differences between the stimulus-specific distributions of power spectral amplitudes. It could be explained neither by enhancements of signal-to-noise ratios, nor by changes in total signal power. Instead our results indicate that attention causes underlying cortical network states to become more distinct for different stimuli, providing a new neurophysiological explanation for improvements of behavioral performance by attention. The absence of the enhancement in discriminability in trials with behavioral errors demonstrates the relevance of this novel neural mechanism for perception.

Delay adaptation in the nervous system

Abstract Time delays are ubiquitous in the nervous system. Empirical findings suggest that time delays are adapted when considering the synchronous activity of neurons. We introduce a framework for studying the dynamics of self-organized delay adaptation in systems which optimize coincidence of inputs. The framework comprises two families of delay adaptation mechanisms, delay shift and delay selection. For the important case of periodically modulated input we derive conditions for the existence and stability of solutions which constrain learning rules for reliable delay adaptation. Delay adaptation is also applicable in the case of several spatio-temporal neuronal input patterns.

Self-Organized Critical Noise Amplification in Human Closed Loop Control

When humans perform closed loop control tasks like in upright standing or while balancing a stick, their behavior exhibits non-Gaussian fluctuations with long-tailed distributions. The origin of these fluctuations is not known. Here, we investigate if they are caused by self-organized critical noise amplification which emerges in control systems when an unstable dynamics becomes stabilized by an adaptive controller that has finite memory. Starting from this theory, we formulate a realistic model of adaptive closed loop control by including constraints on memory and delays. To test this model, we performed psychophysical experiments where humans balanced an unstable target on a screen. It turned out that the model reproduces the long tails of the distributions together with other characteristic features of the human control dynamics. Fine-tuning the model to match the experimental dynamics identifies parameters characterizing a subjects control system which can be independently tested. Our results suggest that the nervous system involved in closed loop motor control nearly optimally estimates system parameters on-line from very short epochs of past observations.

Criticality of avalanche dynamics in adaptive recurrent networks

In many studies of self-organized criticality (SOC), branching processes were used to model the dynamics of the activity of the system during avalanches. This mathematical simplification was also adopted when investigating systems with a complicated connection topology including recurrent and subthreshold interactions. However, none of these studies really analyzed whether this convenient approximation was indeed applicable. In present paper we study the correspondences between avalanches generated by branching processes and by a fully connected neural network. The benefit from the analysis is not only the justification of such correspondence but also a simple learning rule, which allows self-organization of the network towards a critical state as recently observed in slice experiments.

Extending the shine-through effect to classical masking paradigms.

A vernier, presented for a short time, shines through a following grating if the grating contains nine and more elements but remains largely invisible for smaller gratings. Therefore, extended grating masks yield, surprisingly, less masking than smaller ones. Here, we show that this mask size effect is not unique to grating masks. Masking diminishes if the size of classical pattern-, noise-, light-, and metacontrast masks increases and if these masks are regular, i.e. highly ordered.

Marginally subcritical dynamics explain enhanced stimulus discriminability under attention.

Recent experimental and theoretical work has established the hypothesis that cortical neurons operate close to a critical state which describes a phase transition from chaotic to ordered dynamics. Critical dynamics are suggested to optimize several aspects of neuronal information processing. However, although critical dynamics have been demonstrated in recordings of spontaneously active cortical neurons, little is known about how these dynamics are affected by task-dependent changes in neuronal activity when the cortex is engaged in stimulus processing. Here we explore this question in the context of cortical information processing modulated by selective visual attention. In particular, we focus on recent findings that local field potentials (LFPs) in macaque area V4 demonstrate an increase in γ-band synchrony and a simultaneous enhancement of object representation with attention. We reproduce these results using a model of integrate-and-fire neurons where attention increases synchrony by enhancing the efficacy of recurrent interactions. In the phase space spanned by excitatory and inhibitory coupling strengths, we identify critical points and regions of enhanced discriminability. Furthermore, we quantify encoding capacity using information entropy. We find a rapid enhancement of stimulus discriminability with the emergence of synchrony in the network. Strikingly, only a narrow region in the phase space, at the transition from subcritical to supercritical dynamics, supports the experimentally observed discriminability increase. At the supercritical border of this transition region, information entropy decreases drastically as synchrony sets in. At the subcritical border, entropy is maximized under the assumption of a coarse observation scale. Our results suggest that cortical networks operate at such near-critical states, allowing minimal attentional modulations of network excitability to substantially augment stimulus representation in the LFPs.