Friedrich T. Sommer

A network that uses few active neurones to code visual input predicts the diverse shapes of cortical receptive fields

Computational models of primary visual cortex have demonstrated that principles of efficient coding and neuronal sparseness can explain the emergence of neurones with localised oriented receptive fields. Yet, existing models have failed to predict the diverse shapes of receptive fields that occur in nature. The existing models used a particular “soft” form of sparseness that limits average neuronal activity. Here we study models of efficient coding in a broader context by comparing soft and “hard” forms of neuronal sparseness.As a result of our analyses, we propose a novel network model for visual cortex. The model forms efficient visual representations in which the number of active neurones, rather than mean neuronal activity, is limited. This form of hard sparseness also economises cortical resources like synaptic memory and metabolic energy. Furthermore, our model accurately predicts the distribution of receptive field shapes found in the primary visual cortex of cat and monkey.

Memory capacities for synaptic and structural plasticity

Neural associative networks with plastic synapses have been proposed as computational models of brain functions and also for applications such as pattern recognition and information retrieval. To guide biological models and optimize technical applications, several definitions of memory capacity have been used to measure the efficiency of associative memory. Here we explain why the currently used performance measures bias the comparison between models and cannot serve as a theoretical benchmark. We introduce fair measures for information-theoretic capacity in associative memory that also provide a theoretical benchmark. In neural networks, two types of manipulating synapses can be discerned: synaptic plasticity, the change in strength of existing synapses, and structural plasticity, the creation and pruning of synapses. One of the new types of memory capacity we introduce permits quantifying how structural plasticity can increase the network efficiency by compressing the network structure, for example, by pruning unused synapses. Specifically, we analyze operating regimes in the Willshaw model in which structural plasticity can compress the network structure and push performance to the theoretical benchmark. The amount C of information stored in each synapse can scale with the logarithm of the network size rather than being constant, as in classical Willshaw and Hopfield nets ( ln 2 0.7). Further, the review contains novel technical material: a capacity analysis of the Willshaw model that rigorously controls for the level of retrieval quality, an analysis for memories with a nonconstant number of active units (where C 1eln 2 0.53), and the analysis of the computational complexity of associative memories with and without network compression.

Feedforward Excitation and Inhibition Evoke Dual Modes of Firing in the Cat's Visual Thalamus during Naturalistic Viewing

Thalamic relay cells transmit information from retina to cortex by firing either rapid bursts or tonic trains of spikes. Bursts occur when the membrane voltage is low, as during sleep, because they depend on channels that cannot respond to excitatory input unless they are primed by strong hyperpolarization. Cells fire tonically when depolarized, as during waking. Thus, mode of firing is usually associated with behavioral state. Growing evidence, however, suggests that sensory processing involves both burst and tonic spikes. To ask if visually evoked synaptic responses induce each type of firing, we recorded intracellular responses to natural movies from relay cells and developed methods to map the receptive fields of the excitation and inhibition that the images evoked. In addition to tonic spikes, the movies routinely elicited lasting inhibition from the center of the receptive field that permitted bursts to fire. Therefore, naturally evoked patterns of synaptic input engage dual modes of firing.

Data Sharing for Computational Neuroscience

Computational neuroscience is a subfield of neuroscience that develops models to integrate complex experimental data in order to understand brain function. To constrain and test computational models, researchers need access to a wide variety of experimental data. Much of those data are not readily accessible because neuroscientists fall into separate communities that study the brain at different levels and have not been motivated to provide data to researchers outside their community. To foster sharing of neuroscience data, a workshop was held in 2007, bringing together experimental and theoretical neuroscientists, computer scientists, legal experts and governmental observers. Computational neuroscience was recommended as an ideal field for focusing data sharing, and specific methods, strategies and policies were suggested for achieving it. A new funding area in the NSF/NIH Collaborative Research in Computational Neuroscience (CRCNS) program has been established to support data sharing, guided in part by the workshop recommendations. The new funding area is dedicated to the dissemination of high quality data sets with maximum scientific value for computational neuroscience. The first round of the CRCNS data sharing program supports the preparation of data sets which will be publicly available in 2008. These include electrophysiology and behavioral (eye movement) data described towards the end of this article.

Spatially Distributed Local Fields in the Hippocampus Encode Rat Position

Extracting Spatial Information The location of a rat can be deciphered from hippocampal activity by detecting the firing of individual place-selective neurons. In contrast, the local field potential (LFP), which arises from the coherent voltage fluctuations of large hippocampal cell populations, has been hard to decode. Agarwal et al. (p. 626) worked out how to recover positional information exclusively from multiple-site LFP measurements in the rat hippocampus. The information was as precise as that derived from spiking place cells. The approach might also be applicable more generally for deciphering information from coherent population activity anywhere in the brain. Electrical fields within the hippocampus can now be decoded to reveal a rat’s location. Although neuronal spikes can be readily detected from extracellular recordings, synaptic and subthreshold activity remains undifferentiated within the local field potential (LFP). In the hippocampus, neurons discharge selectively when the rat is at certain locations, while LFPs at single anatomical sites exhibit no such place-tuning. Nonetheless, because the representation of position is sparse and distributed, we hypothesized that spatial information can be recovered from multiple-site LFP recordings. Using high-density sampling of LFP and computational methods, we show that the spatiotemporal structure of the theta rhythm can encode position as robustly as neuronal spiking populations. Because our approach exploits the rhythmicity and sparse structure of neural activity, features found in many brain regions, it is useful as a general tool for discovering distributed LFP codes.

Thalamic interneurons and relay cells use complementary synaptic mechanisms for visual processing

Synapses made by local interneurons dominate the thalamic circuits that process signals traveling from the eye downstream. The anatomical and physiological differences between interneurons and the (relay) cells that project to cortex are vast. To explore how these differences might influence visual processing, we made intracellular recordings from both classes of cells in vivo in cats. Macroscopically, all receptive fields were similar, consisting of two concentrically arranged subregions in which dark and bright stimuli elicited responses of the reverse sign. Microscopically, however, the responses of the two types of cells had opposite profiles. Excitatory stimuli drove trains of single excitatory postsynaptic potentials in relay cells, but graded depolarizations in interneurons. Conversely, suppressive stimuli evoked smooth hyperpolarizations in relay cells and unitary inhibitory postsynaptic potentials in interneurons. Computational analyses suggested that these complementary patterns of response help to preserve information encoded in the fine timing of retinal spikes and to increase the amount of information transmitted to cortex.

Exploring the function of neural oscillations in early sensory systems

Neuronal oscillations appear throughout the nervous system, in structures as diverse as the cerebral cortex, hippocampus, subcortical nuclei and sense organs. Whether neural rhythms contribute to normal function, are merely epiphenomena, or even interfere with physiological processing are topics of vigorous debate. Sensory pathways are ideal for investigation of oscillatory activity because their inputs can be defined. Thus, we will focus on sensory systems as we ask how neural oscillations arise and how they might encode information about the stimulus. We will highlight recent work in the early visual pathway that shows how oscillations can multiplex different types of signals to increase the amount of information that spike trains encode and transmit. Last, we will describe oscillation-based models of visual processing and explore how they might guide further research.

Inhibitory circuits for visual processing in thalamus.

Synapses made by local interneurons dominate the intrinsic circuitry of the mammalian visual thalamus and influence all signals traveling from the eye to cortex. Here we draw on physiological and computational analyses of receptive fields in the cats lateral geniculate nucleus to describe how inhibition helps to enhance selectivity for stimulus features in space and time and to improve the efficiency of the neural code. Further, we explore specialized synaptic attributes of relay cells and interneurons and discuss how these might be adapted to preserve the temporal precision of retinal spike trains and thereby maximize the rate of information transmitted downstream.

How Inhibitory Circuits in the Thalamus Serve Vision

Inhibitory neurons dominate the intrinsic circuits in the visual thalamus. Interneurons in the lateral geniculate nucleus innervate relay cells and each other densely to provide powerful inhibition. The visual sector of the overlying thalamic reticular nucleus receives input from relay cells and supplies feedback inhibition to them in return. Together, these two inhibitory circuits influence all information transmitted from the retina to the primary visual cortex. By contrast, relay cells make few local connections. This review explores the role of thalamic inhibition from the dual perspectives of feature detection and information theory. For example, we describe how inhibition sharpens tuning for spatial and temporal features of the stimulus and how it might enhance image perception. We also discuss how inhibitory circuits help to reduce redundancy in signals sent downstream and, at the same time, are adapted to maximize the amount of information conveyed to the cortex.

Statistical Wiring of Thalamic Receptive Fields Optimizes Spatial Sampling of the Retinal Image

It is widely assumed that mosaics of retinal ganglion cells establish the optimal representation of visual space. However, relay cells in the visual thalamus often receive convergent input from several retinal afferents and, in cat, outnumber ganglion cells. To explore how the thalamus transforms the retinal image, we built a model of the retinothalamic circuit using experimental data and simple wiring rules. The model shows how the thalamus might form a resampled map of visual space with the potential to facilitate detection of stimulus position in the presence of sensor noise. Bayesian decoding conducted with the model provides support for this scenario. Despite its benefits, however, resampling introduces image blur, thus impairing edge perception. Whole-cell recordings obtained in vivo suggest that this problem is mitigated by arrangements of excitation and inhibition within the receptive field that effectively boost contrast borders, much like strategies used in digital image processing.