Stefano Cardanobile

How Structure Determines Correlations in Neuronal Networks

Networks are becoming a ubiquitous metaphor for the understanding of complex biological systems, spanning the range between molecular signalling pathways, neural networks in the brain, and interacting species in a food web. In many models, we face an intricate interplay between the topology of the network and the dynamics of the system, which is generally very hard to disentangle. A dynamical feature that has been subject of intense research in various fields are correlations between the noisy activity of nodes in a network. We consider a class of systems, where discrete signals are sent along the links of the network. Such systems are of particular relevance in neuroscience, because they provide models for networks of neurons that use action potentials for communication. We study correlations in dynamic networks with arbitrary topology, assuming linear pulse coupling. With our novel approach, we are able to understand in detail how specific structural motifs affect pairwise correlations. Based on a power series decomposition of the covariance matrix, we describe the conditions under which very indirect interactions will have a pronounced effect on correlations and population dynamics. In random networks, we find that indirect interactions may lead to a broad distribution of activation levels with low average but highly variable correlations. This phenomenon is even more pronounced in networks with distance dependent connectivity. In contrast, networks with highly connected hubs or patchy connections often exhibit strong average correlations. Our results are particularly relevant in view of new experimental techniques that enable the parallel recording of spiking activity from a large number of neurons, an appropriate interpretation of which is hampered by the currently limited understanding of structure-dynamics relations in complex networks.

The role of inhibition in generating and controlling Parkinson’s disease oscillations in the Basal Ganglia

Movement disorders in Parkinson’s disease (PD) are commonly associated with slow oscillations and increased synchrony of neuronal activity in the basal ganglia. The neural mechanisms underlying this dynamic network dysfunction, however, are only poorly understood. Here, we show that the strength of inhibitory inputs from striatum to globus pallidus external (GPe) is a key parameter controlling oscillations in the basal ganglia. Specifically, the increase in striatal activity observed in PD is sufficient to unleash the oscillations in the basal ganglia. This finding allows us to propose a unified explanation for different phenomena: absence of oscillation in the healthy state of the basal ganglia, oscillations in dopamine-depleted state and quenching of oscillations under deep-brain-stimulation (DBS). These novel insights help us to better understand and optimize the function of DBS protocols. Furthermore, studying the model behavior under transient increase of activity of the striatal neurons projecting to the indirect pathway, we are able to account for both motor impairment in PD patients and for reduced response inhibition in DBS implanted patients.

Recurrent interactions in spiking networks with arbitrary topology.

The population activity of random networks of excitatory and inhibitory leaky integrate-and-fire neurons has been studied extensively. In particular, a state of asynchronous activity with low firing rates and low pairwise correlations emerges in sparsely connected networks. We apply linear response theory to evaluate the influence of detailed network structure on neuron dynamics. It turns out that pairwise correlations induced by direct and indirect network connections can be related to the matrix of direct linear interactions. Furthermore, we study the influence of the characteristics of the neuron model. Interpreting the reset as self-inhibition, we examine its influence, via the spectrum of single-neuron activity, on network autocorrelation functions and the overall correlation level. The neuron model also affects the form of interaction kernels and consequently the time-dependent correlation functions. We find that a linear instability of networks with Erdös-Rényi topology coincides with a global transition to a highly correlated network state. Our work shows that recurrent interactions have a profound impact on spike train statistics and provides tools to study the effects of specific network topologies.

Multiplicatively interacting point processes and applications to neural modeling

We introduce a nonlinear modification of the classical Hawkes process allowing inhibitory couplings between units without restrictions. The resulting system of interacting point processes provides a useful mathematical model for recurrent networks of spiking neurons described as Wiener cascades with exponential transfer function. The expected rates of all neurons in the network are approximated by a first-order differential system. We study the stability of the solutions of this equation, and use the new formalism to implement a winner-takes-all network that operates robustly for a wide range of parameters. Finally, we discuss relations with the generalised linear model that is widely used for the analysis of spike trains.

The relevance of network micro-structure for neural dynamics.

The activity of cortical neurons is determined by the input they receive from presynaptic neurons. Many previous studies have investigated how specific aspects of the statistics of the input affect the spike trains of single neurons and neurons in recurrent networks. However, typically very simple random network models are considered in such studies. Here we use a recently developed algorithm to construct networks based on a quasi-fractal probability measure which are much more variable than commonly used network models, and which therefore promise to sample the space of recurrent networks in a more exhaustive fashion than previously possible. We use the generated graphs as the underlying network topology in simulations of networks of integrate-and-fire neurons in an asynchronous and irregular state. Based on an extensive dataset of networks and neuronal simulations we assess statistical relations between features of the network structure and the spiking activity. Our results highlight the strong influence that some details of the network structure have on the activity dynamics of both single neurons and populations, even if some global network parameters are kept fixed. We observe specific and consistent relations between activity characteristics like spike-train irregularity or correlations and network properties, for example the distributions of the numbers of in- and outgoing connections or clustering. Exploiting these relations, we demonstrate that it is possible to estimate structural characteristics of the network from activity data. We also assess higher order correlations of spiking activity in the various networks considered here, and find that their occurrence strongly depends on the network structure. These results provide directions for further theoretical studies on recurrent networks, as well as new ways to interpret spike train recordings from neural circuits.

Nonequilibrium dynamics of stochastic point processes with refractoriness

Stochastic point processes with refractoriness appear frequently in the quantitative analysis of physical and biological systems, such as the generation of action potentials by nerve cells, the release and reuptake of vesicles at a synapse, and the counting of particles by detector devices. Here we present an extension of renewal theory to describe ensembles of point processes with time varying input. This is made possible by a representation in terms of occupation numbers of two states: active and refractory. The dynamics of these occupation numbers follows a distributed delay differential equation. In particular, our theory enables us to uncover the effect of refractoriness on the time-dependent rate of an ensemble of encoding point processes in response to modulation of the input. We present exact solutions that demonstrate generic features, such as stochastic transients and oscillations in the step response as well as resonances, phase jumps and frequency doubling in the transfer of periodic signals. We show that a large class of renewal processes can indeed be regarded as special cases of the model we analyze. Hence our approach represents a widely applicable framework to define and analyze nonstationary renewal processes.

Mean-field analysis of orientation selectivity in inhibition-dominated networks of spiking neurons.

Mechanisms underlying the emergence of orientation selectivity in the primary visual cortex are highly debated. Here we study the contribution of inhibition-dominated random recurrent networks to orientation selectivity, and more generally to sensory processing. By simulating and analyzing large-scale networks of spiking neurons, we investigate tuning amplification and contrast invariance of orientation selectivity in these networks. In particular, we show how selective attenuation of the common mode and amplification of the modulation component take place in these networks. Selective attenuation of the baseline, which is governed by the exceptional eigenvalue of the connectivity matrix, removes the unspecific, redundant signal component and ensures the invariance of selectivity across different contrasts. Selective amplification of modulation, which is governed by the operating regime of the network and depends on the strength of coupling, amplifies the informative signal component and thus increases the signal-to-noise ratio. Here, we perform a mean-field analysis which accounts for this process.

Inferring general relations between network characteristics from specific network ensembles.

Different network models have been suggested for the topology underlying complex interactions in natural systems. These models are aimed at replicating specific statistical features encountered in real-world networks. However, it is rarely considered to which degree the results obtained for one particular network class can be extrapolated to real-world networks. We address this issue by comparing different classical and more recently developed network models with respect to their ability to generate networks with large structural variability. In particular, we consider the statistical constraints which the respective construction scheme imposes on the generated networks. After having identified the most variable networks, we address the issue of which constraints are common to all network classes and are thus suitable candidates for being generic statistical laws of complex networks. In fact, we find that generic, not model-related dependencies between different network characteristics do exist. This makes it possible to infer global features from local ones using regression models trained on networks with high generalization power. Our results confirm and extend previous findings regarding the synchronization properties of neural networks. Our method seems especially relevant for large networks, which are difficult to map completely, like the neural networks in the brain. The structure of such large networks cannot be fully sampled with the present technology. Our approach provides a method to estimate global properties of under-sampled networks in good approximation. Finally, we demonstrate on three different data sets (C. elegans neuronal network, R. prowazekii metabolic network, and a network of synonyms extracted from Roget’s Thesaurus) that real-world networks have statistical relations compatible with those obtained using regression models.

Emergent Properties of Interacting Populations of Spiking Neurons

Dynamic neuronal networks are a key paradigm of increasing importance in brain research, concerned with the functional analysis of biological neuronal networks and, at the same time, with the synthesis of artificial brain-like systems. In this context, neuronal network models serve as mathematical tools to understand the function of brains, but they might as well develop into future tools for enhancing certain functions of our nervous system. Here, we present and discuss our recent achievements in developing multiplicative point processes into a viable mathematical framework for spiking network modeling. The perspective is that the dynamic behavior of these neuronal networks is faithfully reflected by a set of non-linear rate equations, describing all interactions on the population level. These equations are similar in structure to Lotka-Volterra equations, well known by their use in modeling predator-prey relations in population biology, but abundant applications to economic theory have also been described. We present a number of biologically relevant examples for spiking network function, which can be studied with the help of the aforementioned correspondence between spike trains and specific systems of non-linear coupled ordinary differential equations. We claim that, enabled by the use of multiplicative point processes, we can make essential contributions to a more thorough understanding of the dynamical properties of interacting neuronal populations.

The Poisson process with dead time captures important statistical features of neural activity

Here we show that the Poisson process with dead time, a particular simple point process, captures important features of the spiking statistics of neurons [1,2] (Fig. 1). On the level of single neurons, we apply a step change to the rate of a Poisson process with dead time, keeping the dead time constant. The expected PSTH is computed by numerically solving the partial differential equation of the corresponding non-homogeneous renewal process [3] and we also give an analytical approximation. We observe a very sharp transient in the firing-rate (Fig. 2) that resembles experimental results of [4].