Valentin S. Afraimovich

Transient Cognitive Dynamics, Metastability, and Decision Making

The idea that cognitive activity can be understood using nonlinear dynamics has been intensively discussed at length for the last 15 years. One of the popular points of view is that metastable states play a key role in the execution of cognitive functions. Experimental and modeling studies suggest that most of these functions are the result of transient activity of large-scale brain networks in the presence of noise. Such transients may consist of a sequential switching between different metastable cognitive states. The main problem faced when using dynamical theory to describe transient cognitive processes is the fundamental contradiction between reproducibility and flexibility of transient behavior. In this paper, we propose a theoretical description of transient cognitive dynamics based on the interaction of functionally dependent metastable cognitive states. The mathematical image of such transient activity is a stable heteroclinic channel, i.e., a set of trajectories in the vicinity of a heteroclinic skeleton that consists of saddles and unstable separatrices that connect their surroundings. We suggest a basic mathematical model, a strongly dissipative dynamical system, and formulate the conditions for the robustness and reproducibility of cognitive transients that satisfy the competing requirements for stability and flexibility. Based on this approach, we describe here an effective solution for the problem of sequential decision making, represented as a fixed time game: a player takes sequential actions in a changing noisy environment so as to maximize a cumulative reward. As we predict and verify in computer simulations, noise plays an important role in optimizing the gain.

On the origin of reproducible sequential activity in neural circuits

Robustness and reproducibility of sequential spatio-temporal responses is an essential feature of many neural circuits in sensory and motor systems of animals. The most common mathematical images of dynamical regimes in neural systems are fixed points, limit cycles, chaotic attractors, and continuous attractors (attractive manifolds of neutrally stable fixed points). These are not suitable for the description of reproducible transient sequential neural dynamics. In this paper we present the concept of a stable heteroclinic sequence (SHS), which is not an attractor. SHS opens the way for understanding and modeling of transient sequential activity in neural circuits. We show that this new mathematical object can be used to describe robust and reproducible sequential neural dynamics. Using the framework of a generalized high-dimensional Lotka-Volterra model, that describes the dynamics of firing rates in an inhibitory network, we present analytical results on the existence of the SHS in the phase space of the network. With the help of numerical simulations we confirm its robustness in presence of noise in spite of the transient nature of the corresponding trajectories. Finally, by referring to several recent neurobiological experiments, we discuss possible applications of this new concept to several problems in neuroscience.

HETEROCLINIC CONTOURS IN NEURAL ENSEMBLES AND THE WINNERLESS COMPETITION PRINCIPLE

The ability of nonlinear dynamical systems to process incoming information is a key problem of many fundamental and applied sciences. Information processing by computation with attractors (steady states, limit cycles and strange attractors) has been a subject of many publications. In this paper, we discuss a new direction in information dynamics based on neurophysiological experiments that can be applied for the explanation and prediction of many phenomena in living biological systems and for the design of new paradigms in neural computation. This new concept is the Winnerless Competition (WLC) principle. The main point of this principle is the transformation of the incoming identity or spatial inputs into identity-temporal output based on the intrinsic switching dynamics of the neural system. In the presence of stimuli the sequence of the switching, whose geometrical image in the phase space is a heteroclinic contour, uniquely depends on the incoming information. The key problem in the realization of the WLC principle is the robustness against noise and, simultaneously, the sensitivity of the switching to the incoming input. In this paper we prove two theorems about the stability of the sequential switching and give several examples of WLC networks that illustrate the coexistence of sensitivity and robustness.

Information flow dynamics in the brain.

Timing and dynamics of information in the brain is a hot field in modern neuroscience. The analysis of the temporal evolution of brain information is crucially important for the understanding of higher cognitive mechanisms in normal and pathological states. From the perspective of information dynamics, in this review we discuss working memory capacity, language dynamics, goal-dependent behavior programming and other functions of brain activity. In contrast with the classical description of information theory, which is mostly algebraic, brain flow information dynamics deals with problems such as the stability/instability of information flows, their quality, the timing of sequential processing, the top-down cognitive control of perceptual information, and information creation. In this framework, different types of information flow instabilities correspond to different cognitive disorders. On the other hand, the robustness of cognitive activity is related to the control of the information flow stability. We discuss these problems using both experimental and theoretical approaches, and we argue that brain activity is better understood considering information flows in the phase space of the corresponding dynamical model. In particular, we show how theory helps to understand intriguing experimental results in this matter, and how recent knowledge inspires new theoretical formalisms that can be tested with modern experimental techniques.

Stability, structures and chaos in nonlinear synchronization networks

Basic Models, Dynamics of a Chain of Phase Lock-Loop Systems with Unidirectional Coupling Effect of Inertia of Elements on the Dynamics of a Flow Chain Chains with Mutual Coupling Chains with Coupling through Phase Mismatching Signals Nonlinear Dynamics of Lattices Analysis of Stationary Synchronization Regimes Some Remarks on Other Kinds of Chains of Synchronization Systems Stability and Chaos in the Chains of Discrete Phase-Lock Loops Dynamics of a Ring Chain of Discrete Systems Order and Chaos in the Discrete Model of an Active Medium 149 Results and Problems.

Generation and reshaping of sequences in neural systems

The generation of informational sequences and their reorganization or reshaping is one of the most intriguing subjects for both neuroscience and the theory of autonomous intelligent systems. In spite of the diversity of sequential activities of sensory, motor, and cognitive neural systems, they have many similarities from the dynamical point of view. In this review we discus the ideas, models, and mathematical image of sequence generation and reshaping on different levels of the neural hierarchy, i.e., the role of a sensory network dynamics in the generation of a motor program (hunting swimming of marine mollusk Clione), olfactory dynamical coding, and sequential learning and decision making. Analysis of these phenomena is based on the winnerless competition principle. The considered models can be a basis for the design of biologically inspired autonomous intelligent systems.

Chunking dynamics: heteroclinics in mind

Recent results of imaging technologies and non-linear dynamics make possible to relate the structure and dynamics of functional brain networks to different mental tasks and to build theoretical models for the description and prediction of cognitive activity. Such models are non-linear dynamical descriptions of the interaction of the core components—brain modes—participating in a specific mental function. The dynamical images of different mental processes depend on their temporal features. The dynamics of many cognitive functions are transient. They are often observed as a chain of sequentially changing metastable states. A stable heteroclinic channel (SHC) consisting of a chain of saddles—metastable states—connected by unstable separatrices is a mathematical image for robust transients. In this paper we focus on hierarchical chunking dynamics that can represent several forms of transient cognitive activity. Chunking is a dynamical phenomenon that nature uses to perform information processing of long sequences by dividing them in shorter information items. Chunking, for example, makes more efficient the use of short-term memory by breaking up long strings of information (like in language where one can see the separation of a novel on chapters, paragraphs, sentences, and finally words). Chunking is important in many processes of perception, learning, and cognition in humans and animals. Based on anatomical information about the hierarchical organization of functional brain networks, we propose a cognitive network architecture that hierarchically chunks and super-chunks switching sequences of metastable states produced by winnerless competitive heteroclinic dynamics.

Winnerless competition principle and prediction of the transient dynamics in a Lotka-Volterra model.

Predicting the evolution of multispecies ecological systems is an intriguing problem. A sufficiently complex model with the necessary predicting power requires solutions that are structurally stable. Small variations of the system parameters should not qualitatively perturb its solutions. When one is interested in just asymptotic results of evolution (as time goes to infinity), then the problem has a straightforward mathematical image involving simple attractors (fixed points or limit cycles) of a dynamical system. However, for an accurate prediction of evolution, the analysis of transient solutions is critical. In this paper, in the framework of the traditional Lotka-Volterra model (generalized in some sense), we show that the transient solution representing multispecies sequential competition can be reproducible and predictable with high probability.

Topological properties of linearly coupled expanding map lattices

We study topological aspects of the dynamics of one-dimensional lattices of coupled expanding maps of an interval, the coupling being a convolution by a sequence in l1(). Some conditions on the local map are given such that the corresponding coupled map lattice, provided the coupling is sufficiently small, has an invariant set in which the symbolic dynamics is described by the product of local symbolic systems. It follows that both periodic orbits and travelling waves of any real velocity are dense in the uniform topology. Furthermore, we develop a renormalization technique in a family of lattices of coupled piecewise affine maps parametrized by the local slope and the coupling. Self-similarity of the dynamics in this family then follows.

Which hole is leaking the most: a topological approach to study open systems

We study the process of escape of orbits through a hole in the phase space of a dynamical system generated by a chaotic map of an interval. If this hole is an element of Markov partition we are able to use the machinery of symbolic dynamics and estimate the probability of an orbit to escape at the instant of time n in terms of the topological pressure over corresponding symbolic dynamical systems. We obtain exact formulae allowing us to compare different holes according to their ability to support escaping flow of orbits. These results are applicable to the classification of vertices of dynamical networks in terms of the loads on nodes and edges of a network.