Attila Szolnoki

Coevolutionary Games - A Mini Review

Prevalence of cooperation within groups of selfish individuals is puzzling in that it contradicts with the basic premise of natural selection. Favoring players with higher fitness, the latter is key for understanding the challenges faced by cooperators when competing with defectors. Evolutionary game theory provides a competent theoretical framework for addressing the subtleties of cooperation in such situations, which are known as social dilemmas. Recent advances point towards the fact that the evolution of strategies alone may be insufficient to fully exploit the benefits offered by cooperative behavior. Indeed, while spatial structure and heterogeneity, for example, have been recognized as potent promoters of cooperation, coevolutionary rules can extend the potentials of such entities further, and even more importantly, lead to the understanding of their emergence. The introduction of coevolutionary rules to evolutionary games implies, that besides the evolution of strategies, another property may simultaneously be subject to evolution as well. Coevolutionary rules may affect the interaction network, the reproduction capability of players, their reputation, mobility or age. Here we review recent works on evolutionary games incorporating coevolutionary rules, as well as give a didactic description of potential pitfalls and misconceptions associated with the subject. In addition, we briefly outline directions for future research that we feel are promising, thereby particularly focusing on dynamical effects of coevolutionary rules on the evolution of cooperation, which are still widely open to research and thus hold promise of exciting new discoveries.

Evolutionary dynamics of group interactions on structured populations: a review

Interactions among living organisms, from bacteria colonies to human societies, are inherently more complex than interactions among particles and non-living matter. Group interactions are a particularly important and widespread class, representative of which is the public goods game. In addition, methods of statistical physics have proved valuable for studying pattern formation, equilibrium selection and self-organization in evolutionary games. Here, we review recent advances in the study of evolutionary dynamics of group interactions on top of structured populations, including lattices, complex networks and coevolutionary models. We also compare these results with those obtained on well-mixed populations. The review particularly highlights that the study of the dynamics of group interactions, like several other important equilibrium and non-equilibrium dynamical processes in biological, economical and social sciences, benefits from the synergy between statistical physics, network science and evolutionary game theory.

Social diversity and promotion of cooperation in the spatial prisoner's dilemma game

The diversity in wealth and social status is present not only among humans, but throughout the animal world. We account for this observation by generating random variables that determine the social diversity of players engaging in the prisoners dilemma game. Here the term social diversity is used to address extrinsic factors that determine the mapping of game payoffs to individual fitness. These factors may increase or decrease the fitness of a player depending on its location on the spatial grid. We consider different distributions of extrinsic factors that determine the social diversity of players, and find that the power-law distribution enables the best promotion of cooperation. The facilitation of the cooperative strategy relies mostly on the inhomogeneous social state of players, resulting in the formation of cooperative clusters which are ruled by socially high-ranking players that are able to prevail against the defectors even when there is a large temptation to defect. To confirm this, we also study the impact of spatially correlated social diversity and find that cooperation deteriorates as the spatial correlation length increases. Our results suggest that the distribution of wealth and social status might have played a crucial role by the evolution of cooperation amongst egoistic individuals.

Evolutionary games on multilayer networks: a colloquium

Networks form the backbone of many complex systems, ranging from the Internet to human societies. Accordingly, not only is the range of our interactions limited and thus best described and modeled by networks, it is also a fact that the networks that are an integral part of such models are often interdependent or even interconnected. Networks of networks or multilayer networks are therefore a more apt description of social systems. This colloquium is devoted to evolutionary games on multilayer networks, and in particular to the evolution of cooperation as one of the main pillars of modern human societies. We first give an overview of the most significant conceptual differences between single-layer and multilayer networks, and we provide basic definitions and a classification of the most commonly used terms. Subsequently, we review fascinating and counterintuitive evolutionary outcomes that emerge due to different types of interdependencies between otherwise independent populations. The focus is on coupling through the utilities of players, through the flow of information, as well as through the popularity of different strategies on different network layers. The colloquium highlights the importance of pattern formation and collective behavior for the promotion of cooperation under adverse conditions, as well as the synergies between network science and evolutionary game theory.

Interdependent network reciprocity in evolutionary games

Besides the structure of interactions within networks, also the interactions between networks are of the outmost importance. We therefore study the outcome of the public goods game on two interdependent networks that are connected by means of a utility function, which determines how payoffs on both networks jointly influence the success of players in each individual network. We show that an unbiased coupling allows the spontaneous emergence of interdependent network reciprocity, which is capable to maintain healthy levels of public cooperation even in extremely adverse conditions. The mechanism, however, requires simultaneous formation of correlated cooperator clusters on both networks. If this does not emerge or if the coordination process is disturbed, network reciprocity fails, resulting in the total collapse of cooperation. Network interdependence can thus be exploited effectively to promote cooperation past the limits imposed by isolated networks, but only if the coordination between the interdependent networks is not disturbed.

Cooperation enhanced by inhomogeneous activity of teaching for evolutionary Prisoner's Dilemma games

Evolutionary Prisoners Dilemma games with quenched inhomogeneities in the spatial dynamical rules are considered. The players following one of the two pure strategies (cooperation or defection) are distributed on a two-dimensional lattice. The rate of strategy adoption from randomly chosen neighbors is controlled by the payoff difference and a two-value pre-factor w characterizing the players whom the strategy learned from. The reduced teaching activity of players is distributed randomly with concentrations ν at the beginning and fixed further on. Numerical and analytical calculations are performed to study the concentration of cooperators as a function of w and ν for different noise levels and connectivity structures. Significant increase of cooperation is found within a wide range of parameters for this dynamics. The results highlight the importance of asymmetry characterizing the exchange of master-follower role during the strategy adoptions.

Phase diagrams for an evolutionary prisoner’s dilemma game on two-dimensional lattices

The effects of payoffs and noise on the maintenance of cooperative behavior are studied in an evolutionary prisoners dilemma game with players located on the sites of different two-dimensional lattices. This system exhibits a phase transition from a mixed state of cooperators and defectors to a homogeneous one where only the defectors remain alive. Using Monte Carlo simulations and the generalized mean-field approximations we have determined the phase boundaries (critical points) separating the two phases on the plane of the temperature (noise) and temptation to choose defection. In the zero temperature limit the cooperation can be sustained only for those connectivity structures where three-site clique percolation occurs.

Evolution of Public Cooperation on Interdependent Networks: The Impact of Biased Utility Functions

We study the evolution of public cooperation on two interdependent networks that are connected by means of a utility function, which determines to what extent payoffs in one network influence the success of players in the other network. We find that the stronger the bias in the utility function, the higher the level of public cooperation. Yet the benefits of enhanced public cooperation on the two networks are just as biased as the utility functions themselves. While cooperation may thrive on one network, the other may still be plagued by defectors. Nevertheless, the aggregate level of cooperation on both networks is higher than the one attainable on an isolated network. This positive effect of biased utility functions is due to the suppressed feedback of individual success, which leads to a spontaneous separation of characteristic time scales of the evolutionary process on the two interdependent networks. As a result, cooperation is promoted because the aggressive invasion of defectors is more sensitive to the slowing-down than the build-up of collective efforts in sizable groups.

Evolutionary establishment of moral and double moral standards through spatial interactions

Situations where individuals have to contribute to joint efforts or share scarce resources are ubiquitous. Yet, without proper mechanisms to ensure cooperation, the evolutionary pressure to maximize individual success tends to create a tragedy of the commons (such as over-fishing or the destruction of our environment). This contribution addresses a number of related puzzles of human behavior with an evolutionary game theoretical approach as it has been successfully used to explain the behavior of other biological species many times, from bacteria to vertebrates. Our agent-based model distinguishes individuals applying four different behavioral strategies: non-cooperative individuals (“defectors”), cooperative individuals abstaining from punishment efforts (called “cooperators” or “second-order free-riders”), cooperators who punish non-cooperative behavior (“moralists”), and defectors, who punish other defectors despite being non-cooperative themselves (“immoralists”). By considering spatial interactions with neighboring individuals, our model reveals several interesting effects: First, moralists can fully eliminate cooperators. This spreading of punishing behavior requires a segregation of behavioral strategies and solves the “second-order free-rider problem”. Second, the system behavior changes its character significantly even after very long times (“who laughs last laughs best effect”). Third, the presence of a number of defectors can largely accelerate the victory of moralists over non-punishing cooperators. Fourth, in order to succeed, moralists may profit from immoralists in a way that appears like an “unholy collaboration”. Our findings suggest that the consideration of punishment strategies allows one to understand the establishment and spreading of “moral behavior” by means of game-theoretical concepts. This demonstrates that quantitative biological modeling approaches are powerful even in domains that have been addressed with non-mathematical concepts so far. The complex dynamics of certain social behaviors become understandable as the result of an evolutionary competition between different behavioral strategies.

Coevolution of teaching activity promotes cooperation

Evolutionary games are studied where the teaching activity of players can evolve in time. Initially all players following either the cooperative or defecting strategy are distributed on a square lattice. The rate of strategy adoption is determined by the payoff difference and a teaching activity characterizing the donors capability to enforce its strategy on the opponent. Each successful strategy adoption process is accompanied by an increase in the donors teaching activity. By applying an optimum value of the increment, this simple mechanism spontaneously creates relevant inhomogeneities in the teaching activities that support the maintenance of cooperation for both the prisoners dilemma and the snowdrift game.