Karl Sigmund

Evolution of indirect reciprocity by image scoring

Darwinian evolution has to provide an explanation for cooperative behaviour. Theories of cooperation are based on kin selection (dependent on genetic relatedness),, group selection and reciprocal altruism. The idea of reciprocal altruism usually involves direct reciprocity: repeated encounters between the same individuals allow for the return of an altruistic act by the recipient. Here we present a new theoretical framework, which is based on indirect reciprocity and does not require the same two individuals ever to meet again. Individual selection can nevertheless favour cooperative strategies directed towards recipients that have helped others in the past. Cooperation pays because it confers the image of a valuable community member to the cooperating individual. We present computer simulations and analytic models that specify the conditions required for evolutionary stability of indirect reciprocity. We show that the probability of knowing the ‘image’ of the recipient must exceed the cost-to-benefit ratio of the altruistic act. We propose that the emergence of indirect reciprocity was a decisive step for the evolution of human societies.

Evolution of indirect reciprocity

Natural selection is conventionally assumed to favour the strong and selfish who maximize their own resources at the expense of others. But many biological systems, and especially human societies, are organized around altruistic, cooperative interactions. How can natural selection promote unselfish behaviour? Various mechanisms have been proposed, and a rich analysis of indirect reciprocity has recently emerged: I help you and somebody else helps me. The evolution of cooperation by indirect reciprocity leads to reputation building, morality judgement and complex social interactions with ever-increasing cognitive demands.

Evolutionary Games and Population Dynamics: Contents

Every form of behavior is shaped by trial and error. Such stepwise adaptation can occur through individual learning or through natural selection, the basis of evolution. Since the work of Maynard Smith and others, it has been realized how game theory can model this process. Evolutionary game theory replaces the static solutions of classical game theory by a dynamical approach centered not on the concept of rational players but on the population dynamics of behavioral programs. In this book the authors investigate the nonlinear dynamics of the self-regulation of social and economic behavior, and of the closely related interactions among species in ecological communities. Replicator equations describe how successful strategies spread and thereby create new conditions that can alter the basis of their success, i.e., to enable us to understand the strategic and genetic foundations of the endless chronicle of invasions and extinctions that punctuate evolution. In short, evolutionary game theory describes when to escalate a conflict, how to elicit cooperation, why to expect a balance of the sexes, and how to understand natural selection in mathematical terms. Comprehensive treatment of ecological and game theoretic dynamics Invasion dynamics and permanence as key concepts Explanation in terms of games of things like competition between species

Evolutionary Games and Population Dynamics: Dynamical Systems and Lotka–Volterra Equations

Every form of behavior is shaped by trial and error. Such stepwise adaptation can occur through individual learning or through natural selection, the basis of evolution. Since the work of Maynard Smith and others, it has been realized how game theory can model this process. Evolutionary game theory replaces the static solutions of classical game theory by a dynamical approach centered not on the concept of rational players but on the population dynamics of behavioral programs. In this book the authors investigate the nonlinear dynamics of the self-regulation of social and economic behavior, and of the closely related interactions among species in ecological communities. Replicator equations describe how successful strategies spread and thereby create new conditions that can alter the basis of their success, i.e., to enable us to understand the strategic and genetic foundations of the endless chronicle of invasions and extinctions that punctuate evolution. In short, evolutionary game theory describes when to escalate a conflict, how to elicit cooperation, why to expect a balance of the sexes, and how to understand natural selection in mathematical terms. Comprehensive treatment of ecological and game theoretic dynamics Invasion dynamics and permanence as key concepts Explanation in terms of games of things like competition between species

Ergodic Theory on Compact Spaces

Measure-theoretic dynamical systems.- Measures on compact metric spaces.- Invariant measures for continuous tranformations.- Time averages.- Ergodicity.- Mixing and transitivity.- Shifts and subshifts.- Measures on the shift space.- Partitions and generators.- Information and entropy.- The computation of entropy.- Entropy for Bernoulli and Markov shifts.- Ergodic decompositions.- Topological entropy.- Topological generators.- Expansive homeomorphisms.- Subshifts of finite type.- The variational principle for topological entropy.- Measures with maximal entropy-Intrinsically ergodic systems.- Entropy-Expansive homeomorphisms.- The specification property.- Specification and expansiveness.- Basic sets for axiom A.- Automorphisms of the torus.- More on subshifts of finite type.- Preparations for generator theorems.- Combinatorial construction of minimal sets.- Finite generators for ergodic transformations (theorem of Krieger).- Strictly ergodic embedding (Theorem of Jewett and Krieger).- Finite generators for aperiodic transformations.- Embedding theorems for aperiodic transformations.

Via Freedom to Coercion: The Emergence of Costly Punishment

In human societies, cooperative behavior in joint enterprises is often enforced through institutions that impose sanctions on defectors. Many experiments on so-called public goods games have shown that in the absence of such institutions, individuals are willing to punish defectors, even at a cost to themselves. Theoretical models confirm that social norms prescribing the punishment of uncooperative behavior are stable—once established, they prevent dissident minorities from spreading. But how can such costly punishing behavior gain a foothold in the population? A surprisingly simple model shows that if individuals have the option to stand aside and abstain from the joint endeavor, this paves the way for the emergence and establishment of cooperative behavior based on the punishment of defectors. Paradoxically, the freedom to withdraw from the common enterprise leads to enforcement of social norms. Joint enterprises that are compulsory rather than voluntary are less likely to lead to cooperation.

Reward and punishment

Minigames capturing the essence of Public Goods experiments show that even in the absence of rationality assumptions, both punishment and reward will fail to bring about prosocial behavior. This result holds in particular for the well-known Ultimatum Game, which emerges as a special case. But reputation can induce fairness and cooperation in populations adapting through learning or imitation. Indeed, the inclusion of reputation effects in the corresponding dynamical models leads to the evolution of economically productive behavior, with agents contributing to the public good and either punishing those who do not or rewarding those who do. Reward and punishment correspond to two types of bifurcation with intriguing complementarity. The analysis suggests that reputation is essential for fostering social behavior among selfish agents, and that it is considerably more effective with punishment than with reward.

Social learning promotes institutions for governing the commons

Theoretical and empirical research highlights the role of punishment in promoting collaborative efforts. However, both the emergence and the stability of costly punishment are problematic issues. It is not clear how punishers can invade a society of defectors by social learning or natural selection, or how second-order free-riders (who contribute to the joint effort but not to the sanctions) can be prevented from drifting into a coercion-based regime and subverting cooperation. Here we compare the prevailing model of peer-punishment with pool-punishment, which consists in committing resources, before the collaborative effort, to prepare sanctions against free-riders. Pool-punishment facilitates the sanctioning of second-order free-riders, because these are exposed even if everyone contributes to the common good. In the absence of such second-order punishment, peer-punishers do better than pool-punishers; but with second-order punishment, the situation is reversed. Efficiency is traded for stability. Neither other-regarding tendencies or preferences for reciprocity and equity, nor group selection or prescriptions from higher authorities, are necessary for the emergence and stability of rudimentary forms of sanctioning institutions regulating common pool resources and enforcing collaborative efforts.

Punishment and reputation in spatial public goods games

The puzzle of the emergence of cooperation between unrelated individuals is shared across diverse fields of behavioural sciences and economics. In this article we combine the public goods game originating in economics with evolutionary approaches traditionally used in biology. Instead of pairwise encounters, we consider the more complex case of groups of three interacting individuals. We show that territoriality is capable of promoting cooperative behaviour, as in the case of the Prisoners Dilemma. Moreover, by adding punishment opportunities, the readiness to cooperate is greatly enhanced and asocial strategies can be largely suppressed. Finally, as soon as players carry a reputation for being willing or unwilling to punish, highly cooperative and fair outcomes are achieved. This group–beneficial result is obtained, intriguingly, by making individuals more likely to exploit their co–players if they can get away with it. Thus, less–cooperative individuals make more-cooperative societies.

The evolution of stochastic strategies in the Prisoner's Dilemma

The evolution of reactive strategies for repeated 2×2-games occurring in biology is investigated by means of an adaptive dynamics.