Iterated Prisoner's Dilemma with Partial Imitation in Noisy Environments

Andre Amend, Degang Wu, Kwok Yip Szeto

2014

Abstract

Players with one-step memory in an iterated Prisoner's Dilemma game can adaptively change their strategies after playing some games with their opponent. The probability of change of strategies depends on noise levels, the players’ patience (or reaction time), and initial strategies. Players perform partial imitation, since, realistically, they can only imitate what they observe. Patience determines the frequency of a player's possible strategies changes. In this paper, we focus on the evolution of strategies between two major categories of players whose innate characters belong either to cheaters (traitors) or nice (benevolent) players. We consider them as agents whose characters are fixed, but their detailed genetic makeup can still vary among several types, so that, for example, the cheaters can evolve among different types of cheaters. We observe their evolutions by means of their degree of cooperation, where the variables are initial strategies, noise, and patience. Here, noise is incorporated in a sigmoid function that accounts for errors in learning. The numerical results show interesting features that we can explain heuristically: in the iterated games between an adaptive cheater against a patient nice player in a noisy environment, we observe a minimum degree of cooperation at a specific noise level.

References

  1. Axelrod, R., 1984. The Evolution of Cooperation. Basic Books.
  2. Smith, J. M., 1982. Evolution and the Theory of Games. Cambridge University Press.
  3. Antony, M., 2011. Partial Information, Noise and Network Topology in 2x2 Games with Memory, MPhil Thesis, Department of Physics, the Hong Kong University of Science and Technology.
  4. Poundstone, W., 1992. Prisoner's Dilemma: John von Neumann, Game Theory and the Puzzle of the Bomb. Doubleday, New York.
  5. Wu, D., Antony, M., Szeto, K.Y., 2010. Evolution of Grim Trigger in Prisoner Dilemma Game with Partial Imitation, in: Di Chio, C., Cagnoni, S., Cotta, C., Ebner, M., Ekrt, A., Esparcia-Alczar, A.I., Goh, C.-K., Merelo, J.J., Neri, F., Preuß, M., Togelius, J., Yannakakis, G.N. (eds.) EvoApplications 2010, Part I. LNCS, vol. 6024, pp. 151-160. Springer, Heidelberg.
  6. Nowak, M.A., 2006. Five rules for the evolution of cooperation. Science 314(5805), 1560-1563.
  7. Lindgren, K., Nordahl, M.G., 1994. Evolutionary dynamics of spatial games. Physica D Nonlinear Phenomena 75, 292-309
  8. Nowak, M.A., May, R.M., 1993. The spatial dilemmas of evolution. Int. J. of Bifurcation and Chaos 3(1), 35-78.
  9. Baek, S.K., Kim, B.J., 2008. Intelligent tit-for-tat in the iterated prisoner's dilemma game. Physical Review E (Statistical, Nonlinear, and Soft Matter Physics) 78(1), 011125.
  10. Antony, M., Wu, D., Szeto, K.Y., 2013. Partial Imitation Hinders Emergence of Cooperation in the Iterated Prisoner's Dilemma with Direct Reciprocity. In Esparcia-Alczar, A.I. (eds.) EvoApplications 2013, LNCS, vol. 7835, pp. 92-101.
Download


Paper Citation


in Harvard Style

Amend A., Wu D. and Szeto K. (2014). Iterated Prisoner's Dilemma with Partial Imitation in Noisy Environments . In Proceedings of the International Conference on Evolutionary Computation Theory and Applications - Volume 1: ECTA, (IJCCI 2014) ISBN 978-989-758-052-9, pages 228-235. DOI: 10.5220/0005075402280235


in Bibtex Style

@conference{ecta14,
author={Andre Amend and Degang Wu and Kwok Yip Szeto},
title={Iterated Prisoner's Dilemma with Partial Imitation in Noisy Environments},
booktitle={Proceedings of the International Conference on Evolutionary Computation Theory and Applications - Volume 1: ECTA, (IJCCI 2014)},
year={2014},
pages={228-235},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005075402280235},
isbn={978-989-758-052-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Evolutionary Computation Theory and Applications - Volume 1: ECTA, (IJCCI 2014)
TI - Iterated Prisoner's Dilemma with Partial Imitation in Noisy Environments
SN - 978-989-758-052-9
AU - Amend A.
AU - Wu D.
AU - Szeto K.
PY - 2014
SP - 228
EP - 235
DO - 10.5220/0005075402280235