COGNITIVE BIASED ACTION SELECTION STRATEGIES FOR SIMULATIONS OF FINANCIAL SYSTEMS

Marco Remondino, Nicola Miglietta

Abstract

In agent based simulations, the many entities involved usually deal with an action selection based on the reactive paradigm: they usually feature embedded strategies to be used according to the stimuli coming from the environment or other entities. This can give good results at an aggregate level, but in certain situations (e.g. Game Theory), cognitive agents, embedded with some learning technique, could give a better representation of the real system. The actors involved in real Social Systems have a local vision and usually can only see their own actions or neighbours’ ones (bounded rationality) and sometimes they could be biased towards a particular behaviour, even if not optimal for a certain situation. In the paper, a new method for cognitive action selection is formally introduced, keeping into consideration an individual bias: ego biased learning. It allows the agents to adapt their behaviour according to a payoff coming from the action they performed at time t-1, by converting an action pattern into a synthetic value, updated at each time, but keeping into account their individual preferences towards specific actions.

References

  1. Box, H. O., 1984. Primate Behaviour and Social Ecology. London: Chapman and Hall.
  2. Chen M. K., 2008. Rationalization and Cognitive Dissonance: do Choices Affect or Reflect Preferences? Cowles Foundation Discussion Paper No. 1669
  3. Mataric M. J., 2004. Reward Functions for Accelerated Learning. In Proceedings of the Eleventh International Conference on Machine Learning.
  4. Mataric, M. J., 1997. Reinforcement Learning in the Multi-Robot domain. Autonomous Robots, 4(1).
  5. Fudenberg, D., and Levine, D. K. 1998. The Theory of Learning in Games. Cambridge, MA: MIT Press
  6. Fragaszy, D. and Visalberghi, E., 2001. Recognizing a swan: Socially-biased learning. Psychologia, 44.
  7. Powers R. and Shoham Y., 2005. New criteria and a new algorithm for learning in multi-agent systems. In Proceedings of NIPS.
  8. Sharot T., De Martino B., Dolan R.J., 2009. How Choice Reveals and Shapes Expected Hedonic Outcome. The Journal of Neuroscience, 29(12):3760-3765
  9. Sutton, R. S. and Barto A. G., 1998. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA. A Bradford Book
  10. Watkins, C. J. C. H. 1989. Learning from delayed rewards. PhD thesis, Psychology Dep. Univ. of Cambridge.
Download


Paper Citation


in Harvard Style

Remondino M. and Miglietta N. (2009). COGNITIVE BIASED ACTION SELECTION STRATEGIES FOR SIMULATIONS OF FINANCIAL SYSTEMS . In Proceedings of the International Joint Conference on Computational Intelligence - Volume 1: ICNC, (IJCCI 2009) ISBN 978-989-674-014-6, pages 534-539. DOI: 10.5220/0002311405340539


in Bibtex Style

@conference{icnc09,
author={Marco Remondino and Nicola Miglietta},
title={COGNITIVE BIASED ACTION SELECTION STRATEGIES FOR SIMULATIONS OF FINANCIAL SYSTEMS},
booktitle={Proceedings of the International Joint Conference on Computational Intelligence - Volume 1: ICNC, (IJCCI 2009)},
year={2009},
pages={534-539},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002311405340539},
isbn={978-989-674-014-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Joint Conference on Computational Intelligence - Volume 1: ICNC, (IJCCI 2009)
TI - COGNITIVE BIASED ACTION SELECTION STRATEGIES FOR SIMULATIONS OF FINANCIAL SYSTEMS
SN - 978-989-674-014-6
AU - Remondino M.
AU - Miglietta N.
PY - 2009
SP - 534
EP - 539
DO - 10.5220/0002311405340539