Comparison of Agents’ Performance in Learning to Cross a Highway for Two Decisions Formulas

Anna T. Lawniczak, Fei Yu

2017

Abstract

We compare the performance of simple cognitive agents, learning to cross a Cellular Automaton (CA) based highway, for two decision formulas used by the agents’ in their decision-making process. We describe the main features of the simulation model: CA based highway traffic environment, agents and their decision and learning mechanisms. The agents use a type of “observational social learning” strategy, i.e. they observe the performance of other agents and they try to mimic what worked for other agents and they try to avoid what did not work for the other agents. In the decision-making process of deciding whether to cross the highway or to wait, depending on the simulation setup, the agents use one of the two decisions formulas: the first one based only on the assessment of the agents crossing decisions (cDF), or the second one based on the assessment of the agents crossing and waiting decisions (cwDF). Our simulations show that the performance of agents using cwDF is much better than the performance of the agents using cDF in their decision making process. We measure the agents’ performance by the numbers of agents: who crossed successfully, who were killed and those who are still queuing to cross at simulation end.

References

  1. Russell, S., Norvig, P., 2014. Artificial Intelligence, A Modern Approach, Pearson Education Limited.
  2. Poole, D.L., MacKworth, A.K., 2010. Artificial Intelligence, Foundations of Computational Agents, Cambridge University Press, Cambridge, US.
  3. Ferber, J., 1999. Multi-Agent Systems, An Introduction to Distributed Artificial Intelligence, Addison-Wesley, Longman.
  4. Uhrmacher, A.M., Weyns, D., 2009. Multi-Agent Systems Simulation and Applications, CRC Press, Taylor & Francis Group, Boca Raton, Fl.
  5. Nehavin, Ch. L., Dautenhahn, K., 2007. Imitation and Social Learning in Robots, Humans and Animals”, Cambridge University Press, Cambridge, UK.
  6. Bandura, A., 1977. Social Learning Theory, Prentice Hall, Englewood Cliffs, NJ.
  7. Bandura, A., Ross, D., Ross, S.A., 1961. Transmission of aggression through the imitation of aggressive models, Journal of Abnormal and Social Psychology, 63, pp. 575-582.
  8. Hoppitt, W., Laland, K.N., 2013. Social Learning, An Introduction to Mechanisms, Methods, and Models, Princeton University Press, Princeton.
  9. Montes de Oca, M.A., Stutzle, T., 2008. Towards incremental social learning in optimization and multiagent systems, Proceedings of GECCO'08, The 10th Annual Conference Comparison on Genetic and Evolutionary Computation, pp. 1939-1944.
  10. Gong, Y.J., Zhang, J., Li, Y., 2014. From the social learning theory to a social learning algorithm for global optimization, Proceedings of 2014 IEEE International Conference on Systems, Man and Cybernetics (SMC), San Diego, CA, pp. 222 - 227.
  11. Cheng, R., Jin, Y. 2015. A social learning particle swarm optimization algorithm for scalable optimization”, Information Sciences, Vol. 291, pp. 43-60.
  12. Liu, Z.-Z, Chu, D.-H., Song, Ch., Xue, X., Lu, B.-Y., 2016. Social learning optimization (SLO) algorithm paradigm and its application in QoS-aware cloud service composition, Information Sciences, Vol. 326, pp. 315- 333.
  13. Lawniczak, A.T., Ernst, J.B., Di Stefano, B.N., 2012. Creature Learning to Cross A CA Simulated Road”, in: G.C. Sirakoulis, S. Bandini (Eds.) Proc. of ACRI 2012, Springer-Verlag LNCS, Vol.7495, 2012, pp. 425-433.
  14. Lawniczak, A.T., Ernst, J.B., Di Stefano, B.N., 2013. Simulated Naïve Creature Crossing a Highway, Proceedia Computer Science 18, 2013, pp. 2611-2614.
  15. Lawniczak, A.T., Di Stefano, B.N., Ernst, J.B., 2014. Software Implementation of Population of Cognitive Agents Learning to Cross a Highway, J. Was, G.C. Sirakoulis, S. Bandini (Eds.) Proc. of ACRI 2014, Springer-Verlag LNCS, Vol. 8751, pp. 688-697.
  16. Nagel, K., Schreckenberg, M., 1992. A cellular automaton model for freeway traffic”, J. Physique I, 2, pp. 2221 - 2229.
  17. Lawniczak, A.T., Di Stefano, B.N., 2008. Development of CA model of highway traffic”, in Adamatzky, A., Alonso-Sanz, R., Lawniczak, A., Martinez, G. J., Morita, K., Worsch, T., eds., Automata-2008, Theory and Applications of Cellular Automata, Luniver Press, U.K.
  18. Lawniczak, A.T., Di Stefano, B.N., 2010a. Multilane Single GCA-w Based Expressway Traffic Model, in: S. Bandini et al. (Eds.): Prof. of ACRI 2010, SpringerVerlag LNCS Vol. 6350, pp. 600-612.
  19. Lawniczak, A.T., Di Stefano, B.N., 2010b. Digital Laboratory of Agent-Based Highway Traffic Model, Acta Physica Polonica B Proc. Supplement, Vol. 3, No. 2, pp. 479-493.
  20. Lawniczak, A.T., Di Stefano, B.N., Ernst, J.B., 2015. Stochastic Model of Cognitive Agents Learning to Cross a Highway. In A. Steland, E. Rafajlowicz, K. Szajnowski (Ed.) The 12th Workshop on Stochastic Models, Statistics and their Applications, Springer Proceedings in Mathematics and Statistics, Vol.122, pp. 319-326.
  21. Lawniczak, A.T., Di Stefano, B. N., Ly, L., Xie, S., 2016. Performance of Population of Naïve Creatures with Fear and Desire Capable of Observational Social Learning. Acta Physica Polonica Series B, Proceedings Supplement, 9 (1), pp. 95-107.
  22. Lawniczak, A.T., Ly, L., Yu, F., Xie, S., 2016. Effects of Model Parameter Interactions on Naïve Creatures' Success of Learning to Cross a Highway, The 2016 IEEE Congress on Evolutionary Computation (IEEE CEC 2016) at IEEE WCCI 2016, 10 pages.
  23. Dean, A., Voss, D., 1999. Design and Analysis of Experiments, Springer Science+Bussines Media, Inc.
Download


Paper Citation


in Harvard Style

Lawniczak A. and Yu F. (2017). Comparison of Agents’ Performance in Learning to Cross a Highway for Two Decisions Formulas . In Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-758-219-6, pages 208-219. DOI: 10.5220/0006193102080219


in Bibtex Style

@conference{icaart17,
author={Anna T. Lawniczak and Fei Yu},
title={Comparison of Agents’ Performance in Learning to Cross a Highway for Two Decisions Formulas},
booktitle={Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2017},
pages={208-219},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006193102080219},
isbn={978-989-758-219-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - Comparison of Agents’ Performance in Learning to Cross a Highway for Two Decisions Formulas
SN - 978-989-758-219-6
AU - Lawniczak A.
AU - Yu F.
PY - 2017
SP - 208
EP - 219
DO - 10.5220/0006193102080219