Planning and Reactive Agents in Dynamic Game Environments - An Experimental Study

Roman Barták, Cyril Brom, Martin Černý, Jakub Gemrot

Abstract

Many contemporary computer games can be described as dynamic real-time simulations inhabited by autonomous intelligent virtual agents (IVAs) where most of the environmental structure is immutable and navigating through the environment is one of the most common activities. Though controlling the behaviour of such agents seems perfectly suited for action planning techniques, planning is not widely adopted in existing games. This paper contributes to discussion whether the current academic planning technology is ready for integration to existing games and under which conditions. The paper compares reactive techniques to classical planning in handling the action selection problem for IVAs in game-like environments. Several existing classical planners that occupied top positions in the International Planning Competition were connected to the virtual environment of Unreal Development Kit via the Pogamut platform. Performance of IVAs employing those planners and IVAs with reactive architecture was measured on a class of game-inspired maze-like test environments under different levels of external interference. It was shown that agents employing classical planning techniques outperform reactive agents if the size of the planning problem is small or if the environment changes are either hostile to the agent or not very frequent.

References

  1. Balla, R.-K., Fern, A., 2009. UCT for Tactical Assault Planning in Real-Time Strategy Games. in Proceedings of the Twenty-First International Joint Conference on Artificial Intelligence, Pp. 40-45.
  2. Cerný, M., 2012. Comparing Reactive Techniques to Classical Planning for Intelligent Virtual Agents. Master Thesis, Charles University in Prague.
  3. Cerný, M., 2012b. Planning4J. Available at Http://Code.Google.Com/P/Planning4j/
  4. Champandard, A. J., 2007. Understanding Behavior Trees. Available at: Http://Aigamedev.Com/Open/Article/BtOverview/ Accessed 2012-04-11.
  5. Epic Games Inc., 2012. Unreal Development Kit. Available at Http://Udk.Com/ Accessed 2012-04-10.
  6. Fikes, R. E., Nilsson, N. J. , 1971. Strips: a New Approach to the Application of Theorem Proving to Problem Solving. Artificial Intelligence 2:189-208, 1971.
  7. Fox, M., Long, D., 2003. PDDL2.1: an Extension to PDDL for Expressing Temporal Planning Domains. Journal of Artificial Intelligence Research 20: 61-124.
  8. Fu, D., Houlette-Stottler, R., 2004. the Ultimate Guide to Fsms in Games. AI Game Programming Wisdom II, Pp. 283-302. Hingham, Massachusetts: Charles River Media.
  9. Gemrot, J., Kadlec, R., Bída, M., Burkert, O., 2009. Pogamut 3 Can Assist Developers in Building AI (Not Only) for Their Videogame Agents. Agents for Games and Simulations, LNCS 5920, Pp. 1-15.
  10. Hawes, N., 2004. Anytime Deliberation for Computer Game Agents, Ph.D. Diss., School of Computer Science, University of Birmingham, Birmingham, UK.
  11. Helmert, M., 2006. the Fast Downward Planning System. Journal of Artificial Intelligence Research 26: 191-246.
  12. Hoang, H., Lee-Urban, S., Muñoz-Avila, H., 2005. Hierarchical Plan Representations for Encoding Strategic Game AI. Proceedings of the First Artificial Intelligence and Interactive Digital Entertainment Conference, Pp. 63-68.
  13. Hoffmann, J., Nebel, B., 2001. the FF Planning System: Fast Plan Generation through Heuristic Search. Journal of Artificial Intelligence Research 14: 253- 302.
  14. Hothorn, T., Bretz, F., Westfall, P., 2008. Simultaneous Inference in General Parametric Models. Biometrical Journal 50(3): 346-363.
  15. Hsu, C.-W., Wah, B. W., 2008. The Sgplan Planning System in IPC-6. in Proceedings of the Sixth International Planning Competition, Pp. 5-7.
  16. Kautz, H., Selman, B., 1998. BLACKBOX: a New Approach to the Application of Theorem Proving to Problem Solving. in Working Notes of the Workshop on Planning as Combinatorial Search, Pittsburgh.
  17. Lipovetzky, N., Geffner, H., 2011. Searching for Plans with Carefully Designed Probes, in Proceedings of the Twenty-First International Conference on Automated Planning and Scheduling, Pp. 154-161.
  18. Long, E., 2007. Enhanced NPC Behaviour using Goal Oriented Action Planning, Master Thesis, School of Computing and Advanced Technologies, University of Abertay Dundee, Dundee, UK.
  19. Mckillup, S., 2006. Statistics Explained: an Introductory Guide for Life Scientists, Cambridge: Cambridge University Press.
  20. Nguyen T.-H.D. Et Al., 2011. CAPIR: Collaborative Action Planning with Intention Recognition. in Proceedings of the Seventh AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Pp. 61-66.
  21. Orkin, J., 2012. Personal Web Page. Accessed 2012-04-11. Available at Http://Web.Media.Mit.Edu/Jorkin/Goap.Html
  22. Orkin, J., 2006. Three States and a Plan: the AI of F.E.a.R.. in Proceedings of the Game Developer's Conference.
  23. Pollack, M. E., Horty, J. F., 1999. There's More to Life than Making Plans. AI Magazine 20(4): 71-83.
  24. Richter, S., Westphal, M., Helmert, M. 2011. LAMA 2008 and 2011. in Seventh International Planning Competition (IPC 2011), Deterministic Part, Pp. 50- 54.
  25. Thompson, T., Levine, J., 2009. Realtime Execution of Automated Plans using Evolutionary Robotics. in IEEE Symposium on Computational Intelligence and Games, Pp. 333-340.
  26. Vassos, S., Papakonstantinou, M., 2011. the Simplefps Planning Domain: a PDDL Benchmark for Proactive Npcs,” Proceedings of the Non-Player Character AI Workshop (NPCAI-2011) of the Artificial Intelligence & Interactive Digital Entertainment (AIIDE-2011) Conference, Stanford CA, USA.
Download


Paper Citation


in Harvard Style

Barták R., Brom C., Černý M. and Gemrot J. (2013). Planning and Reactive Agents in Dynamic Game Environments - An Experimental Study . In Proceedings of the 5th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-8565-38-9, pages 234-240. DOI: 10.5220/0004254202340240


in Bibtex Style

@conference{icaart13,
author={Roman Barták and Cyril Brom and Martin Černý and Jakub Gemrot},
title={Planning and Reactive Agents in Dynamic Game Environments - An Experimental Study},
booktitle={Proceedings of the 5th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2013},
pages={234-240},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004254202340240},
isbn={978-989-8565-38-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - Planning and Reactive Agents in Dynamic Game Environments - An Experimental Study
SN - 978-989-8565-38-9
AU - Barták R.
AU - Brom C.
AU - Černý M.
AU - Gemrot J.
PY - 2013
SP - 234
EP - 240
DO - 10.5220/0004254202340240