TRAINING BELIEVABLE AGENTS IN 3D ELECTRONIC BUSINESS ENVIRONMENTS USING RECURSIVE-ARC GRAPHS

Anton Bogdanovych, Simeon Simoff, Marc Esteva

Abstract

Using 3D Virtual Worlds for commercial activities on the Web and the development of human-like sales assistants operating in such environments are ongoing trends of E-Commerce. The majority of the existing approaches oriented towards the development of such assistants are agent-based and are focused on explicit programming of the agents’ decision making apparatus. While effective in some very specific situations, these approaches often restrict agents’ capabilities to adapt to the changes in the environment and learn new behaviors. In this paper we propose an implicit training method that can address the aforementioned drawbacks. In this method we formalize the virtual environment using Electronic Institutions and make the agent use these formalizations for observing a human principle and learning believable behaviors from the human. The training of the agent can be conducted implicitly using the specific data structures called recursive-arc graphs.

References

  1. Aleotti, J., Caselli, S., and Reggiani, M. (2003). Toward Programming of Assembly Tasks by Demonstration in Virtual Environments. In IEEE Workshop Robot and Human Interactive Communication., pages 309 - 314.
  2. Alissandrakis, A., Nehaniv, C. L., and Dautenhahn, K. (2001). Through the Looking-Glass with ALICE: Trying to Imitate using Correspondences. In Proceedings of the First International Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems, pages 115-122, Lurid, Sweden.
  3. Bauckhage, C., Gorman, B., Thurau, C., and Humphrys, M. (2007). Learning Human Behavior from Analyzing Activities in Virtual Environments. MMI-Interaktiv, 12(April):3-17.
  4. Biuk-Aghai, R. P. (2003). Patterns of Virtual Collaboration. PhD thesis, University of Technology Sydney, Australia.
  5. Bogdanovych, A. (2007). Virtual Institutions. PhD thesis, University of Technology, Sydney, Australia.
  6. Breazeal, C. (1999). Imitation as social exchange between humans and robots. In Proceedings of the AISB Symposium on Imitation in Animals and Artifacts, pages 96-104.
  7. Esteva, M. (2003). Electronic Institutions: From Specification to Development. PhD thesis, Institut d'Investigació en Intelligència Artificial (IIIA), Spain.
  8. Gorman, B., Thurau, C., Bauckhage, C., and Humphrys, M. (2006). Believability Testing and Bayesian Imitation in Interactive Computer Games. In Proceedings of the 9th International Conference on the Simulation of Adaptive Behavior (SAB'06), volume LNAI 4095, pages 655-666. Springer.
  9. Hastie, T. and Tibshirani, R. (1996). Discriminant adaptive nearest neighbor classification and regression. In Touretzky, D. S., Mozer, M. C., and Hasselmo, M. E., editors, Advances in Neural Information Processing Systems, volume 8, pages 409-415. The MIT Press.
  10. Huang, T. S., Nijholt, A., Pantic, M., and Pentland, A., editors (2007). Artifical Intelligence for Human Computing, ICMI 2006 and IJCAI 2007 International Workshops, volume 4451 of Lecture Notes in Computer Science. Springer.
  11. Le Hy, R., Arrigony, A., Bessiere, P., and Lebeltel, O. (2004). Teaching bayesian behaviors to video game characters. Robotics and Autonomous Systems, 47:177-185.
  12. Livingstone, D. (2006). Turing's test and believable AI in games. Computers in Entertainment, 4(1):6-18.
  13. Maatman, R. M., Gratch, J., and Marsella, S. (2005). Natural behavior of a listening agent. Lecture Notes in Computer Science, pages 25-36.
  14. Magnenat-Thalmann, N., Kim, H., Egges, A., and Garchery, S. (2005). Believability and Interaction in Virtual Worlds. In Proceedings of the Multimedia Modelling Conference (MMM'05), pages 2-9, Washington, DC, USA. IEEE Computer Society.
  15. Pantic, M., Pentland, A., Nijholt, A., and Huang, T. (2006). Human computing and machine understanding of human behavior: a survey. In ICMI 7806: Proceedings of the 8th international conference on Multimodal interfaces, pages 239-248, New York, NY, USA. ACM.
  16. Prendinger, H. and Ishizuka, M. (2001). Let's talk! socially intelligent agents for language conversation training. IEEE Transactions on Systems, Man, and Cybernetics, Part A, 31(5):465-471.
  17. Rist, T., Andre, E., and Baldes, S. (2003). A flexible platform for building applications with life-like characters. In IUI 7803: Proceedings of the 8th international conference on Intelligent user interfaces, pages 158- 165, New York, NY, USA. ACM.
  18. Schaal, S. (1999). Is imitation learning the route to humanoid robots? Trends in cognitive sciences, (6):233- 242.
  19. Thurau, C., Bauckhage, C., and Sagerer, G. (2004). Learning Human-Like Movement Behavior for Computer Games. In Proceedings of the 8-th Simulation of Adaptive Behavior Conference (SAB'04), pages 315- 323. MIT Press.
  20. Tomlinson, B., Yau, M. L., and Baumer, E. (2006). Embodied mobile agents. In Proceedings of AAMAS 7806 conference, pages 969-976, New York, NY, USA. ACM.
Download


Paper Citation


in Harvard Style

Bogdanovych A., Simoff S. and Esteva M. (2008). TRAINING BELIEVABLE AGENTS IN 3D ELECTRONIC BUSINESS ENVIRONMENTS USING RECURSIVE-ARC GRAPHS . In Proceedings of the Third International Conference on Software and Data Technologies - Volume 1: ICSOFT, ISBN 978-989-8111-51-7, pages 339-346. DOI: 10.5220/0001901103390346


in Bibtex Style

@conference{icsoft08,
author={Anton Bogdanovych and Simeon Simoff and Marc Esteva},
title={TRAINING BELIEVABLE AGENTS IN 3D ELECTRONIC BUSINESS ENVIRONMENTS USING RECURSIVE-ARC GRAPHS},
booktitle={Proceedings of the Third International Conference on Software and Data Technologies - Volume 1: ICSOFT,},
year={2008},
pages={339-346},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001901103390346},
isbn={978-989-8111-51-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Software and Data Technologies - Volume 1: ICSOFT,
TI - TRAINING BELIEVABLE AGENTS IN 3D ELECTRONIC BUSINESS ENVIRONMENTS USING RECURSIVE-ARC GRAPHS
SN - 978-989-8111-51-7
AU - Bogdanovych A.
AU - Simoff S.
AU - Esteva M.
PY - 2008
SP - 339
EP - 346
DO - 10.5220/0001901103390346