Multi-Agent Intention Recognition using Logical Hidden Semi-Markov Models

Shi-guang Yue, Ya-bing Zha, Quan-jun Yin, Long Qin

2014

Abstract

Intention recognition (IR) is significant for creating humanlike and intellectual agents in simulation systems. Previous widely used probabilistic graphical methods such as hidden Markov models (HMMs) cannot handle unstructural data, so logical hidden Markov models (LHMMs) are proposed by combining HMMs and first order logic. Logical hidden semi-Markov models (LHSMMs) further extend LHMMs by modeling duration of hidden states explicitly and relax the Markov assumption. In this paper, LHSMMs are used in multi agent intention recognition (MAIR), which identifies not only intentions of every agent but also working modes of the team considering cooperation. Logical predicates and connectives are used to present the working mode; conditional transition probabilities and changeable instances alphabet depending on available observations are introduced; and inference process based on the logical forward algorithm with duration is given. A simple game “Killing monsters” is also designed to evaluate the performance of LHSMMs with its graphical representation depicted to describe activities in the game. The simulation results show that, LHSMMs can get reliable results of recognizing working modes and smoother probability curves than LHMMs. Our models can even recognize destinations of the agent in advance by making use of the cooperation information.

References

  1. Bui, H. H., Venkatesh, S. & West, G. (2002), Policy recognition in the abstract hidden Markov models, Journal of Artificial Intelligence Research, 17, 2002, 451-499.
  2. Duong, T., Phung, D., Bui, H., Venkatesh, S. (2009), Efficient duration and hierarchical modeling for human activity recognition, Artificial Intelligence, 173(7-8), 830-856.
  3. Dereszynski, E. Hostetler, J., Fern, A. & Dietterich, T., Hoang, T. & Udarbe, M. Learning Probabilistic Behavior Models in Real-time Strategy Games, In AIIDE'2011, Proc. of the 7th In Artificial Intelligence and Interactive Digital Entertainment, 20-25. AAAI Press.
  4. Fine, S., Singer,Y., & Tishby, N. (1998), The hierarchical hidden Markov model: Analysis and applications, Machine Learning, 32(1): 41-62.
  5. Kautz, H. A. & Allen, J.F., Generalized plan recognition, In AAAI'1986, Proc. of the 5th National Conference on Artificial Intelligence, 32-37.AAAI Press.
  6. Kersting K., De Raedt L. & Raiko T. (2006).Logical hidden Markov models. Journal of Artificial Intelligence Research, 25, 425-456.
  7. Natarajan, S., Bui, H. H. &Tadepalli, P., et al. 2008.Logical hierarchical hidden Markov models for modeling user activities. In ILP'2008, LNCS 2008, 192-209.Springer Heidelberg
  8. Pfeffer, A., Das, S. & Lawless, D., et al. (2009) Factored reasoning for monitoring dynamic team and goal formation. Information Fusion, 10(1), 99-106.
  9. Sadri, F. (2011). Logic-Based Approaches to Intention Recognition. In N. Chong, & F. Mastrogiovanni (Eds), Handbook of Research on Ambient Intelligence and Smart Environments: Trends and Perspectives, Hershey, PA: Information Science Reference, 346-375.
  10. Schmidt, C. F., Sridharan, N. S. & Goodson J. L. (1978).The plan recognition problem: an intersection of psychology and artificial intelligence. Artificial Intelligence, 11(1-2), 45-83.
  11. Southey, F. Loh, W. & Wilkinson, D, Inferring Complex Agent Motions from Partial Trajectory Observations ,In IJCAI'2007, Proc. of the 20th International Joint Conference on Artificial Intelligence, 2631-2637. AAAI Press.
  12. Yu, S. Z. (2010). Hidden semi-Markov models, Artificial Intelligence, 174, 215-243.
  13. Zha, Y. B., Yue, S. G. &Yin, Q.J.,et al., 2013, Activity recognition using logical hidden semi-Markov models, In ICCWAMTIP'2013, Proc. of 10th International Computer Conference on Wavelet Active Media Technology and Information Processing, 77-84, UESTC Press.
  14. Zouaoui-Elloumi, S., Roy, V. &Marmorat J P, et al. Securing harbors by modeling and classifying ship behavior. In BRIMS'2011, Proc. of 20th Annual Conference on Behavior Representation in Modeling and Simulation, 114-121, Curran Associates.
Download


Paper Citation


in Harvard Style

Yue S., Zha Y., Yin Q. and Qin L. (2014). Multi-Agent Intention Recognition using Logical Hidden Semi-Markov Models . In Proceedings of the 4th International Conference on Simulation and Modeling Methodologies, Technologies and Applications - Volume 1: SIMULTECH, ISBN 978-989-758-038-3, pages 701-708. DOI: 10.5220/0005036707010708


in Bibtex Style

@conference{simultech14,
author={Shi-guang Yue and Ya-bing Zha and Quan-jun Yin and Long Qin},
title={Multi-Agent Intention Recognition using Logical Hidden Semi-Markov Models},
booktitle={Proceedings of the 4th International Conference on Simulation and Modeling Methodologies, Technologies and Applications - Volume 1: SIMULTECH,},
year={2014},
pages={701-708},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005036707010708},
isbn={978-989-758-038-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 4th International Conference on Simulation and Modeling Methodologies, Technologies and Applications - Volume 1: SIMULTECH,
TI - Multi-Agent Intention Recognition using Logical Hidden Semi-Markov Models
SN - 978-989-758-038-3
AU - Yue S.
AU - Zha Y.
AU - Yin Q.
AU - Qin L.
PY - 2014
SP - 701
EP - 708
DO - 10.5220/0005036707010708