USER BEHAVIOR RECOGNITION FOR AN AUTOMATIC PROMPTING SYSTEM - A Structured Approach based on Task Analysis

Christian Peters, Thomas Hermann, Sven Wachsmuth

2012

Abstract

In this paper, we describe a structured approach for user behavior recognition in an automatic prompting system that assists users with cognitive disabilities in the task of brushing their teeth. We analyze the brushing task using qualitative data analysis. The results are a hierarchical decomposition of the task and the identification of environmental configurations during subtasks. We develop a hierarchical recognition framework based on the results of task analysis: We extract a set of features from multimodal sensors which are discretized into the environmental configuration in terms of states of objects involved in the brushing task. We classify subtasks using a Bayesian Network (BN) classifier and a Bayesian Filtering approach. We compare three variants of the BN using different observation models (IU, NaiveBayes and Holistic) with a maximum-margin classifier (multi-class SVM). We present recognition results on 18 trials with regular users and found the BN with a NaiveBayes observation model to produce the best recognition rates of 84.5% on avg.

References

  1. Galata, A., Johnson, N., and Hogg, D. (2001). Learning variable-length Markov models of behavior. Computer Vision and Image Understanding, 81(3):398- 413.
  2. Hoey, J., Ploetz, T., Jackson, D., Monk, A., Pham, C., and Olivier, P. (2011). Rapid specification and automated generation of prompting systems to assist people with dementia. Pervasive and Mobile Computing, 7(3):299 - 318.
  3. Hoey, J., Poupart, P., Bertoldi, A. v., Craig, T., Boutilier, C., and Mihailidis, A. (2010). Automated handwashing assistance for persons with dementia using video and a partially observable markov decision process. Computer Vision and Image Understanding, 114:503-519.
  4. Moore, D., Essa, I., and Hayes, M. (1999). Object Spaces: Context Management for Human Activity Recognition. In AVBPA'99, 2nd Int. Conf. on Audio-Visual Biometric Person Authentication, Washington, DC.
  5. Nguyen, N., Phung, D., Venkatesh, S., and Bui, H. (2005). Learning and detecting activities from movement trajectories using the hierarchical hidden markov model. In CVPR'05, Int. Conf. on Computer Vision and Pattern Recognition, volume 2.
  6. Oliver, N., Horvitz, E., and Garg, A. (2002). Layered representations for human activity recognition. In ICMI'02, Int. Conf. on Multimodal Interfaces, Pittsburgh, PA.
  7. Patterson, D. J., Fox, D., Kautz, H., and Philipose, M. (2005). Fine-grained activity recognition by aggregating abstract object usage. In ISWC'05, IEEE Int. Symposium on Wearable Computers, Washington, DC, USA.
  8. Pusiol, G., Patino, L., Bremond, F., Thonnat, M., and Suresh, S. (2008). Optimizing Trajectories Clustering for Activity Recognition. In MLVMA'08, 1st Int. Workshop on Machine Learning for Vision-based Motion Analysis, Marseille, France.
  9. Robertson, N. and Reid, I. (2006). A general method for human activity recognition in video. Computer Vision and Image Understanding, 104:232-248.
  10. Ryu, H. and Monk, A. (2009). Interaction Unit Analysis: A New Interaction Design Framework. HumanComputer Interaction, 24(4).
  11. Subramanya, A., Raj, A., Bilmes, J. A., and Fox, D. (2006). Recognizing activities and spatial context using wearable sensors. In UAI 7806, 22nd Conference on Uncertainty in Artificial Intelligence, Cambridge,MA, USA.
  12. Wu, J., Osuntogun, A., Choudhury, T., Philipose, M., and Rehg, J. (2007). A scalable approach to activity recognition based on object use. In ICCV'07. IEEE 11th International Conference on Computer Vision.
  13. Wu, T.-F., Lin, C.-J., and Weng, R. C. (2004). Probability estimates for multi-class classification by pairwise coupling. Machine Learning Research, 5:975-1005.
  14. Yang, A. Y., Jafari, R., Sastry, S. S., and Bajcsy, R. (2009). Distributed recognition of human actions using wearable motion sensor networks. Ambient Intelligence and Smart Environments, 1:103-115.
Download


Paper Citation


in Harvard Style

Peters C., Hermann T. and Wachsmuth S. (2012). USER BEHAVIOR RECOGNITION FOR AN AUTOMATIC PROMPTING SYSTEM - A Structured Approach based on Task Analysis . In Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM, ISBN 978-989-8425-99-7, pages 162-171. DOI: 10.5220/0003773601620171


in Bibtex Style

@conference{icpram12,
author={Christian Peters and Thomas Hermann and Sven Wachsmuth},
title={USER BEHAVIOR RECOGNITION FOR AN AUTOMATIC PROMPTING SYSTEM - A Structured Approach based on Task Analysis},
booktitle={Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM,},
year={2012},
pages={162-171},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003773601620171},
isbn={978-989-8425-99-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM,
TI - USER BEHAVIOR RECOGNITION FOR AN AUTOMATIC PROMPTING SYSTEM - A Structured Approach based on Task Analysis
SN - 978-989-8425-99-7
AU - Peters C.
AU - Hermann T.
AU - Wachsmuth S.
PY - 2012
SP - 162
EP - 171
DO - 10.5220/0003773601620171