Automatic Detection and Recognition of Human Movement Patterns in Manipulation Tasks

Lisa Gutzeit, Elsa Andrea Kirchner

2016

Abstract

Understanding human behavior is an active research area which plays an important role in robotic learning and human-computer interaction. The identification and recognition of behaviors is important in learning from demonstration scenarios to determine behavior sequences that should be learned by the system. Furthermore, behaviors need to be identified which are already available to the system and therefore do not need to be learned. Beside this, the determination of the current state of a human is needed in interaction tasks in order that a system can react to the human in an appropriate way. In this paper, characteristic movement patterns in human manipulation behavior are identified by decomposing the movement into its elementary building blocks using a fully automatic segmentation algorithm. Afterwards, the identified movement segments are assigned to known behaviors using k-Nearest Neighbor classification. The proposed approach is applied to pick-and-place and ball-throwing movements recorded by using a motion tracking system. It is shown that the proposed classification method outperforms the widely used Hidden Markov Model-based approaches in case of a small number of labeled training examples which considerably minimizes manual efforts.

References

  1. Aarno, D. and Kragic, D. (2008). Motion intention recognition in robot assisted applications. Robotics and Autonomous Systems, 56:692-705.
  2. Adi-Japha, E., Karni, A., Parnes, A., Loewenschuss, I., and Vakil, E. (2008). A shift in task routines during the learning of a motor skill: Group-averaged data may mask critical phases in the individuals' acquisition of skilled performance. Journal of Experimental Psychology: Learning, Memory, and Cognition, 24:1544-1551.
  3. Argall, B. D., Chernova, S., Veloso, M., and Browning, B. (2009). A survey of robot learning from demonstration. Robotics and Autonomous Systems, 57(5):469- 483.
  4. Fearnhead, P. and Liu, Z. (2007). On-line inference for multiple change point models. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 69:589-605.
  5. Fod, A., Matric, M., and Jenkins, O. (2002). Automated derivation of primitives for movement classification. Autonomous Robots, 12:39-54.
  6. Gong, D., Medioni, G., and Zhao, X. (2013). Structured time series analysis for human action segmentation and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(7):1414-1427.
  7. Gräve, K. and Behnke, S. (2012). Incremental action recognition and generalizing motion generation based on goal-directed features. In International Conference on Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ, pages 751-757.
  8. Graybiel, A. (1998). The basal ganglia and chunking of action repertoires. Neurobiology of Learning and Memory, 70:119-136.
  9. Kirchner, E. A., de Gea Fernandéz, J., Kampmann, P., Schröer, M., Metzen, J. H., and Kirchner, F. (2015). Intuitive Interaction with Robots - Technical Approaches and Challenges, pages 224-248. Springer Verlag GmbH Heidelberg.
  10. Kulic, D., Ott, C., Lee, D., Ishikawa, J., and Nakamura, Y. (2012). Incremental learning of full body motion primitives and their sequencing through human motion observation. The International Journal of Robotics Research, 31(3):330-345.
  11. Metzen, J. H., Fabisch, A., Senger, L., Gea Fernández, J., and Kirchner, E. A. (2013). Towards learning of generic skills for robotic manipulation. KI - Künstliche Intelligenz, 28(1):15-20.
  12. Morasso, P. (1981). Spatial control of arm movements. Experimental Brain Research, 42:223-227.
  13. Mülling, K., Kober, J., Koemer, O., and J.Peters (2013). Learning to select and generalize striking movements in robot table tennis. The International Journal of Robotics Research, 32:263-279.
  14. Pastor, P., Hoffmann, H., Asfour, T., and Schaal, S. (2009). Learning and generalization of motor skills by learning from demonstration. In 2009 IEEE International Conference on Robotics and Automation, pages 763- 768. Ieee.
  15. Poppe, R. (2010). A survey on vision-based human action recognition. Image and Vision Computing, 28(6):976- 990.
  16. Senger, L., Schröer, M., Metzen, J. H., and Kirchner, E. A. (2014). Velocity-based multiple changepoint inference for unsupervised segmentation of human movement behavior. In Proccedings of the 22th International Conference on Pattern Recognition (ICPR2014), pages 4564-4569.
  17. Stefanov, N., Peer, A., and Buss, M. (2010). Online intention recognition in computer-assisted teleoperation systems. In Haptics: Generating and Perceiving Tangible ensations, pages 233-239. Springer Berlin Heidelberg.
Download


Paper Citation


in Harvard Style

Gutzeit L. and Kirchner E. (2016). Automatic Detection and Recognition of Human Movement Patterns in Manipulation Tasks . In Proceedings of the 3rd International Conference on Physiological Computing Systems - Volume 1: PhyCS, ISBN 978-989-758-197-7, pages 54-63. DOI: 10.5220/0005946500540063


in Bibtex Style

@conference{phycs16,
author={Lisa Gutzeit and Elsa Andrea Kirchner},
title={Automatic Detection and Recognition of Human Movement Patterns in Manipulation Tasks},
booktitle={Proceedings of the 3rd International Conference on Physiological Computing Systems - Volume 1: PhyCS,},
year={2016},
pages={54-63},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005946500540063},
isbn={978-989-758-197-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Physiological Computing Systems - Volume 1: PhyCS,
TI - Automatic Detection and Recognition of Human Movement Patterns in Manipulation Tasks
SN - 978-989-758-197-7
AU - Gutzeit L.
AU - Kirchner E.
PY - 2016
SP - 54
EP - 63
DO - 10.5220/0005946500540063