Hierarchical Self-organizing Maps System for Action Classification

Zahra Gharaee, Peter Gärdenfors, Magnus Johnsson

Abstract

We present a novel action recognition system that is able to learn how to recognize and classify actions. Our system employs a three-layered neural network hierarchy consisting of two self-organizing maps together with a supervised neural network for labelling the actions. The system is equipped with a module that pre-processes the 3D input data before the first layer, and a module that transforms the activity elicited over time in the first layer SOM into an ordered vector representation before the second layer, thus achieving a time invariant representation. We have evaluated our system in an experiment consisting of ten different actions selected from a publicly available data set with encouraging result.

References

  1. Balkenius, C., Morén, J., Johansson, B., and Johnsson, M. (2010). Ikaros: Building cognitive models for robots. Advanced Engineering Informatics, 24(1):40-48.
  2. Buonamente, M., Dindo, H., and Johnsson, M. (2013a). Recognizing actions with the associative self-organizing map. In Information, Communication and Automation Technologies (ICAT), 2013 XXIV International Symposium on, pages 1-5. IEEE.
  3. Buonamente, M., Dindo, H., and Johnsson, M. (2013b). Simulating actions with the associative self-organizing map. In Proceedings of the International Workshop on Artificial Intelligence and Cognition (AIC 2013) .
  4. Buonamente, M., Dindo, H., and Johnsson, M. (2014). Action recognition based on hierarchical selforganizing maps. In Proceedings of the International Workshop on Artificial Intelligence and Cognition (AIC 2014).
  5. Buonamente, M., Dindo, H., and Johnsson, M. (2015). Discriminating and simulating actions with the associative self-organizing map. Connection Science, 27(2):118-136.
  6. Buonamente, M., Dindo, H., and Johnsson, M. (2016). Hierarchies of self-organizing maps for action recognition. Cognitive Systems Research, 39:33-41.
  7. Johnsson, M., Balkenius, C., and Hesslow, G. (2009). Associative self-organizing map. In Proceedings of IJCCI, pages 363-370.
  8. Johnsson, M. and Buonamente, M. (2012). Internal simulation of an agent's intentions. In Proceedings of the Biologically Inspired Cognitive Architectures 2012, pages 175-176.
  9. Kohonen, T. (1988). Self-Organization and Associative Memory. Springer Verlag.
  10. Li, W., Zhang, Z., and Liu, Z. (2010). Action recognition based on a bag of 3d points. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on, IEEE, pages 9-14.
  11. Lo Presti, L., La Cascia, M., Sclaroff, S., and Camps, O. (2014). Gesture modeling by hanklet-based hidden markov model. In Asian Conference on Computer Vision (ACCV).
  12. Marr, D. and Nishihara, K. H. (1978). Representation and recognition of the spatial organization of threedimensional shapes. Proceedings of the Royal Society in London, B, 200:269-294.
  13. Marr, D. and Vaina, L. (1982). Representation and recognition of the movements of shapes. Proceedings of the Royal Society in London, B, 214:501-524.
  14. Masood, S., Ellis, C., Tappen, M., LaViola, J., and Sukthankar, R. (2013). Exploring the trade-off between accuracy and observational latency in action recognition. International Journal of Computer Vision, 101.
  15. Oreifej, O., Liu, Z., and Redmond, W. (2013). Hon4d: Histogram of oriented 4d normals for activity recognition from depth sequences. Computer Vision and Pattern Recognition.
  16. Rosch, E. (1975). Cognitive representations of semantic categories. Journal of Experimental Psychology: General, 104:192-233.
  17. Runesson, S. (1994). Perception of biological motion: The ksd-principle and the implications of a distal versus proximal approach. In Perceiving Events and Objects, pages 383-405. Hillsdale, NJ.
  18. Runesson, S. and Frykholm, G. (1983). Kinematic specification of dynamics as an informational basis for person and action perception. expectation, gender recognition, and deceptive intention. Journal of Experimental Psychology: General, 112:585-615.
  19. Shariatpanahi, H. F. and Ahmadabadi, M. N. (2007). Biologically inspired framework for learning and abstract representation of attention control. Attention in cognitive systems, theories and systems from an interdisciplinary viewpoint, 4840:307 - 324.
  20. Vaina, L. (1983). From shapes and movements to objects and actions. Synthese, 54:3-36.
  21. Wan, Y. W. (accessed 2015). Msr action recognition datasets and codes.
  22. Wang, J., Liu, Z., Chorowski, J., Chen, Z., and Wu, Y. (2012a). Robust 3d action recognition with random occupancy patterns. In Computer Vision-ECCV, pages 872-885.
  23. Wang, J., Liu, Z., Wu, Y., and Yuan, J. (2012b). Mining actionlet ensemble for action recognition with depth cameras. In Computer Vision and Pattern Recognition (CVPR) 2012 IEEE Conference on, pages 1290-1297.
  24. Xia, L., Chen, C.-C., and Aggarwal, J. (2012). View invariant human action recognition using histograms of 3d joints. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pages 20-27.
  25. Yang, X. and Tian, Y. (2012). Eigenjoints-based action recognition using nave-bayes-nearest-neighbor. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pages 14-19. DOI: 10.1109/CVPRW.2012.6239232.
  26. Yang, X., Zhang, C., and Tian, Y. (2012). Recognizing actions using depth motion maps-based histograms of oriented gradients. In Proceedings of the 20th ACM international conference on Multimedia, ACM, pages 1057-1060.
Download


Paper Citation


in Harvard Style

Gharaee Z., Gärdenfors P. and Johnsson M. (2017). Hierarchical Self-organizing Maps System for Action Classification . In Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-220-2, pages 583-590. DOI: 10.5220/0006199305830590


in Bibtex Style

@conference{icaart17,
author={Zahra Gharaee and Peter Gärdenfors and Magnus Johnsson},
title={Hierarchical Self-organizing Maps System for Action Classification},
booktitle={Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2017},
pages={583-590},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006199305830590},
isbn={978-989-758-220-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - Hierarchical Self-organizing Maps System for Action Classification
SN - 978-989-758-220-2
AU - Gharaee Z.
AU - Gärdenfors P.
AU - Johnsson M.
PY - 2017
SP - 583
EP - 590
DO - 10.5220/0006199305830590