Fast Gait Recognition from Kinect Skeletons

Tanwi Mallick, Ankit Khedia, Partha Pratim Das, Arun Kumar Majumdar

2016

Abstract

Recognizing persons from gait has attracted attention in computer vision research for over a decade and a half. To extract the motion information in gait, researchers have either used wearable markers or RGB videos. Markers naturally offer good accuracy and reliability but has the disadvantage of being intrusive and expensive. RGB images, on the other hand, need high processing time to achieve good accuracy. Advent of low-cost depth data from Kinect 1.0 and its human-detection and skeleton-tracking abilities have opened new opportunities in gait recognition. Using skeleton data it gets cheaper and easier to get the body-joint information that can provide critical clue to gait-related motions. In this paper, we attempt to use the skeleton stream from Kinect 1.0 for gait recognition. Various types of gait features are extracted from the joint-points in the stream and the appropriate classifiers are used to compute effective matching scores. To test our system and compare performance, we create a benchmark data set of 5 walks each for 29 subjects and implement a state-of-the-art gait recognizer for RGB videos. Tests show a moderate accuracy of 65% for our system. This is low compared to the accuracy of RGB-based method (which achieved 83% on the same data set) but high compared to similar skeleton-based approaches (usually below 50%). Further we compare execution time of various parts of our system to highlight efficiency advantages of our method and its potential as a real-time recogniser if an optimized implementation can be done.

References

  1. Ball, A., Rye, D., Ramos, F., and Velonaki, M. (2012). Unsupervised clustering of people from skeleton data. In Human-Robot Interaction, Proc. of Seventh Annual ACM/IEEE International Conference on, pages 225- 226.
  2. BenAbdelkader, C., Cutler, R., Nanda, H., and Davis, L. (2001). Eigengait: motion-based recognition of people using image self-similarity. In Audioand Video-Based Biometric Person Authentication (AVBPA 2001). Lecture Notes in Computer Science. Proc. of 3rd International Conference on, volume 2091, pages 284-294.
  3. Bobick, A. F. and Johnson, A. Y. (2001). Gait recognition using static activity-specific parameters. In Computer Vision and Pattern Recognition (CVPR 2001). Proc. of 2001 IEEE Computer Society Conference on, volume 1, pages 423-430.
  4. Boulgouris, N. V. and Chi, Z. X. (2007). Gait recognition using radon transform and linear discriminant analysis. Image Processing, IEEE Transactions on, 16:731- 740.
  5. Brand, M. and Hertzmann, A. (2000). Style machines. In Computer Graphics and Interactive Techniques (SIGGRAPH 7800). Proc. of 27th Annual Conference on, pages 183-192.
  6. Bruderlin, A., Amaya, K., and Calvert, T. (1996). Emotion from motion. In Graphics Interface (GI 7896). Proc. of Conference on, pages 222-229.
  7. Bruderlin, A. and Williams, L. (1995). Motion signal processing. In Computer Graphics and Interactive Techniques (SIGGRAPH 7895). Proc. of 22nd Annual Conference on, pages 97-104.
  8. Chattopadhyay, P., Roy, A., Sural, S., and Mukhopadhyay, J. (2014). Pose depth volume extraction from rgb-d streams for frontal gait recognition. Journal of Visual Communication and Image Representation, 25:53-63.
  9. Davis, J. W. and Bobick, A. F. (1997). The representation and recognition of human movement using temporal templates. In Computer Vision and Pattern Recognition. Proc. of IEEE Computer Society Conference on, pages 928-934.
  10. Gabel, M., Gilad-Bachrach, R., Renshaw, E., and Schuster, A. (2012). Full body gait analysis with Kinect. In Engineering in Medicine and Biology Society (EMBC), Proc. of 2012 Annual International Conference of the IEEE, pages 349-361.
  11. Igual, L., Lapedriza, A., and Borras, R. (2013). Robust Gait-Based Gender Classification using Depth Cameras. Eurasip Journal On Image And Video Processing.
  12. Ioannidis, D., Tzovaras, D., Damousis, I. G., Argyropoulos, S., and Moustakas, K. (2007). Gait recognition using compact feature extraction transforms and depth information. Information Forensics and Security, IEEE Transactions on, 2:623-630.
  13. Isa, W. N. M., Sudirman, R., and Sh-Salleh, S. H. (2005). Angular features analysis for gait recognition. In Computers, Communications, & Signal Processing with Special Track on Biomedical Engineering (CCSP 2005). Proc. 1st International Conference on, pages 236-238.
  14. Jean, F., Albu, A. B., and Bergevin, R. (2009). Towards view-invariant gait modeling: Computing viewnormalized body part trajectories. Pattern Recognition, 42:2936-2949.
  15. Johansson, G. (1973). Visual perception of biological motion and a model for its analysis. Perception and Psychophysics, 14:201-211.
  16. Johansson, G. (1975). Visual motion perception. Scientific American, 232:76-88.
  17. Kellokumpu, V., Zhao, G., Li, S. Z., and Pietikinen, M. (2009). Dynamic texture based gait recognition. In Advances in Biometrics (ICB 2009). Lecture Notes in Computer Science. Proc. of 3rd International Conference on, volume 5558, pages 1000-1009.
  18. Müller, M. (2007). Dynamic Time Warping.
  19. O'Brien, J. F., Jr., R. E. B., Brostow., G. J., and Hodgins, J. K. (2000). Automatic joint parameter estimation from magnetic motion capture data. Graphics Interface. Proc. of Conference on, pages 53-60.
  20. Preis, J., Kessel, M., Werner, M., and Linnhoff-Popien, C. (2012). Gait recognition with kinect. In Kinect in Pervasive Computing, Proc. of the First Workshop on.
  21. Ran, Y., Weiss, I., Zheng, Q., and Davis, L. S. (2007). Pedestrian detection via periodic motion analysis. International Journal of Computer Vision, 71:143-160.
  22. Roy, A., Sural, S., and Mukhopadhyay, J. (2012). Gait recognition using pose kinematics and pose energy image. Signal Processing, 92:780-792.
  23. Silaghi, M.-C., Plänkers, R., Boulic, R., Fua, P., and Thalmann, D. (1998). Local and global skeleton fitting techniques for optical motion capture. In Modelling and Motion Capture Techniques for Virtual Environments (CAPTECH 7898). Proc. of International Workshop on, pages 26-40.
  24. Sinha, A., Chakravarty, K., and Bhowmick, B. (2013). Person identification using skeleton information from kinect. In Advances in Computer-Human Interaction (ACHI 2013), Proc. 6th International Conference on, pages 101-108.
  25. Stone, E. and Skubic, M. (2011). Evaluation of an inexpensive depth camera for in-home gait assessment. Journal of Ambient Intelligence and Smart Environments, 3:349-361.
  26. Sudarsky, S. and House, D. (2000). An Integrated Approach towards the Representation, Manipulation and Reuse of Pre-recorded Motion. In Computer Animation (CA 7800). Proc. of Conference, pages 56-61.
  27. Tanawongsuwan, R. and Bobick, A. (2001). Gait Recognition from Time-normalized Joint-angle Trajectories in the Walking Plane. In Computer Vision and Pattern Recognition (CVPR 2001), Proc. of 2001 IEEE Computer Society Conference on, pages 726-731.
  28. Wang, L., Tan, T., Hu, W., and Ning, H. (2003). Automatic gait recognition based on statistical shape analysis. Image Processing, IEEE Transactions on, 12:1120- 1131.
Download


Paper Citation


in Harvard Style

Mallick T., Khedia A., Das P. and Majumdar A. (2016). Fast Gait Recognition from Kinect Skeletons . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 340-347. DOI: 10.5220/0005713903400347


in Bibtex Style

@conference{visapp16,
author={Tanwi Mallick and Ankit Khedia and Partha Pratim Das and Arun Kumar Majumdar},
title={Fast Gait Recognition from Kinect Skeletons},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={340-347},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005713903400347},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)
TI - Fast Gait Recognition from Kinect Skeletons
SN - 978-989-758-175-5
AU - Mallick T.
AU - Khedia A.
AU - Das P.
AU - Majumdar A.
PY - 2016
SP - 340
EP - 347
DO - 10.5220/0005713903400347