Video-to-video Pose and Expression Invariant Face Recognition using Volumetric Directional Pattern

Vijayan Asari, Almabrok E. Essa

2015

Abstract

Face recognition in video has attracted attention as a cryptic method of human identification in surveillance systems. In this paper, we propose an end-to-end video face recognition system, addressing a difficult problem of identifying human faces in video due to the presence of large variations in facial pose and expression, and poor video resolution. The proposed descriptor, named Volumetric Directional Pattern (VDP), is an oriented and multi-scale volumetric descriptor that is able to extract and fuse the information of multi frames, temporal (dynamic) information, and multiple poses and expressions of faces in input video to produce feature vectors, which are used to match with all the videos in the database. To make the approach computationally simple and easy to extend, key-frame extraction method is employed. Therefore, only the frames which contain important information of the video can be used for further processing instead of analysing all the frames in the video. The performance evaluation of the proposed VDP algorithm is conducted on a publicly available database (YouTube celebrities’ dataset) and observed promising recognition rates.

References

  1. G. Shakhnarovich, J. Fisher, and T. Darrell, 2002. Face recognition from long-term observations. Computer Vision ECCV.
  2. X. Liu and T. Chen, 2003. Video-based face recognition using adaptive hidden markov models. In Computer Vision and Pattern Recognition. IEEE Computer Society Conference.
  3. K. C. Lee, J. Ho, M.H. Yang and D. Kriegman, 2003. Video-based face recognition using probabilistic appearance manifolds. In Computer Vision and Pattern Recognition. Proceedings. IEEE Computer Society Conference.
  4. G. Aggarwal, A. K. R. Chowdhury and R. Chellappa, 2004. A system identification approach for video-based face recognition. In Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04). IEEE Computer Society.
  5. O. Arandjelovíc and R. Cipolla, 2009. A pose-wise linear illumination manifold model for face recognition using video. Computer vision and image understanding, 113(1).
  6. M. Nishiyama, O. Yamaguchi and K. Fukui2005. Face recognition with the multiple constrained mutual subspace method. In audio-and video-based biometric person authentication. Springer.
  7. J. Li, Y. Wang, and T. Tan, 2005. Video-based face recognition using a metric of average euclidean distance. Advances in biometric person authentication.
  8. J. Suneetha, 2014. A survey on video-based face recognition approaches. International journal of application or innovation in engineering & management, 3(2), (IJAIEM).
  9. Z. Zhang, Chao Wang and Yunhong Wang, 2011. VideoBased Face Recognition: State of the Art, Lecture Notes in Computer Science: Biometric Recognition, (CCBR).
  10. L. Best-Rowden, B. Klare, J. Klontz, and A. Jain, 2013. Video-to-Video face matching: Establishing a baseline for unconstrained face recognition. Sixth Int. Conference on biom. Compe. IEEE, (BTAS).
  11. S. A. Patil and Paramod j Deore, 2012. Video-based face recognition: a survey. Proceedings of Conference on Advances in Communication and Computing (NCACC'12).
  12. K. Khurana and B. Chandak, 2013. Key frame extraction methodology for video annotation. International journal of computer engineering & Technology, 4(2), (IJCET).
  13. G. Liu, and J. Zhao, 2009. Key frame extraction from MPEG video stream. Proceedings of the second symposium international computer science and computational technology (ISCSCT'09).
  14. T. Jabid, M. H. Kabir, and O. S. Chae, 2010. Local directional pattern (LDP) for face recognition. Proc. IEEE Int. Conference of Consumer Electronics.
  15. T. Jabid, M. H. Kabir, and O. S. Chae, 2010. Robust facial expression recognition based on local directional pattern. ETRI Journal 32(5).
  16. D.J. Kim, S.H. Lee, and M.K. Sohn, 2013. Face recognition via local directional pattern. International Journal of Security and Its Applications. Papers 7(2).
  17. M. Yang, P. Zhu, L. V. Gool, L. Zhang, 2013. Face recognition based on regularized nearest points between image sets. In IEEE FG.
  18. M. Kim, S. Kumar, V. Pavlovic and H. Rowley, 2008. Face tracking and recognition with visual constraints in realworld videos. In Proc. CVPR.
  19. P. Viola and M. J. Jones, 2004. Robust real-time face detection. Int. journal of computer vision, 57(2).
Download


Paper Citation


in Harvard Style

Asari V. and Essa A. (2015). Video-to-video Pose and Expression Invariant Face Recognition using Volumetric Directional Pattern . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-090-1, pages 498-503. DOI: 10.5220/0005353604980503


in Bibtex Style

@conference{visapp15,
author={Vijayan Asari and Almabrok E. Essa},
title={Video-to-video Pose and Expression Invariant Face Recognition using Volumetric Directional Pattern},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={498-503},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005353604980503},
isbn={978-989-758-090-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015)
TI - Video-to-video Pose and Expression Invariant Face Recognition using Volumetric Directional Pattern
SN - 978-989-758-090-1
AU - Asari V.
AU - Essa A.
PY - 2015
SP - 498
EP - 503
DO - 10.5220/0005353604980503