Regularized Latent Least Squares Regression for Unconstrained Still-to-Video Face Recognition

Haoyu Wang, Changsong Liu, Xiaoqing Ding

2015

Abstract

In this paper, we present a novel method for the still-to-video face recognition problem in unconstrained environments. Due to variations in head pose, facial expression, lighting condition and image resolution, it is infeasible to directly matching faces from still images and video frames. We regard samples from these two distinct sources as multi-modal or heterogeneous data, and use latent identity vectors in a common subspace to connect two modalities. Differed from the conventional least squares regression problem, unknown latent variables are treated as response to be computed. Besides, several constraint and regularization terms are introduced into the optimization equation. This method is thus called regularized latent least squares regression. We divide the original problem into two sub-problems and develop an alternating optimization algorithm to solve it. Experimental results on two public datasets demonstrate the effectiveness of our method.

References

  1. Belhumeur, P. N., Hespanha, J. P., and Kriegman, D. (1997). Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection. IEEE Trans. Pattern Analysis and Machine Intelligence, 19(7):711-720.
  2. Cevikalp, H. and Triggs, B. (2010). Face recognition based on image sets. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pages 2567- 2573. IEEE.
  3. He, X., Cai, D., Yan, S., and Zhang, H.-J. (2005a). Neighborhood preserving embedding. In Proc. 10th IEEE International Conference on Computer Vision, volume 2, pages 1208-1213. IEEE.
  4. He, X., Yan, S., Hu, Y., Niyogi, P., and Zhang, H.- J. (2005b). Face recognition using Laplacianfaces. IEEE Trans. Pattern Analysis and Machine Intelligence, 27(3):328-340.
  5. Hu, Y., Mian, A. S., and Owens, R. (2012). Face recognition using sparse approximated nearest points between image sets. IEEE Trans. Pattern Analysis and Machine Intelligence, 34(10):1992-2004.
  6. Huang, Z., Shan, S., Zhang, H., Lao, S., Kuerban, A., and Chen, X. (2012). Benchmarking still-to-video face recognition via partial and local linear discriminant analysis on COX-S2V dataset. In Proc. 11th Asian Conference on Computer Vision, Volume Part II, pages 589-600. Springer-Verlag.
  7. Kan, M., Shan, S., Zhang, H., Lao, S., and Chen, X. (2012). Multi-view discriminant analysis. In Proc. 12th European Conference on Computer Vision, Volume Part I, pages 808-821. Springer-Verlag.
  8. Klare, B. F., Li, Z., and Jain, A. K. (2011). Matching forensic sketches to mug shot photos. IEEE Trans. Pattern Analysis and Machine Intelligence, 33(3):639-646.
  9. Lei, Z. and Li, S. Z. (2009). Coupled spectral regression for matching heterogeneous faces. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pages 1123-1128. IEEE.
  10. Lei, Z., Liao, S., Jain, A. K., and Li, S. Z. (2012). Coupled discriminant analysis for heterogeneous face recognition. IEEE Trans. Information Forensics and Security, 7(6):1707-1716.
  11. Liao, S., Yi, D., Lei, Z., Qin, R., and Li, S. (2009). Heterogeneous face recognition from local structures of normalized appearance. In Proc. International Conference on Advances in Biometrics, pages 209-218. Springer-Verlag.
  12. Liu, Q., Tang, X., Jin, H., Lu, H., and Ma, S. (2005). A nonlinear approach for face sketch synthesis and recognition. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, volume 1, pages 1005-1010. IEEE.
  13. Lowe, D. G. (1999). Object recognition from local scaleinvariant features. In Proc. IEEE International Conference on Computer Vision, volume 2, pages 1150- 1157. IEEE.
  14. Sharma, A. and Jacobs, D. W. (2011). Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pages 593-600. IEEE.
  15. Tang, X. and Wang, X. (2003). Face sketch synthesis and recognition. In Proc. 9th IEEE International Conference on Computer Vision, pages 687-694. IEEE.
  16. Tao, D., Li, X., Wu, X., and Maybank, S. J. (2007). General tensor discriminant analysis and gabor features for gait recognition. IEEE Trans. Pattern Analysis and Machine Intelligence, 29(10):1700-1715.
  17. Tao, D., Li, X., Wu, X., and Maybank, S. J. (2009). Geometric mean for subspace selection. IEEE Trans. Pattern Analysis and Machine Intelligence, 31(2):260- 274.
  18. Turk, M. A. and Pentland, A. P. (1991). Face recognition using Eigenfaces. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 586-591. IEEE.
  19. Wang, R., Shan, S., Chen, X., Dai, Q., and Gao, W. (2012a). Manifold-manifold distance and its application to face recognition with image sets. IEEE Trans. Image Processing, 21(10):4466-4479.
  20. Wang, S., Zhang, D., Liang, Y., and Pan, Q. (2012b). Semicoupled dictionary learning with applications to image super-resolution and photo-sketch synthesis. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pages 2216-2223. IEEE.
  21. Wang, X. and Tang, X. (2009). Face photo-sketch synthesis and recognition. IEEE Trans. Pattern Analysis and Machine Intelligence, 31(11):1955-1967.
  22. Wong, Y., Chen, S., Mau, S., Sanderson, C., and Lovell, B. C. (2011). Patch-based probabilistic image quality assessment for face selection and improved videobased face recognition. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pages 74-81. IEEE.
  23. Yan, S., Xu, D., Zhang, B., Zhang, H.-J., Yang, Q., and Lin, S. (2007). Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans. Pattern Analysis and Machine Intelligence, 29(1):40- 51.
  24. Yang, J. and Liu, C. (2007). Horizontal and vertical 2DPCA-based discriminant analysis for face verification on a large-scale database. IEEE Trans. Information Forensics and Security, 2(4):781-792.
  25. Yang, M., Zhu, P., Van Gool, L., and Zhang, L. (2013). Face recognition based on regularized nearest points between image sets. In Proc. 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, pages 1-7. IEEE.
  26. Yi, D., Liu, R., Chu, R., Lei, Z., and Li, S. Z. (2007). Face matching between near infrared and visible light images. In Proc. International Conference on Advances in Biometrics, pages 523-530. Springer-Verlag.
  27. Zhang, W., Wang, X., and Tang, X. (2011). Coupled information-theoretic encoding for face photo-sketch recognition. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pages 513-520. IEEE.
Download


Paper Citation


in Harvard Style

Wang H., Liu C. and Ding X. (2015). Regularized Latent Least Squares Regression for Unconstrained Still-to-Video Face Recognition . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-090-1, pages 13-20. DOI: 10.5220/0005267300130020


in Bibtex Style

@conference{visapp15,
author={Haoyu Wang and Changsong Liu and Xiaoqing Ding},
title={Regularized Latent Least Squares Regression for Unconstrained Still-to-Video Face Recognition},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={13-20},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005267300130020},
isbn={978-989-758-090-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015)
TI - Regularized Latent Least Squares Regression for Unconstrained Still-to-Video Face Recognition
SN - 978-989-758-090-1
AU - Wang H.
AU - Liu C.
AU - Ding X.
PY - 2015
SP - 13
EP - 20
DO - 10.5220/0005267300130020