A KERNEL MAXIMUM UNCERTAINTY DISCRIMINANT ANALYSIS AND ITS APPLICATION TO FACE RECOGNITION

Carlos Eduardo Thomaz, Gilson Antonio Giraldi

2009

Abstract

In this paper, we extend the Maximum uncertainty Linear Discriminant Analysis (MLDA), proposed recently for limited sample size problems, to its kernel version. The new Kernel Maximum uncertainty Discriminant Analysis (KMDA) is a two-stage method composed of Kernel Principal Component Analysis (KPCA) followed by the standard MLDA. In order to evaluate its effectiveness, experiments on face recognition using the well-known ORL and FERET face databases were carried out and compared with other existing kernel discriminant methods, such as Generalized Discriminant Analysis (GDA) and Regularized Kernel Discriminant Analysis (RKDA). The classification results indicate that KMDA performs as well as GDA and RKDA, with the advantage of being a straightforward stabilization approach for the within-class scatter matrix that uses higher-order features for further classification improvements.

References

  1. Baudat, G. and Anouar, F. (2000). Generalized discriminant analysis using a kernel approach. Neural Computation, 12(10):2385-2404.
  2. Belhumeur, P. N., Hespanha, J. P., and Kriegman, D. J. (1997). Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):711-720.
  3. Chen, L., Liao, H., Ko, M., Lin, J., and Yu, G. (2000). A new lda-based face recognition system which can solve the small sample size problem. Pattern Recognition, 33(10):1713-1726.
  4. Devijver, P. and Kittler, J. (1982). Pattern Classification: A Statistical Approach. Prentice-Hall.
  5. Fukunaga, K. (1990). Introduction to Statistical Pattern Recognition. Morgan Kaufmann, San Francisco, 2nd edition.
  6. Lu, J., Plataniotis, K. N., and Venetsanopoulos, A. N. (2003). Face recognition using kernel direct discriminant analysis algorithms. IEEE Transactions on Neural Networks, 14(1):117-126.
  7. Park, C. H. and Park, H. (2005). Nonlinear discriminant analysis using kernel functions and the generalized singular value decomposition. SIAM J. Matrix Anal. Appl., 27(1):87-102.
  8. Phillips, P. J., Wechsler, H., Huang, J., and Rauss, P. (1998). The feret database and evaluation procedure for face recognition algorithms. Image and Vision Computing, 16:295-306.
  9. Samaria, F. and Harter, A. (1994). Parameterisation of a stochastic model for human face identification. In Proceedings of 2nd IEEE Workshop on Applications of Computer Vision.
  10. Scholkopf, B., Smola, A., and Muller, K.-R. (1998). Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10(5):1299-1319.
  11. Swets, D. L. and Weng, J. J. (1996). Using discriminant eigenfeatures for image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(8):831-836.
  12. Thomaz, C. E., Gillies, D. F., and Feitosa, R. Q. (2004). A new covariance estimate for bayesian classifiers in biometric recognition. IEEE Transactions on Circuits and Systems for Video Technology, Special Issue on Image- and Video-Based Biometrics, 14(2):214-223.
  13. Thomaz, C. E., Kitani, E. C., and Gillies, D. F. (2006). A maximum uncertainty lda-based approach for limited sample size problems - with application to face recognition. Journal of the Brazilian Computer Society, 12(2):7-18.
  14. Yang, J., Jin, Z., yu Yang, J., Zhang, D., and Frangi, A. F. (2004). Essence of kernel fisher discriminant: Kpca plus lda. Pattern Recognition, 37:2097-2100.
  15. Yang, J. and Yang, J. (2003). Why can lda be performed in pca transformed space? Pattern Recognition, 36:563- 566.
  16. Yu, H. and Yang, J. (2001). A direct lda algorithm for high dimensional data - with application to face recognition. Pattern Recognition, 34:2067-2070.
  17. Zheng, W., Zou, C., and Zhao, L. (2005). An improved algorithm for kernel principal component analysis. Neural Process. Lett., 22(1):49-56.
Download


Paper Citation


in Harvard Style

Eduardo Thomaz C. and Antonio Giraldi G. (2009). A KERNEL MAXIMUM UNCERTAINTY DISCRIMINANT ANALYSIS AND ITS APPLICATION TO FACE RECOGNITION . In Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009) ISBN 978-989-8111-69-2, pages 341-346. DOI: 10.5220/0001791003410346


in Bibtex Style

@conference{visapp09,
author={Carlos Eduardo Thomaz and Gilson Antonio Giraldi},
title={A KERNEL MAXIMUM UNCERTAINTY DISCRIMINANT ANALYSIS AND ITS APPLICATION TO FACE RECOGNITION},
booktitle={Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009)},
year={2009},
pages={341-346},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001791003410346},
isbn={978-989-8111-69-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009)
TI - A KERNEL MAXIMUM UNCERTAINTY DISCRIMINANT ANALYSIS AND ITS APPLICATION TO FACE RECOGNITION
SN - 978-989-8111-69-2
AU - Eduardo Thomaz C.
AU - Antonio Giraldi G.
PY - 2009
SP - 341
EP - 346
DO - 10.5220/0001791003410346