GENERATIVE EMBEDDINGS BASED ON RICIAN MIXTURES - Application to Kernel-based Discriminative Classification of Magnetic Resonance Images

Anna C. Carli, Mario A. T. Figueiredo, Manuele Bicego, Vittorio Murino

2012

Abstract

Most approaches to classifier learning for structured objects (such as images or sequences) are based on probabilistic generative models. On the other hand, state-of-the-art classifiers for vectorial data are learned discriminatively. In recent years, these two dual paradigms have been combined via the use of generative embeddings (of which the Fisher kernel is arguably the best known example); these embeddings are mappings from the object space into a fixed dimensional score space, induced by a generative model learned from data, on which a (maybe kernel-based) discriminative approach can then be used. This paper proposes a new semi-parametric approach to build generative embeddings for classification of magnetic resonance images (MRI). Based on the fact that MRI data is well described by Rice distributions, we propose to use Rician mixtures as the underlying generative model, based on which several different generative embeddings are built. These embeddings yield vectorial representations on which kernel-based support vector machines (SVM) can be trained for classification. Concerning the choice of kernel, we adopt the recently proposed nonextensive information theoretic kernels. The methodology proposed was tested on a challenging classification task, which consists in classifying MRI images as belonging to schizophrenic or non-schizophrenic human subjects. The classification is based on a set of regions of interest (ROIs) in each image, with the classifiers corresponding to each ROI being combined via boosting. The experimental results show that the proposed methodology outperforms the previous state-of-the-art methods on the same dataset.

References

  1. Abramowitz, M. and Stegun, I. (1972). Handbook of Mathematical Functions. Dover, New York.
  2. Bosch, A., Zisserman, A., and Munoz, X. (2006). Scene classification via plsa. In Proc. of ECCV.
  3. Burbea, J. and Rao, C. (1982). On the convexity of some divergence measures based on entropy functions. IEEE Trans. on Information Theory, 28(3):489-495.
  4. Cheng, D., Bicego, M., Castellani, U., Cerutti, S., Bellani, M., Rambaldelli, G., Atzori, M., Brambilla, P., and Murino, V. (2009a). Schizophrenia classification using regions of interest in brain MRI. In IDAMAP Workshop.
  5. Cheng, D., Bicego, M., Castellani, U., Cristani, M., Cerruti, S., Bellani, M., Rambaldelli, G., Aztori, M., Brambilla, P., and Murino, V. (2009b). A hybrid generative/discriminative method for classification of regions of interest in schizophrenia brain MRI. In MICCAI09 Workshop on Probabilistic Models for Medical Image Analysis.
  6. Cristianini, N. and Shawe-Taylor, J. (2000). An introduction to Support Vector Machines and other kernel-based learning methods. Cambridge University Press.
  7. Dempster, A., Laird, N., and Rubin, D. (1977). Maximum likelihood from incomplete data via the EM algorithm. Jour. the Royal Statistical Soc. (B), 39:1-38. State-of-the-art methods
  8. (Cheng et al., 2009a) 73.4
  9. (Ulas et al., 2011)
  10. Martins, A. F., Smith, N. A., Aguiar, P. M., and Figueiredo, M. A. T. (2009). Nonextensive information theoretic kernels on measures. Journal of Machine Learning Research, 10:935 - 975.
  11. Ng, A. and Jordan, M. (2002). On discriminative vs generative classifiers: A comparison of logistic regression and naive Bayes. In Neural Information Processing Systems - NIPS.
  12. Perina, A., Cristani, M., Castellani, U., Murino, V., and Jojic, N. (2009). A hybrid generative/discriminative classification framework based on free-energy terms. In Proc. Int. Conf. Computer Vision - ICCV, Kyoto.
  13. Rice, S. O. (1944). Mathematical analysis of random noise. Bell Systems Tech. J., 23:282-332.
  14. Rubinstein, Y. and Hastie, T. (1997). Discriminative vs informative learning. In Proc. 3rd Int. Conf. Knowledge Discovery and Data Mining, Newport Beach.
  15. Schölkopf, B. and Smola, A. J. (2002). Learning with Kernels. MIT Press.
  16. Suyari, H. (2004). Generalization of Shannon-Khinchin axioms to nonextensive systems and the uniqueness theorem for the nonextensive entropy. IEEE Trans. on Information Theory, 50(8):1783-1787.
  17. Ulas, A., Duin, R., Castellani, U., Loog, M., Bicego, M., Murino, V., Bellani, M., Cerruti, S., Tansella, M., and P.Brambilla (2010). Dissimilarity-based detection of schizophrenia. In ICPR 2010 workshop on Pattern Recognition Challenges in fMRI Neuroimaging.
  18. Ulas, A., Duin, R., Castellani, U., Loog, M., Mirtuono, P., Bicego, M., Murino, V., Bellani, M., Cerruti, S., Tansella, M., and P.Brambilla (2011). Dissimilaritybased detection of schizophrenia. Int. Journal of Imaging Systems and Technology.
  19. kind (Abramowitz and Stegun, 1972)
  20. 1 I (1 - t2)t-n-1
Download


Paper Citation


in Harvard Style

C. Carli A., A. T. Figueiredo M., Bicego M. and Murino V. (2012). GENERATIVE EMBEDDINGS BASED ON RICIAN MIXTURES - Application to Kernel-based Discriminative Classification of Magnetic Resonance Images . In Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-8425-98-0, pages 113-122


in Bibtex Style

@conference{icpram12,
author={Anna C. Carli and Mario A. T. Figueiredo and Manuele Bicego and Vittorio Murino},
title={GENERATIVE EMBEDDINGS BASED ON RICIAN MIXTURES - Application to Kernel-based Discriminative Classification of Magnetic Resonance Images},
booktitle={Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2012},
pages={113-122},
publisher={SciTePress},
organization={INSTICC},
doi={},
isbn={978-989-8425-98-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - GENERATIVE EMBEDDINGS BASED ON RICIAN MIXTURES - Application to Kernel-based Discriminative Classification of Magnetic Resonance Images
SN - 978-989-8425-98-0
AU - C. Carli A.
AU - A. T. Figueiredo M.
AU - Bicego M.
AU - Murino V.
PY - 2012
SP - 113
EP - 122
DO -