# Unsupervised Learning of a Finite Discrete Mixture Model Based on the Multinomial Dirichlet Distribution: Application to Texture Modeling

### Nizar Bouguila, Djemel Ziou

#### Abstract

This paper presents a new finite mixture model based on the Multinomial Dirichlet distribution (MDD). For the estimation of the parameters of this mixture we propose an unsupervised algorithm based on the Maximum Likelihood (ML) and Fisher scoring methods. This mixture is used to produce a new texture model. Experimental results concern texture images summarizing and are reported on the Vistex texture image database from the MIT Media Lab.

#### References

- M. Tuceryan and A. K. Jain, Texture Analysis, The Handbook of Pattern Recognition and Computer Vision, pp. 207-248, 1998.
- R. M. Haralick, K. Shanmugan, and I. Dinstein Textural features for image classification, IEEE Transactions on Systems, Man and Cybernetics, vol. 8, pp. 610-621, 1973.
- M. Unser, Sum and Difference Histograms for Texture Classification, IEEE Transactions on Pattern Recognition and Machine Intelligence, vol. 8, No. 1, pp. 118-125, 1986.
- N. Bouguila, D. Ziou and J. Vaillancourt, Novel Mixtures Based on the Dirichlet Distribution: Application to Data and Image Classification , IAPR International Conference on Machine Learning and Data Mining, lNCS2734, pp. 172-181, 2003.
- R. A. Redner and H. F. Walker, Mixture Densities, Maximum Likelihood and EM Algorithm , SIAM Review, vol. 26, No. 2, pp. 195-239, 1984.
- A. P. Dempster, N. M. Laird and D. B. Rubin, Maximum Likelihood from Incomplete Data via the EM Algorithm , Journal of the Royal Statistical Society, B, vol. 39, pp. 1-38, 1977.
- G. Schwarz, Estimating the Dimension of a Model , The Annals of Statistics, vol. 6, No. 2, pp. 461-464, 1978.
- H. Akaike, A New Look at the Statistical Model Identification , IEEE Transactions on Automatic Control, vol. AC-19, No. 6, pp. 716-723, 1974.
- J. Rissanen, Modeling by Shortest Data Description , Biometrika, vol. 14, pp. 465-471, 1978.
- S. Medasani and R. Krishnapuram, Categorization of Image Databases for Efficient Retrieval Using Robust Mixture Decomposition, Computer Vision and Image Understanding, vol. 83, pp. 216-235, 2001.
- C. R. Rao, Advanced Statistical Methods in Biomedical Research, New York: John Wiley and Sons, 1952
- N. Bouguila, D. Ziou and J. Vaillancourt, Probabilistic Multimedia Summarizing Based on the Generalized Dirichlet Mixture, Supplementary Proceedings of ICANN/ICONIP 2003, pp 150-154, 2003.
- J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms, Plenum Press, New York, 1981.
- A. E. Raftery and J. D. Banfield, Model-Based Gaussian and Non-Gaussian Clustering Biometrics, vol. 49, pp. 803-821, 1993.

#### Paper Citation

#### in Harvard Style

Bouguila N. and Ziou D. (2004). **Unsupervised Learning of a Finite Discrete Mixture Model Based on the Multinomial Dirichlet Distribution: Application to Texture Modeling** . In *Proceedings of the 4th International Workshop on Pattern Recognition in Information Systems - Volume 1: PRIS, (ICEIS 2004)* ISBN 972-8865-01-5, pages 118-127. DOI: 10.5220/0002658601180127

#### in Bibtex Style

@conference{pris04,

author={Nizar Bouguila and Djemel Ziou},

title={Unsupervised Learning of a Finite Discrete Mixture Model Based on the Multinomial Dirichlet Distribution: Application to Texture Modeling},

booktitle={Proceedings of the 4th International Workshop on Pattern Recognition in Information Systems - Volume 1: PRIS, (ICEIS 2004)},

year={2004},

pages={118-127},

publisher={SciTePress},

organization={INSTICC},

doi={10.5220/0002658601180127},

isbn={972-8865-01-5},

}

#### in EndNote Style

TY - CONF

JO - Proceedings of the 4th International Workshop on Pattern Recognition in Information Systems - Volume 1: PRIS, (ICEIS 2004)

TI - Unsupervised Learning of a Finite Discrete Mixture Model Based on the Multinomial Dirichlet Distribution: Application to Texture Modeling

SN - 972-8865-01-5

AU - Bouguila N.

AU - Ziou D.

PY - 2004

SP - 118

EP - 127

DO - 10.5220/0002658601180127