Improving Kernel Grower Methods using Ellipsoidal Support Vector Data Description

Sabra Hechmi, Alya Slimene, Ezzeddine Zagrouba

2014

Abstract

In these recent years, kernel methods have gained a considerable interest in many areas of machine learning. This work investigates the ability of kernel clustering methods to deal with one of the meaningful problem of computer vision namely image segmentation task. In this context, we propose a novel kernel method based on an Ellipsoidal Support Vector Data Description ESVDD. Experiments conducted on a selected synthetic data sets and on Berkeley image segmentation benchmark show that our approach significantly outperforms state-of-the-art kernel methods.

References

  1. Singh, K.K. and Singh, A. (2010). A Study of Image Segmentation Algorithms for Different Types of Images. In International Journal of Computer Science Issues, vol. 7, no. 5.
  2. Dehariya, V.K., Shrivastava, S.K. and Jain, R.C. (2010). Clustering of Image Data Set Using K-Means and Fuzzy K-Means Algorithms. In Computational Intelligence and Communication Networks, pp. 386-391.
  3. Filippone, M., Camastra, F., Masulli, F. and Rovetta, S. (2008). A survey of kernel and spectral methods for clustering. In Pattern Recognition, vol. 41, no. 1, pp. 176-190.
  4. Schlkopf, B. and Smola, A.J. (2002). Learning with Kernels. MIT Press Cambridge, MA, USA.
  5. Mercer, J. (1909). Functions of positive and negative type and their connection with the theory of integral equations. In Proceedings of the Royal Society of London, vol. 83, no. 559, pp. 69-70.
  6. Tzortzis, G.F. and Likas, A.C. (2009). The global kernel k-means algorithm for clustering in feature space. In IEEE Transactions on Neural Networks, vol. 20, no. 7, pp. 1181-1194.
  7. Kannan, S.R., Ramathilagam, S., Devi, R. and Sathya, A. (2011). Robust kernel FCM in segmentation of breast medical images. In Expert Systems with Applications, vol. 38, no. 4, pp. 4382-4389.
  8. Tax, D.M.J. and Duin, R.P.W. (2004). Support vector data description. In Machine Learning, vol. 54, no. 1, pp. 45-66.
  9. Camastra, F. and Verri, A. (2005). A novel kernel method for clustering. In IEEE transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 5, pp. 801- 805.
  10. Chang, L., Deng, X.M., Zheng, S.W. and Wang, Y.Q. (2008). Scaling up kernel grower clustering method for large data sets via core-sets. In Acta Automatica Sinica, vol. 34, no. 3, pp. 376-382.
  11. Slimene, A. and Zagrouba, E. (2011). A new PSO based kernel clustering method for image segmentation. In SITIS, Signal Image Technology and Internet Based Systems, pp. 350-357 .
  12. Park, J., Kang, D., Kim, J., Kwok, J.T. and Tsang, I.W. (2007). SVDD-Based Pattern Denoising. In Neural Computation, vol. 19, no. 7, pp.1919-1938.
  13. Lee, S.W. and Park, J. (2006). Low resolution face recognition based on support vector data description. In Pattern Recognition, vol. 39, no. 9, pp. 1809-1812.
  14. Banerjee, A., Burlina, P. and Meth, R. (2007). Fast Hyperspectral Anomaly Detection via SVDD. In IEEE International Conference on Image Processing, vol. 4, pp. 101-104.
  15. Chu, C.S., Tsang, I.W. and Kwok, J.T. (2004). Scaling up support vector data description by using core-sets. In IEEE International Joint Conference on Neural Networks, vol. 1, pp. 425-430.
  16. Kumar, P., Mitchell, J.S.B. and Yildirim, E.A. (2003). Approximate Minimum Enclosing Balls in High Dimensions Using Core-Sets. In Experimental Algorithmics, vol.8, no.1, pp. 1.
  17. Bishop, C. (1995). Neural Networks for Pattern Recognition. Oxford University Press, USA.
  18. Forghani, Y., Effati, S., Yazdi, H.S. and Tabrizi, R.S. (2011). Support vector data description by using hyper-ellipse instead of hyper-sphere. In International Conference on Computer and Knowledge Engineering, pp. 22-27.
  19. Platt, J.C., (1999). Fast training of support vector machines using sequential minimal optimization. In Advances in Kernel Methods: Support Vector Learning, pp. 185- 208.
  20. Keerthi, S.S. (2002). Convergence of a Generalized SMO Algorithm for SVM Classifier Design. In Machine Learning, vol. 46, pp. 351-360.
  21. Kumar, P. and Yildirim, E.A. (2005). Minimum-Volume Enclosing Ellipsoids and Core Sets. In Optimization theory and applications, vol. 126, no. 1, pp. 1-21.
  22. Frank, A. and Asuncion, A. (2010).
  23. Mldata, Machine Learning Data set Repository. (2009).
  24. Martin, D., Fowlkes, C., Tal, D. and Malik, J. (2001). A Database of Human Segmented Natural Images and Its Application to Evaluating Segmentation Algorithms and Measuring Ecological Statistics.
  25. Unnikrishnan, R., Pantofaru, C. and Hebert, M. (2007). Toward objective evaluation of image segmentation algorithms. IEEE Transactions on pattern analysis and machine intelligence, vol. 29, no. 6, pp. 929-944.
Download


Paper Citation


in Harvard Style

Hechmi S., Slimene A. and Zagrouba E. (2014). Improving Kernel Grower Methods using Ellipsoidal Support Vector Data Description . In Proceedings of the 3rd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-018-5, pages 343-349. DOI: 10.5220/0004923203430349


in Bibtex Style

@conference{icpram14,
author={Sabra Hechmi and Alya Slimene and Ezzeddine Zagrouba},
title={Improving Kernel Grower Methods using Ellipsoidal Support Vector Data Description},
booktitle={Proceedings of the 3rd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2014},
pages={343-349},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004923203430349},
isbn={978-989-758-018-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Improving Kernel Grower Methods using Ellipsoidal Support Vector Data Description
SN - 978-989-758-018-5
AU - Hechmi S.
AU - Slimene A.
AU - Zagrouba E.
PY - 2014
SP - 343
EP - 349
DO - 10.5220/0004923203430349