Point-wise Diversity Measure and Visualization for Ensemble of Classifiers - With Application to Image Segmentation

Ahmed Al-Taie, Horst K. Hahn, Lars Linsen

2015

Abstract

The idea of using ensembles of classifiers is to increase the performance when compared to applying a single classifier. Crucial to the performance improvement is the diversity of the ensemble. A classifier ensemble is considered to be diverse, if the classifiers make no coinciding errors. Several studies discuss the diversity issue and its relation to the ensemble accuracy. Most of them proposed measures that are based on an ”Oracle” classification. In this paper, we propose a new probability-based diversity measure for ensembles of unsupervised classifiers, i.e., when no Oracle machine exists. Our measure uses a point-wise definition of diversity, which allows for a distinction of diverse and non-diverse areas. Moreover, we introduce the concept of further categorizing the diverse areas into healthy and unhealthy diversity areas. A diversity area is healthy for the ensemble performance, if there is enough redundancy to compensate for the errors. Then, the performance of the ensemble can be based on two parameters, the non-diversity area, i.e., the size of all regions where the classifiers of the ensemble agree, and the healthy diversity area, i.e., the size of the regions where the diversity is healthy. Furthermore, our point-wise diversity measure allows for an intuitive visualization of the ensemble diversity for visual ensemble performance comparison in the context of image segmentation.

References

  1. Chen S., Zhang D. (2004). Robust image segmentation using fcm with spatial constraints based on new kernelinduced distance metric. IEEE Trans. on System, Man and Cybernetics-Part B, 34(4):1907-1916.
  2. Ahmed, M. N., Yamany, S. M., Mohamed, N., Farag, A. A., and Moriarty, T. (2002). A modified fuzzy c-means algorithm for bias field estimation and segmentation of mri data. IEEE Transactions on Medical Imaging, 21(3):193-199.
  3. Artaechevarria, X., Muoz-Barrutia, A., and de Solorzano, C. O. (2009). Combination strategies in multi-atlas image segmentation: Application to brain mr data. IEEE Transactions Medical Imaging, 28(8):1266- 1277.
  4. Bezdek, J. (1981). Pattern recognition with fuzzy objective function algorithms. Plenum, NY.
  5. Chuang, K.-S., Tzeng, H.-L., Chen, S., Wu, J., and Chen, T.-J. (2006). Fuzzy c-means clustering with spatial information for image segmentation. Computerized Medical Imaging and Graphics, 30(1):9 - 15.
  6. Dietterich, T. G. (2000). Ensemble methods in machine learning. In Proceedings of the First International Workshop on Multiple Classifier Systems, pages 1-15, London, UK, UK. Springer-Verlag.
  7. Fred, A. and Jain, A. (2005). Combining multiple clusterings using evidence accumulation. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 27(6):835-850.
  8. Kittler, J., Hatef, M., Duin, R. P. W., and Matas, J. (1998). On combining classifiers. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 20(3):226- 239.
  9. Kuncheva, L. I. (2004). Combining Pattern Classifiers: Methods and Algorithms. Wiley-Interscience.
  10. Kuncheva, L. I. and Whitaker, C. J. (2003). Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Machine Learning, 51(2):181-207.
  11. Langerak, R., van der Heide, U. A., Kotte, A. N. T. J., Viergever, M. A., van Vulpen, M., and Pluim, J. P. W. (2010). Label fusion in atlas-based segmentation using a selective and iterative method for performance level estimation (simple). IEEE Transactions Medical Imaging, 29(12):2000-2008.
  12. Li, C. and Xu, C. and Anderson, A. and Gore, J. (2009). Mri tissue classification and bias field estimation based on coherent local intensity clustering: A unified energy minimization framework. In Information Processing in Medical Imaging, volume 5636 of Lecture Notes in Computer Science, pages 288-299. Springer Berlin Heidelberg.
  13. Masisi, L. M., Nelwamondo, F. V., and Marwala, T. (2008). The use of entropy to measure structural diversity. CoRR, abs/0810.3525.
  14. Mignotte, M. (2010). A label field fusion bayesian model and its penalized maximum rand estimator for image segmentation. IEEE Transactions on Image Processing, 19(6):1610-1624.
  15. MNI (1997). Brainweb, simulated brain database, available since 1997. Available at http://www.bic.mni.mcgill.ca/brainweb/, access time: on November 2012.
  16. Mohamed, N., Ahmed, M., and Farag, A. (1999). Modified fuzzy c-mean in medical image segmentation. In Proceedings IEEE International Conference on Acoustics, Speeeh, and Signal Processing, 1999, Piscataway, NI USA, volume 6, pages 3429-3432 vol.6.
  17. Paci, M., Nanni, L., and Severi, S. (2013). An ensemble of classifiers based on different texture descriptors for texture classification. Journal of King Saud University - Science, 25(3):235 - 244.
  18. Rohlfing, T. and Maurer, C. R. J. (2005). Multi-classifier framework for atlas-based image segmentation. Pattern Recognition Letters, 26(13):2070 - 2079.
  19. Sharkey, A. J. C. (1999). Combining artificial neural nets: ensemble and modular multi-net systems. SpringerVerlag, New York.
  20. Sirlantzis, K., Hoque, S., and Fairhurst, M. (2008). Diversity in multiple classifier ensembles based on binary feature quantisation with application to face recognition. Applied Soft Computing, 8(1):437 - 445.
  21. Tolias, Y. and Panas, S. (1998). On applying spatial constraints in fuzzy image clustering using a fuzzy rule-based system. Signal Processing Letters, IEEE, 5(10):245-247.
  22. Yuan, K., Wu, L., Cheng, Q., Bao, S., Chen, C., and Zhang, H. (2005). A novel fuzzy c-means algorithm and its application. International Journal of Pattern Recognition and Artificial Intelligence, 19(8):1059-1066.
  23. Zhang, D. and Chen, S. (2004). A novel kernelised fuzzy c-means algorithm with application in medical image segmentation. Artificial Intelligence in Medicine, 32(1):37-50.
Download


Paper Citation


in Harvard Style

Al-Taie A., Hahn H. and Linsen L. (2015). Point-wise Diversity Measure and Visualization for Ensemble of Classifiers - With Application to Image Segmentation . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-089-5, pages 569-576. DOI: 10.5220/0005309605690576


in Bibtex Style

@conference{visapp15,
author={Ahmed Al-Taie and Horst K. Hahn and Lars Linsen},
title={Point-wise Diversity Measure and Visualization for Ensemble of Classifiers - With Application to Image Segmentation},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={569-576},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005309605690576},
isbn={978-989-758-089-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)
TI - Point-wise Diversity Measure and Visualization for Ensemble of Classifiers - With Application to Image Segmentation
SN - 978-989-758-089-5
AU - Al-Taie A.
AU - Hahn H.
AU - Linsen L.
PY - 2015
SP - 569
EP - 576
DO - 10.5220/0005309605690576