SELECTION OF MULTIPLE CLASSIFIERS WITH NO PRIOR LIMIT TO THE NUMBER OF CLASSIFIERS BY MINIMIZING THE CONDITIONAL ENTROPY

Hee-Joong Kang

2009

Abstract

In addition to a study on how to combine multiple classifiers in multiple classifier systems, recently a study on how to select multiple classifiers from a classifier pool has been investigated, because the performance of multiple classifier systems depends on the selected classifiers as well as a combination method. Previous studies on the selection of multiple classifiers select a classifier set based on the assumption that the number of selected classifiers is fixed in advance, or based on the clustering followed the diversity criteria of classifiers in the classifier overproduce and choose paradigm. In this paper, by minimizing the conditional entropy which is the upper bound of Bayes error rate, a new selection method is considered and devised with no prior limit to the number of classifiers, as illustrated in examples.

References

  1. Ho, T. K. (2002). Chapter 7 Multiple Classifier Combination: Lessons and Next Steps. In Bunke, H. and Kandel, A., editors, Hybrid Methods in Pattern Recognition, pages 171-198. World Scientific.
  2. Kang, H.-J. (2005). Selection of Classifiers using Information-Theoretic Criteria. Lecture Notes in Computer Science, 3686:478-487.
  3. Kang, H.-J. and Lee, S.-W. (1999). Combining Classifiers based on Minimization of a Bayes Error Rate. In Proc. of the 5th ICDAR, pages 398-401.
  4. Kittler, J., Hatef, M., Duin, R. P. W., and Matas, J. (1998). On Combining Classifiers. IEEE Trans. on Pattern Analysis and Machine Intelligence, 20(3):226-239.
  5. Roli, F. and Giacinto, G. (2002). Chapter 8 Design of Multiple Classifier Systems. In Bunke, H. and Kandel, A., editors, Hybrid Methods in Pattern Recognition, pages 199-226. World Scientific.
  6. Saerens, M. and Fouss, F. (2004). Yet Another Method for Combining Classifiers Outputs: A Maximum Entropy Approach. Lecture Notes in Computer Science, 3077:82-91.
  7. Woods, K., Kegelmeyer Jr., W. P., and Bowyer, K. (1997). Combinition of Multiple Classifiers Using Local Accuracy Estimates. IEEE Trans. on Pattern Analysis and Machine Intelligence, 19(4):405-410.
Download


Paper Citation


in Harvard Style

Kang H. (2009). SELECTION OF MULTIPLE CLASSIFIERS WITH NO PRIOR LIMIT TO THE NUMBER OF CLASSIFIERS BY MINIMIZING THE CONDITIONAL ENTROPY . In Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2009) ISBN 978-989-8111-69-2, pages 356-361. DOI: 10.5220/0001799103560361


in Bibtex Style

@conference{visapp09,
author={Hee-Joong Kang},
title={SELECTION OF MULTIPLE CLASSIFIERS WITH NO PRIOR LIMIT TO THE NUMBER OF CLASSIFIERS BY MINIMIZING THE CONDITIONAL ENTROPY},
booktitle={Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2009)},
year={2009},
pages={356-361},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001799103560361},
isbn={978-989-8111-69-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2009)
TI - SELECTION OF MULTIPLE CLASSIFIERS WITH NO PRIOR LIMIT TO THE NUMBER OF CLASSIFIERS BY MINIMIZING THE CONDITIONAL ENTROPY
SN - 978-989-8111-69-2
AU - Kang H.
PY - 2009
SP - 356
EP - 361
DO - 10.5220/0001799103560361