EXPERIMENTS ON SOLVING MULTICLASS RECOGNITION TASKS IN THE BIOLOGICAL AND MEDICAL DOMAINS

Paolo Soda

2008

Abstract

Multiclass learning problems can be cast as the task of assigning instances to a finite set of classes. Although in the wide variety of learning tools there exist some algorithms capable of handling polychotomies, many of the tools were designed by nature for dichotomies. In the literature, many techniques that decompose a polychotomy into a series of dichotomies have been proposed. One of the possible approaches, known as one-per-class, is based on a pool of binary modules, where each one distinguishes the elements of one class from those of the others. In this framework, we propose a novel reconstruction criterion, i.e. a rule that sets the final decision on the basis of the single binary classifications. It looks at the quality of the current input and, more specifically, it is a function of the reliability of each classification act provided by the binary modules. The approach has been tested on four biological and medical datasets and the achieved performance has been compared with the one previously reported in the literature, showing that the method improves the accuracies so far.

References

  1. Allwein, E. L., Schapire, R. E., and Singer, Y. (2001). Reducing multiclass to binary: a unifying approach for margin classifiers. J. Mach. Learn. Res., 1:113-141.
  2. Asuncion, A. and Newman, D. J. (2007). UCI machine learning repository.
  3. Cheung, N. (2001). Machine learning techniques for medical analysis. Master's thesis, University of Queensland.
  4. Clark, P. and Niblett, T. (1987). Induction in noisy domains. In Progress in Machine Learning-Proc. of EWSL 87, pages 11-30.
  5. Cordella, L., Foggia, P., and et. al. (1999). Reliability parameters to improve combination strategies in multiexpert systems. Patt. An. & Appl., 2(3):205-214.
  6. Crammer, K. and Singer, Y. (2002). On the algorithmic implementation of multiclass kernel-based vector machines. J. Mach. Learn. Res., 2:265-292.
  7. De Stefano, C., Sansone, C., and Vento, M. (2000). To reject or not to reject: that is the question: an answer in case of neural classifiers. IEEE Trans. on Systems, Man, and Cybernetics-Part C, 30(1):84-93.
  8. Dietterich, T. G. and Bakiri, G. (1995). Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research, 2:263.
  9. Hastie, T. and Tibshirani, R. (1998). Classification by pairwise coupling. In NIPS 7897: Proc. of the 1997 Conf. on Advances in neural information processing systems, pages 507-513. MIT Press.
  10. Jelonek, J. and Stefanowski, J. (1998). Experiments on solving multiclass learning problems by n2 classifier. In 10th European Conference on Machine Learning, pages 172-177. Springer-Verlag Lecture Notes in Artificial Intelligence.
  11. Kavanaugh, A., Tomar, R., and et al. (2000). Guidelines for clinical use of the antinuclear antibody test and tests for specific autoantibodies to nuclear antigens. Am. Col. of Pathologists, Archives of Pathology and Lab. Medicine, 124(1):71-81.
  12. Kittler, J., Hatef, M., and et. al. (1998). On combining classifiers. IEEE Trans. On Pattern Analysis and Machine Intelligence, 20(3):226-239.
  13. Kuncheva, L. I. (2002). Switching between selection and fusion in combining classifiers: an experiment. IEEE Trans. on Systems, Man and Cybernetics, Part B, 32(2):146-156.
  14. Kuncheva, L. I. (2005). Using diversity measures for generating error-correcting output codes in classifier ensembles. Patt. Recogn. Lett., 26(1):83-90.
  15. Kuncheva, L. I., Bezdek, J. C., and Duin, R. (2001). Decision template for multiple classifier fusion: an experimental comparison. Patt. Recognition, 34:299-314.
  16. Masulli, F. and Valentini, G. (2000). Comparing decomposition methods for classication. In KES'2000, Fourth Int. Conf. on Knowledge-Based Intell. Eng. Systems & Allied Technologies, pages 788-791.
  17. Mayoraz, E. and Moreira, M. (1997). On the decomposition of polychotomies into dichotomies. In ICML 7897: Proc. of the 14th Int. Conf. on Machine Learning, pages 219-226. Morgan Kaufmann Publishers Inc.
  18. Rigon, A., Soda, P., Zennaro, D., Iannello, G., and Afeltra, A. (2007). Indirect immunofluorescence (IIF) in autoimmune diseases: Assessment of digital images for diagnostic purpose. Cytometry - Accepted for Publication, February.
  19. Soda, P. and Iannello, G. (2006). A multi-expert system to classify fluorescent intensity in antinuclear autoantibodies testing. In Computer Based Medical Systems, pages 219-224. IEEE Computer Society.
  20. Woods, K., Kegelmeyer, W., and Bowyer, K. (1997). Combination of multiple classifiers using local accuracy estimates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19:405-410.
  21. Xu, L., Krzyzak, A., and Suen, C. (1992). Method of combining multiple classifiers and their application to handwritten numeral recognition. IEEE Trans. on Systems, Man and Cybernetics, 22(3):418-435.
Download


Paper Citation


in Harvard Style

Soda P. (2008). EXPERIMENTS ON SOLVING MULTICLASS RECOGNITION TASKS IN THE BIOLOGICAL AND MEDICAL DOMAINS . In Proceedings of the First International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2008) ISBN 978-989-8111-18-0, pages 64-71. DOI: 10.5220/0001066500640071


in Bibtex Style

@conference{biosignals08,
author={Paolo Soda},
title={EXPERIMENTS ON SOLVING MULTICLASS RECOGNITION TASKS IN THE BIOLOGICAL AND MEDICAL DOMAINS},
booktitle={Proceedings of the First International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2008)},
year={2008},
pages={64-71},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001066500640071},
isbn={978-989-8111-18-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2008)
TI - EXPERIMENTS ON SOLVING MULTICLASS RECOGNITION TASKS IN THE BIOLOGICAL AND MEDICAL DOMAINS
SN - 978-989-8111-18-0
AU - Soda P.
PY - 2008
SP - 64
EP - 71
DO - 10.5220/0001066500640071