Learning Ensembles in the Presence of Imbalanced Classes

Amal Saadallah, Nico Piatkowski, Felix Finkeldey, Petra Wiederkehr, Katharina Morik

2019

Abstract

Class imbalance occurs when data classes are not equally represented. Generally, it occurs when some classes represent rare events, while the other classes represent the counterpart of these events. Rare events, especially those that may have a negative impact, often require informed decision-making in a timely manner. However, class imbalance is known to induce a learning bias towards majority classes which implies a poor detection of minority classes. Thus, we propose a new ensemble method to handle class imbalance explicitly at training time. In contrast to existing ensemble methods for class imbalance that use either data driven or randomized approaches for their constructions, our method exploits both directions. On the one hand, ensemble members are built from randomized subsets of training data. On the other hand, we construct different scenarios of class imbalance for the unknown test data. An ensemble is built for each resulting scenario by combining random sampling with the estimation of the relative importance of specific loss functions. Final predictions are generated by a weighted average of each ensemble prediction. As opposed to existing methods, our approach does not try to fix imbalanced data sets. Instead, we show how imbalanced data sets can make classification easier, due to a limited range of true class frequencies. Our procedure promotes diversity among the ensemble members and is not sensitive to specific parameter settings. An experimental demonstration shows, that our new method outperforms or is on par with state-of-the-art ensembles and class imbalance techniques.

Paper Citation

in Harvard Style

Saadallah A., Piatkowski N., Finkeldey F., Wiederkehr P. and Morik K. (2019). Learning Ensembles in the Presence of Imbalanced Classes.In Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-351-3, pages 866-873. DOI: 10.5220/0007681508660873

in Bibtex Style

@conference{icpram19,
author={Amal Saadallah and Nico Piatkowski and Felix Finkeldey and Petra Wiederkehr and Katharina Morik},
title={Learning Ensembles in the Presence of Imbalanced Classes},
booktitle={Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2019},
pages={866-873},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007681508660873},
isbn={978-989-758-351-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Learning Ensembles in the Presence of Imbalanced Classes
SN - 978-989-758-351-3
AU - Saadallah A.
AU - Piatkowski N.
AU - Finkeldey F.
AU - Wiederkehr P.
AU - Morik K.
PY - 2019
SP - 866
EP - 873
DO - 10.5220/0007681508660873