A Mutual Information Based Discretization-Selection Technique

Artur Ferreira, Artur Ferreira, Mário Figueiredo, Mário Figueiredo

2024

Abstract

In machine learning (ML) and data mining (DM) one often has to resort to data pre-processing techniques to achieve adequate data representations. Among these techniques, we find feature discretization (FD) and feature selection (FS), with many available methods for each one. The use of FD and FS techniques improves the data representation for ML and DM tasks. However, these techniques are usually applied in an independent way, that is, we may use a FD technique but not a FS technique or the opposite case. Using both FD and FS techniques in sequence, may not produce the most adequate results. In this paper, we propose a supervised discretization-selection technique; the discretization step is done in an incremental approach and keeps information regarding the features and the number of bits allocated per feature. Then, we apply a selection criterion based upon the discretization bins, yielding a discretized and dimensionality reduced dataset. We evaluate our technique on different types of data and in most cases the discretized and reduced version of the data is the most suited version, achieving better classification performance, as compared to the use of the original features.

Paper Citation

in Harvard Style

Ferreira A. and Figueiredo M. (2024). A Mutual Information Based Discretization-Selection Technique. In Proceedings of the 13th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM; ISBN 978-989-758-684-2, SciTePress, pages 436-443. DOI: 10.5220/0012467300003654

in Bibtex Style

@conference{icpram24,
author={Artur Ferreira and Mário Figueiredo},
title={A Mutual Information Based Discretization-Selection Technique},
booktitle={Proceedings of the 13th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM},
year={2024},
pages={436-443},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012467300003654},
isbn={978-989-758-684-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM
TI - A Mutual Information Based Discretization-Selection Technique
SN - 978-989-758-684-2
AU - Ferreira A.
AU - Figueiredo M.
PY - 2024
SP - 436
EP - 443
DO - 10.5220/0012467300003654
PB - SciTePress