Union and Intersection K-Fold Feature Selection

Artur Ferreira, Artur Ferreira, Mário A. T. Figueiredo, Mário A. T. Figueiredo

2025

Abstract

Feature selection (FS) is a vast research topic with many techniques proposed over the years. FS techniques may bring many benefits to machine learning algorithms. The combination of FS techniques usually improves the results as compared to the use of one single technique. Recently, the concepts of explainability and interpretability have been proposed in the explainable artificial intelligence (XAI) framework. The recently proposed k-fold feature selection (KFFS) algorithm provides dimensionality reduction and simultaneously yields an output suitable for explainability purposes. In this paper, we extend the KFFS algorithm by performing union and intersection of the individual feature subspaces of two and three feature selection filters. Our experiments performed on 20 datasets show that the union of the feature subsets typically attains better results than the use of individual filters. The intersection also attains adequate results, yielding human manageable (e.g., small) subsets of features, allowing for explainability and interpretability on medical domain data.

Paper Citation

in Harvard Style

Ferreira A. and Figueiredo M. (2025). Union and Intersection K-Fold Feature Selection. In Proceedings of the 14th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM; ISBN 978-989-758-730-6, SciTePress, pages 360-367. DOI: 10.5220/0013282300003905

in Bibtex Style

@conference{icpram25,
author={Artur Ferreira and Mário Figueiredo},
title={Union and Intersection K-Fold Feature Selection},
booktitle={Proceedings of the 14th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM},
year={2025},
pages={360-367},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013282300003905},
isbn={978-989-758-730-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM
TI - Union and Intersection K-Fold Feature Selection
SN - 978-989-758-730-6
AU - Ferreira A.
AU - Figueiredo M.
PY - 2025
SP - 360
EP - 367
DO - 10.5220/0013282300003905
PB - SciTePress