A One-Vs-One Approach to Improve Tangled Program Graph Performance on Classification Tasks

Thibaut Bellanger, Thibaut Bellanger, Matthieu Berre, Manuel Clergue, Jin-Kao Hao

2023

Abstract

We propose an approach to improve the classification performance of the Tangled Programs Graph (TPG). TPG is a genetic programming method that aims to discover Directed Acyclic Graphs (DAGs) through an evolutionary process, where the edges carry programs that allow nodes to create a route from the root to a leaf, and the leaves represent actions or labels in classification. Despite notable successes in reinforcement learning tasks, TPG’s performance in classification appears to be limited in its basic version, as evidenced by the scores obtained on the MNIST dataset. However, the advantage of TPG compared to neural networks is to obtain, like decision trees, a global decision that is decomposable into simple atomic decisions and thus more easily explainable. Compared to decision trees, TPG has the advantage that atomic decisions benefit from the expressiveness of a pseudo register-based programming language, and the graph evolutionary construction prevents the emergence of overfitting. Our approach consists of decomposing the multi-class problem into a set of one-vs-one binary problems, training a set of TPG for each of them, and then combining the results of the TPGs to obtain a global decision, after selecting the best ones by a genetic algorithm. We test our approach on several benchmark datasets, and the results obtained are promising and tend to validate the proposed method.

Paper Citation

in Harvard Style

Bellanger T., Berre M., Clergue M. and Hao J. (2023). A One-Vs-One Approach to Improve Tangled Program Graph Performance on Classification Tasks. In Proceedings of the 15th International Joint Conference on Computational Intelligence - Volume 1: ECTA; ISBN 978-989-758-674-3, SciTePress, pages 53-63. DOI: 10.5220/0012167700003595

in Bibtex Style

@conference{ecta23,
author={Thibaut Bellanger and Matthieu Berre and Manuel Clergue and Jin-Kao Hao},
title={A One-Vs-One Approach to Improve Tangled Program Graph Performance on Classification Tasks},
booktitle={Proceedings of the 15th International Joint Conference on Computational Intelligence - Volume 1: ECTA},
year={2023},
pages={53-63},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012167700003595},
isbn={978-989-758-674-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computational Intelligence - Volume 1: ECTA
TI - A One-Vs-One Approach to Improve Tangled Program Graph Performance on Classification Tasks
SN - 978-989-758-674-3
AU - Bellanger T.
AU - Berre M.
AU - Clergue M.
AU - Hao J.
PY - 2023
SP - 53
EP - 63
DO - 10.5220/0012167700003595
PB - SciTePress