HyperEstimator: Evolving Computationally Efficient CNN Models with Grammatical Evolution

Gauri Vaidya, Luise Ilg, Meghana Kshirsagar, Enrique Naredo, Conor Ryan

2022

Abstract

Deep learning (DL) networks have the dual benefits due to over parameterization and regularization rendering them more accurate than conventional Machine Learning (ML) models. However, they consume massive amounts of resources in training and thus are computationally expensive. A single experimental run consumes a lot of computational resources, in such a way that it could cost millions of dollars thereby dramatically leading to massive project costs. Some of the factors for vast expenses for DL models can be attributed to the computational costs incurred during training, massive storage requirements, along with specialized hardware such as Graphical Processing Unit (GPUs). This research seeks to address some of the challenges mentioned above. Our approach, HyperEstimator, estimates the optimal values of hyperparameters for a given Convolutional Neural Networks (CNN) model and dataset using a suite of Machine Learning algorithms. Our approach consists of three stages: (i) obtaining candidate values for hyperparameters with Grammatical Evolution; (ii) prediction of optimal values of hyperparameters with supervised ML techniques; (iii) training CNN model for object detection. As a case study, the CNN models are validated by using a real-time video dataset representing road traffic captured in some Indian cities. The results are also compared against CIFAR10 and CIFAR100 benchmark datasets.

Paper Citation

in Harvard Style

Vaidya G., Ilg L., Kshirsagar M., Naredo E. and Ryan C. (2022). HyperEstimator: Evolving Computationally Efficient CNN Models with Grammatical Evolution. In Proceedings of the 19th International Conference on Smart Business Technologies - Volume 1: ICSBT, ISBN 978-989-758-587-6, pages 57-68. DOI: 10.5220/0011324800003280

in Bibtex Style

@conference{icsbt22,
author={Gauri Vaidya and Luise Ilg and Meghana Kshirsagar and Enrique Naredo and Conor Ryan},
title={HyperEstimator: Evolving Computationally Efficient CNN Models with Grammatical Evolution},
booktitle={ Proceedings of the 19th International Conference on Smart Business Technologies - Volume 1: ICSBT,},
year={2022},
pages={57-68},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011324800003280},
isbn={978-989-758-587-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Conference on Smart Business Technologies - Volume 1: ICSBT,
TI - HyperEstimator: Evolving Computationally Efficient CNN Models with Grammatical Evolution
SN - 978-989-758-587-6
AU - Vaidya G.
AU - Ilg L.
AU - Kshirsagar M.
AU - Naredo E.
AU - Ryan C.
PY - 2022
SP - 57
EP - 68
DO - 10.5220/0011324800003280