A Framework for Developing Robust Machine Learning Models in Harsh Environments: A Review of CNN Design Choices

William Dennis, James Pope

2025

Abstract

Machine Learning algorithms are envisioned to be used in harsh and/or safety critical environments such as self-driving cars, aerospace, and nuclear sites where the effects of radiation can cause errors in electronics known as Single Event Effects (SEEs). The effect of SEEs on machine learning models, such as neural networks composed of millions of parameters, is currently unknown. Understanding the models in terms of robustness and reliability is essential for their use in these environments. To facilitate this understanding, we propose a novel framework to simulate SEEs during model training and inference. Using the framework we investigate the robustness of the Convolutional Neural Network (CNN) architecture with dropout, regularisa-tion and activation functions under different error models. Two new activation functions are suggested that decrease error by up to 40% compared to ReLU. We also investigate an alternative pooling layer that can provide model robustness with a 16% decrease in error with ReLU. Overall, our results confirm the efficacy of the framework for evaluating model robustness in harsh environments.

Paper Citation

in Harvard Style

Dennis W. and Pope J. (2025). A Framework for Developing Robust Machine Learning Models in Harsh Environments: A Review of CNN Design Choices. In Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART; ISBN 978-989-758-737-5, SciTePress, pages 322-333. DOI: 10.5220/0013155000003890

in Bibtex Style

@conference{icaart25,
author={William Dennis and James Pope},
title={A Framework for Developing Robust Machine Learning Models in Harsh Environments: A Review of CNN Design Choices},
booktitle={Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART},
year={2025},
pages={322-333},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013155000003890},
isbn={978-989-758-737-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART
TI - A Framework for Developing Robust Machine Learning Models in Harsh Environments: A Review of CNN Design Choices
SN - 978-989-758-737-5
AU - Dennis W.
AU - Pope J.
PY - 2025
SP - 322
EP - 333
DO - 10.5220/0013155000003890
PB - SciTePress