A Suite of Incremental Image Degradation Operators for Testing Image Classification Algorithms

Kevin Swingler

2022

Abstract

Convolutional Neural Networks (CNN) are extremely popular for modelling sound and images, but they suffer from a lack of robustness that could threaten their usefulness in applications where reliability is important. Recent studies have shown how it is possible to maliciously create adversarial images—those that appear to the human observer as perfect examples of one class but that fool a CNN into assigning them to a different, incorrect class. It takes some effort to make these images as they need to be designed specifically to fool a given network. In this paper we show that images can be degraded in a number of simple ways that do not need careful design and that would not affect the ability of a human observer, but which cause severe deterioration in the performance of three different CNN models. We call the speed of the deterioration in performance due to incremental degradations in image quality the degradation profile of a model and argue that reporting the degradation profile is as important as reporting performance on clean images.

Paper Citation

in Harvard Style

Swingler K. (2022). A Suite of Incremental Image Degradation Operators for Testing Image Classification Algorithms. In Proceedings of the 14th International Joint Conference on Computational Intelligence (IJCCI 2022) - Volume 1: NCTA; ISBN 978-989-758-611-8, SciTePress, pages 262-272. DOI: 10.5220/0011511000003332

in Bibtex Style

@conference{ncta22,
author={Kevin Swingler},
title={A Suite of Incremental Image Degradation Operators for Testing Image Classification Algorithms},
booktitle={Proceedings of the 14th International Joint Conference on Computational Intelligence (IJCCI 2022) - Volume 1: NCTA},
year={2022},
pages={262-272},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011511000003332},
isbn={978-989-758-611-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Joint Conference on Computational Intelligence (IJCCI 2022) - Volume 1: NCTA
TI - A Suite of Incremental Image Degradation Operators for Testing Image Classification Algorithms
SN - 978-989-758-611-8
AU - Swingler K.
PY - 2022
SP - 262
EP - 272
DO - 10.5220/0011511000003332
PB - SciTePress