What Matters for Out-of-Distribution Detectors using Pre-trained CNN?

Dong-Hee Kim, Jaeyoon Lee, Ki-Seok Chung

2022

Abstract

In many real-world applications, a trained neural network classifier may have inputs that do not belong to any classes of the dataset used for training. Such inputs are called out-of-distribution (OOD) inputs. Obviously, OOD samples may cause the classifier to perform unreliably and inaccurately. Therefore, it is important to have the capability of distinguishing the OOD inputs from the in-distribution (ID) data. To improve the detection capability, quite a few methods using pre-trained convolutional neural networks(CNNs) with OOD samples have been proposed. Even though these methods show good performance in various applications, the OOD detection capabilities may vary depending on the implementation details and the methodology how to apply a set of detection methods. Thus, it is very important to choose both a good set of solutions and the methodology how to apply the set of solutions to maximize the effectiveness. In this paper, we carry out an extensive set of experiments to discuss various factors that may affect the OOD detection performance. Four different OOD detectors are tested with various implementation settings to find the configuration to achieve practically solid results.

Paper Citation

in Harvard Style

Kim D., Lee J. and Chung K. (2022). What Matters for Out-of-Distribution Detectors using Pre-trained CNN?. In Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP; ISBN 978-989-758-555-5, SciTePress, pages 264-273. DOI: 10.5220/0010775000003124

in Bibtex Style

@conference{visapp22,
author={Dong-Hee Kim and Jaeyoon Lee and Ki-Seok Chung},
title={What Matters for Out-of-Distribution Detectors using Pre-trained CNN?},
booktitle={Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP},
year={2022},
pages={264-273},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010775000003124},
isbn={978-989-758-555-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP
TI - What Matters for Out-of-Distribution Detectors using Pre-trained CNN?
SN - 978-989-758-555-5
AU - Kim D.
AU - Lee J.
AU - Chung K.
PY - 2022
SP - 264
EP - 273
DO - 10.5220/0010775000003124
PB - SciTePress