Feature Map Upscaling to Improve Scale Invariance in Convolutional Neural Networks

Dinesh Kumar, Dharmendra Sharma

2021

Abstract

Efforts made by computer scientists to model the visual system has resulted in various techniques from which the most notable has been the Convolutional Neural Network (CNN). Whilst the ability to recognise an object in various scales is a trivial task for the human visual system, it remains a challenge for CNNs to achieve the same behaviour. Recent physiological studies reveal the visual system uses global-first response strategy in its recognition function, that is the visual system processes a wider area from a scene for its recognition function. This theory provides the potential for using global features to solve transformation invariance problems in CNNs. In this paper, we use this theory to propose a global-first feature extraction model called Stacked Filter CNN (SFCNN) to improve scale-invariant classification of images. In SFCNN, to extract features from spatially larger areas of the target image, we develop a trainable feature extraction layer called Stacked Filter Convolutions (SFC). We achieve this by creating a convolution layer with a pyramid of stacked filters of different sizes. When convolved with an input image the outputs are feature maps of different scales which are then upsampled and used as global features. Our results show that by integrating the SFC layer within a CNN structure, the network outperforms traditional CNN on classification of scaled color images. Experiments using benchmark datasets indicate potential effectiveness of our model towards improving scale invariance in CNN networks.

Paper Citation

in Harvard Style

Kumar D. and Sharma D. (2021). Feature Map Upscaling to Improve Scale Invariance in Convolutional Neural Networks. In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP; ISBN 978-989-758-488-6, SciTePress, pages 113-122. DOI: 10.5220/0010246001130122

in Bibtex Style

@conference{visapp21,
author={Dinesh Kumar and Dharmendra Sharma},
title={Feature Map Upscaling to Improve Scale Invariance in Convolutional Neural Networks},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP},
year={2021},
pages={113-122},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010246001130122},
isbn={978-989-758-488-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP
TI - Feature Map Upscaling to Improve Scale Invariance in Convolutional Neural Networks
SN - 978-989-758-488-6
AU - Kumar D.
AU - Sharma D.
PY - 2021
SP - 113
EP - 122
DO - 10.5220/0010246001130122
PB - SciTePress