Exploring the Limitations of the Convolutional Neural Networks on Binary Tests Selection for Local Features

Bernardo Janko Gonçalves Biesseck, Edson Roteia Araujo Junior, Erickson R. Nascimento

2019

Abstract

Convolutional Neural Networks (CNN) have been successfully used to recognize and extract visual patterns in different tasks such as object detection, object classification, scene recognition, and image retrieval. The CNNs have also contributed in local features extraction by learning local representations. A representative approach is LIFT that generates keypoint descriptors more discriminative than handcrafted algorithms like SIFT, BRIEF, and SURF. In this paper, we investigate the binary tests selection problem, and we present an in-depth study of the limit of searching solutions with CNNs when the gradient is computed from the local neighborhood of the selected pixels. We performed several experiments with a Siamese Network trained with corresponding and non-corresponding patch pairs. Our results show the presence of Local Minima and also a problem that we called Incorrect Gradient Components. We pursued to understand the binary tests selection problem and even some limitations of Convolutional Neural Networks to avoid searching for solutions in unviable directions.

Paper Citation

in Harvard Style

Biesseck B., Araujo Junior E. and Nascimento E. (2019). Exploring the Limitations of the Convolutional Neural Networks on Binary Tests Selection for Local Features. In Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019) - Volume 4: VISAPP; ISBN 978-989-758-354-4, SciTePress, pages 261-271. DOI: 10.5220/0007374102610271

in Bibtex Style

@conference{visapp19,
author={Bernardo Janko Gonçalves Biesseck and Edson Roteia Araujo Junior and Erickson R. Nascimento},
title={Exploring the Limitations of the Convolutional Neural Networks on Binary Tests Selection for Local Features},
booktitle={Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019) - Volume 4: VISAPP},
year={2019},
pages={261-271},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007374102610271},
isbn={978-989-758-354-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019) - Volume 4: VISAPP
TI - Exploring the Limitations of the Convolutional Neural Networks on Binary Tests Selection for Local Features
SN - 978-989-758-354-4
AU - Biesseck B.
AU - Araujo Junior E.
AU - Nascimento E.
PY - 2019
SP - 261
EP - 271
DO - 10.5220/0007374102610271
PB - SciTePress