Multi-layer Feature Fusion and Selection from Convolutional Neural Networks for Texture Classification

Hajer Fradi, Anis Fradi, Anis Fradi, Jean-Luc Dugelay

2021

Abstract

Deep feature representation in Convolutional Neural Networks (CNN) can act as a set of feature extractors. However, since CNN architectures embed different representations at different abstraction levels, it is not trivial to choose the most relevant layers for a given classification task. For instance, for texture classification, low-level patterns and fine details from intermediate layers could be more relevant than high-level semantic information from top layers (commonly used for generic classification). In this paper, we address this problem by aggregating CNN activations from different convolutional layers and encoding them into a single feature vector after applying a pooling operation. The proposed approach also involves a feature selection step. This process is favorable for the classification accuracy since the influence of irrelevant features is minimized and the final dimension is reduced. The extracted and selected features from multiple layers can be further manageable by a classifier. The proposed approach is evaluated on three challenging datasets, and the results demonstrate the effectiveness of selecting and fusing multi-layer features for texture classification problem. Furthermore, by means of comparisons to other existing methods, we demonstrate that the proposed approach outperforms the state-of-the-art methods with a significant margin.

Paper Citation

in Harvard Style

Fradi H., Fradi A. and Dugelay J. (2021). Multi-layer Feature Fusion and Selection from Convolutional Neural Networks for Texture Classification. In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 4: VISAPP; ISBN 978-989-758-488-6, SciTePress, pages 574-581. DOI: 10.5220/0010388105740581

in Bibtex Style

@conference{visapp21,
author={Hajer Fradi and Anis Fradi and Jean-Luc Dugelay},
title={Multi-layer Feature Fusion and Selection from Convolutional Neural Networks for Texture Classification},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 4: VISAPP},
year={2021},
pages={574-581},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010388105740581},
isbn={978-989-758-488-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 4: VISAPP
TI - Multi-layer Feature Fusion and Selection from Convolutional Neural Networks for Texture Classification
SN - 978-989-758-488-6
AU - Fradi H.
AU - Fradi A.
AU - Dugelay J.
PY - 2021
SP - 574
EP - 581
DO - 10.5220/0010388105740581
PB - SciTePress