On the Use of Visual Transformer for Image Complexity Assessment

Luigi Celona, Gianluigi Ciocca, Raimondo Schettini

2024

Abstract

Perceiving image complexity is a crucial aspect of human visual understanding, yet explicitly assessing image complexity poses challenges. Historically, this aspect has been understudied due to its inherent subjectivity, stemming from its reliance on human perception, and the semantic dependency of image complexity in the face of diverse real-world images. Different computational models for image complexity estimation have been proposed in the literature. These models leverage a variety of techniques ranging from low-level, hand-crafted features, to advanced machine learning algorithms. This paper explores the use of recent deep-learning approaches based on Visual Transformer to extract robust information for image complexity estimation in a transfer learning paradigm. Specifically, we propose to leverage three visual backbones, CLIP, DINO-v2, and ImageNetViT, as feature extractors, coupled with a Support Vector Regressor with Radial Basis Function kernel as an image complexity estimator. We test our approach on two widely used benchmark datasets (i.e. IC9600 and SAVOIAS) in an intra-dataset and inter-dataset workflow. Our experiments demonstrate the effectiveness of the CLIP-based features for accurate image complexity estimation with results comparable to end-to-end solutions.

Paper Citation

in Harvard Style

Celona L., Ciocca G. and Schettini R. (2024). On the Use of Visual Transformer for Image Complexity Assessment. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP; ISBN 978-989-758-679-8, SciTePress, pages 640-647. DOI: 10.5220/0012426500003660

in Bibtex Style

@conference{visapp24,
author={Luigi Celona and Gianluigi Ciocca and Raimondo Schettini},
title={On the Use of Visual Transformer for Image Complexity Assessment},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP},
year={2024},
pages={640-647},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012426500003660},
isbn={978-989-758-679-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP
TI - On the Use of Visual Transformer for Image Complexity Assessment
SN - 978-989-758-679-8
AU - Celona L.
AU - Ciocca G.
AU - Schettini R.
PY - 2024
SP - 640
EP - 647
DO - 10.5220/0012426500003660
PB - SciTePress