Complement Objective Mining Branch for Optimizing Attention Map

Takaaki Iwayoshi, Hiroki Adachi, Tsubasa Hirakawa, Takayoshi Yamashita, Hironobu Fujiyoshi

2023

Abstract

Attention branch network (ABN) can achieve high accuracy by visualizing the attention area of the network during inference and utilizing it in the recognition process. However, if the attention area does not highlight the target object to be recognized, it may cause recognition failure. While there is a method for fine-tuning the ABN using attention maps modified by human knowledge, it requires a lot of human labor and time because the attention map needs to be modified manually. The method introducing the attention mining branch (AMB) to ABN improves the attention area without using human knowledge by learning while considering whether the attention area is effective for recognition. However, even with AMB, attention regions other than the target object, i.e., unnecessary attention regions, may remain. In this paper, we investigate the effects of unwanted attention areas and propose a method to further improve the attention areas of ABN and AMB. In the evaluation experiments, we show that the proposed method improves the recognition accuracy and obtains an attention map with more gazed objects. Our evaluation experiments show that the proposed method improves the recognition accuracy and obtains an attention map that appropriately focuses on the target object to be recognized.

Paper Citation

in Harvard Style

Iwayoshi T., Adachi H., Hirakawa T., Yamashita T. and Fujiyoshi H. (2023). Complement Objective Mining Branch for Optimizing Attention Map. In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP; ISBN 978-989-758-634-7, SciTePress, pages 105-113. DOI: 10.5220/0011699000003417

in Bibtex Style

@conference{visapp23,
author={Takaaki Iwayoshi and Hiroki Adachi and Tsubasa Hirakawa and Takayoshi Yamashita and Hironobu Fujiyoshi},
title={Complement Objective Mining Branch for Optimizing Attention Map},
booktitle={Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP},
year={2023},
pages={105-113},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011699000003417},
isbn={978-989-758-634-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP
TI - Complement Objective Mining Branch for Optimizing Attention Map
SN - 978-989-758-634-7
AU - Iwayoshi T.
AU - Adachi H.
AU - Hirakawa T.
AU - Yamashita T.
AU - Fujiyoshi H.
PY - 2023
SP - 105
EP - 113
DO - 10.5220/0011699000003417
PB - SciTePress