Fine-grained Action Recognition using Attribute Vectors

Sravani Yenduri, Nazil Perveen, Vishnu Chalavadi, C. Krishna Mohan

2022

Abstract

Modelling the subtle interactions between human and objects is crucial in fine-grained action recognition. However, the existing methodologies that employ deep networks for modelling the interactions are highly supervised, computationally expensive, and need a vast amount of annotated data for training. In this paper, a framework for an efficient representation of fine-grained actions is proposed. First, spatio-temporal features, namely, histogram of optical flow (HOF), and motion boundary histogram (MBH) are extracted for each input video as these features are more robust to irregular motions and capture the motion information in videos efficiently. Then a large Gaussian mixture model (GMM) is trained using the maximum a posterior (MAP) adaption, to capture the attributes of fine-grained actions. The adapted means of all mixtures are concatenated to form an attribute vector for each fine-grained action video. This attribute vector is of large dimension and contains redundant attributes that may not contribute to the particular fine-grained action. So, factor analysis is used to decompose the high-dimensional attribute vector to a low-dimension in order to retain only the attributes which are responsible for that fine-grained action. The efficacy of the proposed approach is demonstrated on three fine-grained action datasets, namely, JIGSAWS, KSCGR, and MPII cooking2.

Paper Citation

in Harvard Style

Yenduri S., Perveen N., Chalavadi V. and Mohan C. (2022). Fine-grained Action Recognition using Attribute Vectors. In Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 5: VISAPP; ISBN 978-989-758-555-5, SciTePress, pages 134-143. DOI: 10.5220/0010828700003124

in Bibtex Style

@conference{visapp22,
author={Sravani Yenduri and Nazil Perveen and Vishnu Chalavadi and C. Krishna Mohan},
title={Fine-grained Action Recognition using Attribute Vectors},
booktitle={Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 5: VISAPP},
year={2022},
pages={134-143},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010828700003124},
isbn={978-989-758-555-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 5: VISAPP
TI - Fine-grained Action Recognition using Attribute Vectors
SN - 978-989-758-555-5
AU - Yenduri S.
AU - Perveen N.
AU - Chalavadi V.
AU - Mohan C.
PY - 2022
SP - 134
EP - 143
DO - 10.5220/0010828700003124
PB - SciTePress