Two-Model-Based Online Hand Gesture Recognition from Skeleton Data

Zorana Doždor, Tomislav Hrkać, Zoran Kalafatić

2023

Abstract

Hand gesture recognition from skeleton data has recently gained popularity due to the broad areas of application and availability of adequate input devices. However, before utilising this technology in real-world conditions there are still many challenges left to overcome. A major challenge is robust gesture localization – estimating the beginning and the end of a gesture in online conditions. We propose an online gesture detection system based on two models – one for gesture localization and the other for gesture classification. This approach is tested and compared against the one-model approach, often found in literature. The system is evaluated on the recent SHREC challenge which offers datasets for online gesture detection. Results show the benefits of distributing the tasks of localization and recognition instead of using one model for both tasks. The proposed system obtains state-of-the-art results on SHREC gesture detection dataset.

Paper Citation

in Harvard Style

Doždor Z., Hrkać T. and Kalafatić Z. (2023). Two-Model-Based Online Hand Gesture Recognition from Skeleton Data. In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP; ISBN 978-989-758-634-7, SciTePress, pages 838-845. DOI: 10.5220/0011663200003417

in Bibtex Style

@conference{visapp23,
author={Zorana Doždor and Tomislav Hrkać and Zoran Kalafatić},
title={Two-Model-Based Online Hand Gesture Recognition from Skeleton Data},
booktitle={Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP},
year={2023},
pages={838-845},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011663200003417},
isbn={978-989-758-634-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP
TI - Two-Model-Based Online Hand Gesture Recognition from Skeleton Data
SN - 978-989-758-634-7
AU - Doždor Z.
AU - Hrkać T.
AU - Kalafatić Z.
PY - 2023
SP - 838
EP - 845
DO - 10.5220/0011663200003417
PB - SciTePress