A Method for Detecting Human-object Interaction based on Motion Distribution around Hand

Tatsuhiro Tsukamoto, Toru Abe, Takuo Suganuma

2020

Abstract

Detecting human-object interaction in video images is an important issue in many computer vision applications. Among various types of human-object interaction, especially the type of interaction where a person is in the middle of moving an object with his/her hand is a key to observing several critical events such as stealing luggage and abandoning suspicious substances in public spaces. This paper proposes a novel method for detecting such type of human-object interaction. In the proposed method, an area surrounding each hand is set in input video frames, and the motion distribution in every surrounding area is analyzed. Whether or not each hand moves an object is decided by whether or not its surrounding area contains regions where movements similar to those of the hand are concentrated. Since the proposed method needs not explicitly extract object regions and recognize their relations to person regions, the effectiveness in detecting the human-object interaction, technically hands which are right in the middle of moving objects, is expected to be improved for diverse situations, e.g., several persons individually move unknown objects with their hands in a scene.

Paper Citation

in Harvard Style

Tsukamoto T., Abe T. and Suganuma T. (2020). A Method for Detecting Human-object Interaction based on Motion Distribution around Hand. In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP; ISBN 978-989-758-402-2, SciTePress, pages 462-469. DOI: 10.5220/0009092204620469

in Bibtex Style

@conference{visapp20,
author={Tatsuhiro Tsukamoto and Toru Abe and Takuo Suganuma},
title={A Method for Detecting Human-object Interaction based on Motion Distribution around Hand},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP},
year={2020},
pages={462-469},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009092204620469},
isbn={978-989-758-402-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP
TI - A Method for Detecting Human-object Interaction based on Motion Distribution around Hand
SN - 978-989-758-402-2
AU - Tsukamoto T.
AU - Abe T.
AU - Suganuma T.
PY - 2020
SP - 462
EP - 469
DO - 10.5220/0009092204620469
PB - SciTePress