Labelling of Continuous Dynamic Interactions with the Environment using a Dynamic Model Representation

Juan C. Ramirez, Darius Burschka

2020

Abstract

We propose an extension for a dynamic 3D model that allows a hieratchical labeling of continuous interactions in scenes. While most systems focus on labels for pure transportation tasks, we show how Atlas information attached to objects identified in the scene can be used to label not only transportation tasks but also physical interactions, like writing, erasing a board, tightning a screw etc. We analyse the dynamic motion observed by a camera system at different abtraction levels ranging from simple motion primitives, over single physical actions to complete processes. The associated observation time horizons range from single turning motion on the screws tightened during a task over the process of inserting screws to the entire process of building a device. The complexity and the time horizon for possible predictions about actions in the scene increase with the abstraction level. We present the extension at the example of typical tasks observed by a camera, like writing and erasing a whiteboard.

Paper Citation

in Harvard Style

Ramirez J. and Burschka D. (2020). Labelling of Continuous Dynamic Interactions with the Environment using a Dynamic Model Representation. In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP; ISBN 978-989-758-402-2, SciTePress, pages 794-800. DOI: 10.5220/0008986407940800

in Bibtex Style

@conference{visapp20,
author={Juan C. Ramirez and Darius Burschka},
title={Labelling of Continuous Dynamic Interactions with the Environment using a Dynamic Model Representation},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP},
year={2020},
pages={794-800},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008986407940800},
isbn={978-989-758-402-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP
TI - Labelling of Continuous Dynamic Interactions with the Environment using a Dynamic Model Representation
SN - 978-989-758-402-2
AU - Ramirez J.
AU - Burschka D.
PY - 2020
SP - 794
EP - 800
DO - 10.5220/0008986407940800
PB - SciTePress