Sensory Extension of a Tangible Object for Physical User Interactions in Augmented Reality

Dagny C. Döring, Robin Horst, Linda Rau, Ralf Dörner

2021

Abstract

Tangible Augmented Reality (TAR) is a subclass of Augmented Reality (AR). It uses real-world objects enabling users to interact with the virtual environment. This can make virtual content easier to grasp and increase the users’ immersion. However, the involvement of tangible objects in a TAR system is challenging. The system needs information on the interaction of users with the tangible object. Besides image-based tracking approaches that are commonly used for AR applications, additional sensors can be used to provide physical interaction possibilities for users. In this work, we investigate which opportunities hardware components can offer and how they can be integrated into a tangible object for a TAR application. We identify a taxonomy for categorizing sensors and control elements that can be used in a TAR setup and show how data provided by sensors can be utilized within such a TAR setup. At the example of a 3D print, we show how hardware elements can be attached to a tangible object and we discuss lessons learned based on a Unity TAR implementation. In particular, the discussion focuses on constructing 3D prints with sensors, exploiting hardware capabilities, and processing data from the additional hardware in a Unity application.

Paper Citation

in Harvard Style

Döring D., Horst R., Rau L. and Dörner R. (2021). Sensory Extension of a Tangible Object for Physical User Interactions in Augmented Reality. In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 2: HUCAPP; ISBN 978-989-758-488-6, SciTePress, pages 153-160. DOI: 10.5220/0010230301530160

in Bibtex Style

@conference{hucapp21,
author={Dagny C. Döring and Robin Horst and Linda Rau and Ralf Dörner},
title={Sensory Extension of a Tangible Object for Physical User Interactions in Augmented Reality},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 2: HUCAPP},
year={2021},
pages={153-160},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010230301530160},
isbn={978-989-758-488-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 2: HUCAPP
TI - Sensory Extension of a Tangible Object for Physical User Interactions in Augmented Reality
SN - 978-989-758-488-6
AU - Döring D.
AU - Horst R.
AU - Rau L.
AU - Dörner R.
PY - 2021
SP - 153
EP - 160
DO - 10.5220/0010230301530160
PB - SciTePress