Effects of Global Illumination of Virtual Objects in 360º Mixed Reality

Jingxin Zhang, Jannis Volz, Frank Steinicke

2022

Abstract

Consistent rendering of virtual objects in 360◦ videos is challenging and crucial for spatial perception and the overall user experience in so-called 360◦ mixed reality (MR) environments. In particular, global illumination can provide important depth cues for localizing spatial objects in MR, and, moreover, improve the overall user experience. Previous works have introduced MR algorithms, which allow for the seamless composition of 3D virtual objects into a 360◦ video-based virtual environment (VE). For instance, for consistent global illumination, the light source in the 360◦ video can be detected and used to illuminate virtual objects and shadow calculation, or the 360◦ video can be reflected on specular virtual objects, known as environment mapping. Until now, it has not been evaluated if and to what extent global illumination of virtual objects in 360◦ MR environments improve spatial localization and user experience. To address this research question, we performed a user study in which we compared object localization with and without global illumination in 360◦ MR environments. The results show that the global illumination of virtual objects significantly reduces the localization error and improves the overall user experience in 360◦ MR environments.

Paper Citation

in Harvard Style

Zhang J., Volz J. and Steinicke F. (2022). Effects of Global Illumination of Virtual Objects in 360º Mixed Reality. In Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 2: HUCAPP; ISBN 978-989-758-555-5, SciTePress, pages 184-189. DOI: 10.5220/0010861100003124

in Bibtex Style

@conference{hucapp22,
author={Jingxin Zhang and Jannis Volz and Frank Steinicke},
title={Effects of Global Illumination of Virtual Objects in 360º Mixed Reality},
booktitle={Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 2: HUCAPP},
year={2022},
pages={184-189},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010861100003124},
isbn={978-989-758-555-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 2: HUCAPP
TI - Effects of Global Illumination of Virtual Objects in 360º Mixed Reality
SN - 978-989-758-555-5
AU - Zhang J.
AU - Volz J.
AU - Steinicke F.
PY - 2022
SP - 184
EP - 189
DO - 10.5220/0010861100003124
PB - SciTePress