Authors:
Jingxin Zhang
;
Jannis Volz
and
Frank Steinicke
Affiliation:
Human-Computer Interaction, University of Hamburg, Germany
Keyword(s):
Global Illumination, 360◦ Mixed Reality, Spatial Localization, User Experience.
Abstract:
Consistent rendering of virtual objects in 360◦ videos is challenging and crucial for spatial perception and the overall user experience in so-called 360◦ mixed reality (MR) environments. In particular, global illumination can provide important depth cues for localizing spatial objects in MR, and, moreover, improve the overall user experience. Previous works have introduced MR algorithms, which allow for the seamless composition of 3D virtual objects into a 360◦ video-based virtual environment (VE). For instance, for consistent global illumination, the light source in the 360◦ video can be detected and used to illuminate virtual objects and shadow calculation, or the 360◦ video can be reflected on specular virtual objects, known as environment mapping. Until now, it has not been evaluated if and to what extent global illumination of virtual objects in 360◦ MR environments improve spatial localization and user experience. To address this research question, we performed a user study in
which we compared object localization with and without global illumination in 360◦ MR environments. The results show that the global illumination of virtual objects significantly reduces the localization error and improves the overall user experience in 360◦ MR environments.
(More)