Photorealistic Reproduction with Anisotropic Reflection on Mobile Devices using Densely Sampled Images

Shoichiro Mihara, Haruhisa Kato, Masaru Sugano

2019

Abstract

Photorealistic reproduction of real objects with complexities of geometry and optics on mobile devices has been a long-standing challenge in augmented reality owing to the difficulties of modeling and rendering the real object faithfully. Although image-based rendering, which does not require the objects to be modeled, has been proposed, it still fails to photorealistically reproduce the object’s complete appearance containing complex optical properties such as anisotropic reflection. We propose a novel system for use on mobile devices capable of reproducing real objects photorealistically from all angles based on new view generation using densely sampled images. In order to realize the proposed system, we developed a method of selecting the image closest to a given camera view from densely sampled images by quantifying the similarity of two rays, performed rigid geometric transformation to preserve the vertical direction for stable viewing, and introduced color correction for consistency of color between the generated view and the real world. Through experiments, we confirmed that our proposed system can reproduce real objects with complex optical properties more photorealistically compared with conventional augmented reality.

Paper Citation

in Harvard Style

Mihara S., Kato H. and Sugano M. (2019). Photorealistic Reproduction with Anisotropic Reflection on Mobile Devices using Densely Sampled Images. In Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019) - Volume 1: GRAPP; ISBN 978-989-758-354-4, SciTePress, pages 217-227. DOI: 10.5220/0007342202170227

in Bibtex Style

@conference{grapp19,
author={Shoichiro Mihara and Haruhisa Kato and Masaru Sugano},
title={Photorealistic Reproduction with Anisotropic Reflection on Mobile Devices using Densely Sampled Images},
booktitle={Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019) - Volume 1: GRAPP},
year={2019},
pages={217-227},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007342202170227},
isbn={978-989-758-354-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019) - Volume 1: GRAPP
TI - Photorealistic Reproduction with Anisotropic Reflection on Mobile Devices using Densely Sampled Images
SN - 978-989-758-354-4
AU - Mihara S.
AU - Kato H.
AU - Sugano M.
PY - 2019
SP - 217
EP - 227
DO - 10.5220/0007342202170227
PB - SciTePress