Authors:
Shoichiro Mihara
;
Haruhisa Kato
and
Masaru Sugano
Affiliation:
KDDI Research, Inc., Saitama and Japan
Keyword(s):
Photorealistic Reproduction, Augmented Reality, Image-based Rendering.
Related
Ontology
Subjects/Areas/Topics:
Augmented, Mixed and Virtual Environments
;
Computer Vision, Visualization and Computer Graphics
;
Image-Based Rendering
;
Interactive Environments
;
Rendering
Abstract:
Photorealistic reproduction of real objects with complexities of geometry and optics on mobile devices has been a long-standing challenge in augmented reality owing to the difficulties of modeling and rendering the real object faithfully. Although image-based rendering, which does not require the objects to be modeled, has been proposed, it still fails to photorealistically reproduce the object’s complete appearance containing complex optical properties such as anisotropic reflection. We propose a novel system for use on mobile devices capable of reproducing real objects photorealistically from all angles based on new view generation using densely sampled images. In order to realize the proposed system, we developed a method of selecting the image closest to a given camera view from densely sampled images by quantifying the similarity of two rays, performed rigid geometric transformation to preserve the vertical direction for stable viewing, and introduced color correction for consis
tency of color between the generated view and the real world. Through experiments, we confirmed that our proposed system can reproduce real objects with complex optical properties more photorealistically compared with conventional augmented reality.
(More)