Novel View Synthesis using Feature-preserving Depth Map Resampling

Duo Chen, Jie Feng, Bingfeng Zhou

2019

Abstract

In this paper, we present a new method for synthesizing images of a 3D scene at novel viewpoints, based on a set of reference images taken in a casual manner. With such an image set as input, our method first reconstruct a sparse 3D point cloud of the scene, and then it is projected to each reference image to get a set of depth points. Afterwards, an improved error-diffusion sampling method is utilized to generate a sampling point set in each reference image, which includes the depth points and preserves the image features well. Therefore the image can be triangulated on the basis of the sampling point set. Then, we propose a distance metric based on Euclidean distance, color similarity and boundary distribution to propagate depth information from the depth points to the rest of sampling points, and hence a dense depth map can be generated by interpolation in the triangle mesh. Given a desired viewpoint, several closest reference viewpoints are selected, and their colored depth maps are projected to the novel view. Finally, multiple projected images are merged to fill the holes caused by occusion, and result in a complete novel view. Experimental results demonstrate that our method can achieve high quality results for outdoor scenes that contain challenging objects.

Paper Citation

in Harvard Style

Chen D., Feng J. and Zhou B. (2019). Novel View Synthesis using Feature-preserving Depth Map Resampling. In Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019) - Volume 1: GRAPP; ISBN 978-989-758-354-4, SciTePress, pages 193-200. DOI: 10.5220/0007308701930200

in Bibtex Style

@conference{grapp19,
author={Duo Chen and Jie Feng and Bingfeng Zhou},
title={Novel View Synthesis using Feature-preserving Depth Map Resampling},
booktitle={Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019) - Volume 1: GRAPP},
year={2019},
pages={193-200},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007308701930200},
isbn={978-989-758-354-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019) - Volume 1: GRAPP
TI - Novel View Synthesis using Feature-preserving Depth Map Resampling
SN - 978-989-758-354-4
AU - Chen D.
AU - Feng J.
AU - Zhou B.
PY - 2019
SP - 193
EP - 200
DO - 10.5220/0007308701930200
PB - SciTePress