Toward Multi-Plane Image Reconstruction from a Casually Captured Focal Stack

Shiori Ueda, Hideo Saito, Shohei Mori, Shohei Mori

2024

Abstract

3D imaging combining a focal stack and multi-plane images (MPI) facilitates various real-time applications, including view synthesis, 3D scene editing, and augmented and virtual reality. Building upon the foundation of MPI, originally derived from multi-view images, we introduce a novel pipeline for reconstructing MPI by casually capturing a focal stack optically using a handheld camera with a manually modulated focus ring. We hypothesized two distinct strategies for focus ring modulation that users could employ, to sample defocus images along the front-facing axis uniformly. Our quantitative analysis using a synthetic dataset suggests tendencies in possible simulated errors in focus modulations, while qualitative results illustrate visual differences. We further showcase applications utilizing the resultant MPI, including depth rendering, occlusion-aware defocus filtering, and de-fencing.

Paper Citation

in Harvard Style

Ueda S., Saito H. and Mori S. (2024). Toward Multi-Plane Image Reconstruction from a Casually Captured Focal Stack. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP; ISBN 978-989-758-679-8, SciTePress, pages 72-82. DOI: 10.5220/0012438700003660

in Bibtex Style

@conference{visapp24,
author={Shiori Ueda and Hideo Saito and Shohei Mori},
title={Toward Multi-Plane Image Reconstruction from a Casually Captured Focal Stack},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP},
year={2024},
pages={72-82},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012438700003660},
isbn={978-989-758-679-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP
TI - Toward Multi-Plane Image Reconstruction from a Casually Captured Focal Stack
SN - 978-989-758-679-8
AU - Ueda S.
AU - Saito H.
AU - Mori S.
PY - 2024
SP - 72
EP - 82
DO - 10.5220/0012438700003660
PB - SciTePress