Editing Scene Illumination and Material Appearance of Light-Field Images

Jaemin Cho, Dongyoung Choi, Dahyun Kang, Gun Bang, Min H. Kim

2025

Abstract

In this paper, we propose a method for editing the scene appearance of light-field images. Our method enables users to manipulate the illumination and material properties of scenes captured in light-field format, offering various control over image appearance, including dynamic relighting and material appearance modification, which leverages our specially designed inverse rendering framework for light-field images. By effectively separating light fields into appearance parameters—such as diffuse albedo, normal, specular intensity, and roughness within a multi-plane image domain, we overcome the traditional challenges of light-field imaging decomposition. These challenges include handling front-parallel views and a limited image count, which have previously hindered neural inverse rendering networks when applying them to light-field image data. Our method also approximates environmental illumination using spherical Gaussians, significantly enhancing the realism of scene reflectance. Furthermore, by differentiating scene illumination into far-bound and near-bound light environments, our method enables highly realistic editing of scene appearance and illumination, especially for local illumination effects. This differentiation allows for efficient, real-time relighting rendering and integrates seamlessly with existing layered light-field rendering frameworks. Our method demonstrates rendering capabilities from casually captured light-field images.

Paper Citation

in Harvard Style

Cho J., Choi D., Kang D., Bang G. and Kim M. (2025). Editing Scene Illumination and Material Appearance of Light-Field Images. In Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP; ISBN 978-989-758-728-3, SciTePress, pages 90-101. DOI: 10.5220/0013145500003912

in Bibtex Style

@conference{visapp25,
author={Jaemin Cho and Dongyoung Choi and Dahyun Kang and Gun Bang and Min Kim},
title={Editing Scene Illumination and Material Appearance of Light-Field Images},
booktitle={Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP},
year={2025},
pages={90-101},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013145500003912},
isbn={978-989-758-728-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP
TI - Editing Scene Illumination and Material Appearance of Light-Field Images
SN - 978-989-758-728-3
AU - Cho J.
AU - Choi D.
AU - Kang D.
AU - Bang G.
AU - Kim M.
PY - 2025
SP - 90
EP - 101
DO - 10.5220/0013145500003912
PB - SciTePress