Sampling-Distribution-Based Evaluation for Monte Carlo Rendering

Christian Freude, Hiroyuki Sakai, Károly Zsolnai-Fehér, Michael Wimmer

2023

Abstract

In this paper, we investigate the application of per-pixel difference metrics for evaluating Monte Carlo (MC) rendering techniques. In particular, we propose to take the sampling distribution of the mean (SDM) into account for this purpose. We establish the theoretical background and analyze other per-pixel difference metrics, such as the absolute deviation (AD) and the mean squared error (MSE) in relation to the SDM. Based on insights from this analysis, we propose a new, alternative, and particularly easy-to-use approach, which builds on the SDM and facilitates meaningful comparisons of MC rendering techniques on a per-pixel basis. In order to demonstrate the usefulness of our approach, we compare it to commonly used metrics based on a variety of images computed with different rendering techniques. Our evaluation reveals limitations of commonly used metrics, in particular regarding the detection of differences between renderings that might be difficult to detect otherwise—this circumstance is particularly apparent in comparison to the MSE calculated for each pixel. Our results indicate the potential of SDM-based approaches to reveal differences between MC renderers that might be caused by conceptual or implementation-related issues. Thus, we understand our approach as a way to facilitate the development and evaluation of rendering techniques.

Paper Citation

in Harvard Style

Freude C., Sakai H., Zsolnai-Fehér K. and Wimmer M. (2023). Sampling-Distribution-Based Evaluation for Monte Carlo Rendering. In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 1: GRAPP; ISBN 978-989-758-634-7, SciTePress, pages 119-130. DOI: 10.5220/0011886300003417

in Bibtex Style

@conference{grapp23,
author={Christian Freude and Hiroyuki Sakai and Károly Zsolnai-Fehér and Michael Wimmer},
title={Sampling-Distribution-Based Evaluation for Monte Carlo Rendering},
booktitle={Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 1: GRAPP},
year={2023},
pages={119-130},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011886300003417},
isbn={978-989-758-634-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 1: GRAPP
TI - Sampling-Distribution-Based Evaluation for Monte Carlo Rendering
SN - 978-989-758-634-7
AU - Freude C.
AU - Sakai H.
AU - Zsolnai-Fehér K.
AU - Wimmer M.
PY - 2023
SP - 119
EP - 130
DO - 10.5220/0011886300003417
PB - SciTePress