Interactive Relighting of Virtual Objects under Environment Lighting

Nick Michiels, Jeroen Put, Philippe Bekaert

2015

Abstract

Current relighting applications often constrain one or several factors of the rendering equation to keep the rendering speed real-time. For example, visibility is often precalculated and animations are not allowed, changes in lighting are limited to simple rotation or the lighting is not very detailed. Other techniques compromise on quality and often coarsely tabulate BRDF functions. In order to solve these problems, some techniques have started to use spherical radial basis functions. However, solving the triple product integral does not guarantee interactivity. In order to dynamically change lighting conditions or alter scene geometry and materials, these three factors need to be converted to the SRBF representation in a fast manner. This paper presents a method to perform the SRBF data construction and rendering in real-time. To support dynamic high-frequency lighting, a multiscale residual transformation algorithm is applied. Area lights are detected through a peak detection algorithm. By using voxel cone tracing and a subsampling scheme, animated geometry casts soft shadows dynamically. We demonstrate the effectiveness of our method with a real-time application. Users can shine with multiple light sources onto a camera and the animated virtual scene is relit accordingly.

References

  1. Crassin, C. and Green, S. (2012). Octree-based sparse voxelization using the gpu hardware rasterizer. In Cozzi, P. and Riccio, C., editors, OpenGL Insights, pages 303-318. CRC Press.
  2. Crassin, C., Neyret, F., Sainz, M., Green, S., and Eisemann, E. (2011). Interactive indirect illumination using voxel-based cone tracing: An insight. In ACM SIGGRAPH 2011 Talks, SIGGRAPH 7811, pages 20:1- 20:1, New York, NY, USA. ACM.
  3. Ferrari, S., Maggioni, M., and Borghese, N. A. (2004). Multiscale approximation with hierarchical radial basis functions networks. IEEE Transactions on Neural Networks, 15(1):178-188.
  4. Gorski, K., Hivon, E., Banday, A., Wandelt, B., Hansen, F., et al. (2005). HEALPix - A Framework for high resolution discretization, and fast analysis of data distributed on the sphere. Astrophys.J., 622:759-771.
  5. Haber, T., Fuchs, C., Bekaer, P., Seidel, H.-P., Goesele, M., and Lensch, H. (2009). Relighting objects from image collections. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 627-634.
  6. Imber, J., Guillemaut, J.-Y., and Hilton, A. (2014). Intrinsic textures for relightable free-viewpoint video. In Fleet, D., Pajdla, T., Schiele, B., and Tuytelaars, T., editors, Computer Vision ECCV 2014, volume 8690 of Lecture Notes in Computer Science, pages 392-407. Springer International Publishing.
  7. Iwasaki, K., Furuya, W., Dobashi, Y., and Nishita, T. (2012). Real-time rendering of dynamic scenes under all-frequency lighting using integral spherical gaussian. Comp. Graph. Forum, 31(2pt4):727-734.
  8. Kajiya, J. T. (1986). The rendering equation. In Proceedings of the 13th annual conference on Computer graphics and interactive techniques, SIGGRAPH 7886, pages 143-150, New York, NY, USA. ACM.
  9. Lam, P.-M., Ho, T.-Y., Leung, C.-S., and Wong, T.-T. (2010). All-frequency lighting with multiscale spherical radial basis functions. Visualization and Computer Graphics, IEEE Transactions on, 16(1):43-56.
  10. Meunier, S., Perrot, R., Aveneau, L., Meneveaux, D., and Ghazanfarpour, D. (2010). Cosine lobes for interactive direct lighting in dynamic scenes. Computers & Graphics, 34(6):767-778.
  11. Michiels, N., Put, J., and Bekaert, P. (2014). Product integral binding coefficients for high-order wavelets. In Proceedings of the 11th International Conference on Signal Processing and Multimedia Applications (SIGMAP 2014). INSTICC.
  12. Ng, R., Ramamoorthi, R., and Hanrahan, P. (2003). Allfrequency shadows using non-linear wavelet lighting approximation. In ACM SIGGRAPH 2003 Papers, SIGGRAPH 7803, pages 376-381, New York, NY, USA. ACM.
  13. Ng, R., Ramamoorthi, R., and Hanrahan, P. (2004). Triple product wavelet integrals for all-frequency relighting. ACM Trans. Graph., 23(3):477-487.
  14. Ngan, A., Durand, F., and Matusik, W. (2005). Experimental analysis of brdf models. In Proceedings of the Sixteenth Eurographics conference on Rendering Techniques, EGSR'05, pages 117-126, Aire-la-Ville, Switzerland, Switzerland. Eurographics Association.
  15. PointGrey (2014). Ladybug3. Web page. http:// www.ptgrey.com/. Accessed October 13 , 2014.
  16. Praun, E. and Hoppe, H. (2003). Spherical parametrization and remeshing. ACM Trans. Graph., 22(3):340-349.
  17. Ramamoorthi, R. and Hanrahan, P. (2001). A signalprocessing framework for inverse rendering. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques, SIGGRAPH 7801, pages 117-128, New York, NY, USA. ACM.
  18. Sellers, G. (2013). Opengl extension specification: Arb sparse texture. Web page. https:// www.opengl.org/registry/specs/ARB/sparse texture.txt. Accessed October 11, 2014.
  19. Sloan, P.-P., Hall, J., Hart, J., and Snyder, J. (2003). Clustered principal components for precomputed radiance transfer. In ACM SIGGRAPH 2003 Papers, SIGGRAPH 7803, pages 382-391, New York, NY, USA. ACM.
  20. Sloan, P.-P., Kautz, J., and Snyder, J. (2002). Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. In Proceedings of the 29th annual conference on Computer graphics and interactive techniques, SIGGRAPH 7802, pages 527-536, New York, NY, USA. ACM.
  21. Sun, X., Zhou, K., Chen, Y., Lin, S., Shi, J., and Guo, B. (2007). Interactive relighting with dynamic brdfs. In ACM SIGGRAPH 2007 papers, SIGGRAPH 7807, New York, NY, USA. ACM.
  22. Tsai, Y.-T. and Shih, Z.-C. (2006). All-frequency precomputed radiance transfer using spherical radial basis functions and clustered tensor approximation. In ACM SIGGRAPH 2006 Papers, SIGGRAPH 7806, pages 967-976, New York, NY, USA. ACM.
  23. Wang, J., Ren, P., Gong, M., Snyder, J., and Guo, B. (2009). All-frequency rendering of dynamic, spatially-varying reflectance. In ACM SIGGRAPH Asia 2009 Papers, SIGGRAPH Asia 7809, pages 133:1-133:10, New York, NY, USA. ACM.
  24. Wang, R., Ng, R., Luebke, D., and Humphreys, G. (2006). Efficient wavelet rotation for environment map rendering. In Proceedings of the 17th Eurographics Conference on Rendering Techniques, EGSR 7806, pages 173-182, Aire-la-Ville, Switzerland, Switzerland. Eurographics Association.
Download


Paper Citation


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2015)
TI - Interactive Relighting of Virtual Objects under Environment Lighting
SN - 978-989-758-087-1
AU - Michiels N.
AU - Put J.
AU - Bekaert P.
PY - 2015
SP - 220
EP - 228
DO - 10.5220/0005360102200228


in Harvard Style

Michiels N., Put J. and Bekaert P. (2015). Interactive Relighting of Virtual Objects under Environment Lighting . In Proceedings of the 10th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2015) ISBN 978-989-758-087-1, pages 220-228. DOI: 10.5220/0005360102200228


in Bibtex Style

@conference{grapp15,
author={Nick Michiels and Jeroen Put and Philippe Bekaert},
title={Interactive Relighting of Virtual Objects under Environment Lighting},
booktitle={Proceedings of the 10th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2015)},
year={2015},
pages={220-228},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005360102200228},
isbn={978-989-758-087-1},
}