A SCALABLE GPU-BASED APPROACH TO SHADING AND SHADOWING FOR PHOTOREALISTIC REAL-TIME AUGMENTED REALITY

Claus B. Madsen, Rune Laursen

2007

Abstract

Visually realistic Augmented Reality (AR) entails addressing several difficult problems. The most difficult problem is that of rendering the virtual objects with illumination which is consistent with the illumination of the real scene. The paper describes a complete AR rendering system centered around the use of High Dynamic Range environment maps for representing the real scene illumination. The main contribution lies in a novel, physically-based approach to rendering shadows cast by virtual objects without changing the shadows already present in the images of the real scene. The proposed approach effectively involves real-time estimation of the diffuse albedos of the real scene, and essentially relighting these areas to take virtual shadows into account. Another contribution lies in the fact that the proposed approach is designed to run on graphics hardware and is scalable in the sense that it offers a simple way to balance performance with visual quality.

References

  1. Barsi, A., Szirmay-Kalos, L., and Szécsi, L. (2005). Image/based illumination on the gpu. Machine Graphics and Vision, 14(2):159 - 169.
  2. Cohen, J. M. and Debevec, P. (2001). The LightGen HDRShop plugin. www.hdrshop.com/mainpages/plugins.html.
  3. Debevec, P. (1998). Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proceedings: SIGGRAPH 1998, Orlando, Florida, USA.
  4. Debevec, P. (2002). Tutorial: Image-based lighting. IEEE Computer Graphics and Applications, pages 26 - 34.
  5. Debevec, P. (2005). A median cut algorithm for light probe sampling. In Proceedings: SIGGRAPH 2005, Los Angeles, California, USA. Poster abstract.
  6. Debevec, P. and Malik, J. (1997). Recovering high dynamic range radiance maps from photographs. In Proceedings: SIGGRAPH 1997, Los Angeles, CA, USA.
  7. Debevec et al., P. (2006). www.hdrshop.com.
  8. Gibson, S., Cook, J., Howard, T., and Hubbold, R. (2003). Rapic shadow generation in real-world lighting environments. In Proceedings: EuroGraphics Symposium on Rendering, Leuwen, Belgium.
  9. Greger, G., Shirley, P., Hubbard, P. M., and Greenberg, D. P. (1998). The irradiance volume. IEEE Computer Graphics and Applications, 18(2):32-43.
  10. Havran, V., Smyk, M., Krawczyk, G., Myszkowski, K., and Seidel, H.-P. (2005). Importance Sampling for Video Environment Maps. In Bala, K. and Dutré, P., editors, Eurographics Symposium on Rendering 2005, pages 31-42,311, Konstanz, Germany. ACM SIGGRAPH.
  11. Jacobs, K., Angus, C., and Loscos, C. (2005). Automatic generation of consistent shadows for augmented reality. In Proceedings: Graphics Interface, Vancouver, Canada.
  12. Jensen, T., Andersen, M., and Madsen, C. B. (2006a). Estimation of dynamic light changes in outdoor scenes without the use of calibration objects. In Proceedings: International Conference on Pattern Recognition, Hong Kong, page (4 pages).
  13. Jensen, T., Andersen, M., and Madsen, C. B. (2006b). Realtime image-based lighting for outdoor augmented reality under dynamically changing illumination conditions. In Proceedings: International Conference on Graphics Theory and Applications, Setúbal, Portugal, pages 364-371.
  14. Kanbara, M. and Yokoya, N. (2004). Real-time estimation of light source environment for photorealistic augmented reality. In Proceedings of the 17th International Conference on Pattern Recognition, Cambridge, United Kingdom, pages 911-914.
  15. Loscos, C., Drettakis, G., and Robert, L. (2000). Interative virtual relighting of real scenes. IEEE Transactions on Visualization and Computer Graphics, 6(4):289 - 305.
  16. Madsen, C. B., Sørensen, M. K. D., and Vittrup, M. (2003). Estimating positions and radiances of a small number of light sources for real-time image-based lighting. In Proceedings: Annual Conference of the European Association for Computer Graphics, EUROGRAPHICS 2003, Granada, Spain, pages 37 - 44.
  17. Sato, I., Sato, Y., and Ikeuchi, K. (1999a). Acquiring a radiance distribution to superimpose virtual objects onto a real scene. IEEE Transactions on Visualization and Computer Graphics, 5(1):1-12.
  18. Sato, I., Sato, Y., and Ikeuchi, K. (1999b). Illumination distribution from brightness in shadows: adaptive estimation of illumination distribution with unknown reflectance properties in shadow regions. In Proceedings: International Conference on Computer Vision, pages 875-882.
  19. SourceForge.net (2006). OpenCV Computer Vision Library, www.sourceforge.net/projects/opencv/.
  20. Watt, A. and Policarpo, F. (2001). 3D Games: RealTime Rendering and Software Technology, volume 1. Addison-Wesley.
Download


Paper Citation


in Harvard Style

B. Madsen C. and Laursen R. (2007). A SCALABLE GPU-BASED APPROACH TO SHADING AND SHADOWING FOR PHOTOREALISTIC REAL-TIME AUGMENTED REALITY . In Proceedings of the Second International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, ISBN 978-972-8865-71-9, pages 252-261. DOI: 10.5220/0002083602520261


in Bibtex Style

@conference{grapp07,
author={Claus B. Madsen and Rune Laursen},
title={A SCALABLE GPU-BASED APPROACH TO SHADING AND SHADOWING FOR PHOTOREALISTIC REAL-TIME AUGMENTED REALITY},
booktitle={Proceedings of the Second International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP,},
year={2007},
pages={252-261},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002083602520261},
isbn={978-972-8865-71-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Second International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP,
TI - A SCALABLE GPU-BASED APPROACH TO SHADING AND SHADOWING FOR PHOTOREALISTIC REAL-TIME AUGMENTED REALITY
SN - 978-972-8865-71-9
AU - B. Madsen C.
AU - Laursen R.
PY - 2007
SP - 252
EP - 261
DO - 10.5220/0002083602520261