TOWARDS PROBE-LESS AUGMENTED REALITY - A Position Paper

Claus B. Madsen, Michael Nielsen

Abstract

The main problem area for Augmented Reality is ensuring that the illumination of the virtual objects is continuously consistent with the illumination in the real scene. State of the art in the area typically requires the real scene illumination conditions to be captured as a High Dynamic Range environment map. The environment map is then used for shading and shadowing. Handling the real and the virtual shadows and their interaction is the single most difficult aspect. This paper presents a completely different approach to determining the illumination conditions in the real scene. Based on an assumption that the scene is outdoor we automatically detect shadows in the image and use this information to determine the ratio of sky irradiance to sun irradiance. We then present how to convert this information into radiance levels for both the sky and the sun. When combined with a computation of the Sun’s position based on date, time and information about position on the Earth, we arrive at a full illumination model applicable for rendering virtual objects into real scenes.

References

  1. Barsi, A., Szirmay-Kalos, L., and Szécsi, L. (2005). Imagebased illumination on the gpu. Machine Graphics and Vision, 14(2):159 - 169.
  2. Boivin, S. and Gagalowicz, A. (2001). Image-based rendering of diffuse, specular and glossy surfaces from a single image. In Proceedings: ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, pages 107-116.
  3. Boivin, S. and Gagalowicz, A. (2002). Inverse rendering from a single image. In Proceedings: First European Conference on Color in Graphics, Images and Vision, Poitiers, France, pages 268-277.
  4. Cao, X., Shen, Y., Shah, M., and Foroosh, H. (2005). Single view compositing with shadows. The Visual Computer, pages 639 - 648.
  5. Debevec, P. (1998). Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proceedings: SIGGRAPH 1998, Orlando, Florida, USA.
  6. Debevec, P. (2002). Tutorial: Image-based lighting. IEEE Computer Graphics and Applications, pages 26 - 34.
  7. Debevec, P. (2005). A median cut algorithm for light probe sampling. In Proceedings: SIGGRAPH 2005, Los Angeles, California, USA. Poster abstract.
  8. Gibson, S., Cook, J., Howard, T., and Hubbold, R. (2003). Rapic shadow generation in real-world lighting environments. In Proceedings: EuroGraphics Symposium on Rendering, Leuwen, Belgium.
  9. Havran, V., Smyk, M., Krawczyk, G., Myszkowski, K., and Seidel, H.-P. (2005). Importance Sampling for Video Environment Maps. In Bala, K. and Dutré, P., editors, Eurographics Symposium on Rendering 2005, pages 31-42,311, Konstanz, Germany. ACM SIGGRAPH.
  10. Jacobs, K. and Loscos, C. (2004). State of the art report on classification of illumination methods for mixed reality. In EUROGRAPHICS, Grenoble, France.
  11. Jensen, T., Andersen, M., and Madsen, C. B. (2006). Realtime image-based lighting for outdoor augmented reality under dynamically changing illumination conditions. In Proceedings: International Conference on Graphics Theory and Applications, Setúbal, Portugal, pages 364-371.
  12. Madsen, C. B. and Laursen, R. (2007). A scalable gpubased approach to shading and shadowing for photorealistic real-time augmented reality. In Proceedings: International Conference on Graphics Theory and Applications, Barcelona, Spain, pages 252 - 261.
  13. Madsen, C. B., Sørensen, M. K. D., and Vittrup, M. (2003). Estimating positions and radiances of a small number of light sources for real-time image-based lighting. In Proceedings: Annual Conference of the European Association for Computer Graphics, EUROGRAPHICS 2003, Granada, Spain, pages 37 - 44.
  14. Nielsen, M. and Madsen, C. (2007a). Graph cut based segmentation of soft shadows for seemless removal and augmentation. In Proceedings: Scandinavian Conference on Image Analysis, Aalborg, Denmark, pages 918 - 927.
  15. Nielsen, M. and Madsen, C. (2007b). Segmentation of soft shadows based on a daylight and penumbra model. In Proceedings: MIRAGE 2007, pages 341 - 352.
  16. Sato, I., Sato, Y., and Ikeuchi, K. (1999). Illumination distribution from brightness in shadows: Adaptive estimation of of illumination distribution with unknown reflectance properties in shadow regions. In Proceedings: International Conference on Computer Vision, pages 875 - 882.
  17. Schlyter, P. (2007). Computing Planetary Positions - a Tutorial With Worked Examples. www.stjarnhimlen.se/comp/tutorial.html.
  18. Yu, Y., Debevec, P., Malik, J., and Hawkins, T. (1999). Inverse global illumination: Recovering reflectance models of real scenes from photographs. In Proceedings: SIGGRAPH 1999, Los Angeles, California, USA, pages 215 - 224.
Download


Paper Citation


in Harvard Style

B. Madsen C. and Nielsen M. (2008). TOWARDS PROBE-LESS AUGMENTED REALITY - A Position Paper . In Proceedings of the Third International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2008) ISBN 978-989-8111-20-3, pages 255-261. DOI: 10.5220/0001099502550261


in Bibtex Style

@conference{grapp08,
author={Claus B. Madsen and Michael Nielsen},
title={TOWARDS PROBE-LESS AUGMENTED REALITY - A Position Paper},
booktitle={Proceedings of the Third International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2008)},
year={2008},
pages={255-261},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001099502550261},
isbn={978-989-8111-20-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2008)
TI - TOWARDS PROBE-LESS AUGMENTED REALITY - A Position Paper
SN - 978-989-8111-20-3
AU - B. Madsen C.
AU - Nielsen M.
PY - 2008
SP - 255
EP - 261
DO - 10.5220/0001099502550261