OUTDOOR ILLUMINATION ESTIMATION IN IMAGE SEQUENCES FOR AUGMENTED REALITY

Claus B. Madsen, Brajesh B. Lal

Abstract

The paper presents a technique for estimating the radiance of the sky and sun for outdoor, daylight illumination conditions. Shadows cast by dynamic objects are detected using color imagery, combined with depth information from a commercial stereo camera setup. Color information extracted from the detected shadows is used to estimate the radiance of the sun. The technique does not require special purpose objects in the scene, nor does it require High Dynamic Range imagery. Results are demonstrated by rendering augmented objects into real images with shading and shadows which are consistent with the real scene.

References

  1. Barsi, L., Szimary-Kalos, L., and Szecsi, L. (2005). Imagebased illumination on the gpu. Machine Graphics and Graphics, 14(2):159 - 169.
  2. Blanco-Muriel, M., Alarcón-Padilla, D. C., LópezMoratalla, T., and Lara-Coira, M. (2001). Computing the solar vector. Solar Energy, 70(5):431 - 441.
  3. Boivin, S. and Gagalowicz, A. (2001). Image-based rendering of diffuse, specular and glossy surfaces from a single image. In Proceedings: ACM SIGGRAPH 2001, pages 107-116.
  4. Boivin, S. and Gagalowicz, A. (2002). Inverse rendering from a single image. In Proceedings: First European Conference on Color in Graphics, Images and Vision, Poitiers, France, pages 268-277.
  5. Cao, X., Shen, Y., Shah, M., and Foroosh, H. (2005). Single view compositing with shadows. The Visual Computer, pages 639 - 648.
  6. Chalidabhongse, T., Kim, K., Harwood, D., and Davis, L. (2003). A Perturbation Method for Evaluating Background Subtraction Algorithms. In Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, Nice, France.
  7. Debevec, P. (1998). Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proceedings: SIGGRAPH 1998, Orlando, Florida, USA.
  8. Debevec, P. (2002). Tutorial: Image-based lighting. IEEE Computer Graphics and Applications, pages 26 - 34.
  9. Debevec, P. and Malik, J. (1997). Recovering high dynamic range radiance maps from photographs. In Proceedings: SIGGRAPH 1997, Los Angeles, CA, USA.
  10. Dutré, P., Bekaert, P., and Bala, K. (2003). Global Illumination. A. K. Peters.
  11. Finlayson, G., Hordley, S., and Drew, M. (2002). Removing shadows from images. In Heyden, A., Sparr, G., Nielsen, M., and Johansen, P., editors, Proceedings: European Conference on Computer Vision, pages 823 - 836.
  12. Gibson, S., Cook, J., Howard, T., and Hubbold, R. (2003). Rapic shadow generation in real-world lighting environments. In Proceedings: EuroGraphics Symposium on Rendering, Leuwen, Belgium.
  13. Hara, K., Nishino, K., and Ikeuchi, K. (2005). Light source position and reflectance estimation from a single view without the distant illumination assumption. IEEE Trans. Pattern Anal. Mach. Intell., 27(4):493-505.
  14. Havran, V., Smyk, M., Krawczyk, G., Myszkowski, K., and Seidel, H.-P. (2005). Importance Sampling for Video Environment Maps. In Eurographics Symposium on Rendering 2005, pages 31-42,311, Konstanz, Germany.
  15. Horprasert, T., Harwood, D., and Davis, L. S. (1999). A statistical approach for real-time robust background subtraction and shadow detection. In Proceedings: IEEE ICCV'99 FRAME-RATE Workshop, Kerkyra, Greece.
  16. Huerta, I., Holte, M., Moeslund, T., and Gonzàlez, J. (2009). Detection and removal of chromatic moving shadows in surveillance scenarios. In Proceedings: IEEE ICCV'09, Kyoto, Japan.
  17. Jacobs, K. and Loscos, C. (2004). State of the art report on classification of illumination methods for mixed reality. In EUROGRAPHICS, Grenoble, France.
  18. Kanbara, M. and Yokoya, N. (2004). Real-time estimation of light source environment for photorealistic augmented reality. In Proceedings of the 17th ICPR, Cambridge, United Kingdom, pages 911-914.
  19. Kim, K., Chalidabhongse, T., Harwood, D., and Davis, L. (2005). Real-time Foreground-Background Segmentation using Codebook Model. Real-time Imaging, 11(3):167-256.
  20. Loscos, C., Drettakis, G., and Robert, L. (2000). Interative virtual relighting of real scenes. IEEE Transactions on Visualization and Computer Graphics, 6(4):289 - 305.
  21. Madsen, C. B. and Laursen, R. (2007). A scalable gpubased approach to shading and shadowing for photorealistic real-time augmented reality. In Proceedings: International Conference on Graphics Theory and Applications, Barcelona, Spain, pages 252 - 261.
  22. Madsen, C. B., Moeslund, T. B., Pal, A., and Balasubramanian, S. (2009). Shadow detection in dynamic scenes using dense stereo information and an outdoor illumination model. In Koch, R. and Kolb, A., editors, Proceedings: 3rd Workshop on Dynamic 3D Imaging, in conjunction with Symposium of the German Association for Pattern Recognition, Jena, Germany, pages 100 - 125.
  23. Marchand, J. A. and Onyango, C. M. (2000). Shadowinvariant classification for scenes illuminated by daylight. Journal of the Optical Society of America, 17(11):1952 - 1961.
  24. Nielsen, M. and Madsen, C. (2007). Graph cut based segmentation of soft shadows for seemless removal and augmentation. In Proceedings: Scandinavian Conference on Image Analysis, Aalborg, Denmark, pages 918 - 927.
  25. Perez, R., Seals, R., and Michalsky, J. (1993). All-weather model for sky luminance distribution-preliminary configuration and validation. Solar Energy, 50(3):235 - 245.
  26. PointGrey (2009). Bumblebee XB3 camera, Point Grey Research, www.ptgrey.com/products/bumblebee/index.html.
  27. Prati, A., Mikic, I., Trivedi, M., and Cucchiara, R. (2003). Detecting Moving Shadows: Algorithms and Evaluation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25:918-923.
  28. Preetham, A. J., Shirley, P., and Smits, B. (1999). A practical analytic model for daylight. In Proceedings of the 26th annual conference on Computer graphics and interactive techniques, SIGGRAPH 7899, pages 91-100, New York, NY, USA. ACM Press/Addison-Wesley Publishing Co.
  29. Salvador, E., Cavalarro, A., and Ebrahimi, T. (2004). Shadow identification and classification using invariant color models. Computer Vision and Image Understanding, 95:238 - 259.
  30. Sato, I., Sato, Y., and Ikeuchi, K. (1999a). Acquiring a radiance distribution to superimpose virtual objects onto a real scene. IEEE Transactions on Visualization and Computer Graphics, 5(1):1-12.
  31. Sato, I., Sato, Y., and Ikeuchi, K. (1999b). Illumination distribution from brightness in shadows: adaptive estimation of illumination distribution with unknown reflectance properties in shadow regions. In Proceedings: International Conference on Computer Vision, pages 875-882.
  32. Wang, Y. and Samaras, D. (2008). Estimation of multiple directional illuminants from a single image. Image Vision Computing, 26(9):1179-1195.
  33. Ward, G. (2009). Radiance - Synthetic Imaging System. radsite.lbl.gov/radiance/.
  34. Yu, Y., Debevec, P., Malik, J., and Hawkins, T. (1999). Inverse global illumination: Recovering reflectance models of real scenes from photographs. In Proceedings: SIGGRAPH 1999, Los Angeles, California, USA, pages 215 - 224.
Download


Paper Citation


in Harvard Style

B. Madsen C. and B. Lal B. (2011). OUTDOOR ILLUMINATION ESTIMATION IN IMAGE SEQUENCES FOR AUGMENTED REALITY . In Proceedings of the International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2011) ISBN 978-989-8425-45-4, pages 129-139. DOI: 10.5220/0003321301290139


in Bibtex Style

@conference{grapp11,
author={Claus B. Madsen and Brajesh B. Lal},
title={OUTDOOR ILLUMINATION ESTIMATION IN IMAGE SEQUENCES FOR AUGMENTED REALITY},
booktitle={Proceedings of the International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2011)},
year={2011},
pages={129-139},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003321301290139},
isbn={978-989-8425-45-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2011)
TI - OUTDOOR ILLUMINATION ESTIMATION IN IMAGE SEQUENCES FOR AUGMENTED REALITY
SN - 978-989-8425-45-4
AU - B. Madsen C.
AU - B. Lal B.
PY - 2011
SP - 129
EP - 139
DO - 10.5220/0003321301290139