AN AUGMENTED REALITY SYSTEM BASED ON LIGHT FIELDS

A. Quintana, R. Quirós, I. Remolar, E. Camahort

Abstract

The development of augmented reality systems that combine virtual elements with the real world is currently increasing. This paper presents an augmented reality system that renders the virtual elements from models based on the light fields. The use of these models allow us to obtain higher level of photorealism than representations that render polygons. Using light fields also allows us to keep constant the rendering time. The presented system has been implemented using the Open Source library ARToolKit and a spherical model of the light field based on the direction-and-point parameterization (DPP) with some associated depth information. The system has been validated using different light fields, and it has been compared its performance with a classic version of the ARToolKit library based on VRML files. The presented augmented reality system can be applied to the visual inspection of synthetic objects of great complexity or based on real images.

References

  1. Adelson, E. H. and Bergen, J. R. (1991). The plenoptic function and the elements of early vision. In Landy, M. S. and Movshon, A. J., editors, Computational Models of Visual Processing, pages 3-20. MIT Press.
  2. ARToolKit (2011). Artoolkit user manual, version 2.33.
  3. Asai, K., Osawa, N., Sugimoto, Y. Y., and Kondo, K. (2004). Operation-support system for transportable earth station using augmented reality. In Masoodian, M., Jones, S., and Rogers, B., editors, APCHI, volume 3101 of Lecture Notes in Computer Science, pages 9- 18. Springer.
  4. Azuma, R. T. (1997). A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments, 6(4):355-385.
  5. Camahort, E., A., and Fussell, D. S. (1998). Uniformly sampled light fields. In Rendering Techniques, pages 117-130.
  6. Escriva, M., Domingo, A., Abad, F., Vivo, R., and Camahort, E. (2006). Modeling and rendering of dpp-based light fields. Geometric Modeling and Imaging-New Trends, pages 51-56.
  7. Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. (1996). The lumigraph. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, SIGGRAPH 7896, pages 43-54.
  8. Guo, Y., Du, Q., Luo, Y., Zhang, W., and Xu, L. (2008). Application of augmented reality gis in architecture. In ISPRS08, pages 331-336.
  9. Gurrea, E. C. (2001). 4d light-field modeling and rendering.
  10. Kang, S. B., Szeliski, R., and Anandan, P. (2000). The geometry-image representation tradeoff for rendering. In Proceedings ICIP, pages 13-16.
  11. Kwon, Y. and Park, J. (2005). Tangible tele-meeting system with dv-arpn (augmented reality peripheral network). In Computational science and its applications - ICCSA 2005. International conference, Singapore, May 9-12, 2005. Proceedings, Part I, pages 913-920.
  12. Levoy, M. and Hanrahan, P. (1996). Light field rendering. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, SIGGRAPH 7896, pages 31-42. ACM.
  13. Levoy, M. and Whitted, T. (1985). The use of points as a display primitive. In Technical Report 85-022, Computer Science Department,Technical Report 85-022, Computer Science Department.
  14. Liang, C., Liu, G., and Chen, H. H. (2007). Light field acquisition using programmable aperture camera. In ICIP (5), pages 233-236.
  15. McMillan, L. and Bishop, G. (1995). Plenoptic modeling: an image-based rendering system. In Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, SIGGRAPH 7895, pages 39-46.
  16. Nischelwitzer, A., Lenz, F., Searle, G., and Holzinger, A. (2007). Some aspects of the development of low-cost augmented reality learning environments as examples for future interfaces in technology enhanced learning. In Proceedings of the 4th international conference on Universal access in human-computer interaction: applications and services, pages 728-737.
  17. Shum, H., Kang, S., and Chan, S. (2003). Survey of imagebased representations and compression techniques. IEEE Trans. Circuits Syst. Video Techn., 13(11):1020- 1037.
  18. Wagner, D. and Schmalstieg, D. (2009). Making augmented reality practical on mobile phones, part 2. IEEE Comput. Graph. Appl., 29:6-9.
  19. Wikitude (2011). Wikitude, http://www.wikitude.com/.
  20. Wong, T., Heng, P., Or, S., and Ng, W. (1997). Imagebased rendering with controllable illumination. In Proceedings of the Eurographics Workshop on Rendering Techniques 7897, pages 13-22.
Download


Paper Citation


in Harvard Style

Quintana A., Quirós R., Remolar I. and Camahort E. (2012). AN AUGMENTED REALITY SYSTEM BASED ON LIGHT FIELDS . In Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2012) ISBN 978-989-8565-02-0, pages 453-459. DOI: 10.5220/0003852204530459


in Bibtex Style

@conference{grapp12,
author={A. Quintana and R. Quirós and I. Remolar and E. Camahort},
title={AN AUGMENTED REALITY SYSTEM BASED ON LIGHT FIELDS},
booktitle={Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2012)},
year={2012},
pages={453-459},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003852204530459},
isbn={978-989-8565-02-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2012)
TI - AN AUGMENTED REALITY SYSTEM BASED ON LIGHT FIELDS
SN - 978-989-8565-02-0
AU - Quintana A.
AU - Quirós R.
AU - Remolar I.
AU - Camahort E.
PY - 2012
SP - 453
EP - 459
DO - 10.5220/0003852204530459