Light Field Rendering for Head Mounted Displays using Pixel Reprojection

Anne Juhler Hansen, Jákup Klein, Martin Kraus

2017

Abstract

Light field displays have advantages over traditional stereoscopic head mounted displays, for example, because they can overcome the vergence-accommodation conflict. However, rendering light fields can be a heavy task for computers due to the number of images that have to be rendered. Since much of the information of the different images is redundant, we use pixel reprojection from the corner cameras to compute the remaining images in the light field. We compare the reprojected images with directly rendered images in a user test. In most cases, the users were unable to distinguish the images. In extreme cases, the reprojection approach is not capable of creating the light field. We conclude that pixel reprojection is a feasible method for rendering light fields as far as quality of perspective and diffuse shading is concerned, but render time needs to be reduced to make the method practical.

References

  1. Adelson, S. J. and Hodges, L. F. (1995). Generating exact ray-traced animation frames by reprojection. IEEE Computer Graphics and Applications, 15(3):43-52.
  2. Borg, M., Johansen, S. S., Thomsen, D. L., and Kraus, M. (2012). Practical implementation of a graphics turing test. In International Symposium on Visual Computing, pages 305-313. Springer.
  3. Cunningham, D. W. and Wallraven, C. (2011). Experimental design: From user studies to psychophysics. CRC Press.
  4. Havran, V., Damez, C., Myszkowski, K., and Seidel, H.- P. (2003). An efficient spatio-temporal architecture for animation rendering. In ACM SIGGRAPH 2003 Sketches & Applications, pages 1-1. ACM.
  5. Hoffman, D. M., Girshick, A. R., Akeley, K., and Banks, M. S. (2008). Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. Journal of vision, 8(3):33.
  6. Kang, S. B. (1998). Geometrically valid pixel reprojection methods for novel view synthesis. ISPRS journal of photogrammetry and remote sensing, 53(6):342-353.
  7. Lanman, D. and Luebke, D. (2013). Near-eye light field displays. ACM Transactions on Graphics (TOG), 32(6):220.
  8. Levoy, M. (2006). Light fields and computational imaging. IEEE Computer, 39(8):46-55.
  9. Levoy, M. and Hanrahan, P. (1996). Light field rendering. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, pages 31- 42. ACM.
  10. McKee, S. P., Klein, S. A., and Teller, D. Y. (1985). Statistical properties of forced-choice psychometric functions: Implications of probit analysis. Perception & Psychophysics, 37(4):286-298.
  11. Nehab, D., Sander, P. V., Lawrence, J., Tatarchuk, N., and Isidoro, J. R. (2007). Accelerating real-time shading with reverse reprojection caching. In Graphics hardware, volume 41, pages 61-62.
  12. Rolland, J. and Hua, H. (2005). Head-mounted display systems. Encyclopedia of optical engineering, pages 1- 13.
  13. Shibata, T., Kim, J., Hoffman, D. M., and Banks, M. S. (2011). Visual discomfort with stereo displays: Effects of viewing distance and direction of vergenceaccommodation conflict. In IS&T/SPIE Electronic Imaging, pages 78630P-78630P. International Society for Optics and Photonics.
  14. Sitthi-amorn, P., Lawrence, J., Yang, L., Sander, P. V., Nehab, D., and Xi, J. (2008). Automated reprojectionbased pixel shader optimization. ACM Transactions on Graphics (TOG), 27(5):127.
  15. Suryakumar, R., Meyers, J. P., Irving, E. L., and Bobier, W. R. (2007). Vergence accommodation and monocular closed loop blur accommodation have similar dynamic characteristics. Vision research, 47(3):327- 337.
  16. Tawara, T., Myszkowski, K., and Seidel, H.-P. (2004). Exploiting temporal coherence in final gathering for dynamic scenes. In Computer Graphics International, 2004. Proceedings, pages 110-119. IEEE.
Download


Paper Citation


in Harvard Style

Juhler Hansen A., Klein J. and Kraus M. (2017). Light Field Rendering for Head Mounted Displays using Pixel Reprojection . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017) ISBN 978-989-758-224-0, pages 27-36. DOI: 10.5220/0006091100270036


in Bibtex Style

@conference{grapp17,
author={Anne Juhler Hansen and Jákup Klein and Martin Kraus},
title={Light Field Rendering for Head Mounted Displays using Pixel Reprojection},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017)},
year={2017},
pages={27-36},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006091100270036},
isbn={978-989-758-224-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017)
TI - Light Field Rendering for Head Mounted Displays using Pixel Reprojection
SN - 978-989-758-224-0
AU - Juhler Hansen A.
AU - Klein J.
AU - Kraus M.
PY - 2017
SP - 27
EP - 36
DO - 10.5220/0006091100270036