Objective and Subjective Metrics for 3D Display Perception Evaluation

Andrea Albarelli, Luca Cosmo, Filippo Bergamasco, Andrea Gasparetto

Abstract

Many modern professional 3D display systems adopt stereo vision and viewer-dependent rendering in order to offer an immersive experience and to enable complex interaction models. Within these scenarios, the ability of the user to effectively perform a task depends both on the correct rendering of the scene and on his ability to perceive it. These factors, in turn, are affected by several error sources, such as accuracy of the user position estimation or lags between tracking and rendering. With this paper, we introduce a practical and sound method to quantitatively assess the accuracy of any view-dependent display approach and the effects of the different error sources. This is obtained by defining a number of metrics that can be used to analyze the results of a set of experiments specially crafted to tickle different aspects of the system. This fills a clear shortcoming of the evaluation methods for 3D displays found in literature, that are, for the most part, qualitative.

References

  1. Bergamasco, F., Albarelli, A., Rodola, E., and Torsello, A. (2011). Rune-tag: A high accuracy fiducial marker with strong occlusion resilience. In Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 7811, pages 113-120, Washington, DC, USA. IEEE Computer Society.
  2. Bimber, O., Wetzstein, G., Emmerling, A., and Nitschke, C. (2005). Enabling view-dependent stereoscopic projection in real environments. In Mixed and Augmented Reality, 2005. Proceedings. Fourth IEEE and ACM International Symposium on, pages 14-23.
  3. Buchanan, P. and Green, R. (2008). Creating a view dependent rendering system for mainstream use. In Image and Vision Computing New Zealand, 2008. IVCNZ 2008. 23rd International Conference, pages 1-6.
  4. Cruz-Neira, C., Sandin, D. J., and DeFanti, T. A. (1993). Surround-screen projection-based virtual reality: The design and implementation of the cave. In Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 7893, pages 135-142, New York, NY, USA. ACM.
  5. Deering, M. (1992). High resolution virtual reality. In Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 7892, pages 195-202, New York, NY, USA. ACM.
  6. Garstka, J. and Peters, G. (2011). View-dependent 3d projection using depth-image-based head tracking. In Proceedings of the 8th IEEE International Workshop on ProjectorCamera Systems, PROCAM 7811, pages 41-47. IEEE.
  7. Harish, P. and Narayanan, P. J. (2009). A view-dependent, polyhedral 3d display. In Proceedings of the 8th International Conference on Virtual Reality Continuum and Its Applications in Industry, VRCAI 7809, pages 71-75, New York, NY, USA. ACM.
  8. Hoang, A. N., Tran Hoang, V., and Kim, D. (2013). A realtime rendering technique for view-dependent stereoscopy based on face tracking. In Proceedings of the 13th International Conference on Computational Science and Its Applications - Volume 1, ICCSA'13, pages 697-707, Berlin, Heidelberg. Springer-Verlag.
  9. Parzen, E. (1962). On estimation of a probability density function and mode. The annals of mathematical statistics, 33(3):1065-1076.
  10. Pierard, S., Pierlot, V., Lejeune, A., and Van Droogenbroeck, M. (2012). I-see-3d ! an interactive and immersive system that dynamically adapts 2d projections to the location of a user's eyes. In 3D Imaging (IC3D), 2012 International Conference on, pages 1-8.
  11. Rosenblatt, M. (1956). Remarks on some nonparametric estimates of a density function. The Annals of Mathematical Statistics, 27(3):832-837.
  12. Thorpe, J. R. and Russell, M. J. (2011). Perceptual effects when scaling screen size of stereo 3d presentations. SMPTE Conferences, 2011(1):1-10.
Download


Paper Citation


in Harvard Style

Albarelli A., Cosmo L., Bergamasco F. and Gasparetto A. (2015). Objective and Subjective Metrics for 3D Display Perception Evaluation . In Proceedings of the International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM, ISBN 978-989-758-077-2, pages 309-317. DOI: 10.5220/0005280603090317


in Bibtex Style

@conference{icpram15,
author={Andrea Albarelli and Luca Cosmo and Filippo Bergamasco and Andrea Gasparetto},
title={Objective and Subjective Metrics for 3D Display Perception Evaluation},
booktitle={Proceedings of the International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM,},
year={2015},
pages={309-317},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005280603090317},
isbn={978-989-758-077-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM,
TI - Objective and Subjective Metrics for 3D Display Perception Evaluation
SN - 978-989-758-077-2
AU - Albarelli A.
AU - Cosmo L.
AU - Bergamasco F.
AU - Gasparetto A.
PY - 2015
SP - 309
EP - 317
DO - 10.5220/0005280603090317