Refresh Rate Modulation for Perceptually Optimized Computer Graphics

Jeffrey Smith, Thomas Booth, Reynold Bailey

2014

Abstract

The application of human visual perception models to remove imperceptible components in a graphics system, has been proven effective in achieving significant computational speedup. Previous implementations of such techniques have focused on spatial level of detail reduction, which typically results in noticeable degradation of image quality. We introduce Refresh Rate Modulation (RRM), a novel perceptual optimization technique that produces better performance enhancement while more effectively preserving image quality and resolving static scene elements in full detail. In order to demonstrate the effectiveness of this technique, we have developed a graphics framework that interfaces with eye tracking hardware to take advantage of user fixation data in real-time. Central to the framework is a high-performance GPGPU ray-tracing engine. RRM reduces the frequency with which pixels outside of the foveal region are updated by the ray-tracer. A persistent pixel buffer is maintained such that peripheral data from previous frames provides context for the foveal image in the current frame. Applying the RRM technique to the ray-tracing engine results in a speedup of 3.2 (260 fps vs. 82 fps at 1080p) for the classic Whitted scene without secondary rays and a speedup of 6.3 (119 fps vs. 19 fps at 1080p) with them. We also observe a speedup of 2.8 (138 fps vs. 49 fps at 1080p) for a high-polygon scene that depicts the Stanford Bunny. A user study indicates that RRM achieves these results with minimal impact to perceived image quality. We also investigate the performance benefits of increasing physics engine error tolerance for bounding volume hierarchy based collision detection when the scene elements involved are in the user’s periphery. For a scene with a static high-polygon model and 50 moving spheres, a speedup of 1.8 was observed for physics calculations.

References

  1. Avidan, S. and Shamir, A. (2007). Seam carving for content-aware image resizing. In ACM SIGGRAPH 2007 papers, SIGGRAPH 7807, New York, NY, USA. ACM.
  2. Cater, K., Chalmers, A., and Ward, G. (2003). Detail to attention: exploiting visual tasks for selective rendering. In Proceedings of the 14th Eurographics workshop on Rendering, EGRW 7803, pages 270-280, Aire-la-Ville, Switzerland. Eurographics Association.
  3. Geisler, W. S. and Perry, J. S. (1999). Variableresolution displays for visual communication and simulation. SID Symposium Digest of Technical Papers, 30(1):420-423.
  4. Goldsmith, J. and Salmon, J. (1987). Automatic creation of object hierarchies for ray tracing. IEEE Comput. Graph. Appl., 7(5):14-20.
  5. Levoy, M. and Whitaker, R. (1990). Gaze-directed volume rendering. SIGGRAPH Comput. Graph., 24(2):217- 223.
  6. Livingstone, M. (2002). Vision and Art: The Biology of Seeing. Harry N. Abrams, Inc.
  7. Marmitt, G. (2002). Modeling Visual Attention in VR: Measuring the Accuracy of Predicted Scanpaths. Clemson University.
  8. McKee, S. and Nakayama, K. (1984). The detection of motion in the peripheral visual field. Vision Research, 24(1):25-32.
  9. Murphy, H. and Duchowski, A. T. (2001). Gaze-contingent level of detail rendering. In Proceedings of Eurographics 2001, Manchester, UK.
  10. O'Sullivan, C., Radach, R., and Collins, S. (1999). A model of collision perception for real-time animation. In Proc. 1999 Conference on Computer Animation and Simulation - Eurographics Workshop (EGCAS, pages 67-76. Springer.
  11. Raj, A. and Rosenholtz, R. (2010). What your design looks like to peripheral vision. In Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization, APGV 7810, pages 89-92, New York, NY, USA. ACM.
  12. Reddy, M. (2001). Perceptually optimized 3D graphics. IEEE Comput. Graph. Appl., 21(5):68-75.
  13. Thrane, N., Simonsen, L. O., and Ørbaek, P. (2005). A comparison of acceleration structures for gpu assisted ray tracing. Technical report.
  14. Wald, I. and Havran, V. (2006). On building fast kd-trees for ray tracing, and on doing that in O(N log N). In Proceedings of the 2006 IEEE Symposium on Interactive Ray Tracing, pages 61-70.
  15. Whitted, T. (1980). An improved illumination model for shaded display. Commun. ACM, 23(6):343-349.
Download


Paper Citation


in Harvard Style

Smith J., Booth T. and Bailey R. (2014). Refresh Rate Modulation for Perceptually Optimized Computer Graphics . In Proceedings of the 9th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2014) ISBN 978-989-758-002-4, pages 200-208. DOI: 10.5220/0004691102000208


in Bibtex Style

@conference{grapp14,
author={Jeffrey Smith and Thomas Booth and Reynold Bailey},
title={Refresh Rate Modulation for Perceptually Optimized Computer Graphics},
booktitle={Proceedings of the 9th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2014)},
year={2014},
pages={200-208},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004691102000208},
isbn={978-989-758-002-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2014)
TI - Refresh Rate Modulation for Perceptually Optimized Computer Graphics
SN - 978-989-758-002-4
AU - Smith J.
AU - Booth T.
AU - Bailey R.
PY - 2014
SP - 200
EP - 208
DO - 10.5220/0004691102000208