A New Algorithm for Objective Video Quality Assessment on Eye Tracking Data

Maria Grazia Albanesi, Riccardo Amadeo

2014

Abstract

In this paper, we present an innovative algorithm based on a voting process approach, to analyse the data provided by an eye tracker during tasks of user evaluation of video quality. The algorithm relies on the hypothesis that a lower quality video is more “challenging” for the Human Visual System (HVS) than a high quality one, and therefore visual impairments influence the user viewing strategy. The goal is to generate a map of saliency of the human gaze on video signals, in order to create a No Reference objective video quality assessment metric. We consider the impairment of video compression (H.264/AVC algorithm) to generate different versions of video quality. We propose a protocol that assigns different playlists to different user groups, in order to avoid any effect of memorization of the visual stimuli on strategy. We applied our algorithm to data generated on a heterogeneous set of video clips, and the final result is the computation of statistical measures which provide a rank of the videos according to the perceived quality. Experimental results show that there is a strong correlation between the metric we propose and the quality of impaired video, and this fact confirms the initial hypothesis.

References

  1. Albanesi, M. G. & Amadeo, R., 2011. Impact of Fixation Time on Subjective Quality Metric: a New Proposal for Lossy Compression Impairment Assessment. World Academy of Science, Engineering and Technology, Volume 59, pp. 1604-1611.
  2. Boulos, F., Chen, W., Parrein, B. & Le Callet, P., 2009. A new H.264/AVC error resilience model based on Regions of Interest. Seattle, WA, Packet Video Workshop. 17th International, pp. 1-9.
  3. Cerf, M., Frady, P. E. & Koch, C., 2009. Faces and text attract gaze independent of the task: Experimental data and computer model. Journal of Vision, 9(12), pp. 1- 15.
  4. Chamaret, C. & Le Meur, O., 2008. Attention-based video reframing: Validation using eye-tracking. Tampa, FL, Pattern Recognition. 19th International Conference on, pp. 1-4.
  5. Engelke, U. et al., 2013. Comparative Study of Fixation Density Maps. IEEE Transactions on Image Processing, 22(3), pp. 1121-1133.
  6. Gulliver, S. R. & Ghinea, G., 2009. A Perceptual Comparison of Empirical and Predictive Region-ofInterest Video. IEEE Transactions on Systems, Man, and Cybernetics, part A: Systems and Humans, 39(4), pp. 744-753.
  7. Hadizadeh, H., Enriquez, M. & Bajic, I., 2012. EyeTracking Database for a Set of Standard Video Sequences. IEEE Transactions on Image Processing, 21(2), pp. 898-903.
  8. Huynh-Thu, Q. et al., 2011. Study of Rating Scales for Subjective Quality Assessment of High-Definition Video. IEEE Transactions on Broadcasting, 57(1), pp. 1-14.
  9. Kunze, K. & Strohmeier, D., 2012. Examining subjective evaluation methods used in multimedia Quality of Experience research. Yarra Valley, Australia, Quality of Multimedia Experience (QoMEX). Fourth International Workshop on, pp. 51-56.
  10. Le Meur, O., Ninassi, A., Le Callet, P. & Barba , D., 2010. Overt visual attention for free-viewing and quality assessment tasks: Impact of the regions of interest on a video quality metric. Signal Processing: Image Communication, 25(7), pp. 547-558.
  11. Le Meur, O., Ninassi, A., Le Callet, P. & Barba, D., 2010. Do video coding impairments disturb the visual attention deployment?. Signal Processing: Image Communication, 25(8), p. 597-609.
  12. Lee, J.-S. & Ebrahimi, T., 2012. Perceptual Video Compression: A Survey. IEEE Journal of selected topics in signal processing, 6(6), pp. 684-697.
  13. Linying, J., Ren, J. & Li, D., 2012. Content-based image retrieval algorithm oriented by users' experience. Melbourne, Australia, Computer Science & Education (ICCSE), 7th International Conference on, pp. 470- 474.
  14. Liu, H. & Heynderickx, I., 2011. Visual Attention in Objective Image Quality Assessment: Based on EyeTracking Data. IEEE transactions on Circuits and Systems for Video Technology, 21(7), pp. 971-982.
  15. Mittal, A., Moorthy, A., Geisler, W. & Bovik, A., 2011. Task dependence of visual attention on compressed videos: point of gaze statistics and analysis. San Francisco, CA, Human Vision and Electronic Imaging XVI.
  16. Ninassi, A., Le Meur, O., Le Callet, P. & Barba, D., 2007. Does where you Gaze on an Image Affect your Perception of Quality? Applying Visual Attention to Image Quality Metric. San Antonio, TX, s.n., pp. 169- 172.
  17. Seeling, P. & Reisslein, M., 2012. Video Transport Evaluation With H.264 Video Traces. IEEE Communications Surveys and Tutorials, 14(4), pp. 1142-1165.
  18. University of Hannover, March 2011. [Online] Available at: ftp://ftp.tnt.unihannover.de/pub/svc/ testsequences/
  19. Wang, Z., Bovik, A. C., Sheikh, H. R. & Simoncelli, E. P., 2004. Image quality assessment: from error visibility to structural similairty. IEEE Transaction on Image Processing, 14(4), pp. 600-612.
  20. Winkler, S. & Mohandas, P., 2008. The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics. IEEE Transactions on Broadcasting, 54(3), pp. 660-668.
  21. xiph.org, March 2011. Xiph.org Video Test Media. [Online] Available at: Xiph.org Video Test Media Youlong, F., Cheung, G., Tan, W.-t. & Ji, Y., 2012. GazeDriven video streaming with saliency-based dualstream switching. San Diego, CA, s.n., pp. 1-6.
  22. Zhu, H., Han, B. & Ruan, X., 2012. Visual saliency: A manifold way of perception. Tsukuba, Japan, 21st International Conference on Pattern Recognition (ICPR), pp. 2606-2609.
Download


Paper Citation


in Harvard Style

Grazia Albanesi M. and Amadeo R. (2014). A New Algorithm for Objective Video Quality Assessment on Eye Tracking Data . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-003-1, pages 462-469. DOI: 10.5220/0004672104620469


in Bibtex Style

@conference{visapp14,
author={Maria Grazia Albanesi and Riccardo Amadeo},
title={A New Algorithm for Objective Video Quality Assessment on Eye Tracking Data},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={462-469},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004672104620469},
isbn={978-989-758-003-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014)
TI - A New Algorithm for Objective Video Quality Assessment on Eye Tracking Data
SN - 978-989-758-003-1
AU - Grazia Albanesi M.
AU - Amadeo R.
PY - 2014
SP - 462
EP - 469
DO - 10.5220/0004672104620469