EyeRec: An Open-source Data Acquisition Software for Head-mounted Eye-tracking

Thiago Santini, Wolfgang Fuhl, Thomas Kübler, Enkelejda Kasneci

2016

Abstract

Head-mounted eye tracking offers remarkable opportunities for human computer interaction in dynamic scenarios (e.g., driving assistance). Although a plethora of proprietary software for the acquisition of such eyetracking data exists, all of them are plagued by a critical underlying issue: their source code is not available to the end user. Thus, a researcher is left with few options when facing a scenario in which the proprietary software does not perform as expected. In such a case, the researcher is either forced to change the experimental setup (which is undesirable) or invest a considerable amount of time and money in a different eye-tracking system (which may also underperform). In this paper, we introduce EyeRec, an open-source data acquisition software for head-mounted eye-tracking. Out of the box, EyeRec offers real-time state-of-the-art pupil detection and gaze estimation, which can be easily replaced by user implemented algorithms if desired. Moreover, this software supports multiple head-mounted eye-tracking hardware, records eye and scene videos, and stores pupil and gaze information, which are also available as a real-time stream. Thus, EyeRec can be an efficient means towards facilitating gazed-based human computer interaction research and applications. Available at: www.perception.uni-tuebingen.de

References

  1. Bradski, G. et al. (2000). The OpenCV Library. Doctor Dobbs Journal, 25(11):120-126.
  2. Dalmaijer, E. S., Mathoˆt, S., and Van der Stigchel, S. (2014). Pygaze: An open-source, cross-platform toolbox for minimal-effort programming of eyetracking experiments. Behavior research methods, 46(4).
  3. Duchowski, A. T. (2002). A breadth-first survey of eyetracking applications. Behavior Research Methods, Instruments, & Computers, 34(4):455-470.
  4. Ergoneers (2014). D-Lab Manual.
  5. Ergoneers (2015). Dikablis Glasses. http://www.ergoneers.com/en/hardware/eyetracking/.
  6. Fuhl, W., Kübler, T., Sippel, K., Rosenstiel, W., and Kasneci, E. (2015). Excuse: Robust pupil detection in real-world scenarios. In Computer Analysis of Images and Patterns 2015. CAIP 2015. 16th International Conference. IEEE.
  7. Fuhl, W., Santini, T., Kübler, T., and Kasneci, E. (2016). Else: Ellipse selection for robust pupil detection in real-world environments. In Proceedings of the Symposium on Eye Tracking Research and Applications. ACM. Forthcoming.
  8. Guestrin, E. D. and Eizenman, M. (2006). General theory of remote gaze estimation using the pupil center and corneal reflections. Biomedical Engineering, IEEE Transactions on, 53(6):1124-1133.
  9. Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., and Van de Weijer, J. (2011). Eye tracking: A comprehensive guide to methods and measures. Oxford University Press.
  10. Holsanova, J., Rahm, H., and Holmqvist, K. (2006). Entry points and reading paths on newspaper spreads: comparing a semiotic analysis with eye-tracking measurements. Visual communication, 5(1):65-93.
  11. Javadi, A.-H., Hakimi, Z., Barati, M., Walsh, V., and Tcheang, L. (2015). Set: a pupil detection method using sinusoidal approximation. Frontiers in neuroengineering, 8.
  12. Kasneci, E., Kasneci, G., Kübler, T. C., and Rosenstiel, W. (2014). The applicability of probabilistic methods to the online recognition of fixations and saccades in dynamic scenes. In Proceedings of the Symposium on Eye Tracking Research and Applications, ETRA 7814, pages 323-326, New York, NY, USA. ACM.
  13. Kasneci, E., Kasneci, G., Kübler, T. C., and Rosenstiel, W. (2015). Online recognition of fixations, saccades, and smooth pursuits for automated analysis of traffic hazard perception. In Koprinkova-Hristova, P., Mladenov, V., and Kasabov, N. K., editors, Artificial Neural Networks, volume 4 of Springer Series in Bio/Neuroinformatics, pages 411-434. Springer International Publishing.
  14. Kassner, M., Patera, W., and Bulling, A. (2014). Pupil: An open source platform for pervasive eye tracking and mobile gaze-based interaction. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication, UbiComp 7814 Adjunct, pages 1151-1160, New York, NY, USA. ACM.
  15. Kübler, T., Sippel, K., Fuhl, W., Schievelbein, G., Aufreiter, J., Rosenberg, R., Rosenstiel, W., and Kasneci, E. (2015). Analysis of eye movements with Eyetrace, volume In press. Communications in Computer and Information Science (CCIS), Biomedical Engineering Systems and Technologies. Springer International Publishing.
  16. Li, D., Babcock, J., and Parkhurst, D. J. (2006). openeyes: A low-cost head-mounted eye-tracking solution. In Proceedings of the 2006 Symposium on Eye Tracking Research &Amp; Applications, ETRA 7806, pages 95- 100, New York, NY, USA. ACM.
  17. Li, D., Winfield, D., and Parkhurst, D. J. (2005). Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches. In Computer Vision and Pattern Recognition Workshops, 2005. CVPR Workshops. IEEE Computer Society Conference on, pages 79-79. IEEE.
  18. Martirena, Javier B. (2015). The VideoMan Library. http://videomanlib.sourceforge.net/.
  19. Model, D. and Eizenman, M. (2010). User-calibration-free remote gaze estimation system. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, pages 29-36. ACM.
  20. Mohammed, G. J., Hong, B. R., and Jarjes, A. A. (2012). Accurate pupil features extraction based on new projection function. Computing and Informatics, 29(4):663-680.
  21. Pirri, F., Pizzoli, M., and Rudi, A. (2011). A general method for the point of regard estimation in 3d space. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 921-928. IEEE.
  22. Qt Project (2015). The Qt Framework. http://www.qt.io/.
  23. Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological bulletin, 124(3):372.
  24. Salvucci, D. D. and Goldberg, J. H. (2000). Identifying fixations and saccades in eye-tracking protocols. In Proceedings of the 2000 symposium on Eye tracking research & applications, pages 71-78. ACM.
  25. Santini, T., Fuhl, W., K übler, T., and Kasneci, E. (2016). Bayesian identification of fixations, saccades, and smooth pursuits. In Proceedings of the Symposium on Eye Tracking Research and Applications. ACM. Forthcoming.
  26. Swirski, L., Bulling, A., and Dodgson, N. (2012). Robust real-time pupil tracking in highly off-axis images. In Proceedings of the Symposium on Eye Tracking Research and Applications, pages 173-176. ACM.
  27. Swirski, L. and Dodgson, N. A. (2013). A fully-automatic, temporal approach to single camera, glint-free 3d eye model fitting. InProceedings of ECEM 2013.
  28. Tsukada, A. and Kanade, T. (2012). Automatic acquisition of a 3d eye model for a wearable first-person vision device. In Proceedings of the Symposium on Eye Tracking Research and Applications, pages 213-216. ACM.
  29. Yamazoe, H., Utsumi, A., Yonezawa, T., and Abe, S. (2008). Remote gaze estimation with a single camera based on facial-feature tracking without special calibration actions. In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications, pages 245-250. ACM.
Download


Paper Citation


in Harvard Style

Santini T., Fuhl W., Kübler T. and Kasneci E. (2016). EyeRec: An Open-source Data Acquisition Software for Head-mounted Eye-tracking . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 384-389. DOI: 10.5220/0005758903840389


in Bibtex Style

@conference{visapp16,
author={Thiago Santini and Wolfgang Fuhl and Thomas Kübler and Enkelejda Kasneci},
title={EyeRec: An Open-source Data Acquisition Software for Head-mounted Eye-tracking},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={384-389},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005758903840389},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)
TI - EyeRec: An Open-source Data Acquisition Software for Head-mounted Eye-tracking
SN - 978-989-758-175-5
AU - Santini T.
AU - Fuhl W.
AU - Kübler T.
AU - Kasneci E.
PY - 2016
SP - 384
EP - 389
DO - 10.5220/0005758903840389