Appearance-based Eye Control System by Manifold Learning

Ke Liang, Youssef Chahir, Michèle Molina, Charles Tijus, François Jouen

2014

Abstract

Eye-movements are increasingly employed to study usability issues in HCI (Human-Computer Interacetion) contexts. In this paper we introduce our appearance-based eye control system which utilizes 5 specific eye movements, such as closed-eye movement and eye movements with gaze fixation at the positions (up, down, right, left) for HCI applications. In order to measure these eye movements, we employ a fast appeance-based gaze tracking method with manifold learning technique. First we propose to concatenate local eye appearance Center-Symmetric Local Binary Pattern(CS-LBP) descriptor for each subregion of eye image to form an eye appearance feature vector. The calibration phase is then introduced to construct a trainning samples by spectral clustering. After that, Laplacian Eigenmaps will be applied to the trainning set and unseen input together to get the structure of eye manifolds. Finally we can infer the eye movement of the new input by its distances with the clusters in the trainning set. Experimental results demonstrate that our system with quick 4-points calibration not only can reduce the run-time cost, but also provide another way to mesure eye movements without mesuring gaze coordinates to a HCI application such as our eye control system.

References

  1. Baluja, S. and Pomerleau, D. (1994). Non-intrusive gaze tracking using artificial neural networks. Advances in Neural Information Processing Systems.
  2. Belkin, M. and Niyogi, P. (2001). Laplacian eigenmaps and spectral techniques for embedding and clustering. NIPS, 15(6):1373-1396.
  3. Belkin, M. and Niyogi, P. (2003). Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput., 15(6):1373-1396.
  4. Fukuda, T., Morimoto, K., and Yamana, H. (2011). Modelbased eye-tracking method for low-resolution eyeimages. 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction.
  5. Hansen, D. W. and Ji, Q. (2010). In the eye of the beholder: A survey of models for eyes and gaze. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(3):478-500.
  6. Heikkilä, M., Pietikäinen, M., and Schmid, C. (2009). Description of interest regions with local binary patterns. Pattern Recogn., 42(3):425-436.
  7. Lee, K.-C. and Kriegman, D. (2005). Online learning of probabilistic appearance manifolds for video-based recognition and tracking. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01, CVPR 7805, pages 852-859, Washington, DC, USA. IEEE Computer Society.
  8. Lu, F., Sugano, Y., Okabe, T., and Sato, Y. (2011). Inferring human gaze from appearance via adaptive linear regression. In Metaxas, D. N., Quan, L., Sanfeliu, A., and Gool, L. J. V., editors, ICCV, pages 153-160. IEEE.
  9. Martinez, F., Carbonne, A., and Pissaloux, E. (2012). Gaze estimation using local features and non-linear regression. ICIP(International Conference on Image Processing).
  10. Morimoto, C. H., Koons, D., Amir, A., and Flickner, M. (2000). Pupil detection and tracking using multiple light sources. Image and Vision Computing, pages 331-335.
  11. Nguyen, B. L., Chahir, Y., and Jouen, F. (2009). Eye gaze tracking. RIVF 7809.
  12. Noris, B., Benmachiche, K., and Billard, A. (2008). Calibration-free eye gaze direction detection with gaussian processes. Proceedings of the International Conference on Computer Vision Theory and Application.
  13. Rahimi, A., Recht, B., and Darrell, T. (2005). Learning appearance manifolds from video. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01, CVPR 7805, pages 868-875, Washington, DC, USA. IEEE Computer Society.
  14. Shi, J. and Malik, J. (2000). Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence.
  15. Shih, S.-W. and Liu, J. (2004). A novel approach to 3d gaze tracking using stereo cameras. IEEE Trans. Systems, Man, and Cybernetics.
  16. Stiefelhagen, R., Yang, J., and Waibel, A. (1997). Tracking eyes and monitoring eye gaze. Proc. Workshop Perceptual User Interfaces.
  17. Tan, K. H., Kriegman, D. J., and Ahuja, N. (2002). Appearance-based eye gaze estimation. Proc. Sixth IEEE Workshop Application of Computer Vision 7802.
  18. T.F.Cootes, C.J.Taylor, D.H.Cooper, and J.Graham (1995). Active shape models- their training and application. Computer vision and image understanding, 61(1):38- 59.
  19. Wang, J.-G., Sung, E., et al. (2005). Estimating the eye gaze from one eye. Computer Vision and Image Understanding.
  20. Weinberger, K. Q. and Saul, L. K. (2006). Unsupervised learning of image manifolds by semidefinite programming. Int. J. Comput. Vision, 70(1):77-90.
  21. Williams, O., Blake, A., and Cipolla, R. (2006). Sparse and semi-supervised visual mapping with the s3p. Proc. IEEE CS Conf. Computer Vision and Pattern Recognition.
  22. XU, L.-Q., Machin, D., and Sheppard, P. (1998). A novel approach to real-time non-intrusive gaze finding. Proc. British Machine Vision Conference.
  23. Zhang, J., Li, S. Z., and Wang, J. (2004). Manifold learning and applications in recognition. In in Intelligent Multimedia Processing with Soft Computing, pages 281- 300. Springer-Verlag.
  24. Zhu, Z. and Ji, Q. (2007). Novel eye gaze tracking techniques under natural head movement. IEEE TRANSACTIONS on biomedical engineering.
Download


Paper Citation


in Harvard Style

Liang K., Chahir Y., Molina M., Tijus C. and Jouen F. (2014). Appearance-based Eye Control System by Manifold Learning . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-009-3, pages 148-155. DOI: 10.5220/0004682601480155


in Bibtex Style

@conference{visapp14,
author={Ke Liang and Youssef Chahir and Michèle Molina and Charles Tijus and François Jouen},
title={Appearance-based Eye Control System by Manifold Learning},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={148-155},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004682601480155},
isbn={978-989-758-009-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014)
TI - Appearance-based Eye Control System by Manifold Learning
SN - 978-989-758-009-3
AU - Liang K.
AU - Chahir Y.
AU - Molina M.
AU - Tijus C.
AU - Jouen F.
PY - 2014
SP - 148
EP - 155
DO - 10.5220/0004682601480155