Image Transformation of Eye Areas for Synthesizing Eye-contacts in Video Conferencing

Takuya Inoue, Tomokazu Takahashi, Takatsugu Hirayama, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase, Takayuki Kurozumi, Kunio Kashino

2016

Abstract

Recently, the spread of Web cameras has facilitated video-conferencing. Since a Web camera is usually located outside the display while the user looks at his/her partner in the display, there is a problem that they cannot establish eye contact with each other. Various methods have been proposed to solve this problem, but most of them required specific sensors. In this paper, we propose a method that transforms the eye areas to synthesize eye contact using a single camera that is commonly implemented in laptop computers and mobile phones. Concretely, we implemented a system which transforms the user’s eye areas in an image to his/her eye image with a straight gaze to the camera only when the user’s gaze falls in a range that the partner would perceive eye contact.

References

  1. Anstis, S., Mayhew, J., and Morley, T. (1969). The perception of where a face or television 'portrait' is looking. American J. of Psychology, 82(4):474-489.
  2. Cortes, C. and Vapnik, V. N. (1995). Support vector networks. Machine Learning, 20(3):273-297.
  3. Dalal, N. and Triggs, W. (2005). Histograms of oriented gradients for human detection. In Proc. of the 2005 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, volume 1, pages 886-893.
  4. Giger, D., Bazin, J., Kuster, C., Popa, T., and Gross, M. (2014). Gaze correction with a single webcam. In Proc. of the 2014 IEEE Int. Conf. on Multimedia and Expo, pages 68-72.
  5. Kollarits, R., Woodworth, C., and Ribera, J. (1995). An eyecontact cameras/display system for videophone applications using a conventional direct-view LCD. In Digest of 1995 SID Int. Symposium, pages 765-768.
  6. Kuster, C., Popa, T., Bazin, J., Gotsman, C., and Gross, M. (2012). Gaze correction for home video conferencing. ACM Trans. on Graphics, 31(6):174:1-174:6.
  7. Muhlbach, L., Kellner, B., Prussog, A., and Romahn, G. (1985). The importance of eye contact in videotelephone service. In Proc. of the 11th Int. Symposium on Human Factors in Telecommunications, number O-4, pages 1-8.
  8. Saragih, J., Lucey, S., and Cohn, J. (2011). Deformable model fitting by regularized landmark mean-shift. Int. J. of Computer Vision, 91(3):200-215.
  9. Solina, F. and Ravnik, R. (2011). Fixing missing eyecontact in video conferencing systems. In Proc. of the 33rd Int. Conf. on Information Technology Interfaces, pages 233-236.
  10. Sugano, Y., Matsushita, Y., Sato, Y., and Koike, H. (2015). Appearance-based gaze estimation with online calibration from mouse operations. IEEE Trans. on Human-Machine Systems, 45(6):750-760.
  11. Uono, S. and Hietanen, J. (2015). Eye contact perception in the West and East: A cross-cultural study. Plos one, 10(2):e0118094.
  12. Yang, R. and Zhang, Z. (2004). Eye gaze correction with stereovision for video-teleconferencing. IEEE Trans. on Pattern Analysis and Machine Intelligence, 26(6):956-960.
  13. Yip, B. (2005). Face and eye rectification in video conference using affine transform. In Proc. of the 2005 IEEE Int. Conf. on Image Processing, volume 3, pages 513- 516.
Download


Paper Citation


in Harvard Style

Inoue T., Takahashi T., Hirayama T., Kawanishi Y., Deguchi D., Ide I., Murase H., Kurozumi T. and Kashino K. (2016). Image Transformation of Eye Areas for Synthesizing Eye-contacts in Video Conferencing . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 273-279. DOI: 10.5220/0005668702730279


in Bibtex Style

@conference{visapp16,
author={Takuya Inoue and Tomokazu Takahashi and Takatsugu Hirayama and Yasutomo Kawanishi and Daisuke Deguchi and Ichiro Ide and Hiroshi Murase and Takayuki Kurozumi and Kunio Kashino},
title={Image Transformation of Eye Areas for Synthesizing Eye-contacts in Video Conferencing},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={273-279},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005668702730279},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)
TI - Image Transformation of Eye Areas for Synthesizing Eye-contacts in Video Conferencing
SN - 978-989-758-175-5
AU - Inoue T.
AU - Takahashi T.
AU - Hirayama T.
AU - Kawanishi Y.
AU - Deguchi D.
AU - Ide I.
AU - Murase H.
AU - Kurozumi T.
AU - Kashino K.
PY - 2016
SP - 273
EP - 279
DO - 10.5220/0005668702730279