Interfacing Assessment using Facial Expression Recognition

Rune A. Andersen, Kamal Nasrollahi, Thomas B. Moeslund, Mohammad A. Haque

2014

Abstract

One of the most important issues in gaming is deciding about the employed interfacing technology. Gamepad has traditionally been a popular interfacing technology for the gaming industry, but, recently motion controlled interfacing has been used widely in this industry. This is exactly the purpose of this paper to study whether the motion controlled interface is a feasible alternative to the gamepad, when evaluated from a user experience point of view. To do so, a custom game has been developed and 25 test subjects have been asked to play the game using both types of interfaces. To evaluate the users experiences during the game, their hedonic and pragmatic quality are assessed using both subjective and objective evaluation methods in order to crossvalidate the obtained results. An application of computer vision, facial expression recognition, has been used as a non-obtrusive objective and hedonic measure. While, the score obtained by the user during the game has been used as a pragmatic quality measure. The use of facial expression recognition has, to the best of our knowledge, not been used before to assess the hedonic quality of interfaces for games. The thorough experimental results show that the user experience of the motion controlled interface is significantly better than the gamepad interface, both in terms of hedonic and pragmatic quality. The facial expression recognition system proved to be a useful non-obtrusive way to objectively evaluate the hedonic quality of the interfacing technologies.

References

  1. Bateman, S., Doucette, A., Xiao, R., Gutwin, C., Mandryk, R., and Cockburn, A. (2011). Effects of view, input device, and track width on video game driving. In Graphics Interface 2011, pages 207-214, St. John's, Canada.
  2. Birk, M. and Mandryk, R. L. (2013). Control your gameself: effects of controller type on enjoyment, motivation, and personality in game. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 7813, pages 685-694, New York, NY, USA. ACM.
  3. Crawley, M. J. (2005). Statistics: An Introduction using R. Wiley. ISBN 0-470-02297-3.
  4. Dahlgren, K. and Lyck, M. (2011). Motion control: In control or out of control? Master's thesis, Stockholm University.
  5. Deci, E. and Ryan, R. (2002). Handbook of SelfDetermination Research. University of Rochester's Press.
  6. Ghijsen, M. (2004). Facial expression analysis for human computer interaction. IEEE Transactions on Visualization and Computer Graphics, 2(3):147-161.
  7. Hassenzahl, M., Burmester, M., and Koller, F. (2003). Attrakdiff: Ein fragebogen zur messung wahrgenommener hedonischer und pragmatischer qualitt.
  8. Higgins, E. T. (1987). Self-discrepancy: a theory relating self and affect. Psychol Rev, 94(3):319-340.
  9. Jick, T. D. (1979). Mixing qualitative and quantitative methods: Triangulation in action. Administrative Science Quarterly, 24(4):pp. 602-611.
  10. Kublbeck, C. and Ernst, A. (2006). Face detection and tracking in video sequences using the modified census transformation. Image and Vision Computing, 24(6):564 - 572.
  11. Lindley, S. E., Le Couteur, J., and Berthouze, N. L. (2008). Stirring up experience through movement in game play: effects on engagement and social behaviour. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 7808, pages 511- 514, New York, NY, USA. ACM.
  12. McEwan, M., Johnson, D., Wyeth, P., and Blackler, A. (2012). Videogame control device impact on the play experience. In Proceedings of The 8th Australasian Conference on Interactive Entertainment: Playing the System, IE 7812, pages 18:1-18:3, New York, NY, USA. ACM.
  13. Natapov, D., Castellucci, S. J., and MacKenzie, I. S. (2009). Iso 9241-9 evaluation of video game controllers. In Proceedings of Graphics Interface 2009, GI 7809, pages 223-230, Toronto, Ont., Canada, Canada. Canadian Information Processing Society.
  14. Pietschmann, D., Valtin, G., and Ohler, P. (2012). The effect of authentic input devices on computer game immersion. pages 279-292.
  15. Ryan, R., Rigby, and Przybylski, A. (2006). The Motivational Pull of Video Games: A Self-Determination Theory Approach. Motivation and Emotion, 30(4):344-360.
  16. Shafer, D. M., Carbonara, C. P., and Popova, L. (2011). Spatial presence and perceived reality as predictors of motion-based video game enjoyment. Presence: Teleoper. Virtual Environ., 20(6):591-619.
  17. Skalski, P., Lange, R., Tamborini, R., and Shelton, A. (2007). Mapping the road to fun: Natural video game controllers, presence, and game enjoyment. In 57th Annual Conference of the International Communication Association.
  18. Tan, C. T., Rosser, D., Bakkes, S., and Pisan, Y. (2012). A feasibility study in using facial expressions analysis to evaluate player experiences. In Proceedings of The 8th Australasian Conference on Interactive Entertainment: Playing the System, IE 7812, pages 5:1-5:10, New York, NY, USA. ACM.
Download


Paper Citation


in Harvard Style

Andersen R., Nasrollahi K., Moeslund T. and Haque M. (2014). Interfacing Assessment using Facial Expression Recognition . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-009-3, pages 186-193. DOI: 10.5220/0004730801860193


in Bibtex Style

@conference{visapp14,
author={Rune A. Andersen and Kamal Nasrollahi and Thomas B. Moeslund and Mohammad A. Haque},
title={Interfacing Assessment using Facial Expression Recognition},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={186-193},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004730801860193},
isbn={978-989-758-009-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014)
TI - Interfacing Assessment using Facial Expression Recognition
SN - 978-989-758-009-3
AU - Andersen R.
AU - Nasrollahi K.
AU - Moeslund T.
AU - Haque M.
PY - 2014
SP - 186
EP - 193
DO - 10.5220/0004730801860193