Enhancing Recommender Systems for TV by Face Recognition

Toon De Pessemier, Damien Verlee, Luc Martens

2016

Abstract

Recommender systems have proven their usefulness as a tool to cope with the information overload problem for many online services offering movies, books, or music. Recommender systems rely on identifying individual users and deducing their preferences from the feedback they provide on the content. To automate this user identification and feedback process for TV applications, we propose a solution based on face detection and recognition services. These services output useful information such as an estimation of the age, the gender, and the mood of the person. Demographic characteristics (age and gender) are used to classify the user and cope with the cold start problem. Detected smiles and emotions are used as an automatic feedback mechanism during content consumption. Accurate results are obtained in case of a frontal view of the face. Head poses deviating from a frontal view and suboptimal illumination conditions may hinder face detection and recognition, especially if parts of the face, such as eyes or mouth are not sufficiently visible.

References

  1. Affect Analysis Group - Research Lab at the University of Pittsburgh (2015). Cohn-kanade au-coded expression database. Available at http://www.pitt.edu/ ~emotion/ck-spread.htm.
  2. Animetrics (2015). Facer identity management system: Connecting mobile devices with photographic clouds. Available at http://animetrics.com/ cloud-web-service-architecture/.
  3. Arapakis, I., Moshfeghi, Y., Joho, H., Ren, R., Hannah, D., and Jose, J. (2009). Integrating facial expressions into user profiling for the improvement of a multimodal recommender system. In Multimedia and Expo, 2009. ICME 2009. IEEE International Conference on, pages 1440-1443.
  4. De Pessemier, T., Dooms, S., and Martens, L. (2014a). Comparison of group recommendation algorithms. Multimedia Tools and Applications, 72(3):2497- 2541.
  5. De Pessemier, T., Dooms, S., and Martens, L. (2014b). Context-aware recommendations through context and activity recognition in a mobile environment. Multimedia Tools and Applications, 72(3):2925-2948.
  6. Eyeris (2015). Emovu emotion recognition software. Available at http://http://emovu.com.
  7. Face++ (2015). Leading face recognition on cloud. Available at https://http://www.faceplusplus.com/.
  8. Gourier, N., Hall, D., and Crowley, J. L. (2015a). Head pose image database. Available at http://www-prima. inrialpes.fr/perso/Gourier/Faces/HPDatabase.html.
  9. Gourier, N., Hall, D., and Crowley, J. L. (2015b). The yale face database. Available at http://vision. ucsd.edu/content/yale-face-database.
  10. Kuo, F.-F., Chiang, M.-F., Shan, M.-K., and Lee, S.-Y. (2005). Emotion-based music recommendation by association discovery from film music. In Proceedings of the 13th Annual ACM International Conference on Multimedia, MULTIMEDIA 7805, pages 507- 510, New York, NY, USA. ACM.
  11. Lucey, P., Cohn, J., Kanade, T., Saragih, J., Ambadar, Z., and Matthews, I. (2010). The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on, pages 94-101.
  12. Meier, R. (2015). Android developers blog. Available at http://android-developers.blogspot.be/2015/08/ face-detection-in-google-play-services.html.
  13. Noldus (2015a). Facereader: Facial expression recognition software. Available at http://www.noldus.com/ facereader.
  14. Noldus (2015b). Tracklab. Available at http:// www.noldus.com/innovationworks/products/tracklab.
  15. Orbeus (2015). Rekognition - integrated visual recognition solution based in the cloud. Available at https:// rekognition.com/.
  16. Park Aging Mind Lab, University of Texas (2015). Face database. Available at http://agingmind.utdallas.edu/ facedb/view/normed-faces-by-kristen-kennedy.
  17. Resnick, P. and Varian, H. R. (1997). Recommender systems. Commun. ACM, 40(3):56-58.
  18. Siebel, N. T. (2015). People tracking - the reading people tracker. Available at http://www.siebel-research.de/ people tracking/reading people tracker/.
  19. SkyBiometry (2015). Cloud-based face detection and recognition api. Available at https:// www.skybiometry.com/.
  20. Themoviedb.org (2015). TMDb API. Available at https:// www.themoviedb.org/documentation/api.
  21. Tkalcic, M., Burnik, U., and Kosir, A. (2010). Using affective parameters in a content-based recommender system for images. User Modeling and User-Adapted Interaction, 20(4):279-311.
Download


Paper Citation


in Harvard Style

De Pessemier T., Verlee D. and Martens L. (2016). Enhancing Recommender Systems for TV by Face Recognition . In Proceedings of the 12th International Conference on Web Information Systems and Technologies - Volume 2: WEBIST, ISBN 978-989-758-186-1, pages 243-250. DOI: 10.5220/0005861302430250


in Bibtex Style

@conference{webist16,
author={Toon De Pessemier and Damien Verlee and Luc Martens},
title={Enhancing Recommender Systems for TV by Face Recognition},
booktitle={Proceedings of the 12th International Conference on Web Information Systems and Technologies - Volume 2: WEBIST,},
year={2016},
pages={243-250},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005861302430250},
isbn={978-989-758-186-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Conference on Web Information Systems and Technologies - Volume 2: WEBIST,
TI - Enhancing Recommender Systems for TV by Face Recognition
SN - 978-989-758-186-1
AU - De Pessemier T.
AU - Verlee D.
AU - Martens L.
PY - 2016
SP - 243
EP - 250
DO - 10.5220/0005861302430250