Feature Selection for Emotion Recognition based on Random Forest

Sonia Gharsalli, Bruno Emile, Hélène Laurent, Xavier Desquesnes

2016

Abstract

Automatic facial emotion recognition is a challenging problem. Emotion recognition system robustness is particularly difficult to achieve as the similarity of some emotional expressions induces confusion between them. Facial representation needs feature extraction and feature selection. This paper presents a selection method incorporated into an emotion recognition system. Appearance features are firstly extracted by a Gabor filter bank and the huge feature size is reduced by a pretreatment step. Then, an iterative selection method based on Random Forest (RF) feature importance measure is applied. Emotions are finally classified by SVM. The proposed approach is evaluated on the Cohn-Kanade database with seven expressions (anger, happiness, fear, disgust, sadness, surprise and the neutral expression). Emotion recognition rate achieves 95.2% after feature selection and an improvement of 22% for sadness recognition is noticed. PCA is also used to select features and compared to RF base feature selection method. As well, a comparison with emotion recognition methods from literature which use a feature selection step is done.

References

  1. Bartlett, M.-S., Gwen, L., Ian, F., and Javier, R.-M. (2003). Real time face detection and facial expression recognition: Development and applications to human computer interaction. Computer Vision and Pattern Recognition Workshop.
  2. Benli, K. and Eskil, M. (2014). Extraction and selection of muscle based features for facial expression recognition. 22nd International Conference on Pattern Recognition, pages 1651-1656.
  3. Bradski, G., Darrell, T., Essa, I., Malik, J., Perona, P., Sclaroff, S., and Tomasi, C. (2006). http ://sourceforge.net/projects/opencvlibrary/.
  4. Breiman, L. (2001.). Random forests. Machine learning, 45(1):5-32.
  5. Chuang, Z.-J. and Wu, C.-H. (2004). Multi-modal emotion recognition from speech and text. Computational Linguistics and Chinese Language Processing, 9:45-62.
  6. Ekman, P. (1992). An argument for basic emotions. cognition and emotion, pages 169-200.
  7. Genuer, R., Poggi, J. M., and Malot, C. T. (2010). Variable selection using random forests. Pattern Recognition Letters, 31(14):2225-2236.
  8. Kanade, T., Cohn, J. F., and Yingli, T. (2000). Comprehensive database for facial expression analysis. 4th IEEE International conference on Automatic Face and Gesture Recognition.
  9. Kotsia, I., Buciu, I., and Pitas, I. (2008). An analysis of facial expression recognition under partial facial image occlusion. Image and Vision Computing, 26(7):1052- 1067.
  10. Lajevardi, S. and Hussain, Z. (2009). Feature selection for facial expression recognition based on mutual information. 5th IEEE GCC Conference and Exhibition, pages 1 - 5.
  11. Li, P., Phung, P., Bouzerdoum, A., and Tivive, F. (2010). Feature selection for facial expression recognition. 2nd European Workshop on Visual Information Processing, pages 35-39.
  12. Movellan, J. (2005). Tutorial on gabor filters. MPLab Tutorials, UCSD MPLab, Tech.
  13. Shan, C., Gong, S., and McOwan, P. (2009). Facial expression recognition based on local binary patterns: A comprehensive study. Image and Vision Computing, 27:803-816.
  14. Soyel, H. and Demirel, H. (2010). Optimal feature selection for 3d facial expression recognition using coarse-tofine classification. Turkish Journal of Electrical Engineering and Computer Sciences., 18(6):1031-1040.
  15. Viola, P. and Jones, M. (2001). Robust real-time object detection. In International Journal of Computer Vision.
  16. Zhang, L., Tjondronegoro, D., and Chandran, V. (2011). Evaluation of texture and geometry for dimensional facial expression recognition. International Conference on Digital Image Computing: Techniques and Applications, pages 620-626.
Download


Paper Citation


in Harvard Style

Gharsalli S., Emile B., Laurent H. and Desquesnes X. (2016). Feature Selection for Emotion Recognition based on Random Forest . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 610-617. DOI: 10.5220/0005725206100617


in Bibtex Style

@conference{visapp16,
author={Sonia Gharsalli and Bruno Emile and Hélène Laurent and Xavier Desquesnes},
title={Feature Selection for Emotion Recognition based on Random Forest},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={610-617},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005725206100617},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)
TI - Feature Selection for Emotion Recognition based on Random Forest
SN - 978-989-758-175-5
AU - Gharsalli S.
AU - Emile B.
AU - Laurent H.
AU - Desquesnes X.
PY - 2016
SP - 610
EP - 617
DO - 10.5220/0005725206100617