Configural Representation of Facial Action Units for Spontaneous Facial Expression Recognition in the Wild

Nazil Perveen, Chalavadi Krishna Mohan

2020

Abstract

In this paper, we propose an approach for spontaneous expression recognition in the wild using configural representation of facial action units. Since all configural features do not contribute to the formation of facial expressions, we consider configural features from only those facial regions where significant movement is observed. These chosen configural features are used to identify the relevant facial action units, which are combined to recognize facial expressions. Such combinational rules are also known as coding system. However, the existing coding systems incur significant overlap among facial action units across expressions, we propose to use a coding system based on subjective interpretation of the expressions to reduce the overlap between facial action units, which leads to better recognition performance while recognizing expressions. The proposed approach is evaluated for various facial expression recognition tasks on different datasets: (a) expression recognition in controlled environment on two benchmark datasets, CK+ and JAFFE, (b) spontaneous expression recognition on two wild datasets, SFEW and AFEW, (c) laughter localization on MAHNOB laughter dataset, and (d) recognizing posed and spontaneous smiles on UVA-NEMO smile dataset.

Paper Citation

in Harvard Style

Perveen N. and Mohan C. (2020). Configural Representation of Facial Action Units for Spontaneous Facial Expression Recognition in the Wild. In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP; ISBN 978-989-758-402-2, SciTePress, pages 93-102. DOI: 10.5220/0009099700930102

in Bibtex Style

@conference{visapp20,
author={Nazil Perveen and Chalavadi Krishna Mohan},
title={Configural Representation of Facial Action Units for Spontaneous Facial Expression Recognition in the Wild},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP},
year={2020},
pages={93-102},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009099700930102},
isbn={978-989-758-402-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP
TI - Configural Representation of Facial Action Units for Spontaneous Facial Expression Recognition in the Wild
SN - 978-989-758-402-2
AU - Perveen N.
AU - Mohan C.
PY - 2020
SP - 93
EP - 102
DO - 10.5220/0009099700930102
PB - SciTePress