Improving Bag-of-Visual-Words Towards Effective Facial Expressive Image Classification

Dawood Al Chanti, Alice Caplier

2018

Abstract

Bag-of-Visual-Words (BoVW) approach has been widely used in the recent years for image classification purposes. However, the limitations regarding optimal feature selection, clustering technique, the lack of spatial organization of the data and the weighting of visual words are crucial. These factors affect the stability of the model and reduce performance. We propose to develop an algorithm based on BoVW for facial expression analysis which goes beyond those limitations. Thus the visual codebook is built by using k-Means++ method to avoid poor clustering. To exploit reliable low level features, we search for the best feature detector that avoids locating a large number of keypoints which do not contribute to the classification process. Then, we propose to compute the relative conjunction matrix in order to preserve the spatial order of the data by coding the relationships among visual words. In addition, a weighting scheme that reflects how important a visual word is with respect to a given image is introduced. We speed up the learning process by using histogram intersection kernel by Support Vector Machine to learn a discriminative classifier. The efficiency of the proposed algorithm is compared with standard bag of visual words method and with bag of visual words method with spatial pyramid. Extensive experiments on the CK+, the MMI and the JAFFE databases show good average recognition rates. Likewise, the ability to recognize spontaneous and non-basic expressive states is investigated using the DynEmo database.

Paper Citation

in Harvard Style

Al Chanti D. and Caplier A. (2018). Improving Bag-of-Visual-Words Towards Effective Facial Expressive Image Classification. In Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2018) - Volume 5: VISAPP; ISBN 978-989-758-290-5, SciTePress, pages 145-152. DOI: 10.5220/0006537601450152

in Bibtex Style

@conference{visapp18,
author={Dawood Al Chanti and Alice Caplier},
title={Improving Bag-of-Visual-Words Towards Effective Facial Expressive Image Classification},
booktitle={Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2018) - Volume 5: VISAPP},
year={2018},
pages={145-152},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006537601450152},
isbn={978-989-758-290-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2018) - Volume 5: VISAPP
TI - Improving Bag-of-Visual-Words Towards Effective Facial Expressive Image Classification
SN - 978-989-758-290-5
AU - Al Chanti D.
AU - Caplier A.
PY - 2018
SP - 145
EP - 152
DO - 10.5220/0006537601450152
PB - SciTePress