ImpressionNet: A Multi-view Approach to Predict Socio-facial Impressions

Rohan Gupta, Dakshina Kisku

2022

Abstract

The visual facial features do reveal a lot about an individual and can be used to analyse several important social attributes. Existing works have shown that it is possible to learn these attributes through computational models and classify or score subject-faces accordingly. However, we find that there exists local variance in perception. There could be different perspectives of the face which the conventional methods fail to efficiently capture. We also note that Deeper neural networks usually require enough training data and add little to no improvement upon existing ones. In this work, we take social attribute prediction a notch higher and propose a novel multi-view regression approach to incorporate multiple views of face inspired by multi-modal learning. Experimental results show that the proposed approach can achieve superior feature generalisation and diversification on existing datasets using multiple views to improve the coefficient of determination scores and outperforms the state-of-the-art social attribute prediction method. We further propose a method that enables real-time video analysis of multiple subject faces which can have several applications.

Paper Citation

in Harvard Style

Gupta R. and Kisku D. (2022). ImpressionNet: A Multi-view Approach to Predict Socio-facial Impressions. In Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART, ISBN 978-989-758-547-0, pages 33-38. DOI: 10.5220/0010762400003116

in Bibtex Style

@conference{icaart22,
author={Rohan Gupta and Dakshina Kisku},
title={ImpressionNet: A Multi-view Approach to Predict Socio-facial Impressions},
booktitle={Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART,},
year={2022},
pages={33-38},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010762400003116},
isbn={978-989-758-547-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART,
TI - ImpressionNet: A Multi-view Approach to Predict Socio-facial Impressions
SN - 978-989-758-547-0
AU - Gupta R.
AU - Kisku D.
PY - 2022
SP - 33
EP - 38
DO - 10.5220/0010762400003116