Social Relation Trait Discovery from Visual LifeLog Data with Facial Multi-Attribute Framework

Tung Duy Dinh, Dinh-Hieu Nguyen, Minh-Triet Tran

2018

Abstract

Social relation defines the status of interactions among individuals or groups. Although people's happiness is significantly affected by the quality of social relationships, there are few studies focusing on this aspect. This motivates us to propose a method to discover potential social relation traits, the interpersonal feelings between two people, from visual lifelog data to improve the status of our relationships. We propose Facial Multi-Attribute Framework (FMAF), a flexible network that can embed different sets of multiple pre-trained Facial Single-Attribute Networks to capture various facial features such as head pose, expression, age, and gender for social trait evaluation. We adopt the architecture of Inception-Resnet-V2 to each single attribute component to utilize the flexibility of Inception model and avoid the degradation problem with the residual module. We use a Siamese network with two FMAFs to evaluate social relation traits for two main persons in an image. Our experiment on the social relation trait dataset by Zhangpeng Zhang et.al shows that our method achieves the accuracy of 77.30%, which is 4.10% higher than the state-of-the-art result (73.20%). We also develop a prototype system integrated into Facebook to analyse and visualize the chronological changes in social traits between a user with friends in daily lives via uploaded photos and video clips.

Paper Citation

in Harvard Style

Duy Dinh T., Nguyen D. and Tran M. (2018). Social Relation Trait Discovery from Visual LifeLog Data with Facial Multi-Attribute Framework.In Proceedings of the 7th International Conference on Pattern Recognition Applications and Methods - Volume 1: INDEED, ISBN 978-989-758-276-9, pages 665-674. DOI: 10.5220/0006749206650674

in Bibtex Style

@conference{indeed18,
author={Tung Duy Dinh and Dinh-Hieu Nguyen and Minh-Triet Tran},
title={Social Relation Trait Discovery from Visual LifeLog Data with Facial Multi-Attribute Framework},
booktitle={Proceedings of the 7th International Conference on Pattern Recognition Applications and Methods - Volume 1: INDEED,},
year={2018},
pages={665-674},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006749206650674},
isbn={978-989-758-276-9},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 7th International Conference on Pattern Recognition Applications and Methods - Volume 1: INDEED,
TI - Social Relation Trait Discovery from Visual LifeLog Data with Facial Multi-Attribute Framework
SN - 978-989-758-276-9
AU - Duy Dinh T.
AU - Nguyen D.
AU - Tran M.
PY - 2018
SP - 665
EP - 674
DO - 10.5220/0006749206650674