SIMULTANEOUS REGISTRATION AND CLUSTERING FOR TEMPORAL SEGMENTATION OF FACIAL GESTURES FROM VIDEO

Fernando De la Torre, Joan Campoy, Jeffrey F. Cohn, Takeo Kanade

2007

Abstract

Temporal segmentation of facial gestures from video sequences is an important unsolved problem for automatic facial analysis. Recovering temporal gesture structure from a set of 2D facial features tracked points is a challenging problem because of the difficulty of factorizing rigid and non-rigid motion and the large variability in the temporal scale of the facial gestures. In this paper, we propose a two step approach for temporal segmentation of facial gestures. The first step consist on clustering shape and appearance features into a number of clusters and the second step involves temporally grouping these clusters. Results on clustering largely depend on the registration process. To improve the clustering/registration, we propose a Parameterized Cluster Analysis (PaCA) method that jointly performs registration and clustering. Besides the joint clustering/registration, PaCA solves the rounding off problem of existing spectral graph methods for clustering. After the clustering is performed, we group sets of clusters into facial gestures. Several toy and real examples show the benefits of our approach for temporal facial gesture segmentation.

Paper Citation

in Harvard Style

De la Torre F., Campoy J., F. Cohn J. and Kanade T. (2007). SIMULTANEOUS REGISTRATION AND CLUSTERING FOR TEMPORAL SEGMENTATION OF FACIAL GESTURES FROM VIDEO . In Proceedings of the Second International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, ISBN 978-972-8865-74-0, pages 110-115. DOI: 10.5220/0002049301100115

in Bibtex Style

@conference{visapp07,
author={Fernando De la Torre and Joan Campoy and Jeffrey F. Cohn and Takeo Kanade},
title={SIMULTANEOUS REGISTRATION AND CLUSTERING FOR TEMPORAL SEGMENTATION OF FACIAL GESTURES FROM VIDEO},
booktitle={Proceedings of the Second International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,},
year={2007},
pages={110-115},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002049301100115},
isbn={978-972-8865-74-0},
}

in EndNote Style

TY - CONF
JO - Proceedings of the Second International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,
TI - SIMULTANEOUS REGISTRATION AND CLUSTERING FOR TEMPORAL SEGMENTATION OF FACIAL GESTURES FROM VIDEO
SN - 978-972-8865-74-0
AU - De la Torre F.
AU - Campoy J.
AU - F. Cohn J.
AU - Kanade T.
PY - 2007
SP - 110
EP - 115
DO - 10.5220/0002049301100115