Authors:
Adrien Chan-Hon-Tong
1
;
Nicolas Ballas
1
;
Bertrand Delezoide
1
;
Catherine Achard
2
;
Laurent Lucat
1
;
Patrick Sayd
1
and
Françoise Prêteux
3
Affiliations:
1
CEA, LIST and DIASI, France
;
2
UPMC, France
;
3
Mines ParisTech, France
Keyword(s):
Skeleton Trajectory, Human Activity Classification.
Related
Ontology
Subjects/Areas/Topics:
Computer Vision, Visualization and Computer Graphics
;
Features Extraction
;
Image and Video Analysis
Abstract:
Automatic human action annotation is a challenging problem, which overlaps with many computer vision fields such as video-surveillance, human-computer interaction or video mining. In this work, we offer a skeleton based algorithm to classify segmented human-action sequences. Our contribution is twofold. First, we offer and evaluate different trajectory descriptors on skeleton datasets. Six short term trajectory features
based on position, speed or acceleration are first introduced. The last descriptor is the most original since it extends the well-known bag-of-words approach to the bag-of-gestures ones for 3D position of articulations. All these descriptors are evaluated on two public databases with state-of-the art machine learning algorithms. The second contribution is to measure the influence of missing data on algorithms based on skeleton. Indeed skeleton extraction algorithms commonly fail on real sequences, with side or back views and very complex postures. Thus on these real d
ata, we offer to compare recognition methods based on image and those based on skeleton with many missing data.
(More)