Authors:
Ali Al-Raziqi
and
Joachim Denzler
Affiliation:
Friedrich Schiller University of Jena, Germany
Keyword(s):
Interaction Detection, Multiple Object Tracking, Unsupervised Clustering, Hierarchical Dirichlet Processes.
Abstract:
Extracting compound interactions involving multiple objects is a challenging task in computer vision due to
different issues such as the mutual occlusions between objects, the varying group size and issues raised from
the tracker. Additionally, the single activities are uncommon compared with the activities that are performed
by two or more objects, e.g., gathering, fighting, running, etc. The purpose of this paper is to address the problem
of interaction recognition among multiple objects based on dynamic features in an unsupervised manner.
Our main contribution is twofold. First, a combined framework using a tracking-by-detection framework for
trajectory extraction and HDPs for latent interaction extraction is introduced. Another important contribution
is the introduction of a new dataset, the Cavy dataset. The Cavy dataset contains about six dominant
interactions performed several times by two or three cavies at different locations. The cavies are interacting
in complicat
ed and unexpected ways, which leads to perform many interactions in a short time. This makes
working on this dataset more challenging. The experiments in this study are not only performed on the Cavy
dataset but we also use the benchmark dataset Behave. The experiments on these datasets demonstrate the
effectiveness of the proposed method. Although the our approach is completely unsupervised, we achieved
satisfactory results with a clustering accuracy of up to 68.84% on the Behave dataset and up to 45% on the
Cavy dataset.
(More)