Authors:
F. Ragusa
1
;
L. Guarnera
1
;
A. Furnari
1
;
S. Battiato
1
;
G. Signorello
2
and
G. M. Farinella
3
Affiliations:
1
DMI - IPLab, University of Catania, Catania and Italia
;
2
CUTGANA, University of Catania and Italia
;
3
DMI - IPLab, University of Catania, Catania, Italia, CUTGANA, University of Catania and Italia
Keyword(s):
Localization, Video Summarization, Egocentric Vision, First Person Vision, Temporal Video Segmentation, Cultural Heritage.
Related
Ontology
Subjects/Areas/Topics:
Multimedia
;
Multimedia Databases, Indexing, Recognition and Retrieval
;
Multimedia Systems and Applications
;
Semantic Analysis of Multimedia Data
;
Telecommunications
Abstract:
We consider the problem of localizing visitors in a museum from egocentric (first person) images. Localization information can be useful to both assist the user during his visit (e.g., by suggesting where to go and what to see next) and to provide behavioral information to the manager of the museum (e.g., how much time has been spent by visitors at a given location?). To address the problem, we have considered a dataset of egocentric videos acquired using two cameras: a head-mounted HoloLens and a chest-mounted GoPro. We performed experiments exploiting a state-of-the-art method for room-based temporal segmentation of egocentric videos. Experiments pointed out that compelling information can be extracted to serve both the visitors and the site-manager. A web interface has been developed to provide a tool useful to manage the cultural site and to perform analysis of the videos acquired by visitors. Also a digital summary is generated as additional service for the visitors providing “s
harable” memories of their experience.
(More)