loading
Documents

Research.Publish.Connect.

Paper

Authors: Eden Pereira da Silva 1 ; Eliaquim Ramos 1 ; Leandro Tavares da Silva 2 ; Jaime Cardoso 3 and Gilson Giraldi 1

Affiliations: 1 National Laboratory for Scientific Computing, Petrópolis, Brazil ; 2 National Laboratory for Scientific Computing, Petrópolis, Brazil, Federal Center of Technology Education Celso Suckow da Fonseca, Petrópolis, Brazil ; 3 INESC TEC and University of Porto, Porto, Portugal

ISBN: 978-989-758-402-2

ISSN: 2184-4321

Keyword(s): Summarization, Cosine Similarity Metric, Total Variation, Autoencoder, K-means.

Abstract: Video summarization is an important tool considering the amount of data to analyze. Techniques in this area aim to yield synthetic and useful visual abstraction of the videos contents. Hence, in this paper we present a new summarization algorithm, based on image features, which is composed by the following steps: (i) Query video processing using cosine similarity metric and total variation smoothing to identify classes in the query sequence; (ii) With this result, build a labeled training set of frames; (iii) Generate the unlabeled training set composed by samples of the video database; (iv) Training a deep semi-supervised autoencoder; (v) Compute the K-means for each video separately, in the encoder space, with the number of clusters set as a percentage of the video size; (vi) Select key-frames in the K-means clusters to define the summaries. In this methodology, the query video is used to incorporate prior knowledge in the whole process through the obtained labeled data. The step (i ii) aims to include unknown patterns useful for the summarization process. We evaluate the methodology using some videos from OPV video database. We compare the performance of our algorithm with the VSum. The results indicate that the pipeline was well succeed in the summarization presenting a F-score value superior to VSum. (More)

PDF ImageFull Text

Download
CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 35.172.233.2

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Silva, É.; Ramos, E.; Tavares da Silva, L.; Cardoso, J. and Giraldi, G. (2020). Video Summarization through Total Variation, Deep Semi-supervised Autoencoder and Clustering Algorithms.In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, ISBN 978-989-758-402-2, ISSN 2184-4321, pages 315-322. DOI: 10.5220/0008969303150322

@conference{visapp20,
author={Silva, É. and Eliaquim Monteiro Ramos. and Leandro Tavares da Silva. and Jaime S. Cardoso. and Gilson A. Giraldi.},
title={Video Summarization through Total Variation, Deep Semi-supervised Autoencoder and Clustering Algorithms},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP,},
year={2020},
pages={315-322},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008969303150322},
isbn={978-989-758-402-2},
}

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP,
TI - Video Summarization through Total Variation, Deep Semi-supervised Autoencoder and Clustering Algorithms
SN - 978-989-758-402-2
AU - Silva, É.
AU - Ramos, E.
AU - Tavares da Silva, L.
AU - Cardoso, J.
AU - Giraldi, G.
PY - 2020
SP - 315
EP - 322
DO - 10.5220/0008969303150322

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.