Supervised versus Self-supervised Assistant for Surveillance of Harbor Fronts

Jinsong Liu, Mark P. Philipsen, Thomas B. Moeslund

2021

Abstract

Drowning in harbors and along waterfronts is a serious problem, worsened by the challenge of achieving timely rescue efforts. To address this problem, we propose a privacy-friendly assistant surveillance system for identifying potentially hazardous situations (human activities near the water’s edge) in order to give early warning. This will allow lifeguards and first responders to react proactively with a basis in accurate information. In order to achieve this, we develop and compare two vision-based solutions. One is a supervised approach based on the popular object detection framework, which allows us to detect humans in a defined area near the water’s edge. The other is a self-supervised approach where anomalies are detected based on the reconstruction error from an autoencoder. To best comply with privacy requirements both solutions rely on thermal imaging captured in an active harbor environment. With a dataset having both safe and risky scenes, the two solutions are evaluated and compared, showing that the detector-based method wins in terms of performances, while the autoencoder-based method has the benefit of not requiring expensive annotations.

Paper Citation

in Harvard Style

Liu J., Philipsen M. and Moeslund T. (2021). Supervised versus Self-supervised Assistant for Surveillance of Harbor Fronts. In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP; ISBN 978-989-758-488-6, SciTePress, pages 610-617. DOI: 10.5220/0010323906100617

in Bibtex Style

@conference{visapp21,
author={Jinsong Liu and Mark P. Philipsen and Thomas B. Moeslund},
title={Supervised versus Self-supervised Assistant for Surveillance of Harbor Fronts},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP},
year={2021},
pages={610-617},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010323906100617},
isbn={978-989-758-488-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP
TI - Supervised versus Self-supervised Assistant for Surveillance of Harbor Fronts
SN - 978-989-758-488-6
AU - Liu J.
AU - Philipsen M.
AU - Moeslund T.
PY - 2021
SP - 610
EP - 617
DO - 10.5220/0010323906100617
PB - SciTePress