Deep Learning based Object Detection and Tracking for Maritime Situational Awareness

Rihab Lahouli, Geert De Cubber, Benoît Pairet, Charles Hamesse, Timothée Fréville, Rob Haelterman

2022

Abstract

Improving real-time situational awareness using deep-learning based video processing is of great interest in maritime and inland waterway environments. For instance, automating visual analysis for the classification and interpretation of the objects surrounding a vessel remains a critical challenge towards more autonomous navigational system. The complexity dramatically increases when we address waterway environments with a more dense traffic compared to open sea, and presenting navigation marks that need to be detected and correctly understood to take correct decisions. In this paper, we will therefore propose a new training dataset tailored to the navigation and mooring in waterway environments. The dataset contains 827 representative images gathered in various Belgian waterways. The images are captured on board a navigating barge and from a camera mounted on a drone. The dataset covers a range of realistic conditions of traffic and weather conditions. We investigate in the current study the training of the YOLOv5 model for the detection of seven different classes corresponding to vessels, obstacles and different navigation marks. The detector is combined with a pretrained Deep Sort Tracker. The YOLOv5 training results proved to reach an overall mean average precision of 0.891 for an intersection over union of 0.5.

Paper Citation

in Harvard Style

Lahouli R., De Cubber G., Pairet B., Hamesse C., Fréville T. and Haelterman R. (2022). Deep Learning based Object Detection and Tracking for Maritime Situational Awareness. In Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP; ISBN 978-989-758-555-5, SciTePress, pages 643-650. DOI: 10.5220/0010901000003124

in Bibtex Style

@conference{visapp22,
author={Rihab Lahouli and Geert De Cubber and Benoît Pairet and Charles Hamesse and Timothée Fréville and Rob Haelterman},
title={Deep Learning based Object Detection and Tracking for Maritime Situational Awareness},
booktitle={Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP},
year={2022},
pages={643-650},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010901000003124},
isbn={978-989-758-555-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP
TI - Deep Learning based Object Detection and Tracking for Maritime Situational Awareness
SN - 978-989-758-555-5
AU - Lahouli R.
AU - De Cubber G.
AU - Pairet B.
AU - Hamesse C.
AU - Fréville T.
AU - Haelterman R.
PY - 2022
SP - 643
EP - 650
DO - 10.5220/0010901000003124
PB - SciTePress