Pluggable Drone Imaging Analysis Framework for Mob Detection during Open-air Events

Jerico Moeyersons, Brecht Verhoeve, Pieter-Jan Maenhaut, Bruno Volckaert, Filip De Turck

2019

Abstract

Drones and thermal cameras are often combined within applications such as search and rescue, and fire fighting. Due to vendor specific hardware and software, applications for these drones are hard to develop and maintain. As a result, a pluggable drone imaging analysis architecture is proposed that facilitates the development of custom image processing applications. This architecture is prototyped as a microservice-based plugin framework and allows users to build image processing applications by connecting media streams using microservices that connect inputs (e.g. regular or thermal camera image streams) to image analysis services. The prototype framework is evaluated in terms of modifiability, interoperability and performance. This evaluation has been carried out on the use case of detecting large crowds of people (mobs) during open-air events. The framework achieves modifiability and performance by being able to work in soft real-time and it achieves the interoperability by having an average successful exchange ratio of 99.998%. A new dataset containing thermal images of such mobs is presented, on which a YOLOv3 neural network is trained. The trained model is able to detect mobs on new thermal images in real-time achieving frame rates of 55 frames per second when deployed on a modern GPU.

Paper Citation

in Harvard Style

Moeyersons J., Verhoeve B., Maenhaut P., Volckaert B. and De Turck F. (2019). Pluggable Drone Imaging Analysis Framework for Mob Detection during Open-air Events.In Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-351-3, pages 64-72. DOI: 10.5220/0007260400640072

in Bibtex Style

@conference{icpram19,
author={Jerico Moeyersons and Brecht Verhoeve and Pieter-Jan Maenhaut and Bruno Volckaert and Filip De Turck},
title={Pluggable Drone Imaging Analysis Framework for Mob Detection during Open-air Events},
booktitle={Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2019},
pages={64-72},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007260400640072},
isbn={978-989-758-351-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Pluggable Drone Imaging Analysis Framework for Mob Detection during Open-air Events
SN - 978-989-758-351-3
AU - Moeyersons J.
AU - Verhoeve B.
AU - Maenhaut P.
AU - Volckaert B.
AU - De Turck F.
PY - 2019
SP - 64
EP - 72
DO - 10.5220/0007260400640072