Instance Segmentation and Detection of Children to Safeguard Vulnerable Traffic User by Infrastructure

Shiva Agrawal, Savankumar Bhanderi, Sumit Amanagi, Kristina Doycheva, Gordon Elger, Gordon Elger

2023

Abstract

Cameras mounted on intelligent roadside infrastructure units and vehicles can detect humans on the road using state-of-the-art perception algorithms, but these algorithms are presently not trained to distinguish between human and adult. However, this is a crucial requirement from a safety perspective because a child may not follow all the traffic rules, particularly while crossing the road. Moreover, a child may stop or may start playing on the road. In such situations, the separation of a child from an adult is necessary. The work in this paper targets to solve this problem by applying a transfer-learning-based neural network approach to classify child and adult separately in camera images. The described work is comprised of image data collection, data annotation, transfer learning-based model development, and evaluation. For the work, Mask-RCNN (region-based convolutional neural network) with different backbone architectures and two different baselines are investigated and the perception precision of the architectures after transfer-learning is compared. The results reveal that the best performing trained model is able to detect and classify children and adults separately in different road scenarios with segmentation mask AP (average precision) of 85% and bounding box AP of 92%.

Paper Citation

in Harvard Style

Agrawal S., Bhanderi S., Amanagi S., Doycheva K. and Elger G. (2023). Instance Segmentation and Detection of Children to Safeguard Vulnerable Traffic User by Infrastructure. In Proceedings of the 9th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS, ISBN 978-989-758-652-1, SciTePress, pages 206-214. DOI: 10.5220/0011825400003479

in Bibtex Style

@conference{vehits23,
author={Shiva Agrawal and Savankumar Bhanderi and Sumit Amanagi and Kristina Doycheva and Gordon Elger},
title={Instance Segmentation and Detection of Children to Safeguard Vulnerable Traffic User by Infrastructure},
booktitle={Proceedings of the 9th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS,},
year={2023},
pages={206-214},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011825400003479},
isbn={978-989-758-652-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 9th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS,
TI - Instance Segmentation and Detection of Children to Safeguard Vulnerable Traffic User by Infrastructure
SN - 978-989-758-652-1
AU - Agrawal S.
AU - Bhanderi S.
AU - Amanagi S.
AU - Doycheva K.
AU - Elger G.
PY - 2023
SP - 206
EP - 214
DO - 10.5220/0011825400003479
PB - SciTePress