Simultaneous Object Detection and Semantic Segmentation

Niels Salscheider

2020

Abstract

Both object detection in and semantic segmentation of camera images are important tasks for automated vehicles. Object detection is necessary so that the planning and behavior modules can reason about other road users. Semantic segmentation provides for example free space information and information about static and dynamic parts of the environment. There has been a lot of research to solve both tasks using Convolutional Neural Networks. These approaches give good results but are computationally demanding. In practice, a compromise has to be found between detection performance, detection quality and the number of tasks. Otherwise it is not possible to meet the real-time requirements of automated vehicles. In this work, we propose a neural network architecture to solve both tasks simultaneously. This architecture was designed to run with around 10 Hz on 1 MP images on current hardware. Our approach achieves a mean IoU of 61.2% for the semantic segmentation task on the challenging Cityscapes benchmark. It also achieves an average precision of 69.3% for cars and 67.7% for pedestrians on the moderate difficulty level of the KITTI benchmark.

Paper Citation

in Harvard Style

Salscheider N. (2020). Simultaneous Object Detection and Semantic Segmentation. In Proceedings of the 9th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-397-1, pages 555-561. DOI: 10.5220/0009142905550561

in Bibtex Style

@conference{icpram20,
author={Niels Salscheider},
title={Simultaneous Object Detection and Semantic Segmentation},
booktitle={Proceedings of the 9th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2020},
pages={555-561},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009142905550561},
isbn={978-989-758-397-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 9th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Simultaneous Object Detection and Semantic Segmentation
SN - 978-989-758-397-1
AU - Salscheider N.
PY - 2020
SP - 555
EP - 561
DO - 10.5220/0009142905550561