Real-time 3D Object Detection from Point Clouds using an RGB-D Camera

Ya Wang, Shu Xu, Andreas Zell

2020

Abstract

This paper aims at real-time high-accuracy 3D object detection from point clouds for both indoor and outdoor scenes using only a single RGB-D camera. We propose a new network system that combines both 2D and 3D object detection algorithms to achieve better real-time object detection results and has faster speed by simplifying our networks on real robots. YOLOv3 is one of the state-of-the-art object detection methods based on 2D images. Frustum PointNets is a real-time method using frustum constraints to predict a 3D bounding box of an object. Combining these two approaches can be efficient for real-time 2D-3D object detection, both indoor and outdoor. We not only have the improved training and evaluation accuracy and lower mean loss on the KITTI object detection benchmark, but also achieve better average precision (AP) on 3D detection of all classes in three different levels of difficulty. In addition, we implement our system of on-board real-time 2D and 3D object detection using only an RGB-D camera on three different hardware devices.

Paper Citation

in Harvard Style

Wang Y., Xu S. and Zell A. (2020). Real-time 3D Object Detection from Point Clouds using an RGB-D Camera. In Proceedings of the 9th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-397-1, pages 407-414. DOI: 10.5220/0008918904070414

in Bibtex Style

@conference{icpram20,
author={Ya Wang and Shu Xu and Andreas Zell},
title={Real-time 3D Object Detection from Point Clouds using an RGB-D Camera},
booktitle={Proceedings of the 9th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2020},
pages={407-414},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008918904070414},
isbn={978-989-758-397-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 9th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Real-time 3D Object Detection from Point Clouds using an RGB-D Camera
SN - 978-989-758-397-1
AU - Wang Y.
AU - Xu S.
AU - Zell A.
PY - 2020
SP - 407
EP - 414
DO - 10.5220/0008918904070414