Camera and Lidar Cooperation for 3D Feature Extraction

Burtin Gabriel, Bonnin Patrick, Malartre Florent

2019

Abstract

The objective of this work is to use efficiently various sensors to create a SLAM system. This algorithm has to be fast (real-time), computationally light and efficient enough to allow the robot to navigate in the environment. Because other processes embedded require large amount of cpu-time, our objective was to use efficiently complementary sensors to obtain a fairly accurate localization with minimal computation. To reach this, we used a combination of two sensors: a 2D lidar and a camera, mounted above each other on the robot and oriented toward the same direction. The objective is to pinpoint and cross features in the camera and lidar FOV. Our optimized algorithms are based on segments detection. We decided to observe intersections between vertical lines seen with the camera and locate them in 3D with the ranges provided by the 2D lidar. First we implemented a RGB vertical line detector using RGB gradient and linking process, then a lidar data segmentation with accelerated computation and finally we used this feature detector in a Kalman filter. The final code is evaluated and validated using an advanced real-time robotic simulator and later confirmed with a real experiment.

Paper Citation

in Harvard Style

Gabriel B., Patrick B. and Florent M. (2019). Camera and Lidar Cooperation for 3D Feature Extraction.In Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-989-758-380-3, pages 23-33. DOI: 10.5220/0007808900230033

in Bibtex Style

@conference{icinco19,
author={Burtin Gabriel and Bonnin Patrick and Malartre Florent},
title={Camera and Lidar Cooperation for 3D Feature Extraction},
booktitle={Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2019},
pages={23-33},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007808900230033},
isbn={978-989-758-380-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - Camera and Lidar Cooperation for 3D Feature Extraction
SN - 978-989-758-380-3
AU - Gabriel B.
AU - Patrick B.
AU - Florent M.
PY - 2019
SP - 23
EP - 33
DO - 10.5220/0007808900230033