CaRaCTO: Robust Camera-Radar Extrinsic Calibration with Triple Constraint Optimization

Mahdi Chamseddine, Mahdi Chamseddine, Jason Rambach, Didier Stricker, Didier Stricker

2024

Abstract

The use of cameras and radar sensors is well established in various automation and surveillance tasks. The multimodal nature of the data captured by those two sensors allows for a myriad of applications where one covers for the shortcomings of the other. While cameras can capture high resolution color data, radar can capture the depth and velocity of targets. Calibration is a necessary step before applying fusion algorithms to the data. In this work, a robust extrinsic calibration algorithm is developed for camera-radar setups. The standard geometric constraints used in calibration are extended with elevation constraints to improve the optimization. Furthermore, the method does not rely on any external measurements beyond the camera and radar data, and does not require complex targets unlike existing work. The calibration is done in 3D thus allowing for the estimation of the elevation information that is lost when using 2D radar. The results are evaluated against a sub-millimeter ground truth system and show superior results to existing more complex algorithms. https://github.com/mahdichamseddine/CaRaCTO.

Paper Citation

in Harvard Style

Chamseddine M., Rambach J. and Stricker D. (2024). CaRaCTO: Robust Camera-Radar Extrinsic Calibration with Triple Constraint Optimization. In Proceedings of the 13th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM; ISBN 978-989-758-684-2, SciTePress, pages 534-545. DOI: 10.5220/0012369700003654

in Bibtex Style

@conference{icpram24,
author={Mahdi Chamseddine and Jason Rambach and Didier Stricker},
title={CaRaCTO: Robust Camera-Radar Extrinsic Calibration with Triple Constraint Optimization},
booktitle={Proceedings of the 13th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM},
year={2024},
pages={534-545},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012369700003654},
isbn={978-989-758-684-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM
TI - CaRaCTO: Robust Camera-Radar Extrinsic Calibration with Triple Constraint Optimization
SN - 978-989-758-684-2
AU - Chamseddine M.
AU - Rambach J.
AU - Stricker D.
PY - 2024
SP - 534
EP - 545
DO - 10.5220/0012369700003654
PB - SciTePress