A Modular Multimodal Multi-Object Tracking-by-Detection Approach, with Applications in Outdoor and Indoor Environments

Eduardo Borges, Luís Garrote, Urbano Nunes

2024

Abstract

Object detection and tracking are integral components of numerous modern robotics systems, playing an essential role in applications like autonomous driving and industrial Autonomous Mobile Robots (AMRs). In this paper, we propose a modular multimodal multi-object detection and tracking system tailored for AMRs in complex industrial environments. The proposed system employs a tracking-by-detection approach, utilizing both 3D point cloud and RGB data to detect and track multiple objects simultaneously. To develop it, a baseline unimodal framework was created using a PointPillars detector and the AB3DMOT tracker, operating exclusively on point cloud data. To enhance detection and tracking accuracy, a 2D object detector (YOLOv8) was integrated, enabling multimodal detection. The system’s performance was evaluated on the KITTI dataset, demonstrating notable improvements in detection accuracy and tracking consistency. This enhancement strengthens the system’s robustness and reliability, which are critical factors for real-time perception in AMRs.

Paper Citation

in Harvard Style

Borges E., Garrote L. and Nunes U. (2024). A Modular Multimodal Multi-Object Tracking-by-Detection Approach, with Applications in Outdoor and Indoor Environments. In Proceedings of the 21st International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO; ISBN 978-989-758-717-7, SciTePress, pages 336-344. DOI: 10.5220/0013073200003822

in Bibtex Style

@conference{icinco24,
author={Eduardo Borges and Luís Garrote and Urbano Nunes},
title={A Modular Multimodal Multi-Object Tracking-by-Detection Approach, with Applications in Outdoor and Indoor Environments},
booktitle={Proceedings of the 21st International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO},
year={2024},
pages={336-344},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013073200003822},
isbn={978-989-758-717-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 21st International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO
TI - A Modular Multimodal Multi-Object Tracking-by-Detection Approach, with Applications in Outdoor and Indoor Environments
SN - 978-989-758-717-7
AU - Borges E.
AU - Garrote L.
AU - Nunes U.
PY - 2024
SP - 336
EP - 344
DO - 10.5220/0013073200003822
PB - SciTePress