N-MuPeTS: Event Camera Dataset for Multi-Person Tracking and Instance Segmentation

Tobias Bolten, Christian Neumann, Regina Pohle-Fröhlich, Klaus Tönnies

2023

Abstract

Compared to well-studied frame-based imagers, event-based cameras form a new paradigm. They are biologically inspired optical sensors and differ in operation and output. While a conventional frame is dense and ordered, the output of an event camera is a sparse and unordered stream of output events. Therefore, to take full advantage of these sensors new datasets are needed for research and development. Despite their ongoing use, the selection and availability of event-based datasets is currently still limited. To address this limitation, we present a technical recording setup as well as a software processing pipeline for generating event-based recordings in the context of multi-person tracking. Our approach enables the automatic generation of highly accurate instance labels for each individual output event using color features in the scene. Additionally, we employed our method to release a dataset including one to four persons addressing the common challenges arising in multi-person tracking scenarios. This dataset contains nine different scenarios, with a total duration of over 85 minutes.

Paper Citation

in Harvard Style

Bolten T., Neumann C., Pohle-Fröhlich R. and Tönnies K. (2023). N-MuPeTS: Event Camera Dataset for Multi-Person Tracking and Instance Segmentation. In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP; ISBN 978-989-758-634-7, SciTePress, pages 290-300. DOI: 10.5220/0011680300003417

in Bibtex Style

@conference{visapp23,
author={Tobias Bolten and Christian Neumann and Regina Pohle-Fröhlich and Klaus Tönnies},
title={N-MuPeTS: Event Camera Dataset for Multi-Person Tracking and Instance Segmentation},
booktitle={Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP},
year={2023},
pages={290-300},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011680300003417},
isbn={978-989-758-634-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP
TI - N-MuPeTS: Event Camera Dataset for Multi-Person Tracking and Instance Segmentation
SN - 978-989-758-634-7
AU - Bolten T.
AU - Neumann C.
AU - Pohle-Fröhlich R.
AU - Tönnies K.
PY - 2023
SP - 290
EP - 300
DO - 10.5220/0011680300003417
PB - SciTePress