A Framework for the Segmentation and Classification of 3D Point Clouds using Temporal, Spatial and Semantic Information

Mehmet Ali Çagri Tuncer, Dirk Schulz

2018

Abstract

This paper proposes a novel framework for the segmentation and classification of 3D point cloud which jointly uses spatial, temporal and semantic information. It improves the classification performance by reducing under-segmentation errors. The presented framework, which can determine the number and label of objects in each spatially extracted blob, is decomposed into three steps to acquire spatial, temporal and semantic cues. For the spatial features, blobs are extracted spatially with a neighborhood system on an occupancy grid representation. A smoothed motion field is estimated for the acquisition of temporal cue, where the grid cells are tracked using individual Kalman filters and estimated velocities are transformed to one dimensional movement directions. A support vector machine (SVM) classifier is trained to discriminate the classes of interest for the semantic information of the blobs. A confidence metric is defined to probabilistically compare the volume of each classified blob with the volume of an average object for that class. If this metric is below a predefined threshold, a sequential variant of distance dependent Chinese restaurant process (s-ddCRP) performs the final partition in this blob by using spatial and temporal information. If the s-ddCRP approach splits the blob, the partitioned sub-blobs are afterwards reassigned to new objects by the classifier. Otherwise, the queried blob remains the same. This procedure iteratively continues while searching each blob in the scene at each time frame. Experiments on data obtained with a Velodyne HDL64 scanner in real traffic scenarios illustrate that the proposed framework improves the classification performance of an SVM classifier by reducing under-segmentation errors.

Paper Citation

in Harvard Style

Tuncer M. and Schulz D. (2018). A Framework for the Segmentation and Classification of 3D Point Clouds using Temporal, Spatial and Semantic Information.In Proceedings of the 15th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-989-758-321-6, pages 325-332. DOI: 10.5220/0006858903250332

in Bibtex Style

@conference{icinco18,
author={Mehmet Ali Çagri Tuncer and Dirk Schulz},
title={A Framework for the Segmentation and Classification of 3D Point Clouds using Temporal, Spatial and Semantic Information},
booktitle={Proceedings of the 15th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2018},
pages={325-332},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006858903250332},
isbn={978-989-758-321-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - A Framework for the Segmentation and Classification of 3D Point Clouds using Temporal, Spatial and Semantic Information
SN - 978-989-758-321-6
AU - Tuncer M.
AU - Schulz D.
PY - 2018
SP - 325
EP - 332
DO - 10.5220/0006858903250332