Fast and Robust Keypoint Detection in Unstructured 3-D Point Clouds

Jens Garstka, Gabriele Peters


In robot perception, as well as in other areas of 3-D computer vision, keypoint detection is the first major step for an efficient and accurate 3-D perception of the environment. Thus, a fast and robust algorithm for an automatic identification of keypoints in unstructured 3-D point clouds is essential. The presented algorithm is designed to be highly parallelizable and can be implemented on modern GPUs for fast execution. The computation is based on a convolution of a voxel based representation of the point cloud and a voxelized integral volume. The generation of the voxel-based representation neither requires additional surface information or normals nor needs to approximate them. The proposed approach is robust against noise up to the mean distance between the 3-D points. In addition, the algorithm provides moderate scale invariance, i. e., it can approximate keypoints for lower resolution versions of the input point cloud. This is particularly useful, if keypoints are supposed to be used with any local 3-D point cloud descriptor to recognize or classify point clouds at different scales. We evaluate our approach in a direct comparison with state-of-the-art keypoint detection algorithms in terms of repeatability and computation time.


  1. Adamson, A. and Alexa, M. (2003). Ray tracing point set surfaces. In Shape Modeling International, 2003, pages 272-279. IEEE.
  2. Bay, H., Tuytelaars, T., and Van Gool, L. (2006). Surf: Speeded up robust features. In Computer VisionECCV 2006, pages 404-417. Springer.
  3. Dutagaci, H., Cheung, C. P., and Godil, A. (2012). Evaluation of 3d interest point detection techniques via human-generated ground truth. The Visual Computer, 28(9):901-917.
  4. Filipe, S. and Alexandre, L. A. (2013). A Comparative Evaluation of 3D Keypoint Detectors. In 9th Conference on Telecommunications, Conftele 2013, pages 145-148, Castelo Branco, Portugal.
  5. Flint, A., Dick, A., and Hengel, A. v. d. (2007). Thrift: Local 3d structure recognition. In Digital Image Computing Techniques and Applications, 9th Biennial Conference of the Australian Pattern Recognition Society on, pages 182-188. IEEE.
  6. Gelfand, N., Mitra, N. J., Guibas, L. J., and Pottmann, H. (2005). Robust global registration. In Symposium on geometry processing, volume 2, page 5.
  7. Guo, Y., Bennamoun, M., Sohel, F., Lu, M., and Wan, J. (2014). 3d object recognition in cluttered scenes with local surface features: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 99(PrePrints):1.
  8. Hornung, A. and Kobbelt, L. (2006). Robust reconstruction of watertight 3d models from non-uniformly sampled point clouds without normal information. In Proceedings of the Fourth Eurographics Symposium on Geometry Processing, SGP 7806, pages 41-50, Aire-la-Ville, Switzerland, Switzerland. Eurographics Association.
  9. Lai, K., Bo, L., Ren, X., and Fox, D. (2011a). A largescale hierarchical multi-view rgb-d object dataset. In Robotics and Automation (ICRA), 2011 IEEE International Conference on, pages 1817-1824. IEEE.
  10. Lai, K., Bo, L., Ren, X., and Fox, D. (2011b). A scalable tree-based approach for joint object and pose recognition. In AAAI.
  11. Lowe, D. G. (2004). Distinctive image features from scaleinvariant keypoints. International Journal of Computer Vision, 60:91-110.
  12. Matei, B., Shan, Y., Sawhney, H. S., Tan, Y., Kumar, R., Huber, D., and Hebert, M. (2006). Rapid object indexing using locality sensitive hashing and joint 3d-signature space estimation. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 28(7):1111-1126.
  13. Mian, A., Bennamoun, M., and Owens, R. (2010). On the repeatability and quality of keypoints for local featurebased 3d object retrieval from cluttered scenes. International Journal of Computer Vision, 89(2-3):348- 361.
  14. Pauly, M., Keiser, R., and Gross, M. (2003). Multi-scale feature extraction on point-sampled surfaces. In Computer graphics forum, volume 22, pages 281-289. Wiley Online Library.
  15. Salti, S., Tombari, F., and Stefano, L. D. (2011). A performance evaluation of 3d keypoint detectors. In 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), 2011 International Conference on, pages 236-243. IEEE.
  16. Scott, D. W. (1979). On optimal and data-based histograms. Biometrika, 66(3):pp. 605-610.
  17. Sipiran, I. and Bustos, B. (2011). Harris 3d: a robust extension of the harris operator for interest point detection on 3d meshes. The Visual Computer, 27(11):963-976.
  18. Smith, S. M. and Brady, J. M. (1997). Susana new approach to low level image processing. International journal of computer vision, 23(1):45-78.
  19. Stanford (2014). The stanford 3d scanning repository.
  20. Unnikrishnan, R. and Hebert, M. (2008). Multi-scale interest regions from unorganized point clouds. In Computer Vision and Pattern Recognition Workshops, 2008. CVPRW'08. IEEE Computer Society Conference on, pages 1-8. IEEE.
  21. Zhong, Y. (2009). Intrinsic shape signatures: A shape descriptor for 3d object recognition. In Computer Vision Workshops (ICCV Workshops), 2009 IEEE 12th International Conference on, pages 689-696. IEEE.

Paper Citation

in Harvard Style

Garstka J. and Peters G. (2015). Fast and Robust Keypoint Detection in Unstructured 3-D Point Clouds . In Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-989-758-123-6, pages 131-140. DOI: 10.5220/0005569501310140

in Bibtex Style

author={Jens Garstka and Gabriele Peters},
title={Fast and Robust Keypoint Detection in Unstructured 3-D Point Clouds},
booktitle={Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},

in EndNote Style

JO - Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - Fast and Robust Keypoint Detection in Unstructured 3-D Point Clouds
SN - 978-989-758-123-6
AU - Garstka J.
AU - Peters G.
PY - 2015
SP - 131
EP - 140
DO - 10.5220/0005569501310140