Noise-resistant Unsupervised Object Segmentation in Multi-view Indoor Point Clouds

Dmytro Bobkov, Sili Chen, Martin Kiechle, Sebastian Hilsenbeck, Eckehard Steinbach

2017

Abstract

3D object segmentation in indoor multi-view point clouds (MVPC) is challenged by a high noise level, varying point density and registration artifacts. This severely deteriorates the segmentation performance of state-of-the- art algorithms in concave and highly-curved point set neighborhoods, because concave regions normally serve as evidence for object boundaries. To address this issue, we derive a novel robust criterion to detect and remove such regions prior to segmentation so that noise modelling is not required anymore. Thus, a significant number of inter-object connections can be removed and the graph partitioning problem becomes simpler. After initial segmentation, such regions are labelled using a novel recovery procedure. Our approach has been experimentally validated within a typical segmentation pipeline on multi-view and single-view point cloud data. To foster further research, we make the labelled MVPC dataset public (Bobkov et al., 2017).

References

  1. Armeni, I., Sener, O., Zamir, A. R., Jiang, H., Brilakis, I., Fischer, M., and Savarese, S. (2016). 3d semantic parsing of large-scale indoor spaces. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition.
  2. Bobkov, D., Chen, S., Kiechle, M., Hilsenbeck, S., and Steinbach, E. (2017). Supplementary material for paper: Noise-resistant unsupervised object segmentation in multi-view indoor point clouds. https://github.com/DBobkov/segmentation. Accessed: 2016-11-29.
  3. Boulch, A. and Marlet, R. (2012). Fast and robust normal estimation for point clouds with sharp features. Computer Graphics Forum, 31(5):1765-1774.
  4. Boyko, A. and Funkhouser, T. (2014). Cheaper by the dozen: Group annotation of 3D data. In UIST.
  5. Deng, Z., Todorovic, S., and Jan Latecki, L. (2015). Semantic segmentation of rgbd images with mutex constraints. In The IEEE International Conference on Computer Vision (ICCV).
  6. Felzenszwalb, P. F. and Huttenlocher, D. P. (2004). Efficient graph-based image segmentation. International Journal on Computer Vision, 59(2):167-181.
  7. Fouhey, D., Gupta, A., and Hebert, M. (2014). Unfolding an indoor origami world. In Fleet, D., Pajdla, T., Schiele, B., and Tuytelaars, T., editors, Computer Vision ECCV 2014, volume 8694 of Lecture Notes in Computer Science, pages 687-702. Springer International Publishing.
  8. Gupta, S., Arbelez, P., and Malik, J. (2013). Perceptual organization and recognition of indoor scenes from rgbd images. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 564- 571.
  9. Huitl, R., Schroth, G., Hilsenbeck, S., Schweiger, F., and Steinbach, E. (2012). TUMindoor: an extensive image and point cloud dataset for visual indoor localization and mapping. In IEEE International Conference on Image Processing (ICIP 2012), Orlando, FL, USA.
  10. Jiang, H. (2014). Finding approximate convex shapes in rgbd images. In Computer Vision ECCV 2014, volume 8691 of Lecture Notes in Computer Science, pages 582-596. Springer International Publishing.
  11. Karpathy, A., Miller, S., and Fei-Fei, L. (2013). Object discovery in 3D scenes via shape analysis. In Robotics and Automation (ICRA), 2013 IEEE International Conference on, pages 2088-2095.
  12. Lai, K., Bo, L., Ren, X., and Fox, D. (2013). Rgb-d object recognition: Features, algorithms, and a large scale benchmark. In Consumer Depth Cameras for Computer Vision, pages 167-192. Springer.
  13. Liu, T., Carlberg, M., Chen, G., Chen, J., Kua, J., and Zakhor, A. (2010). Indoor localization and visualization using a human-operated backpack system. In Indoor Positioning and Indoor Navigation (IPIN), 2010 International Conference on, pages 1-10.
  14. Mattausch, O., Panozzo, D., Mura, C., Sorkine-Hornung, O., and Pajarola, R. (2014). Object detection and classification from large-scale cluttered indoor scans. Computer Graphics Forum, 33(2):11-21.
  15. Mian, A., Bennamoun, M., and Owens, R. (2006). Threedimensional model-based object recognition and segmentation in cluttered scenes. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 28(10):1584-1601.
  16. N. Silberman, D. Hoiem, P. K. and Fergus, R. (2012). Indoor segmentation and support inference from RGBD images. In ECCV.
  17. Papon, J., Abramov, A., Schoeler, M., and Worgotter, F. (2013). Voxel cloud connectivity segmentation - supervoxels for point clouds. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 2027-2034.
  18. Pomerleau, F., Colas, F., Siegwart, R., and Magnenat, S. (2013). Comparing icp variants on real-world data sets. Autonomous Robots, 34(3):133-148.
  19. Richtsfeld, A., Morwald, T., Prankl, J., Zillich, M., and Vincze, M. (2012). Segmentation of unknown objects in indoor environments. In Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference on, pages 4791-4796.
  20. Rusu, R. B., Marton, Z. C., Blodow, N., Dolha, M., and Beetz, M. (2008). Towards 3D point cloud based object maps for household environments. robotics and autonomous systems.
  21. Song, S. and Xiao, J. (2014). Sliding shapes for 3d object detection in depth images. In Computer Vision-ECCV 2014, pages 634-651. Springer International Publishing.
  22. Soni, N., Namboodiri, A. M., Jawahar, C., and Ramalingam, S. (2015). Semantic classification of boundaries of an RGBD image. In Proceedings of the British Machine Vision Conference (BMVC 2015), pages 114.1-114.12. BMVA Press.
  23. Stein, S., Schoeler, M., Papon, J., and Worgotter, F. (2014). Object partitioning using local convexity. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 304-311.
  24. Tateno, K., Tombari, F., and Navab, N. (2015). Realtime and scalable incremental segmentation on dense slam. In Intelligent Robots and Systems (IROS), 2015 IEEE/RSJ International Conference on, pages 4465- 4472. IEEE.
  25. van Kaick, O., Fish, N., Kleiman, Y., Asafi, S., and CohenOr, D. (2014). Shape segmentation by approximate convexity analysis. ACM Transactions on Graphics.
  26. Xiao, J., Owens, A., and Torralba, A. (2013). Sun3d: A database of big spaces reconstructed using sfm and object labels. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 1625-1632.
Download


Paper Citation


in Harvard Style

Bobkov D., Chen S., Kiechle M., Hilsenbeck S. and Steinbach E. (2017). Noise-resistant Unsupervised Object Segmentation in Multi-view Indoor Point Clouds . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-226-4, pages 149-156. DOI: 10.5220/0006100801490156


in Bibtex Style

@conference{visapp17,
author={Dmytro Bobkov and Sili Chen and Martin Kiechle and Sebastian Hilsenbeck and Eckehard Steinbach},
title={Noise-resistant Unsupervised Object Segmentation in Multi-view Indoor Point Clouds},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={149-156},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006100801490156},
isbn={978-989-758-226-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP, (VISIGRAPP 2017)
TI - Noise-resistant Unsupervised Object Segmentation in Multi-view Indoor Point Clouds
SN - 978-989-758-226-4
AU - Bobkov D.
AU - Chen S.
AU - Kiechle M.
AU - Hilsenbeck S.
AU - Steinbach E.
PY - 2017
SP - 149
EP - 156
DO - 10.5220/0006100801490156