Detection and Classification of Holes in Point Clouds

Nader H. Aldeeb, Olaf Hellwich

2017

Abstract

Structure from Motion (SfM) is the most popular technique behind 3D image reconstruction. It is mainly based on matching features between multiple views of the target object. Therefore, it gives good results only if the target object has enough texture on its surface. If not, virtual holes are caused in the estimated models. But, not all holes that appear in the estimated model are virtual, i.e. correspond to a failure of the reconstruction. There could be a real physical hole in the structure of the target object being reconstructed. This presents ambiguity when applying a hole-filling algorithm. That is, which hole should be filled and which must be left as it is. In this paper, we first propose a simple approach for the detection of holes in point sets. Then we investigate two different measures for automatic classification of these detected holes in point sets. According to our knowledge, hole-classification has not been addressed beforehand. Experiments showed that all holes in 3D models are accurately identified and classified.

References

  1. Abdou, I. E. and Pratt, W. K., 1979. Quantitative design and evaluation of enhancement/thresholding edge detectors. Proceedings of the IEEE, 67(5), pp.753-763.
  2. Alismail, H., Browning, B. and Lucey, S., 2016. Direct Visual Odometry using Bit-Planes. arXiv preprint arXiv:1604.00990.
  3. Alismail, H., Browning, B. and Lucey, S., 2016. Photometric Bundle Adjustment for Vision-Based SLAM. arXiv preprint arXiv:1608.02026.
  4. Bendels, G. H., Schnabel, R. and Klein, R., 2006. Detecting holes in point set surfaces.
  5. Boykov, Y. and Funka-Lea, G., 2006. Graph cuts and efficient ND image segmentation. International journal of computer vision, 70(2), pp.109-131.
  6. Dey, T. K. and Giesen, J., 2003. Detecting undersampling in surface reconstruction. In Discrete and Computational Geometry (pp. 329-345).
  7. Furukawa, Y. and Ponce, J., 2010. Accurate, dense, and robust multiview stereopsis. IEEE transactions on pattern analysis and machine intelligence, 32(8), pp.1362-1376.
  8. Haluška, J., 2015. On fields inspired with the polar HSVRGB theory of Colour. arXiv preprint arXiv:1512.01440.
  9. Kong, L. X., Yao, Y. and Hu, Q. X., 2010. Hole boundary identification algorithm for 3D closed triangle mesh. Computer Engineering, 36, pp.177-180.
  10. Lindeberg, T., 2012. Scale invariant feature transform. Scholarpedia, 7(5), p.10491.
  11. Muratov, O., Slynko, Y., Chernov, V., Lyubimtseva, M., Shamsuarov, A. and Bucha, V., 2016. 3DCapture: 3D Reconstruction for a Smartphone. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (pp. 75-82).
  12. Noble, J. A., Gupta, R., Mundy, J., Schmitz, A. and Hartley, R.I., 1998. High precision X-ray stereo for automated 3D CAD-based inspection. IEEE Transactions on Robotics and automation, 14(2), pp.292-302.
  13. Saponaro, P., Sorensen, S., Rhein, S., Mahoney, A.R. and Kambhamettu, C., 2014, October. Reconstruction of textureless regions using structure from motion and image-based interpolation. In 2014 IEEE International Conference on Image Processing (ICIP) (pp. 1847- 1851). IEEE.
  14. Scharstein, D. and Szeliski, R., 2002. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International journal of computer vision, 47(1-3), pp.7-42.
  15. Snavely, N., Seitz, S. and Szeliski, R., 2006. Photo Tourism: Exploring Image Collections in 3D. ACM Transactions on Graphics.
  16. Snavely, N., Seitz, S. M. and Szeliski, R., 2008. Modeling the world from internet photo collections. International Journal of Computer Vision, 80(2), pp.189-210.
  17. Strecha, C., von Hansen, W., Van Gool, L., Fua, P. and Thoennessen, U., 2008, June. On benchmarking camera calibration and multi-view stereo for high resolution imagery. In Computer Vision and Pattern Recognition, 2008. CVPR 2008, pp. 1-8.
  18. Tomasi, C. and Kanade, T., 1992. Shape and motion from image streams under orthography: a factorization method. International Journal of Computer Vision, 9(2), pp.137-154.
  19. Wang, J. and Oliveira, M. M., 2007. Filling holes on locally smooth surfaces reconstructed from point clouds. Image and Vision Computing, 25(1), pp.103- 113.
  20. Wang, Y., Liu, R., Li, F., Endo, S., Baba, T. and Uehara, Y., 2012, August. An effective hole detection method for 3D models. In Signal Processing Conference (EUSIPCO), 2012 Proceedings of the 20th European (pp. 1940-1944). IEEE.
  21. Wu, C., 2011. VisualSFM: A visual structure from motion system.
  22. Zaman, F., Wong, Y. P. and Ng, B. Y., 2016. Densitybased Denoising of Point Cloud. arXiv preprint arXiv:1602.05312.
Download


Paper Citation


in Harvard Style

Aldeeb N. and Hellwich O. (2017). Detection and Classification of Holes in Point Clouds . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-227-1, pages 321-330. DOI: 10.5220/0006296503210330


in Bibtex Style

@conference{visapp17,
author={Nader H. Aldeeb and Olaf Hellwich},
title={Detection and Classification of Holes in Point Clouds},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={321-330},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006296503210330},
isbn={978-989-758-227-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)
TI - Detection and Classification of Holes in Point Clouds
SN - 978-989-758-227-1
AU - Aldeeb N.
AU - Hellwich O.
PY - 2017
SP - 321
EP - 330
DO - 10.5220/0006296503210330