Persistence-based Interest Point Detection for 3D Deformable Surface

Xupeng Wang, Ferdous Sohel, Mohammed Bennamoun, Yulan Guo, Hang Lei

2017

Abstract

Several approaches for interest point detection on rigid shapes have been proposed, but few are available for non-rigid shapes. It is a very challenging task due to the presence of the large degrees of local deformations. This paper presents a novel method called persistence-based heat kernel signature (pHKS). It consists of two steps: scalar field construction and interest point detection. We propose to use the heat kernel signature function at a moderately small time scale to construct the scalar field. It has the advantage of being stable under various transformations. Based on the predefined scalar field, a 0-dimensional persistence diagram is computed, and the local geometric and global structural information of the shape are captured at the same time. Points with local maxima and high persistence are selected as interest points. We perform a comprehensive evaluation on two popular datasets (i.e., PHOTOMESH and Interest Points Dataset) to show the effectiveness of our method. Compared with existing techniques, our interest point detector achieves a superior performance in terms of repeatability and distinctiveness.

References

  1. Aubry, M., Schlickewei, U., and Cremers, D. (2011). The wave kernel signature: A quantum mechanical approach to shape analysis. In Computer Vision Workshops (ICCV Workshops), 2011 IEEE International Conference on, pages 1626-1633. IEEE.
  2. Bauer, U., Kerber, M., and Reininghaus, J. (2014). Distributed computation of persistent homology. In Proceedings of the Meeting on Algorithm Engineering & Expermiments, pages 31-38. Society for Industrial and Applied Mathematics.
  3. Biasotti, S., Cerri, A., Bronstein, A., and Bronstein, M. (2015). Recent trends, applications, and perspectives in 3d shape similarity assessment. In Computer Graphics Forum. Wiley Online Library.
  4. Chazal, F., Cohen-Steiner, D., Glisse, M., Guibas, L. J., and Oudot, S. Y. (2009). Proximity of persistence modules and their diagrams. In Proceedings of the twenty-fifth annual symposium on Computational geometry, pages 237-246. ACM.
  5. Chazal, F., Guibas, L. J., Oudot, S. Y., and Skraba, P. (2013). Persistence-based clustering in riemannian manifolds. Journal of the ACM (JACM), 60(6):41.
  6. Cormen, T. H. (2009). Introduction to algorithms. MIT press.
  7. Dey, T. K., Li, K., Luo, C., Ranjan, P., Safa, I., and Wang, Y. (2010). Persistent heat signature for pose-oblivious matching of incomplete models. In Computer Graphics Forum, volume 29, pages 1545-1554. Wiley Online Library.
  8. Dutagaci, H., Cheung, C. P., and Godil, A. (2012). Evaluation of 3d interest point detection techniques via human-generated ground truth. The Visual Computer, 28(9):901-917.
  9. Edelsbrunner, H. and Harer, J. (2010). Computational topology: an introduction. American Mathematical Soc.
  10. Ganapathi-Subramanian, V., Thibert, B., Ovsjanikov, M., and Guibas, L. (2016). Stable region correspondences between non-isometric shapes.
  11. Garro, V. and Giachetti, A. (2016). Scale space graph representation and kernel matching for non rigid and textured 3d shape retrieval. IEEE transactions on pattern analysis and machine intelligence, 38(6):1258-1271.
  12. Gbal, K., Baerentzen, J. A., Aanaes, H., and Larsen, R. (2009). Shape analysis using the auto diffusion function. In Computer Graphics Forum, volume 28, pages 1405-1413. Wiley Online Library.
  13. Godil, A. and Wagan, A. I. (2011). Salient local 3d features for 3d shape retrieval. In IS&T/SPIE Electronic Imaging, pages 78640S-78640S. International Society for Optics and Photonics.
  14. Guo, Y., Bennamoun, M., Sohel, F., Lu, M., and Wan, J. (2014a). 3d object recognition in cluttered scenes with local surface features: a survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(11):2270-2287.
  15. Guo, Y., Bennamoun, M., Sohel, F., Lu, M., Wan, J., and Kwok, N. M. (2016). A comprehensive performance evaluation of 3d local feature descriptors. International Journal of Computer Vision, 116(1):66-89.
  16. Guo, Y., Bennamoun, M., Sohel, F. A., Wan, J., and Lu, M. (2013a). 3d free form object recognition using rotational projection statistics. In Applications of Computer Vision (WACV), 2013 IEEE Workshop on, pages 1-8. IEEE.
  17. Guo, Y., Sohel, F., Bennamoun, M., Lu, M., and Wan, J. (2013b). Rotational projection statistics for 3d local surface description and object recognition. Int J Comput Vision, 105(1):63-86.
  18. Guo, Y., Sohel, F., Bennamoun, M., Wan, J., and Lu, M. (2014b). An accurate and robust range image registration algorithm for 3d object modeling. IEEE Transactions on Multimedia, 16(5):1377-1390.
  19. Guo, Y., Sohel, F. A., Bennamoun, M., Lu, M., and Wan, J. (2013c). Trisi: A distinctive local surface descriptor for 3d modeling and object recognition. In GRAPP/IVAPP, pages 86-93.
  20. Guo, Y., Sohel, F. A., Bennamoun, M., Wan, J., and Lu, M. (2013d). Rops: A local feature descriptor for 3d rigid objects based on rotational projection statistics. In Communications, Signal Processing, and their Applications (ICCSPA), 2013 1st International Conference on, pages 1-6. IEEE.
  21. Harris, C. and Stephens, M. (1988). A combined corner and edge detector. In Alvey vision conference, volume 15, page 50. Citeseer.
  22. Lee, C. H., Varshney, A., and Jacobs, D. W. (2005). Mesh saliency. In ACM Transactions on Graphics (TOG), volume 24, pages 659-666. ACM.
  23. Li, C., Ovsjanikov, M., and Chazal, F. (2014). Persistencebased structural recognition. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
  24. Litman, R. and Bronstein, A. M. (2014). Learning spectral descriptors for deformable shape correspondence. IEEE transactions on pattern analysis and machine intelligence, 36(1):171-180.
  25. Liu, X., Liu, L., Song, W., Liu, Y., and Ma, L. (2016). Shape context based mesh saliency detection and its applications: A survey. Computers & Graphics, 57:12-30.
  26. Lowe, D. G. (2004). Distinctive image features from scaleinvariant keypoints. International Journal of Computer Vision, 60(2):91-110.
  27. Mian, A., Bennamoun, M., and Owens, R. (2010). On the repeatability and quality of keypoints for local featurebased 3d object retrieval from cluttered scenes. International Journal of Computer Vision, 89(2-3):348- 361.
  28. Novatnack, J. and Nishino, K. (2007). Scale-dependent 3d geometric features. In 2007 IEEE 11th International Conference on Computer Vision, pages 1-8. IEEE.
  29. Ovsjanikov, M., Mérigot, Q., Mémoli, F., and Guibas, L. (2010). One point isometric matching with the heat kernel. In Computer Graphics Forum, volume 29, pages 1555-1564. Wiley Online Library.
  30. Pratikakis, I., Spagnuolo, M., Theoharis, T., and Veltkamp, R. (2010). A robust 3d interest points detector based on harris operator. In Eurographics workshop on 3D object retrieval, volume 5. Citeseer.
  31. Reuter, M., Wolter, F.-E., and Peinecke, N. (2006). Laplace-beltrami spectra as shape-dnaof surfaces and solids. Computer-Aided Design, 38(4):342-366.
  32. Sipiran, I. and Bustos, B. (2011). Harris 3d: a robust extension of the harris operator for interest point detection on 3d meshes. The Visual Computer, 27(11):963-976.
  33. Sipiran, I. and Bustos, B. (2013). A fully hierarchical approach for finding correspondences in non-rigid shapes. In Proceedings of the IEEE International Conference on Computer Vision, pages 817-824.
  34. Skraba, P., Ovsjanikov, M., Chazal, F., and Guibas, L. (2010). Persistence-based segmentation of deformable shapes. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, pages 45-52. IEEE.
  35. Sun, J., Ovsjanikov, M., and Guibas, L. (2009). A concise and provably informative multi-scale signature based on heat diffusion. In Computer graphics forum, volume 28, pages 1383-1392. Wiley Online Library.
  36. Tombari, F., Salti, S., and Di Stefano, L. (2013). Performance evaluation of 3D keypoint detectors. International Journal of Computer Vision, 102(1-3):198-220.
  37. Wang, X., Sohel, F., Bennamoun, M., and Lei, H. (2015). Binary descriptor based on heat diffusion for non-rigid shape analysis. In Pacific-Rim Symposium on Image and Video Technology, pages 751-761. Springer.
  38. Wang, X., Sohel, F., Bennamoun, M., and Lei, H. (2016). Heat propagation contours for 3d non-rigid shape analysis. In 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), pages 1-7. IEEE.
  39. Xie, J., Wang, M., and Fang, Y. (2016). Learned binary spectral shape descriptor for 3d shape correspondence. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 3309-3317.
  40. Zaharescu, A., Boyer, E., and Horaud, R. (2012). Keypoints and local descriptors of scalar functions on 2d manifolds. International Journal of Computer Vision, 100(1):78-98.
Download


Paper Citation


in Harvard Style

Wang X., Sohel F., Bennamoun M., Guo Y. and Lei H. (2017). Persistence-based Interest Point Detection for 3D Deformable Surface . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017) ISBN 978-989-758-224-0, pages 58-69. DOI: 10.5220/0006093800580069


in Bibtex Style

@conference{grapp17,
author={Xupeng Wang and Ferdous Sohel and Mohammed Bennamoun and Yulan Guo and Hang Lei},
title={Persistence-based Interest Point Detection for 3D Deformable Surface},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017)},
year={2017},
pages={58-69},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006093800580069},
isbn={978-989-758-224-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017)
TI - Persistence-based Interest Point Detection for 3D Deformable Surface
SN - 978-989-758-224-0
AU - Wang X.
AU - Sohel F.
AU - Bennamoun M.
AU - Guo Y.
AU - Lei H.
PY - 2017
SP - 58
EP - 69
DO - 10.5220/0006093800580069