A Novel Technique for Point-wise Surface Normal Estimation

Daniel Barath, Ivan Eichhardt

2016

Abstract

Nowadays multi-view stereo reconstruction algorithms can achieve impressive results using many views of the scene. Our primary objective is to robustly extract more information about the underlying surface from fewer images. We present a method for point-wise surface normal and tangent plane estimation in stereo case to reconstruct real-world scenes. The proposed algorithm works for general camera model, however, we choose the pinhole-camera in order to demonstrate its efficiency. The presented method uses particle swarm optimization under geometric and epipolar constraints in order to achieve suitable speed and quality. An oriented point cloud is generated using a single point correspondence for each oriented 3D point and a cost function based on photo-consistency. It can straightforwardly be extended to multi-view reconstruction. Our method is validated in both synthesized and real tests. The proposed algorithm is compared to one of the state-of-the-art patch-based multi-view reconstruction algorithms.

References

  1. Barath, D., Molnar, J., and Hajder, L. (2015). Optimal Surface Normal from Affine Transformation. InVISAPP 2015, pages 305-316.
  2. Bradski, G. et al. (2000). The OpenCV library. Dr. Dobb's Journal of Software Tools, 25(11):120-126.
  3. Cagnoni, S. (2008). Evolutionary computer vision: a taxonomic tutorial. In HIS'08. Eighth International Conference on, pages 1-6. IEEE.
  4. Cignoni, P., Corsini, M., and Ranzuglia, G. (2008). Meshlab: an open-source 3d mesh processing system. Ercim news, 73:45-46.
  5. Faugeras, O. and Keriven, R. (2002). Variational principles, surface evolution, pde's, level set methods and the stereo problem. IEEE.
  6. Faugeras, O. and Lustman, F. (1988). Motion and structure from motion in a piecewise planar environment. Technical Report RR-0856, INRIA.
  7. Furukawa, Y. and Ponce, J. (2010). Accurate, Dense, and Robust Multiview Stereopsis. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 32(8):1362-1376.
  8. Habbecke, M. and Kobbelt, L. (2006). Iterative multi-view plane fitting. In Int. Fall Workshop of Vision, Modeling, and Visualization, pages 73-80.
  9. Habbecke, M. and Kobbelt, L. (2007). A surface-growing approach to multi-view stereo reconstruction. In CVPR'07. IEEE Conference on, pages 1-8. IEEE.
  10. Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., and Stuetzle, W. (1992). Surface reconstruction from unorganized points, volume 26. ACM.
  11. Kazhdan, M., Bolitho, M., and Hoppe, H. (2006). Poisson surface reconstruction. In Proceedings of the fourth Eurographics symposium on Geometry processing, volume 7.
  12. Kennedy, J. (2010). Particle swarm optimization. In Encyclopedia of Machine Learning, pages 760-766.
  13. Lhuillier, M. and Quan, L. (2005). A quasi-dense approach to surface reconstruction from uncalibrated images. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 27(3):418-433.
  14. Martin, J. and Crowley, J. L. (1995). Comparison of correlation techniques. In International Conference on Intelligent Autonmous Systems, Karlsruhe (Germany), pages 86-93.
  15. Megyesi, Z., Kós, G., and Chetverikov, D. (2006). Surface normal aided dense reconstruction from images. In Proceedings of Computer Vision Winter Workshop. Telc:[sn]. Citeseer.
  16. Molnár, J. and Chetverikov, D. (2014). Quadratic transformation for planar mapping of implicit surfaces. Journal of mathematical imaging and vision, 48(1):176- 184.
  17. Morel, J.-M. and Yu, G. (2009). ASIFT: A new framework for fully affine invariant image comparison. SIAM Journal on Imaging Sciences, 2(2):438-469.
  18. Pons, J.-P., Keriven, R., and Faugeras, O. (2007). Multiview stereo reconstruction and scene flow estimation with a global image-based matching score. International Journal of Computer Vision, 72(2):179-193.
  19. Shi, Y. and Eberhart, R. (1998). A modified particle swarm optimizer. In Evolutionary Computation Proceedings, 1998. IEEE World Congress on Computational Intelligence., The 1998 IEEE International Conference on, pages 69-73. IEEE.
  20. Strecha, C., Fransens, R., and Van Gool, L. (2006). Combined depth and outlier estimation in multi-view stereo. In CVPR'06 IEEE Computer Society Conference on, volume 2, pages 2394-2401. IEEE.
  21. Vu, H.-H., Labatut, P., Pons, J.-P., and Keriven, R. (2012). High accuracy and visibility-consistent dense multiview stereo. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 34(5):889-901.
  22. Yu, G. and Morel, J.-M. (2009). A fully affine invariant image comparison method. In ICASSP 2009. IEEE International Conference on, pages 1597-1600. IEEE.
  23. Zaharescu, A., Boyer, E., and Horaud, R. (2007). Transformesh: a topology-adaptive mesh-based approach to surface evolution. In ACCV'07, pages 166-175. Springer.
Download


Paper Citation


in Harvard Style

Barath D. and Eichhardt I. (2016). A Novel Technique for Point-wise Surface Normal Estimation . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 686-693. DOI: 10.5220/0005776406860693


in Bibtex Style

@conference{visapp16,
author={Daniel Barath and Ivan Eichhardt},
title={A Novel Technique for Point-wise Surface Normal Estimation},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={686-693},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005776406860693},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)
TI - A Novel Technique for Point-wise Surface Normal Estimation
SN - 978-989-758-175-5
AU - Barath D.
AU - Eichhardt I.
PY - 2016
SP - 686
EP - 693
DO - 10.5220/0005776406860693