ROBUST AND UNBIASED FOREGROUND / BACKGROUND ENERGY FOR MULTI-VIEW STEREO

Zhihu Chen, Kwan-Yee K. Wong

2011

Abstract

This paper revisits the graph-cuts based approach for solving the multi-view stereo problem, and proposes a novel foreground / background energy which is shown to be unbiased and robust against noisy depth maps. Unlike most existing works which focus on deriving a robust photo-consistency energy, this paper targets at deriving a robust and unbiased foreground / background energy. By introducing a novel data-dependent foreground / background energy, we show that it is possible to recover the object surface from noisy depth maps even in the absence of the photo-consistency energy. This demonstrates that the foreground / background energy is equally important as the photo-consistency energy in graph-cuts based methods. Experiments on real data sequences further show that high quality reconstructions can be achieved using our proposed foreground / background energy with a very simple photo-consistency energy.

References

  1. Boykov, Y. and Kolmogorov, V. (2004). An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. on Pattern Analysis and Machine Intelligence, pages 1124-1137.
  2. Esteban, C. H. and Schmitt, F. (2004). Silhouette and stereo fusion for 3d object modeling. Computer Vision and Image Understanding, pages 367-392.
  3. Hernández, C., Vogiatzis, G., and Cipolla, R. (2007). Probabilistic visibility for multi-view stereo. In Proc. Conf. Computer Vision and Pattern Recognition, pages 1-8.
  4. Kolmogorov, V. and Zabih, R. (2002). Multi-camera scene reconstruction via graph cuts. In Proc. European Conf. on Computer Vision, pages 82-96.
  5. Ladikos, A., Benhimane, S., and Navab, N. (2008). Multiview reconstruction using narrow-band graph-cuts and surface normal optimization. In Proc. British Machine Vision Conference, pages 143-152.
  6. Lempitsky, V. S., Boykov, Y., and Ivanov, D. V. (2006). Oriented visibility for multiview reconstruction. In Proc. European Conf. on Computer Vision, pages 226-238.
  7. Lorensen, W. E. and Cline, H. E. (1987). Marching cubes: A high resolution 3d surface construction algorithm. SIGGRAPH Comput. Graph., pages 163-169.
  8. Seitz, S. M., Curless, B., Diebel, J., Scharstein, D., and Szeliski, R. (2006). A comparison and evaluation of multi-view stereo reconstruction algorithms. In Proc. Conf. Computer Vision and Pattern Recognition, pages 519-528.
  9. Sinha, S. N. and Pollefeys, M. (2005). Multi-view reconstruction using photo-consistency and exact silhouette constraints: A maximum-flow formulation. Proc. Int. Conf. on Computer Vision, pages 349-356.
  10. Taubin, G. (1995). A signal processing approach to fair surface design. In SIGGRAPH 7895: Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, pages 351-358.
  11. Tran, S. and Davis, L. (2006). 3d surface reconstruction using graph cuts with surface constraints. In Proc. European Conf. on Computer Vision, pages 219-231.
  12. Vogiatzis, G., Hernández Esteban, C., Torr, P. H. S., and Cipolla, R. (2007). Multiview stereo via volumetric graph-cuts and occlusion robust photo-consistency. IEEE Trans. on Pattern Analysis and Machine Intelligence, pages 2241-2246.
  13. Vogiatzis, G., Torr, P. H. S., and Cipolla, R. (2005). Multiview stereo via volumetric graph-cuts. In Proc. Conf. Computer Vision and Pattern Recognition, pages 391- 398.
Download


Paper Citation


in Harvard Style

Chen Z. and K. Wong K. (2011). ROBUST AND UNBIASED FOREGROUND / BACKGROUND ENERGY FOR MULTI-VIEW STEREO . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2011) ISBN 978-989-8425-47-8, pages 451-458. DOI: 10.5220/0003308604510458


in Bibtex Style

@conference{visapp11,
author={Zhihu Chen and Kwan-Yee K. Wong},
title={ROBUST AND UNBIASED FOREGROUND / BACKGROUND ENERGY FOR MULTI-VIEW STEREO},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2011)},
year={2011},
pages={451-458},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003308604510458},
isbn={978-989-8425-47-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2011)
TI - ROBUST AND UNBIASED FOREGROUND / BACKGROUND ENERGY FOR MULTI-VIEW STEREO
SN - 978-989-8425-47-8
AU - Chen Z.
AU - K. Wong K.
PY - 2011
SP - 451
EP - 458
DO - 10.5220/0003308604510458