GPU-FRIENDLY MULTI-VIEW STEREO FOR OUTDOOR PLANAR SCENE RECONSTRUCTION

Hyojin Kim, Quinn Hunter, Mark Duchaineau, Kenneth Joy, Nelson Max

2012

Abstract

This paper presents a new multi-view stereo approach that reconstructs aerial or outdoor scenes in both a planar and a point representation. One of the key features is to integrate two heterogeneous schemes for planar and non-planar reconstruction, given a color segmentation where each segment is classified as either planar or non-planar. In planar reconstruction, an optimal plane for each segment is chosen among possible plane candidates by comparing the remapped reference segment region with multiple target images in parallel on a GPU. In point reconstruction for non-planar objects, remapped pixel descriptors along an epipolar line pair are efficiently matched on a GPU. Our method also detects and discards incorrect segment planes and outliers that have a large 3D discontinuity with the neighboring segment planes. Several aerial and outdoor scene reconstruction results with quantitative analyses are provided.

References

  1. Bay, H., Ess, A., Tuytelaars, T., and Gool, L. V. (2008). Surf: Speeded up robust features. In Computer Vision and Image Understanding, volume 110, pages 346- 359.
  2. Bleyer, M., Rother, C., and Kohli, P. (2010). Surface stereo with soft segmentation. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1570- 1577.
  3. Cignoni, P. and Ranzuglia, G. (2011). Mesh lab. Website. available at http://meshlab.sourceforge.net.
  4. Comaniciu, D. and Meer, P. (2002). Mean shift: A robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24:603-619.
  5. Furukawa, Y. and Ponce, J. (2009). Accurate, dense, and robust multi-view stereopsis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32:1362- 1376.
  6. Gallup, D., Frahm, J.-M., Mordohai, P., Yang, Q., and Pollefeys, M. (2007). Real-time plane-sweeping stereo with multiple sweeping directions. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1-8.
  7. Habbecke, M. and Kobbelt, L. (2006). Iterative multi-view plane fitting. In 11th International Fall Workshop, Vision, Modeling, and Visualization, pages 73-80.
  8. Hong, L. and Chen, G. (2004). Segment-based stereo matching using graph cuts. In IEEE Conference on Computer Vision and Pattern Recognition, pages 74- 81.
  9. Romero, C. K. (2009). Aerial images of Stockton, California. Website. available at http:// www.cognigraph.com/kique D80-Card1 101NIKON.
  10. Snavely, N., Seitz, S. M., and Szeliski, R. (2008). Modeling the world from internet photo collections. International Journal of Computer Vision, 80.
  11. Taguchi, Y., Wilburn, B., and Zitnick, C. L. (2008). Stereo reconstruction with mixed pixels using adaptive oversegmentation. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1-8.
  12. Tao, H. and Sawhney, H. S. (2000). Global matching criterion and color segmentation based stereo. In IEEE Workshop on Applications of Computer Vision, pages 246-253.
  13. Tola, E., Lepetit, V., and Fua, P. (2010). Daisy: An efficient dense descriptor applied to wide-baseline stereo. In IEEE Transactions on Pattern Analysis and Machine Intelligence, volume 32, pages 815-830.
  14. Wayne, B. (2007). Aerial images of Walnut Creek, California. Website. available at http:// www.cognigraph.com/walnut creek Nov 2005.
Download


Paper Citation


in Harvard Style

Kim H., Hunter Q., Duchaineau M., Joy K. and Max N. (2012). GPU-FRIENDLY MULTI-VIEW STEREO FOR OUTDOOR PLANAR SCENE RECONSTRUCTION . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012) ISBN 978-989-8565-04-4, pages 255-264. DOI: 10.5220/0003825502550264


in Bibtex Style

@conference{visapp12,
author={Hyojin Kim and Quinn Hunter and Mark Duchaineau and Kenneth Joy and Nelson Max},
title={GPU-FRIENDLY MULTI-VIEW STEREO FOR OUTDOOR PLANAR SCENE RECONSTRUCTION},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012)},
year={2012},
pages={255-264},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003825502550264},
isbn={978-989-8565-04-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012)
TI - GPU-FRIENDLY MULTI-VIEW STEREO FOR OUTDOOR PLANAR SCENE RECONSTRUCTION
SN - 978-989-8565-04-4
AU - Kim H.
AU - Hunter Q.
AU - Duchaineau M.
AU - Joy K.
AU - Max N.
PY - 2012
SP - 255
EP - 264
DO - 10.5220/0003825502550264