A 3D Feature for Building Segmentation based on Shape-from-Shading

Dimitrios Konstantinidis, Vasileios Argyriou, Tania Stathaki, Nikos Grammalidis

2015

Abstract

An important cue that can assist towards an accurate building detection and segmentation is 3D information. Because of their height, buildings can easily be distinguished from the ground and small objects, allowing for their successful segmentation. Unfortunately, 3D knowledge is not always available, but there are ways to infer 3D information from 2D images. Shape-from-shading techniques extract height and surface normal information from a single 2D image by taking into consideration knowledge about illumination, reflectance and shape. In this paper, a novel feature is proposed that can describe the 3D information of reconstructed images based on a shape-from-shading technique in order to successfully acquire building boundaries. The results are promising and show that such a 3D feature can significantly assist in a correct building boundary detection and segmentation.

References

  1. Agarwal, S., Furukawa, Y., Snavely, N., Simon, I., Curless, B., Seitz, S., and Szeliski, R. (2011). Building Rome in a Day. Communications of the ACM, 54(10):105- 112.
  2. Argyriou, V. and Petrou, M. (2008). Recursive photometric stereo when multiple shadows and highlights are present. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1-6.
  3. Argyriou, V., Zafeiriou, S., Villarini, B., and Petrou, M. (2013). A sparse representation method for determining the optimal illumination directions in Photometric Stereo. Signal Processing, 93(11):3027-3038.
  4. Baillard, C., Schmid, C., Zisserman, A., and Fitzgibbon, A. (1999). Automatic line matching and 3d reconstruction of buildings from multiple views. In ISPRS Conference on Automatic Extraction of GIS Objects from Digital Imagery, volume 32, Part 3-2W5, pages 69-80.
  5. Barron, J. and Malik, J. (2013). Shape, Illumination, and Reflectance from Shading. Technical Report UCB/EECS-2013-117, EECS, UC Berkeley.
  6. Barsky, S. and Petrou, M. (2003). The 4-source photometric stereo technique for three-dimensional surfaces in the presence of highlights and shadows. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(10):1239-1252.
  7. Barsky, S. and Petrou, M. (2006). Design Issues for a Colour Photometric Stereo System. Journal of Mathematical Imaging and Vision, 24(1):143-162.
  8. Bay, H., Ess, A., Tuytelaars, T., and Van Gool, L. (2008). Speeded-up robust features (surf). Computer Vision and Image Understanding, 110(3):346-359.
  9. Bors, A., Hancock, E., and Wilson, R. (2003). Terrain analysis using radar shape-from-shading. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(8):974-992.
  10. Coleman Jr., North, E. and Jain, R. (1982). Obtaining 3- dimensional shape of textured and specular surfaces using four-source photometry. Computer Graphics and Image Processing, 18(4):309 - 328.
  11. Durou, J., Falcone, M., and Sagona, M. (2008). Numerical Methods for Shape-from-shading: A New Survey with Benchmarks. Computer Vision and Image Understanding, 109(1):22-43.
  12. Eisert, P., Steinbach, E., and Girod, B. (1999). Multihypothesis volumetric reconstruction of 3-d objects from multiple calibrated camera views. In Proceedings of International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pages 3509-3512.
  13. Fischler, M. and Bolles, R. (1981). Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6):381-395.
  14. Frankot, R. and Chellappa, R. (1988). A method for enforcing integrability in shape from shading algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence, 10(4):439-451.
  15. Geiger, A., Ziegler, J., and Stiller, C. (2011). StereoScan: Dense 3d reconstruction in real-time. In Intelligent Vehicles Symposium (IV), pages 963-968.
  16. Hamilton, W. (1844). On quaternions, or on a new system of imaginaries in algebra. Philosophical Magazine, 25(3):489-495.
  17. Horn, B. K. (1970). Shape from Shading: A method for obtaining the shape of a smooth opaque object from one view. Technical report, MIT.
  18. Kim, N., Yoo, S., and Lee, K. (2003). Polygon reduction of 3D objects using Stokes' theorem. Computer Methods and Programs in Biomedicine, 71(3):203-210.
  19. Kim, S.-I. and Li, R. (2006). Complete 3D surface reconstruction from unstructured point cloud. Journal of Mechanical Science and Technology, 20(12):2034- 2042.
  20. Kolluri, R., Shewchuk, J., and O'Brien, J. (2004). Spectral Surface Reconstruction from Noisy Point Clouds. In Symposium on Geometry Processing, pages 11-21. ACM Press.
  21. Kordelas, G., Perez-Moneo Agapito, J. D., Vegas Hernandez, J. M., and Daras, P. (2010). State-of-the-art Algorithms for Complete 3D Model Reconstruction. In Summer School ENGAGE-Immersive and Engaging Interaction with VH on Internet.
  22. Lourakis, M. and Argyros, A. (2009). SBA: a software package for generic sparse bundle adjustment. ACM Transactions on Mathematical Software, 36(1):1-30.
  23. Lowe, D. (2004). Distinctive image features from scale invariant keypoints. International Journal of Computer Vision, 60(2):91-110.
  24. MacQueen, J. (1967). Some Methods for classification and Analysis of Multivariate Observations. In Proceedings of 5th Berkeley Symposium on Mathematical Statistics and Probability, pages 281-297. University of California Press.
  25. Makantasis, K., Doulamis, A., Doulamis, N., and Ioannides, M. (2014). In the wild image retrieval and clustering for 3D cultural heritage landmarks reconstruction. Multimedia Tools and Applications, pages 1-37.
  26. Nayar, S., Ikeuchi, K., and Kanade, T. (1990). Determining shape and reflectance of hybrid surfaces by photometric sampling. IEEE Transactions on Robotics and Automation, 6(4):418-431.
  27. Petrou, M. and Barsky, S. (2001). Shadows and highlights detection in 4-source colour photometric stereo. In International Conference on Image Processing, volume 3, pages 967-970.
  28. Seitz, S. and Dyer, C. (1997). Photorealistic scene reconstruction by voxel coloring. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1067-1073.
  29. Woodham, R. (1980). Photometric method for determining surface orientation from multiple images. Optical Engineering, 19(1):139-144.
  30. Zhang, R., Tsai, P., Cryer, J., and Shah, M. (1999). Shape from Shading: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(8):690- 706.
Download


Paper Citation


in Harvard Style

Konstantinidis D., Argyriou V., Stathaki T. and Grammalidis N. (2015). A 3D Feature for Building Segmentation based on Shape-from-Shading . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: MMS-ER3D, (VISIGRAPP 2015) ISBN 978-989-758-090-1, pages 595-602. DOI: 10.5220/0005456305950602


in Bibtex Style

@conference{mms-er3d15,
author={Dimitrios Konstantinidis and Vasileios Argyriou and Tania Stathaki and Nikos Grammalidis},
title={A 3D Feature for Building Segmentation based on Shape-from-Shading},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: MMS-ER3D, (VISIGRAPP 2015)},
year={2015},
pages={595-602},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005456305950602},
isbn={978-989-758-090-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: MMS-ER3D, (VISIGRAPP 2015)
TI - A 3D Feature for Building Segmentation based on Shape-from-Shading
SN - 978-989-758-090-1
AU - Konstantinidis D.
AU - Argyriou V.
AU - Stathaki T.
AU - Grammalidis N.
PY - 2015
SP - 595
EP - 602
DO - 10.5220/0005456305950602