Automatic Update and Completion of Occluded Regions for Accurate 3D Urban Cartography by combining Multiple Views and Multiple Passages

Ahmad Kamal Aijazi, Paul Checchin, Laurent Trassoudaine

Abstract

Handling occlusions is one of the more difficult challenges faced today in urban landscape analysis and cartography. In this paper, we successfully address this problem by using a new method in which multiple views and multiple sessions or passages are used to complete occluded regions in a 3D cartographic map. Two 3D point clouds, from different viewing angles, obtained in each passage are first classified into two main object classes: Permanent and Temporary (which contains both Temporarily static and Mobile objects) using inference based on basic reasoning. All these Temporary objects, considered as occluding objects, are removed from the scene leaving behind two perforated 3D point clouds of the cartography. These two perforated point clouds from the same passage are then combined together to fill in some of the holes and form a unified perforated 3D point cloud of the cartography. This unified perforated 3D point cloud is then updated by similar subsequent perforated point clouds, obtained on different days and hours of the day, filling in the remaining holes and completing the missing features/regions of the urban cartography. This automatic method ensures that the resulting 3D point cloud of the cartography is most accurate containing only the exact and actual permanent features/regions. Special update and reset functions are added to increase the robustness of the method. The method is evaluated on a standard data set to demonstrate its efficacy and prowess.

References

  1. Aijazi, A. K., Checchin, P., and Trassoudaine, L. (2012). Classification of 3D Urban Scenes - A Voxel Based Approach. In Int. Conf. on Pattern Recognition, Applications and Methods, Vilamoura, Portugal.
  2. Becker, S. and Haala, N. (2007). Combined Feature Extraction for Fac¸ade Reconstruction. In ISPRS Workshop on Laser Scanning and SilviLaser, page 44, Espoo, Finland.
  3. Benitez, S., Denis, E., and Baillard, C. (2010). Automatic Production of Occlusion-Free Rectified Fac¸ade Textures using Vehicle-Based Imagery. In Photogrammetric Computer Vision and Image Analysis, page A:275.
  4. Besl, P. and McKay, N. (1992). A Method for Registration of 3-D Shapes. In IEEE Trans. on Pattern Analysis and Machine Intelligence, volume 14(2), pages 239- 256, USA.
  5. Craciun, D., Paparoditis, N., and Schmitt, F. (2010). Multiview scans alignment for 3D spherical mosaicing in large-scale unstructured environments. Computer Vision and Image Understanding, 114(11):1248 - 1263.
  6. Criminisi, A., Pérez, P., and Toyama, K. (2004). Region filling and object removal by exemplar-based inpainting. IEEE Trans. Image Processing, 13(9):1200-1212.
  7. Engels, C., Tingdahl, D., Vercruysse, M., Tuytelaars, T., Sahli, H., and Van Gool, L. (2011). Automatic occlusion removal from fac¸ades for 3D urban reconstruction. Advanced Concepts for Intellig. Vision Systems, pages 681-692.
  8. Frueh, C., Sammon, R., and Zakhor, A. (2004). Automated texture mapping of 3D city models with oblique aerial imagery. In Proc. of 2nd Int. Symp. on 3D Data Processing, Visualization and Transmission (3DPVT), pages 396-403. IEEE.
  9. Hripcsak, G. and Rothschild, A. S. (2005). Agreement, the F-Measure, and Reliability in Information Retrieval. Journal of American Medical Iinformatics Association, 12(3):296-298.
  10. Konushin, V. and Vezhnevets, V. (2007). Automatic building texture completion. In Proc. Graphicon'2007, Moscow, Russia.
  11. Li, Y., Zheng, Q., Sharf, A., Cohen-Or, D., Chen, B., and Mitra, N. J. (2011). 2D-3D Fusion for Layer Decomposition of Urban Facades. In IEEE Int. Conf. on Computer Vision (ICCV), Barcelona, Spain.
  12. Wang, L., Jin, H., Yang, R., and Gong, M. (2008). Stereoscopic inpainting: Joint color and depth completion from stereo images. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pages 1-8.
  13. Xiao, J., Fang, T., Zhao, P., Lhuillier, M., and Quan, L. (2009). Image-based street-side city modeling. ACM Trans. Graph., 28:114:1-114:12.
Download


Paper Citation


in Harvard Style

Kamal Aijazi A., Checchin P. and Trassoudaine L. (2013). Automatic Update and Completion of Occluded Regions for Accurate 3D Urban Cartography by combining Multiple Views and Multiple Passages . In Proceedings of the 2nd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-8565-41-9, pages 405-412. DOI: 10.5220/0004182704050412


in Bibtex Style

@conference{icpram13,
author={Ahmad Kamal Aijazi and Paul Checchin and Laurent Trassoudaine},
title={Automatic Update and Completion of Occluded Regions for Accurate 3D Urban Cartography by combining Multiple Views and Multiple Passages},
booktitle={Proceedings of the 2nd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2013},
pages={405-412},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004182704050412},
isbn={978-989-8565-41-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Automatic Update and Completion of Occluded Regions for Accurate 3D Urban Cartography by combining Multiple Views and Multiple Passages
SN - 978-989-8565-41-9
AU - Kamal Aijazi A.
AU - Checchin P.
AU - Trassoudaine L.
PY - 2013
SP - 405
EP - 412
DO - 10.5220/0004182704050412