Crack Identification Via User Feedback, Convolutional Neural Networks and Laser Scanners for Tunnel Infrastructures

Eftychios Protopapadakis, Konstantinos Makantasis, George Kopsiaftis, Nikolaos Doulamis, Angelos Amditis

2016

Abstract

In this paper, a deep learning approach synergetically to a laser scanning process are employed for the visual detection and accurate description of concrete defects in tunnels. Analysis is performed over raw RGB images; Convolutional Neural Network serves as the crack detector, during the inspection. In case of a positive detection, the tunnel’s cross-section morphology is assessed via 3D point clouds, created by a laser scanner, allowing the identification of deformations in the compartment. The proposed approach, in contrast to the existing ones, emphasizes on applicability (easy initialization, no preprocessing of the input data) and provides a holistic assessment of the structure; reconstructed 3D model allows the fast identification of structural divergence from the original design, alerting the engineers for possible dangers.

References

  1. Abdel-Qader, I., Abudayyeh, O., and Kelly, M. E. (2003). Analysis of edge-detection techniques for crack identification in bridges. Journal of Computing in Civil Engineering, 17(4):255-263.
  2. Argüelles-Fraga, R., Ord ón˜ez, C., García-Cort és, S., and Roca-Pardin˜as, J. (2013). Measurement planning for circular cross-section tunnels using terrestrial laser scanning. Automation in Construction, 31:1-9.
  3. Bastien, F., Lamblin, P., Pascanu, R., Bergstra, J., Goodfellow, I., Bergeron, A., Bouchard, N., Warde-Farley, D., and Bengio, Y. (2012). Theano: new features and speed improvements. arXiv:1211.5590 [cs]. arXiv: 1211.5590.
  4. Coleman, T. and Li, Y. (1994). On the convergence of reflective newton methods for large-scale nonlinear minimization subject to bounds vol. 67. Ithaca, NY, USA: Cornell University.
  5. Coleman, T. F. and Li, Y. (1996). An interior trust region approach for nonlinear minimization subject to bounds. SIAM journal on optimization, 6(2):418-445.
  6. Doulamis, A. (2014). Event-driven video adaptation: A powerful tool for industrial video supervision. Multimedia Tools and Applications, 69(2):339-358.
  7. Doulamis, A. and Matsatsinis, N. (2012). Visual understanding industrial workflows under uncertainty on distributed service oriented architectures. Future Generation Computer Systems, 28(3):605-617.
  8. Fitzpatrick, P., Metta, G., and Natale, L. (2008). Towards long-lived robot genes. Robotics and Autonomous Systems, 56(1):29-45.
  9. German, S., Brilakis, I., and DesRoches, R. (2012). Rapid entropy-based detection and properties measurement of concrete spalling with machine vision for postearthquake safety assessments. Advanced Engineering Informatics, 26(4):846-858.
  10. Halfawy, M. R. and Hengmeechai, J. (2014). Automated defect detection in sewer closed circuit television images using histograms of oriented gradients and support vector machine. Automation in Construction, 38:1- 13.
  11. Han, J.-Y., Guo, J., and Jiang, Y.-S. (2013). Monitoring tunnel deformations by means of multi-epoch dispersed 3d lidar point clouds: An improved approach. Tunnelling and Underground Space Technology, 38:385- 389.
  12. Hinton, G. E., Osindero, S., and Teh, Y.-W. (2006). A fast learning algorithm for deep belief nets. Neural computation, 18(7):1527-1554.
  13. Hinton, G. E. and Salakhutdinov, R. R. (2006). Reducing the dimensionality of data with neural networks. Science, 313(5786):504-507.
  14. Jahanshahi, M. R., Masri, S. F., Padgett, C. W., and Sukhatme, G. S. (2013). An innovative methodology for detection and quantification of cracks through incorporation of depth perception. Machine Vision and Applications, 24(2):227-241.
  15. Kim, Y.-S. and Haas, C. T. (2000). A model for automation of infrastructure maintenance using representational forms. Automation in Construction, 10(1):57-68.
  16. Koch, C. and Brilakis, I. (2011). Pothole detection in asphalt pavement images. Advanced Engineering Informatics, 25(3):507-515.
  17. Liu, Z., Suandi, S. A., Ohashi, T., and Ejima, T. (2002). Tunnel crack detection and classification system based on image processing. In Electronic Imaging 2002, pages 145-152. International Society for Optics and Photonics.
  18. Makantasis, K., Protopapadakis, E., Doulamis, A. D., Doulamis, N. D., and Loupos, C. (2015). Deep Convolutional Neural Networks for Efficient Vision Based Tunnel Inspection. Cluj-Napoca, Romania.
  19. Mohanty, A. and Wang, T. T. (2012). Image mosaicking of a section of a tunnel lining and the detection of cracks through the frequency histogram of connected elements concept. volume 8335, pages 83351P-83351P9.
  20. Monserrat, O. and Crosetto, M. (2008). Deformation measurement using terrestrial laser scanning data and least squares 3d surface matching. ISPRS Journal of Photogrammetry and Remote Sensing, 63(1):142-154.
  21. Nuttens, T., Stal, C., De Backer, H., Schotte, K., Van Bogaert, P., and De Wulf, A. (2014). Methodology for the ovalization monitoring of newly built circular train tunnels based on laser scanning: Liefkenshoek rail link (belgium). Automation in Construction, 43:1-9.
  22. Pejic, M. (2013). Design and optimisation of laser scanning for tunnels geometry inspection. Tunnelling and Underground Space Technology, 37:199-206.
  23. Protopapadakis, E. and Doulamis, N. (2015). Image Based Approaches for Tunnels Defects Recognition via Robotic Inspectors. In Bebis, G., Boyle, R., Parvin, B., Koracin, D., Pavlidis, I., Feris, R., McGraw, T., Elendt, M., Kopper, R., Ragan, E., Ye, Z., and Weber, G., editors, Advances in Visual Computing, number 9474 in Lecture Notes in Computer Science, pages 706-716. Springer International Publishing. DOI: 10.1007/978-3-319-27857-5 63.
  24. Pynn, J., Wright, A., and Lodge, R. (1999). Automatic identification of cracks in road surfaces. InImage Processing and Its Applications, 1999. Seventh International Conference on (Conf. Publ. No. 465), volume 2, pages 671-675 vol.2.
  25. Sinha, S. K. and Fieguth, P. W. (2006). Automated detection of cracks in buried concrete pipe images. Automation in Construction, 15(1):58-72.
  26. Son, H., Kim, C., and Kim, C. (2012). Automated Color ModelBased Concrete Detection in ConstructionSite Images by Using Machine Learning Algorithms. Journal of Computing in Civil Engineering, 26(3):421-433.
  27. Tung, P.-C., Hwang, Y.-R., and Wu, M.-C. (2002). The development of a mobile manipulator imaging system for bridge crack inspection. Automation in Construction, 11(6):717-729.
  28. Yu, S.-N., Jang, J.-H., and Han, C.-S. (2007). Auto inspection system using a mobile robot for detecting concrete cracks in a tunnel. Automation in Construction, 16(3):255-261.
Download


Paper Citation


in Harvard Style

Protopapadakis E., Makantasis K., Kopsiaftis G., Doulamis N. and Amditis A. (2016). Crack Identification Via User Feedback, Convolutional Neural Networks and Laser Scanners for Tunnel Infrastructures . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: RGB-SpectralImaging, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 725-734. DOI: 10.5220/0005853007250734


in Bibtex Style

@conference{rgb-spectralimaging16,
author={Eftychios Protopapadakis and Konstantinos Makantasis and George Kopsiaftis and Nikolaos Doulamis and Angelos Amditis},
title={Crack Identification Via User Feedback, Convolutional Neural Networks and Laser Scanners for Tunnel Infrastructures},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: RGB-SpectralImaging, (VISIGRAPP 2016)},
year={2016},
pages={725-734},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005853007250734},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: RGB-SpectralImaging, (VISIGRAPP 2016)
TI - Crack Identification Via User Feedback, Convolutional Neural Networks and Laser Scanners for Tunnel Infrastructures
SN - 978-989-758-175-5
AU - Protopapadakis E.
AU - Makantasis K.
AU - Kopsiaftis G.
AU - Doulamis N.
AU - Amditis A.
PY - 2016
SP - 725
EP - 734
DO - 10.5220/0005853007250734