Matching CAD Model and Image Features for Robot Navigation and Inspection of an Aircraft

Igor Jovančević, Ilisio Viana, Jean-José Orteu, Thierry Sentenac, Stanislas Larnier

2016

Abstract

This paper focuses on the navigation of a moving robot equipped with cameras, moving around an aircraft to perform inspection of different types of items (probes, doors, etc.). Matching CAD model and image features is useful to provide meaningful features for localization and inspection tasks. In our approach two primitive sets are matched using a similarity function. The similarity scores are injected in the edges of a bipartite graph. A best-match search procedure in bipartite graph guarantees the uniqueness of the match solution. The method provides good matching results even when the location of the robot with respect to the aircraft is badly estimated. Inspection approaches on static ports and air inlet vent are presented.

References

  1. Akinlar, C. and Topal, C. (2011). EDLines: A real-time line segment detector with a false detection control. Pattern Recognition Letters, 32(13):1633 - 1642.
  2. Akinlar, C. and Topal, C. (2013). EDCircles: A real-time circle detector with a false detection control. Pattern Recognition, 46(3):725 - 740.
  3. Bay, H., Ferrari, V., and Gool, L. V. (2005). Wide-baseline stereo matching with line segments. Proceedings of Computer Vision and Pattern Recognition, 1:329-336.
  4. Chaumette, F. and Hutchinson, S. (2006). Visual servo control, part I: Basic approaches. IEEE Robotics and Automation Magazine, 13(4):82-90.
  5. Fishkel, F., Fischer, A., and Ar, S. (2006). Verification of engineering models based on bipartite graph matching for inspection applications. Springer-Verlag Berlin Heidelberg. LNCS 4077, pages 485-499.
  6. Futterlieb, M., Cadenat, V., and Sentenac, T. (2014). A navigational framework combining visual servoing and spiral obstacle avoidance techniques. In Proc. of the 11th International Conference on Informatics in Control, Automation and Robotics, Volume 2, Vienna, Austria, 1 - 3 September, 2014, pages 57-64.
  7. Hutter, M. and Brewer, N. (2009). Matching 2-d ellipses to 3-d circles with application to vehicle pose identification. Proc. of International Conference Image and Vision Computing, pages 153 - 158.
  8. Jovanc?evic, I., Larnier, S., Orteu, J.-J., and Sentenac, T. (2015). Automated exterior inspection of an aircraft with a pan-tilt-zoom camera mounted on a mobile robot. Journal of Electronic Imaging, 24(6):061110.
  9. Jr., R. M. C., Bengoetxea, E., Bloch, I., and Larran˜aga, P. (2005). Inexact graph matching for model-based recognition: Evaluation and comparison of optimization algorithms. Elsevier, Pattern Recognition, 38:2099-2113.
  10. Malamas, E. N., Petrakis, E. G., Zervakis, M., Petit, L., and Legat, J.-D. (2003). A survey on industrial vision systems, applications and tools. Image and Vision Computing, 21(2):171 - 188.
  11. Marchand, E. and Chaumette, F. (2005). Feature tracking for visual servoing purposes. Robotics and Autonomous Systems, 52(1):53-70.
  12. Matas, J., Galambos, C., and Kittler, J. (2000). Robust detection of lines using the progressive probabilistic Hough transform. Computer Vision and Image Understanding, 78(1):119 - 137.
  13. McIntosh, J. H. and Mutch, K. M. (1988). Matching straight lines. Computer Vision, Graphics and Image Processing, 43:386-408.
  14. Mumtaz, R., Mumtaz, M., Mansoor, A. B., and Masood, H. (2012). Computer aided visual inspection of aircraft surfaces. International Journal of Image Processing (IJIP), 6(1):38-53.
  15. Panda, B. and Pradhan, D. (2013). Minimum paireddominating set in chordal bipartite graphs and perfect elimination bipartite graphs. Journal of Combinatorial Optimization, 26:770 - 785.
  16. Prasad, D. K., Leung, M. K., and Quek, C. (2013). Ellifit: An unconstrained, non-iterative, least squares based geometric ellipse fitting method. Pattern Recognition, 46(5):1449 - 1465.
  17. Siegel, M., Gunatilake, P., and Podnar, G. (1998). Robotic assistants for aircraft inspectors. Instrumentation Measurement Magazine, IEEE, 1(1):16-30.
  18. Viana, I., Bugarin, F., Cornille, N., and Orteu, J.-J. (2015). Cad-guided inspection of aeronautical mechanical parts using monocular vision.
  19. von Gioi, R. G., Jakubowicz, J., Morel, J.-M., and Randall, G. (2010). LSD: A fast line segment detector with a false detection control. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(4):722-732.
Download


Paper Citation


in Harvard Style

Jovančević I., Viana I., Orteu J., Sentenac T. and Larnier S. (2016). Matching CAD Model and Image Features for Robot Navigation and Inspection of an Aircraft . In Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-173-1, pages 359-366. DOI: 10.5220/0005756303590366


in Bibtex Style

@conference{icpram16,
author={Igor Jovančević and Ilisio Viana and Jean-José Orteu and Thierry Sentenac and Stanislas Larnier},
title={Matching CAD Model and Image Features for Robot Navigation and Inspection of an Aircraft},
booktitle={Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2016},
pages={359-366},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005756303590366},
isbn={978-989-758-173-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Matching CAD Model and Image Features for Robot Navigation and Inspection of an Aircraft
SN - 978-989-758-173-1
AU - Jovančević I.
AU - Viana I.
AU - Orteu J.
AU - Sentenac T.
AU - Larnier S.
PY - 2016
SP - 359
EP - 366
DO - 10.5220/0005756303590366