Authors:
Julien Miranda
1
;
Stanislas Larnier
2
;
Ariane Herbulot
3
and
Michel Devy
3
Affiliations:
1
LAAS, CNRS, 7 Avenue du Colonel Roche, F-31400 Toulouse, France, Univ de Toulouse, UPS, LAAS, F-31400 Toulouse, France, Donecle, 201 Rue Pierre et Marie Curie, F-31670 Labège and France
;
2
Donecle, 201 Rue Pierre et Marie Curie, F-31670 Labège and France
;
3
LAAS, CNRS, 7 Avenue du Colonel Roche, F-31400 Toulouse, France, Univ de Toulouse, UPS, LAAS, F-31400 Toulouse and France
Keyword(s):
Computer Vision, Convolutional Neural Network, Pattern Recognition, Generative Model, Bipartite Graph.
Related
Ontology
Subjects/Areas/Topics:
Applications
;
Computer Vision, Visualization and Computer Graphics
;
Image and Video Analysis
;
Pattern Recognition
;
Robotics
;
Segmentation and Grouping
;
Software Engineering
Abstract:
We propose a new approach to detect and inspect aircraft exterior screws. An Unmanned Aerial Vehicle (UAV) locating itself in the aircraft frame thanks to lidar technology is able to acquire precise images coming with useful metadata. We use a method based on a convolutional neural network (CNN) to characterize zones of interest (ZOI) and to extract screws from images; methods are proposed to create prior model for matching. Classic matching approaches are used to match the screws from this model with the detected ones, to increase screw recognition accuracy and detect missing screws, giving the system a new ability. Computer vision algorithms are then applied to evaluate the state of each visible screw, and detect missing and loose ones.