Controlled Synthesis of Fibre-reinforced Plastics Images from Segmentation Maps using Generative Adversarial Neural Networks

Nicolas Schaaf, Hans Zhou, Chrismarie Enslin, Florian Brillowski, Daniel Lütticke

2022

Abstract

The replacement of traditional construction materials with lightweight fibre-reinforced plastics is an accepted way to reduce emissions. By automating quality assurance, errors in production can be detected earlier, avoiding follow-up costs and hard-to-recycle scrap. Deep learning based defect detection systems have shown promising results, but their prediction accuracy often suffers from scarce labelled data in production processes. Especially in the domain of fibre-reinforced plastics, the task remains challenging because of varying textile specific errors. In our work, we applied conditional generative adversarial networks combined with image-to-image translation methods to address data scarcity through generating synthetic images. By training a generative model on image-segmentation pairs, we produce realistic fibre images matching the given segmentation maps. Our model enables control over generated output images of arbitrary fibre shapes and structures, including gaps, ondulations, and folds as error classes. We evaluate our synthetic images based on GAN metrics, feature distribution and show that they are suitable as a data augmentation method to improve the error classification performance of deep neural networks. Thereby, we provide a solution for the manufacturing domain of fibre-reinforced plastics with scarce data, consequently contributing to an automated defect detection system that reduces resource-intensive scrap in the future.

Paper Citation

in Harvard Style

Schaaf N., Zhou H., Enslin C., Brillowski F. and Lütticke D. (2022). Controlled Synthesis of Fibre-reinforced Plastics Images from Segmentation Maps using Generative Adversarial Neural Networks. In Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART, ISBN 978-989-758-547-0, pages 801-809. DOI: 10.5220/0010913700003116

in Bibtex Style

@conference{icaart22,
author={Nicolas Schaaf and Hans Zhou and Chrismarie Enslin and Florian Brillowski and Daniel Lütticke},
title={Controlled Synthesis of Fibre-reinforced Plastics Images from Segmentation Maps using Generative Adversarial Neural Networks},
booktitle={Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART,},
year={2022},
pages={801-809},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010913700003116},
isbn={978-989-758-547-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART,
TI - Controlled Synthesis of Fibre-reinforced Plastics Images from Segmentation Maps using Generative Adversarial Neural Networks
SN - 978-989-758-547-0
AU - Schaaf N.
AU - Zhou H.
AU - Enslin C.
AU - Brillowski F.
AU - Lütticke D.
PY - 2022
SP - 801
EP - 809
DO - 10.5220/0010913700003116