Catalog Integration of Low-quality Product Data by Attribute Label Ranking

Oliver Schmidts, Bodo Kraft, Marvin Winkens, Albert Zündorf

2020

Abstract

The integration of product data from heterogeneous sources and manufacturers into a single catalog is often still a laborious, manual task. Especially small- and medium-sized enterprises face the challenge of timely integrating the data their business relies on to have an up-to-date product catalog, due to format specifications, low quality of data and the requirement of expert knowledge. Additionally, modern approaches to simplify catalog integration demand experience in machine learning, word vectorization, or semantic similarity that such enterprises do not have. Furthermore, most approaches struggle with low-quality data. We propose Attribute Label Ranking (ALR), an easy to understand and simple to adapt learning approach. ALR leverages a model trained on real-world integration data to identify the best possible schema mapping of previously unknown, proprietary, tabular format into a standardized catalog schema. Our approach predicts multiple labels for every attribute of an input column. The whole column is taken into consideration to rank among these labels. We evaluate ALR regarding the correctness of predictions and compare the results on real-world data to state-of-the-art approaches. Additionally, we report findings during experiments and limitations of our approach.

Paper Citation

in Harvard Style

Schmidts O., Kraft B., Winkens M. and Zündorf A. (2020). Catalog Integration of Low-quality Product Data by Attribute Label Ranking.In Proceedings of the 9th International Conference on Data Science, Technology and Applications - Volume 1: DATA, ISBN 978-989-758-440-4, pages 90-101. DOI: 10.5220/0009831000900101

in Bibtex Style

@conference{data20,
author={Oliver Schmidts and Bodo Kraft and Marvin Winkens and Albert Zündorf},
title={Catalog Integration of Low-quality Product Data by Attribute Label Ranking},
booktitle={Proceedings of the 9th International Conference on Data Science, Technology and Applications - Volume 1: DATA,},
year={2020},
pages={90-101},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009831000900101},
isbn={978-989-758-440-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 9th International Conference on Data Science, Technology and Applications - Volume 1: DATA,
TI - Catalog Integration of Low-quality Product Data by Attribute Label Ranking
SN - 978-989-758-440-4
AU - Schmidts O.
AU - Kraft B.
AU - Winkens M.
AU - Zündorf A.
PY - 2020
SP - 90
EP - 101
DO - 10.5220/0009831000900101