Grocery Recognition in the Wild: A New Mining Strategy for Metric Learning

Marco Filax, Tim Gonschorek, Frank Ortmeier

2021

Abstract

Recognizing grocery products at scale is an open issue for computer-vision systems due to their subtle visual differences. Typically the problem is addressed as a classification problem, e.g., by learning a CNN, for which all classes that are to be distinguished need to be known at training time. We instead observe that the products within stores change over time. Sometimes new products are put on shelves, or existing appearances of products are changed. In this work, we demonstrate the use of deep metric learning for grocery recognition, whereby classes during inference are unknown while training. We also propose a new triplet mining strategy that uses all known classes during training while preserving the ability to perform cross-folded validation. We demonstrate the applicability of the proposed mining strategy using different, publicly available real-world grocery datasets. The proposed approach preserves the ability to distinguish previously unseen groceries while increasing the precision by up to 5 percent.

Paper Citation

in Harvard Style

Filax M., Gonschorek T. and Ortmeier F. (2021). Grocery Recognition in the Wild: A New Mining Strategy for Metric Learning. In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 4: VISAPP; ISBN 978-989-758-488-6, SciTePress, pages 498-505. DOI: 10.5220/0010322304980505

in Bibtex Style

@conference{visapp21,
author={Marco Filax and Tim Gonschorek and Frank Ortmeier},
title={Grocery Recognition in the Wild: A New Mining Strategy for Metric Learning},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 4: VISAPP},
year={2021},
pages={498-505},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010322304980505},
isbn={978-989-758-488-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 4: VISAPP
TI - Grocery Recognition in the Wild: A New Mining Strategy for Metric Learning
SN - 978-989-758-488-6
AU - Filax M.
AU - Gonschorek T.
AU - Ortmeier F.
PY - 2021
SP - 498
EP - 505
DO - 10.5220/0010322304980505
PB - SciTePress