Using Keypoint Matching and Interactive Self Attention Network to Verify Retail POSMs

Harshita Seth, Sonaal Kant, Muktabh Srivastava

2022

Abstract

Point of Sale Materials(POSM) are the merchandising and decoration items that are used by companies to communicate product information and offers in retail stores. POSMs are part of companies’ retail marketing strategy and are often applied as stylized window displays around retail shelves. In this work, we apply computer vision techniques to the task of verification of POSMs in supermarkets by telling if all desired components of window display are present in a shelf image. We use Convolutional Neural Network based unsupervised keypoint matching as a baseline to verify POSM components and propose a supervised Neural Network based method to enhance the accuracy of baseline by a large margin. We also show that the supervised pipeline is not restricted to the POSM material it is trained on and can generalize. We train and evaluate our model on a private dataset composed of retail shelf images.

Paper Citation

in Harvard Style

Seth H., Kant S. and Srivastava M. (2022). Using Keypoint Matching and Interactive Self Attention Network to Verify Retail POSMs. In Proceedings of the 2nd International Conference on Image Processing and Vision Engineering - Volume 1: IMPROVE, ISBN 978-989-758-563-0, pages 195-201. DOI: 10.5220/0011087800003209

in Bibtex Style

@conference{improve22,
author={Harshita Seth and Sonaal Kant and Muktabh Srivastava},
title={Using Keypoint Matching and Interactive Self Attention Network to Verify Retail POSMs},
booktitle={Proceedings of the 2nd International Conference on Image Processing and Vision Engineering - Volume 1: IMPROVE,},
year={2022},
pages={195-201},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011087800003209},
isbn={978-989-758-563-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 2nd International Conference on Image Processing and Vision Engineering - Volume 1: IMPROVE,
TI - Using Keypoint Matching and Interactive Self Attention Network to Verify Retail POSMs
SN - 978-989-758-563-0
AU - Seth H.
AU - Kant S.
AU - Srivastava M.
PY - 2022
SP - 195
EP - 201
DO - 10.5220/0011087800003209