Apply Deep Learning in Real-time Customer Detection and Classification System for Advertisement Decision Making at Supermarket

Dang Phuc, Dau Hieu, Nguyen Hoang, Tran Khoa

2022

Abstract

Shopping in shopping malls and supermarket is gradually increasing and replacing traditional market because of the convenient conditions such as full of products, clean place with all time air-conditioner, modern environment, etc. Supermarket owner always want to find the way that attract more and more customers come to the supermarket as well as advertise their products to the customers as many as possible. In order to offer relevant and attractive advertising to customers, detection and classification customers entering to the supermarket is taken into consideration. Due to the characteristics different customer groups, the relevant products should be showed to attract customer, help them save the time for finding products. In this paper, we build a real-time customer detection and classification system at the supermarket. The goal of this proposed Internet of Things (IoT) system is automatically show the suitable advertising clips to many customers at the right time. We build a classification model using deep learning with a large amount of data. The dataset is collected from reality and labelled with five different object classes. To ensure reliability, 7000 images are collected from different conditions such as variations in camera used, bad lighting, angles, and not stable background. The data is trained on YOLOv4 and YOLOv4-tiny models. The models are deployed on the embedded system with the Jetson Nano device as the processor. We compare the accuracy and speed of the two models on the same embedded system, analyse the results, and chose the best model according to the specific system requirements.

Paper Citation

in Harvard Style

Phuc D., Hieu D., Hoang N. and Khoa T. (2022). Apply Deep Learning in Real-time Customer Detection and Classification System for Advertisement Decision Making at Supermarket. In Proceedings of the 11th International Conference on Smart Cities and Green ICT Systems - Volume 1: SMARTGREENS, ISBN 978-989-758-572-2, pages 94-102. DOI: 10.5220/0010993600003203

in Bibtex Style

@conference{smartgreens22,
author={Dang Phuc and Dau Hieu and Nguyen Hoang and Tran Khoa},
title={Apply Deep Learning in Real-time Customer Detection and Classification System for Advertisement Decision Making at Supermarket},
booktitle={Proceedings of the 11th International Conference on Smart Cities and Green ICT Systems - Volume 1: SMARTGREENS,},
year={2022},
pages={94-102},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010993600003203},
isbn={978-989-758-572-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Smart Cities and Green ICT Systems - Volume 1: SMARTGREENS,
TI - Apply Deep Learning in Real-time Customer Detection and Classification System for Advertisement Decision Making at Supermarket
SN - 978-989-758-572-2
AU - Phuc D.
AU - Hieu D.
AU - Hoang N.
AU - Khoa T.
PY - 2022
SP - 94
EP - 102
DO - 10.5220/0010993600003203