Application development for product recognition on-shelf with deep learning

Negligence of empty shelf and high human intervention have been the issues that leads to low customer retention in brick-and-mortar stores. Hence, state-ofthe-art deep learning models are trained and compared for product recognition on-shelf and an application to detect empty shelf with the best dee...

Full description

Bibliographic Details
Main Author: Eyu, Jer Min
Format: Final Year Project / Dissertation / Thesis
Published: 2022
Subjects:
Online Access:http://eprints.utar.edu.my/5016/
http://eprints.utar.edu.my/5016/1/1906365_EYU_JER_MIN.pdf
_version_ 1848886304316588032
author Eyu, Jer Min
author_facet Eyu, Jer Min
author_sort Eyu, Jer Min
building UTAR Institutional Repository
collection Online Access
description Negligence of empty shelf and high human intervention have been the issues that leads to low customer retention in brick-and-mortar stores. Hence, state-ofthe-art deep learning models are trained and compared for product recognition on-shelf and an application to detect empty shelf with the best deep learning model is developed. The three compared models are YOLOv3, YOLOv4, and YOLOv5 to recognise Philips 9w bulb and Philips 11w bulb in lighting equipment store. YOLOv5 outperformed in three compared models. Then, a dataset of 200 images of empty shelf had been filtered and annotated for empty shelf detection training. The accuracy of implemented model is as high as 99.5%. The developed application has successfully detected empty space on the shelf and sent Telegram message to remind the retailers to restock. To identify if the system works in real-life scenario, usability testing is carried out by three employees from the stores and two lecturers from the university. The overall SUS score is 91%. However, the limitations of the developed application should be overcame for real-world implementation. These included that the smooth preview of surveillance tool is not produced, all black and long items are detected as empty shelf, adaptation of different stocking method is low, and crashing of the application under low connectivity.
first_indexed 2025-11-15T19:36:22Z
format Final Year Project / Dissertation / Thesis
id utar-5016
institution Universiti Tunku Abdul Rahman
institution_category Local University
last_indexed 2025-11-15T19:36:22Z
publishDate 2022
recordtype eprints
repository_type Digital Repository
spelling utar-50162022-12-26T14:04:22Z Application development for product recognition on-shelf with deep learning Eyu, Jer Min QA76 Computer software Negligence of empty shelf and high human intervention have been the issues that leads to low customer retention in brick-and-mortar stores. Hence, state-ofthe-art deep learning models are trained and compared for product recognition on-shelf and an application to detect empty shelf with the best deep learning model is developed. The three compared models are YOLOv3, YOLOv4, and YOLOv5 to recognise Philips 9w bulb and Philips 11w bulb in lighting equipment store. YOLOv5 outperformed in three compared models. Then, a dataset of 200 images of empty shelf had been filtered and annotated for empty shelf detection training. The accuracy of implemented model is as high as 99.5%. The developed application has successfully detected empty space on the shelf and sent Telegram message to remind the retailers to restock. To identify if the system works in real-life scenario, usability testing is carried out by three employees from the stores and two lecturers from the university. The overall SUS score is 91%. However, the limitations of the developed application should be overcame for real-world implementation. These included that the smooth preview of surveillance tool is not produced, all black and long items are detected as empty shelf, adaptation of different stocking method is low, and crashing of the application under low connectivity. 2022 Final Year Project / Dissertation / Thesis NonPeerReviewed application/pdf http://eprints.utar.edu.my/5016/1/1906365_EYU_JER_MIN.pdf Eyu, Jer Min (2022) Application development for product recognition on-shelf with deep learning. Final Year Project, UTAR. http://eprints.utar.edu.my/5016/
spellingShingle QA76 Computer software
Eyu, Jer Min
Application development for product recognition on-shelf with deep learning
title Application development for product recognition on-shelf with deep learning
title_full Application development for product recognition on-shelf with deep learning
title_fullStr Application development for product recognition on-shelf with deep learning
title_full_unstemmed Application development for product recognition on-shelf with deep learning
title_short Application development for product recognition on-shelf with deep learning
title_sort application development for product recognition on-shelf with deep learning
topic QA76 Computer software
url http://eprints.utar.edu.my/5016/
http://eprints.utar.edu.my/5016/1/1906365_EYU_JER_MIN.pdf