Development of a POS system with computer vision for automated retail checkout
A Point-of-Sale (POS) is a computerized system of hardware and software utilized by businesses to complete sales transactions. In conventional POS setups, cashiers manually scan individual product barcodes, before processing the totals. This manual procedure is laborious and often leads to long queu...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Penerbit Universiti Kebangsaan Malaysia
2024
|
| Online Access: | http://journalarticle.ukm.my/25532/ http://journalarticle.ukm.my/25532/1/kejut_10.pdf |
| _version_ | 1848816382935826432 |
|---|---|
| author | Nasharuddin Zainal, Muhammad Faiz Bukhori, Aeisha Danella Lemi Gordon, Seri Mastura Mustaza, Abdul Halim Ismail, |
| author_facet | Nasharuddin Zainal, Muhammad Faiz Bukhori, Aeisha Danella Lemi Gordon, Seri Mastura Mustaza, Abdul Halim Ismail, |
| author_sort | Nasharuddin Zainal, |
| building | UKM Institutional Repository |
| collection | Online Access |
| description | A Point-of-Sale (POS) is a computerized system of hardware and software utilized by businesses to complete sales transactions. In conventional POS setups, cashiers manually scan individual product barcodes, before processing the totals. This manual procedure is laborious and often leads to long queues and waiting times, especially during peak hours, ultimately affecting customer experience and retention. This work seeks to automate the product scanning procedure with a computer vision approach, thereby expediting the sales process. An efficient YOLOv4 object detection model was trained on a custom dataset of common products found in Malaysian retail stores. 550 images were initially acquired and split 80:20 into training and validation groups; further augmentation tripled the size of the training group to 1,320 images. Training was conducted for 10,000 epochs, at 0.0013 learning rate. During training, the model achieved 99.19% mAP, 87.42% average IoU, and a 0.40 average loss. Subsequently, the model was deployed on a low-power single-board computer running a transaction notification program. To evaluate its performance, 10 instances of shopping carts with random product combinations were processed using the system. The system autonomously identified and quantified all products through its video feed, generating itemized bills in real-time. Fixed with a 0.9 confidence threshold, the system yielded a 98% average accuracy across all object classes. On average, transactions, from product detection to delivering the itemized bill to the system administrator, were processed in just 14 seconds. This POS system holds potential for integration with unmanned stores, offering a seamless shopping experience. |
| first_indexed | 2025-11-15T01:05:00Z |
| format | Article |
| id | oai:generic.eprints.org:25532 |
| institution | Universiti Kebangasaan Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T01:05:00Z |
| publishDate | 2024 |
| publisher | Penerbit Universiti Kebangsaan Malaysia |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | oai:generic.eprints.org:255322025-07-14T07:55:38Z http://journalarticle.ukm.my/25532/ Development of a POS system with computer vision for automated retail checkout Nasharuddin Zainal, Muhammad Faiz Bukhori, Aeisha Danella Lemi Gordon, Seri Mastura Mustaza, Abdul Halim Ismail, A Point-of-Sale (POS) is a computerized system of hardware and software utilized by businesses to complete sales transactions. In conventional POS setups, cashiers manually scan individual product barcodes, before processing the totals. This manual procedure is laborious and often leads to long queues and waiting times, especially during peak hours, ultimately affecting customer experience and retention. This work seeks to automate the product scanning procedure with a computer vision approach, thereby expediting the sales process. An efficient YOLOv4 object detection model was trained on a custom dataset of common products found in Malaysian retail stores. 550 images were initially acquired and split 80:20 into training and validation groups; further augmentation tripled the size of the training group to 1,320 images. Training was conducted for 10,000 epochs, at 0.0013 learning rate. During training, the model achieved 99.19% mAP, 87.42% average IoU, and a 0.40 average loss. Subsequently, the model was deployed on a low-power single-board computer running a transaction notification program. To evaluate its performance, 10 instances of shopping carts with random product combinations were processed using the system. The system autonomously identified and quantified all products through its video feed, generating itemized bills in real-time. Fixed with a 0.9 confidence threshold, the system yielded a 98% average accuracy across all object classes. On average, transactions, from product detection to delivering the itemized bill to the system administrator, were processed in just 14 seconds. This POS system holds potential for integration with unmanned stores, offering a seamless shopping experience. Penerbit Universiti Kebangsaan Malaysia 2024-07 Article PeerReviewed application/pdf en http://journalarticle.ukm.my/25532/1/kejut_10.pdf Nasharuddin Zainal, and Muhammad Faiz Bukhori, and Aeisha Danella Lemi Gordon, and Seri Mastura Mustaza, and Abdul Halim Ismail, (2024) Development of a POS system with computer vision for automated retail checkout. Jurnal Kejuruteraan, 36 (4). pp. 1451-1457. ISSN 0128-0198 https://www.ukm.my/jkukm/volume-3604-2024/ |
| spellingShingle | Nasharuddin Zainal, Muhammad Faiz Bukhori, Aeisha Danella Lemi Gordon, Seri Mastura Mustaza, Abdul Halim Ismail, Development of a POS system with computer vision for automated retail checkout |
| title | Development of a POS system with computer vision for automated retail checkout |
| title_full | Development of a POS system with computer vision for automated retail checkout |
| title_fullStr | Development of a POS system with computer vision for automated retail checkout |
| title_full_unstemmed | Development of a POS system with computer vision for automated retail checkout |
| title_short | Development of a POS system with computer vision for automated retail checkout |
| title_sort | development of a pos system with computer vision for automated retail checkout |
| url | http://journalarticle.ukm.my/25532/ http://journalarticle.ukm.my/25532/ http://journalarticle.ukm.my/25532/1/kejut_10.pdf |