NON-VERBAL HUMAN-ROBOT INTERACTION USING NEURAL NETWORK FOR THE APPLICATION OF SERVICE ROBOT
Service robots ; re prevailing in many industries to assis.: humans in c..md acing repetitive tasks, which require a natural interaction called Human Robot Interaction (HRI). In particular. nonverbal HRI plays an important role in social interactions, which highlights the need to accurately detect t...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IIUM Press
2023
|
| Subjects: | |
| Online Access: | http://eprints.uthm.edu.my/8524/ http://eprints.uthm.edu.my/8524/1/J15662_942c3ecbc3be675cdaa9744d7645b4b4.pdf |
| _version_ | 1848889422944141312 |
|---|---|
| author | SOOMRO, ZUBAIR ADIL SHAMSUDIN, ABU UBAIDAH ABD RAHIM, RUZAIRI ADRIANS, ANDI HAZELI, MOHD |
| author_facet | SOOMRO, ZUBAIR ADIL SHAMSUDIN, ABU UBAIDAH ABD RAHIM, RUZAIRI ADRIANS, ANDI HAZELI, MOHD |
| author_sort | SOOMRO, ZUBAIR ADIL |
| building | UTHM Institutional Repository |
| collection | Online Access |
| description | Service robots ; re prevailing in many industries to assis.: humans in c..md acing repetitive tasks, which require a natural interaction called Human Robot Interaction (HRI). In particular. nonverbal HRI plays an important role in social interactions, which highlights the need to accurately detect the subject's attention by evaluating the programmed cues. In this paper, a conceptual attentiveness model algorithm called attentive Recognition Model (ARM) is proposed to recognize a person's aii:ontiveness, which improves the of detection and subjective experience during nonverbal ARI using three combined detection models: face tracking, iris tracking and eye blinking. The face tracking model was trained using a Long Short-Term Memory (LSTM) neural network, which is based on deep learning. Meanwhile, the iris tracking and eye blinking use a mathematical model. The eye blinking model uses a random face landmark point to calculate the Eye Aspect Ratio (EAR), which is much more reliable compared to the prior method, which could detect a person blinking at a further distance even if the person was not blinking, The conducted experiments for face and iris tracking were able to detect direction up to 2 meters. Meanwhile, the tested eye blinking model gave an accuracy of 83.33% at up to 2 meters, The overall attentive accuracy of ARM was up to 85.7%. The experiments showed that the service robot was able to understand the programmed cues and hence perform certain tasks, such as approaching the interested person. |
| first_indexed | 2025-11-15T20:25:56Z |
| format | Article |
| id | uthm-8524 |
| institution | Universiti Tun Hussein Onn Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T20:25:56Z |
| publishDate | 2023 |
| publisher | IIUM Press |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | uthm-85242023-04-05T03:07:11Z http://eprints.uthm.edu.my/8524/ NON-VERBAL HUMAN-ROBOT INTERACTION USING NEURAL NETWORK FOR THE APPLICATION OF SERVICE ROBOT SOOMRO, ZUBAIR ADIL SHAMSUDIN, ABU UBAIDAH ABD RAHIM, RUZAIRI ADRIANS, ANDI HAZELI, MOHD TJ210.2-211.47 Mechanical devices and figures. Automata. Ingenious mechanisms. Robots (General) Service robots ; re prevailing in many industries to assis.: humans in c..md acing repetitive tasks, which require a natural interaction called Human Robot Interaction (HRI). In particular. nonverbal HRI plays an important role in social interactions, which highlights the need to accurately detect the subject's attention by evaluating the programmed cues. In this paper, a conceptual attentiveness model algorithm called attentive Recognition Model (ARM) is proposed to recognize a person's aii:ontiveness, which improves the of detection and subjective experience during nonverbal ARI using three combined detection models: face tracking, iris tracking and eye blinking. The face tracking model was trained using a Long Short-Term Memory (LSTM) neural network, which is based on deep learning. Meanwhile, the iris tracking and eye blinking use a mathematical model. The eye blinking model uses a random face landmark point to calculate the Eye Aspect Ratio (EAR), which is much more reliable compared to the prior method, which could detect a person blinking at a further distance even if the person was not blinking, The conducted experiments for face and iris tracking were able to detect direction up to 2 meters. Meanwhile, the tested eye blinking model gave an accuracy of 83.33% at up to 2 meters, The overall attentive accuracy of ARM was up to 85.7%. The experiments showed that the service robot was able to understand the programmed cues and hence perform certain tasks, such as approaching the interested person. IIUM Press 2023 Article PeerReviewed text en http://eprints.uthm.edu.my/8524/1/J15662_942c3ecbc3be675cdaa9744d7645b4b4.pdf SOOMRO, ZUBAIR ADIL and SHAMSUDIN, ABU UBAIDAH and ABD RAHIM, RUZAIRI and ADRIANS, ANDI and HAZELI, MOHD (2023) NON-VERBAL HUMAN-ROBOT INTERACTION USING NEURAL NETWORK FOR THE APPLICATION OF SERVICE ROBOT. IIUM Engineering Journal, 24 (1). pp. 1-18. ISSN 1511-758x https://doi.org/110.314361iiumej |
| spellingShingle | TJ210.2-211.47 Mechanical devices and figures. Automata. Ingenious mechanisms. Robots (General) SOOMRO, ZUBAIR ADIL SHAMSUDIN, ABU UBAIDAH ABD RAHIM, RUZAIRI ADRIANS, ANDI HAZELI, MOHD NON-VERBAL HUMAN-ROBOT INTERACTION USING NEURAL NETWORK FOR THE APPLICATION OF SERVICE ROBOT |
| title | NON-VERBAL HUMAN-ROBOT INTERACTION USING NEURAL NETWORK FOR THE APPLICATION OF SERVICE ROBOT |
| title_full | NON-VERBAL HUMAN-ROBOT INTERACTION USING NEURAL NETWORK FOR THE APPLICATION OF SERVICE ROBOT |
| title_fullStr | NON-VERBAL HUMAN-ROBOT INTERACTION USING NEURAL NETWORK FOR THE APPLICATION OF SERVICE ROBOT |
| title_full_unstemmed | NON-VERBAL HUMAN-ROBOT INTERACTION USING NEURAL NETWORK FOR THE APPLICATION OF SERVICE ROBOT |
| title_short | NON-VERBAL HUMAN-ROBOT INTERACTION USING NEURAL NETWORK FOR THE APPLICATION OF SERVICE ROBOT |
| title_sort | non-verbal human-robot interaction using neural network for the application of service robot |
| topic | TJ210.2-211.47 Mechanical devices and figures. Automata. Ingenious mechanisms. Robots (General) |
| url | http://eprints.uthm.edu.my/8524/ http://eprints.uthm.edu.my/8524/ http://eprints.uthm.edu.my/8524/1/J15662_942c3ecbc3be675cdaa9744d7645b4b4.pdf |