Real-time face recognition social enhancement for visually impaired people
Vision is significant to every individual in their social life. Unfortunately, visually impaired people lose their sight and are only able to rely on the auditory sense to recognise the identity of a person. This makes visually impaired people (VIP) always be passive in social activity and affects t...
| Main Author: | |
|---|---|
| Format: | Final Year Project / Dissertation / Thesis |
| Published: |
2022
|
| Subjects: | |
| Online Access: | http://eprints.utar.edu.my/4666/ http://eprints.utar.edu.my/4666/1/fyp_CS_2022_TJJ.pdf |
| _version_ | 1848886210645196800 |
|---|---|
| author | Tan, Jing Jie |
| author_facet | Tan, Jing Jie |
| author_sort | Tan, Jing Jie |
| building | UTAR Institutional Repository |
| collection | Online Access |
| description | Vision is significant to every individual in their social life. Unfortunately, visually impaired people lose their sight and are only able to rely on the auditory sense to recognise the identity of a person. This makes visually impaired people (VIP) always be passive in social activity and affects their social confidence. However, there is a lack of affordable visual assistive devices to enhance their quality of social life.
The novelty of this project is to develop a social enhancement assistant that assists VIP in both physical and virtual social activity. Hence, this project developed a face recognition mobile application that assists the VIP to identify a person from device cameras, external camera, and device’s screen. Meanwhile, this project also includes other recognition features such as emotion, gender, and age recognition. This application targets to improve VIP social life quality by being the eyes for them in meeting, presentation, chatting, and using social media. In fact, the fraud cases of misusing other’s identity towards VIP can also be reduced. Besides, the Machine Learning Kit Face Detection API and 3 light-weighted TensorFlow Lite face recognition models are implemented to achieve a high accuracy, and short recognition time. The model architectures are FaceNet – Inception-ResNet v1 (face identity), Mini-Xception (face emotion), and Inception module (face details).
Besides, this application meets the requirement of TalkBack service in order to produce zero barrier for VIP when they are using this application. In addition, this application has visual accessibility user interface design and has implemented various interaction channels – vision, auditory, touch, vibrate and shake. Last but not least, this application integrated database backup functionality via Firebase Storage to ease data migration and ensure a minimum loss of face records. |
| first_indexed | 2025-11-15T19:34:52Z |
| format | Final Year Project / Dissertation / Thesis |
| id | utar-4666 |
| institution | Universiti Tunku Abdul Rahman |
| institution_category | Local University |
| last_indexed | 2025-11-15T19:34:52Z |
| publishDate | 2022 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | utar-46662023-01-15T13:30:05Z Real-time face recognition social enhancement for visually impaired people Tan, Jing Jie Q Science (General) T Technology (General) Vision is significant to every individual in their social life. Unfortunately, visually impaired people lose their sight and are only able to rely on the auditory sense to recognise the identity of a person. This makes visually impaired people (VIP) always be passive in social activity and affects their social confidence. However, there is a lack of affordable visual assistive devices to enhance their quality of social life. The novelty of this project is to develop a social enhancement assistant that assists VIP in both physical and virtual social activity. Hence, this project developed a face recognition mobile application that assists the VIP to identify a person from device cameras, external camera, and device’s screen. Meanwhile, this project also includes other recognition features such as emotion, gender, and age recognition. This application targets to improve VIP social life quality by being the eyes for them in meeting, presentation, chatting, and using social media. In fact, the fraud cases of misusing other’s identity towards VIP can also be reduced. Besides, the Machine Learning Kit Face Detection API and 3 light-weighted TensorFlow Lite face recognition models are implemented to achieve a high accuracy, and short recognition time. The model architectures are FaceNet – Inception-ResNet v1 (face identity), Mini-Xception (face emotion), and Inception module (face details). Besides, this application meets the requirement of TalkBack service in order to produce zero barrier for VIP when they are using this application. In addition, this application has visual accessibility user interface design and has implemented various interaction channels – vision, auditory, touch, vibrate and shake. Last but not least, this application integrated database backup functionality via Firebase Storage to ease data migration and ensure a minimum loss of face records. 2022-04-01 Final Year Project / Dissertation / Thesis NonPeerReviewed application/pdf http://eprints.utar.edu.my/4666/1/fyp_CS_2022_TJJ.pdf Tan, Jing Jie (2022) Real-time face recognition social enhancement for visually impaired people. Final Year Project, UTAR. http://eprints.utar.edu.my/4666/ |
| spellingShingle | Q Science (General) T Technology (General) Tan, Jing Jie Real-time face recognition social enhancement for visually impaired people |
| title | Real-time face recognition social enhancement for visually impaired people
|
| title_full | Real-time face recognition social enhancement for visually impaired people
|
| title_fullStr | Real-time face recognition social enhancement for visually impaired people
|
| title_full_unstemmed | Real-time face recognition social enhancement for visually impaired people
|
| title_short | Real-time face recognition social enhancement for visually impaired people
|
| title_sort | real-time face recognition social enhancement for visually impaired people |
| topic | Q Science (General) T Technology (General) |
| url | http://eprints.utar.edu.my/4666/ http://eprints.utar.edu.my/4666/1/fyp_CS_2022_TJJ.pdf |