Mobile application for sign language learning with real time feedback
With over 70 million deaf people worldwide, sign languages serve as means of communication and connection within Deaf communities. However, limited accessibility of sign language education poses barriers to social inclusion and awareness. This project proposes developing an innovative mobile applica...
| Main Author: | |
|---|---|
| Format: | Final Year Project / Dissertation / Thesis |
| Published: |
2024
|
| Subjects: | |
| Online Access: | http://eprints.utar.edu.my/6655/ http://eprints.utar.edu.my/6655/1/fyp_CS_2024_LXXA.pdf |
| _version_ | 1848886737783226368 |
|---|---|
| author | Lee, Xiao Xu Alexis |
| author_facet | Lee, Xiao Xu Alexis |
| author_sort | Lee, Xiao Xu Alexis |
| building | UTAR Institutional Repository |
| collection | Online Access |
| description | With over 70 million deaf people worldwide, sign languages serve as means of communication and connection within Deaf communities. However, limited accessibility of sign language education poses barriers to social inclusion and awareness. This project proposes developing an innovative mobile application for interactive sign language learning to benefit both Deaf individuals and hearing loss individuals globally. The app aims to deliver courses methodically from basic vocabulary to advanced grammar, diverse learning materials like video demonstrations, quizzes and exercises. A major innovation of this project involves integrating computer vision and machine learning for real-time sign recognition and feedback during signing exercises. Machine learning algorithms using MediaPipe and deep learning will analyse users' hand motions to provide corrections for improving technique. Overall, this project strives to transform sign language learning through assistive technologies. This mobile application aspires to deliver innovative tools empowering deaf and hearing loss individuals globally to connect across social barriers. |
| first_indexed | 2025-11-15T19:43:15Z |
| format | Final Year Project / Dissertation / Thesis |
| id | utar-6655 |
| institution | Universiti Tunku Abdul Rahman |
| institution_category | Local University |
| last_indexed | 2025-11-15T19:43:15Z |
| publishDate | 2024 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | utar-66552024-10-23T06:01:41Z Mobile application for sign language learning with real time feedback Lee, Xiao Xu Alexis H Social Sciences (General) HB Economic Theory T Technology (General) TD Environmental technology. Sanitary engineering With over 70 million deaf people worldwide, sign languages serve as means of communication and connection within Deaf communities. However, limited accessibility of sign language education poses barriers to social inclusion and awareness. This project proposes developing an innovative mobile application for interactive sign language learning to benefit both Deaf individuals and hearing loss individuals globally. The app aims to deliver courses methodically from basic vocabulary to advanced grammar, diverse learning materials like video demonstrations, quizzes and exercises. A major innovation of this project involves integrating computer vision and machine learning for real-time sign recognition and feedback during signing exercises. Machine learning algorithms using MediaPipe and deep learning will analyse users' hand motions to provide corrections for improving technique. Overall, this project strives to transform sign language learning through assistive technologies. This mobile application aspires to deliver innovative tools empowering deaf and hearing loss individuals globally to connect across social barriers. 2024-01 Final Year Project / Dissertation / Thesis NonPeerReviewed application/pdf http://eprints.utar.edu.my/6655/1/fyp_CS_2024_LXXA.pdf Lee, Xiao Xu Alexis (2024) Mobile application for sign language learning with real time feedback. Final Year Project, UTAR. http://eprints.utar.edu.my/6655/ |
| spellingShingle | H Social Sciences (General) HB Economic Theory T Technology (General) TD Environmental technology. Sanitary engineering Lee, Xiao Xu Alexis Mobile application for sign language learning with real time feedback |
| title | Mobile application for sign language learning with real time feedback |
| title_full | Mobile application for sign language learning with real time feedback |
| title_fullStr | Mobile application for sign language learning with real time feedback |
| title_full_unstemmed | Mobile application for sign language learning with real time feedback |
| title_short | Mobile application for sign language learning with real time feedback |
| title_sort | mobile application for sign language learning with real time feedback |
| topic | H Social Sciences (General) HB Economic Theory T Technology (General) TD Environmental technology. Sanitary engineering |
| url | http://eprints.utar.edu.my/6655/ http://eprints.utar.edu.my/6655/1/fyp_CS_2024_LXXA.pdf |