Sign language recognition with computer vision

This project centres on crafting a web application that recognizes sign language, accessible across different devices and operating systems. Its primary objective is to convert American Sign Language (ASL) gestures into text, facilitating communication for the hearing impaired. Leveraging Computer V...

Full description

Bibliographic Details
Main Author: Tee, Wei Heng
Format: Final Year Project / Dissertation / Thesis
Published: 2024
Subjects:
Online Access:http://eprints.utar.edu.my/6676/
http://eprints.utar.edu.my/6676/1/fyp_CS_2024_TWH.pdf
_version_ 1848886742997794816
author Tee, Wei Heng
author_facet Tee, Wei Heng
author_sort Tee, Wei Heng
building UTAR Institutional Repository
collection Online Access
description This project centres on crafting a web application that recognizes sign language, accessible across different devices and operating systems. Its primary objective is to convert American Sign Language (ASL) gestures into text, facilitating communication for the hearing impaired. Leveraging Computer Vision (CV), the project aims to equip computers with the ability to interpret visual cues. Addressing the inherent challenges of sign language, including its limited universality and usage, the project unfolds in seven key stages: data collection, feature engineering, data preparation, model design and training, testing and evaluation, and application development. Noteworthy testing results showcase a robust 95% training accuracy and an 85% testing accuracy. The envisioned web application boasts a feature-rich interface encompassing gesture recognition, user ratings, translation history management, account administration, and an extensive sign language dictionary. Clarifying the system's functionality, diagrams are employed for enhanced comprehension. In the implementation phase, meticulous attention is paid to hardware and software configurations, with detailed setup instructions provided. System operations are thoroughly elucidated, alongside candid discussions on encountered challenges such as data quality issues and processing constraints. To ensure the system's reliability, a comprehensive testing regimen is executed, spanning video frame capture, model prediction, and web application feature validation. In summary, this project marks a good stride towards enhancing communication accessibility for the hearing impaired.
first_indexed 2025-11-15T19:43:20Z
format Final Year Project / Dissertation / Thesis
id utar-6676
institution Universiti Tunku Abdul Rahman
institution_category Local University
last_indexed 2025-11-15T19:43:20Z
publishDate 2024
recordtype eprints
repository_type Digital Repository
spelling utar-66762024-10-23T06:36:27Z Sign language recognition with computer vision Tee, Wei Heng T Technology (General) TD Environmental technology. Sanitary engineering This project centres on crafting a web application that recognizes sign language, accessible across different devices and operating systems. Its primary objective is to convert American Sign Language (ASL) gestures into text, facilitating communication for the hearing impaired. Leveraging Computer Vision (CV), the project aims to equip computers with the ability to interpret visual cues. Addressing the inherent challenges of sign language, including its limited universality and usage, the project unfolds in seven key stages: data collection, feature engineering, data preparation, model design and training, testing and evaluation, and application development. Noteworthy testing results showcase a robust 95% training accuracy and an 85% testing accuracy. The envisioned web application boasts a feature-rich interface encompassing gesture recognition, user ratings, translation history management, account administration, and an extensive sign language dictionary. Clarifying the system's functionality, diagrams are employed for enhanced comprehension. In the implementation phase, meticulous attention is paid to hardware and software configurations, with detailed setup instructions provided. System operations are thoroughly elucidated, alongside candid discussions on encountered challenges such as data quality issues and processing constraints. To ensure the system's reliability, a comprehensive testing regimen is executed, spanning video frame capture, model prediction, and web application feature validation. In summary, this project marks a good stride towards enhancing communication accessibility for the hearing impaired. 2024-01 Final Year Project / Dissertation / Thesis NonPeerReviewed application/pdf http://eprints.utar.edu.my/6676/1/fyp_CS_2024_TWH.pdf Tee, Wei Heng (2024) Sign language recognition with computer vision. Final Year Project, UTAR. http://eprints.utar.edu.my/6676/
spellingShingle T Technology (General)
TD Environmental technology. Sanitary engineering
Tee, Wei Heng
Sign language recognition with computer vision
title Sign language recognition with computer vision
title_full Sign language recognition with computer vision
title_fullStr Sign language recognition with computer vision
title_full_unstemmed Sign language recognition with computer vision
title_short Sign language recognition with computer vision
title_sort sign language recognition with computer vision
topic T Technology (General)
TD Environmental technology. Sanitary engineering
url http://eprints.utar.edu.my/6676/
http://eprints.utar.edu.my/6676/1/fyp_CS_2024_TWH.pdf