Challenges facing pen tip detection for applications supporting the visually impaired

Paper-based forms (such as tax forms) present a significant barrier for the visually impaired, whom traditionally require the assistance of a third party to fill in such forms. While there have been efforts in creating systems providing the visually impaired with independence in form-filling, the cr...

Full description

Bibliographic Details
Main Authors: Brower, Arlen, Peursum, Patrick
Other Authors: Hamza, M.H.
Format: Conference Paper
Published: ACTA Press 2012
Subjects:
Online Access:http://hdl.handle.net/20.500.11937/25191
_version_ 1848751639296475136
author Brower, Arlen
Peursum, Patrick
author2 Hamza, M.H.
author_facet Hamza, M.H.
Brower, Arlen
Peursum, Patrick
author_sort Brower, Arlen
building Curtin Institutional Repository
collection Online Access
description Paper-based forms (such as tax forms) present a significant barrier for the visually impaired, whom traditionally require the assistance of a third party to fill in such forms. While there have been efforts in creating systems providing the visually impaired with independence in form-filling, the critical problem of detecting a user's pen effectively has remained unsolved. Given that little research exists in pen tip detection, we examine a range of algorithms that could be used for the task -- borrowing from other fields, such as fingertip tracking, as well as adapting shape detection techniques to finding pen tips. We choose algorithms that could ultimately be implemented on consumer mobile devices and compare their performance in terms of accuracy and speed in both a simplified environment as well as on a real form containing text, lines and fields. In doing so, we demonstrate that existing algorithms are inadequate and the problem is not yet solved, despite being one of importance for a significant proportion of the population.
first_indexed 2025-11-14T07:55:55Z
format Conference Paper
id curtin-20.500.11937-25191
institution Curtin University Malaysia
institution_category Local University
last_indexed 2025-11-14T07:55:55Z
publishDate 2012
publisher ACTA Press
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-251912019-03-08T10:37:14Z Challenges facing pen tip detection for applications supporting the visually impaired Brower, Arlen Peursum, Patrick Hamza, M.H. Object detection visually impaired Hough Transform Paper-based forms (such as tax forms) present a significant barrier for the visually impaired, whom traditionally require the assistance of a third party to fill in such forms. While there have been efforts in creating systems providing the visually impaired with independence in form-filling, the critical problem of detecting a user's pen effectively has remained unsolved. Given that little research exists in pen tip detection, we examine a range of algorithms that could be used for the task -- borrowing from other fields, such as fingertip tracking, as well as adapting shape detection techniques to finding pen tips. We choose algorithms that could ultimately be implemented on consumer mobile devices and compare their performance in terms of accuracy and speed in both a simplified environment as well as on a real form containing text, lines and fields. In doing so, we demonstrate that existing algorithms are inadequate and the problem is not yet solved, despite being one of importance for a significant proportion of the population. 2012 Conference Paper http://hdl.handle.net/20.500.11937/25191 10.2316/P.2012.786-085 ACTA Press restricted
spellingShingle Object detection
visually impaired
Hough Transform
Brower, Arlen
Peursum, Patrick
Challenges facing pen tip detection for applications supporting the visually impaired
title Challenges facing pen tip detection for applications supporting the visually impaired
title_full Challenges facing pen tip detection for applications supporting the visually impaired
title_fullStr Challenges facing pen tip detection for applications supporting the visually impaired
title_full_unstemmed Challenges facing pen tip detection for applications supporting the visually impaired
title_short Challenges facing pen tip detection for applications supporting the visually impaired
title_sort challenges facing pen tip detection for applications supporting the visually impaired
topic Object detection
visually impaired
Hough Transform
url http://hdl.handle.net/20.500.11937/25191