3D lips development and measurement for visual speech synthesis
This paper presents works involves in developing a three-dimensional lips model to be used in a visual speech synthesis. Even though several works have been done in similar areas, but a systematic approach of identifying and determining the number of vertices used in the lips model for visual speech...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
EuroJournals Publishing
2009
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/12638/ http://psasir.upm.edu.my/id/eprint/12638/1/12638.pdf |
| _version_ | 1848841889072021504 |
|---|---|
| author | Salleh, Siti Salwa O. K. Rahmat, Rahmita Wirza Mahmod, Ramlan Ahmad, Fatimah |
| author_facet | Salleh, Siti Salwa O. K. Rahmat, Rahmita Wirza Mahmod, Ramlan Ahmad, Fatimah |
| author_sort | Salleh, Siti Salwa |
| building | UPM Institutional Repository |
| collection | Online Access |
| description | This paper presents works involves in developing a three-dimensional lips model to be used in a visual speech synthesis. Even though several works have been done in similar areas, but a systematic approach of identifying and determining the number of vertices used in the lips model for visual speech synthesis were not explained thoroughly. Instead of the development technique involved, this paper also present experimental design and set up to test the capabilities and flexibility of the lips in deforming speech. The work starts with the process of capturing the lips shape using 3D scanner and then the number of vertices
reduced using relevance measure technique in order to achieve the optimum number of vertices to deform all visemes in Standard Malay. Results shown in this work proves that a systematic degradation of 10,000 vertices into 60 vertices by retaining 0.0006% of the initial vertices managed to be done. We also found out that the deformation of the lips with smaller number of vertices is still remaining the similar quality of the lips deformation of the 150 or 100 vertices. Therefore, the outcome of this study proposes and justifies the appropriate number of vertices to be used in visual speech synthesis in our future work. |
| first_indexed | 2025-11-15T07:50:24Z |
| format | Article |
| id | upm-12638 |
| institution | Universiti Putra Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T07:50:24Z |
| publishDate | 2009 |
| publisher | EuroJournals Publishing |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | upm-126382018-10-25T00:31:58Z http://psasir.upm.edu.my/id/eprint/12638/ 3D lips development and measurement for visual speech synthesis Salleh, Siti Salwa O. K. Rahmat, Rahmita Wirza Mahmod, Ramlan Ahmad, Fatimah This paper presents works involves in developing a three-dimensional lips model to be used in a visual speech synthesis. Even though several works have been done in similar areas, but a systematic approach of identifying and determining the number of vertices used in the lips model for visual speech synthesis were not explained thoroughly. Instead of the development technique involved, this paper also present experimental design and set up to test the capabilities and flexibility of the lips in deforming speech. The work starts with the process of capturing the lips shape using 3D scanner and then the number of vertices reduced using relevance measure technique in order to achieve the optimum number of vertices to deform all visemes in Standard Malay. Results shown in this work proves that a systematic degradation of 10,000 vertices into 60 vertices by retaining 0.0006% of the initial vertices managed to be done. We also found out that the deformation of the lips with smaller number of vertices is still remaining the similar quality of the lips deformation of the 150 or 100 vertices. Therefore, the outcome of this study proposes and justifies the appropriate number of vertices to be used in visual speech synthesis in our future work. EuroJournals Publishing 2009 Article PeerReviewed text en http://psasir.upm.edu.my/id/eprint/12638/1/12638.pdf Salleh, Siti Salwa and O. K. Rahmat, Rahmita Wirza and Mahmod, Ramlan and Ahmad, Fatimah (2009) 3D lips development and measurement for visual speech synthesis. European Journal of Scientific Research, 35 (2). pp. 159-172. ISSN 1450-216X |
| spellingShingle | Salleh, Siti Salwa O. K. Rahmat, Rahmita Wirza Mahmod, Ramlan Ahmad, Fatimah 3D lips development and measurement for visual speech synthesis |
| title | 3D lips development and measurement for visual speech synthesis |
| title_full | 3D lips development and measurement for visual speech synthesis |
| title_fullStr | 3D lips development and measurement for visual speech synthesis |
| title_full_unstemmed | 3D lips development and measurement for visual speech synthesis |
| title_short | 3D lips development and measurement for visual speech synthesis |
| title_sort | 3d lips development and measurement for visual speech synthesis |
| url | http://psasir.upm.edu.my/id/eprint/12638/ http://psasir.upm.edu.my/id/eprint/12638/1/12638.pdf |