Framework development of real-time lip sync Animation on viseme based human speech
Performance of real-time lip sync animation is an approach to perform a virtual computer generated character talk, which synchronizes an accurate lip movement and sound in live. Based on the review, the creation of lip sync animation in real-time is particularly challenging in mapping the lip ani...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
UTM Press
2015
|
| Subjects: | |
| Online Access: | http://ir.unimas.my/id/eprint/10600/ http://ir.unimas.my/id/eprint/10600/1/NO%2058%20Framework%20development%20of%20real-time%20lip%20sync%20animation%20on%20viseme%20based%20human%20speech%20%28abstract%29.pdf |
| _version_ | 1848836817116200960 |
|---|---|
| author | Loh, Ngiik Hoon Khairul Aidil Azlin, Abd. Rahman Wang, Yin Chai |
| author_facet | Loh, Ngiik Hoon Khairul Aidil Azlin, Abd. Rahman Wang, Yin Chai |
| author_sort | Loh, Ngiik Hoon |
| building | UNIMAS Institutional Repository |
| collection | Online Access |
| description | Performance of real-time lip sync animation is an approach to perform a virtual computer
generated character talk, which synchronizes an accurate lip movement and sound in
live. Based on the review, the creation of lip sync animation in real-time is particularly
challenging in mapping the lip animation movement and sounds that are synchronized.
The fluidity and accuracy in natural speech are one of the most difficult things to do
convincingly in facial animation. People are very sensitive to this when you get it wrong
because we are all focused on faces. Especially in real time application, the visual impact
needed is immediate, commanding and convincing to the audience. A research on
viseme based human speech was conducted to develop a lip synchronization platform in
order to achieve an accurate lip motion with the sounds that are synchronized as well as
increase the visual performance of the facial animation. Through this research, a usability
automated digital speech system for lip sync animation was developed. Automatic
designed with the use of simple synchronization tricks which generally improve accuracy
and realistic visual impression and implementation of advanced features into lip
synchronization application. This study allows simulation of lip synching in real time and
offline application. Hence, it can be applied in various areas such as entertainment,
education, tutoring, animation and live performances, such as theater, broadcasting,
education and live presentation. |
| first_indexed | 2025-11-15T06:29:47Z |
| format | Article |
| id | unimas-10600 |
| institution | Universiti Malaysia Sarawak |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T06:29:47Z |
| publishDate | 2015 |
| publisher | UTM Press |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | unimas-106002016-10-21T06:01:31Z http://ir.unimas.my/id/eprint/10600/ Framework development of real-time lip sync Animation on viseme based human speech Loh, Ngiik Hoon Khairul Aidil Azlin, Abd. Rahman Wang, Yin Chai N Visual arts (General) For photography, see TR Performance of real-time lip sync animation is an approach to perform a virtual computer generated character talk, which synchronizes an accurate lip movement and sound in live. Based on the review, the creation of lip sync animation in real-time is particularly challenging in mapping the lip animation movement and sounds that are synchronized. The fluidity and accuracy in natural speech are one of the most difficult things to do convincingly in facial animation. People are very sensitive to this when you get it wrong because we are all focused on faces. Especially in real time application, the visual impact needed is immediate, commanding and convincing to the audience. A research on viseme based human speech was conducted to develop a lip synchronization platform in order to achieve an accurate lip motion with the sounds that are synchronized as well as increase the visual performance of the facial animation. Through this research, a usability automated digital speech system for lip sync animation was developed. Automatic designed with the use of simple synchronization tricks which generally improve accuracy and realistic visual impression and implementation of advanced features into lip synchronization application. This study allows simulation of lip synching in real time and offline application. Hence, it can be applied in various areas such as entertainment, education, tutoring, animation and live performances, such as theater, broadcasting, education and live presentation. UTM Press 2015 Article PeerReviewed text en http://ir.unimas.my/id/eprint/10600/1/NO%2058%20Framework%20development%20of%20real-time%20lip%20sync%20animation%20on%20viseme%20based%20human%20speech%20%28abstract%29.pdf Loh, Ngiik Hoon and Khairul Aidil Azlin, Abd. Rahman and Wang, Yin Chai (2015) Framework development of real-time lip sync Animation on viseme based human speech. Jurnal Teknologi, 75 (4). pp. 43-48. ISSN 2180–3722 http://www.jurnalteknologi.utm.my |
| spellingShingle | N Visual arts (General) For photography, see TR Loh, Ngiik Hoon Khairul Aidil Azlin, Abd. Rahman Wang, Yin Chai Framework development of real-time lip sync Animation on viseme based human speech |
| title | Framework development of real-time lip sync Animation on viseme based human speech |
| title_full | Framework development of real-time lip sync Animation on viseme based human speech |
| title_fullStr | Framework development of real-time lip sync Animation on viseme based human speech |
| title_full_unstemmed | Framework development of real-time lip sync Animation on viseme based human speech |
| title_short | Framework development of real-time lip sync Animation on viseme based human speech |
| title_sort | framework development of real-time lip sync animation on viseme based human speech |
| topic | N Visual arts (General) For photography, see TR |
| url | http://ir.unimas.my/id/eprint/10600/ http://ir.unimas.my/id/eprint/10600/ http://ir.unimas.my/id/eprint/10600/1/NO%2058%20Framework%20development%20of%20real-time%20lip%20sync%20animation%20on%20viseme%20based%20human%20speech%20%28abstract%29.pdf |