Now you see it, now you don’t - frequency distribution of articulatory information reflected in speech face motion
Although the increase in intelligibility of spoken language when watching the speaker’s face is well documented, the characteristics and the distribution of phonetic information over the frequency range of visual speech remain largely unknown. For this study face motion and tongue movements were mea...
| Main Authors: | , , |
|---|---|
| Other Authors: | |
| Format: | Conference Paper |
| Published: |
Australasian Speech Science and Technology Association (ASSTA)
2012
|
| Subjects: | |
| Online Access: | http://assta.org/sst/SST-12/SST2012/PDF/AUTHOR/ST120096.PDF http://hdl.handle.net/20.500.11937/17025 |
| _version_ | 1848749345337245696 |
|---|---|
| author | Kroos, Christian Bundgaard-Nielsen, R. Best, C. |
| author2 | Felicity Cox |
| author_facet | Felicity Cox Kroos, Christian Bundgaard-Nielsen, R. Best, C. |
| author_sort | Kroos, Christian |
| building | Curtin Institutional Repository |
| collection | Online Access |
| description | Although the increase in intelligibility of spoken language when watching the speaker’s face is well documented, the characteristics and the distribution of phonetic information over the frequency range of visual speech remain largely unknown. For this study face motion and tongue movements were measured simultaneously for three speakers of American English. The motion signals were subjected to a multiresolution analysis using spline wavelets and partial least squares regression was applied to estimate tongue movements from face motion. The amount of recovered variance was found to be small (below 30%) compared to previous studies and more pronounced in the lower frequencies. |
| first_indexed | 2025-11-14T07:19:28Z |
| format | Conference Paper |
| id | curtin-20.500.11937-17025 |
| institution | Curtin University Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-14T07:19:28Z |
| publishDate | 2012 |
| publisher | Australasian Speech Science and Technology Association (ASSTA) |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | curtin-20.500.11937-170252023-02-02T07:57:38Z Now you see it, now you don’t - frequency distribution of articulatory information reflected in speech face motion Kroos, Christian Bundgaard-Nielsen, R. Best, C. Felicity Cox Katherine Demuth Susan Lin Kelly Miles Sallyanne Palethrope Jason Shaw Ivan Yuen face motion electromagnetic articulography auditory-visual speech wavelets partial least squares Although the increase in intelligibility of spoken language when watching the speaker’s face is well documented, the characteristics and the distribution of phonetic information over the frequency range of visual speech remain largely unknown. For this study face motion and tongue movements were measured simultaneously for three speakers of American English. The motion signals were subjected to a multiresolution analysis using spline wavelets and partial least squares regression was applied to estimate tongue movements from face motion. The amount of recovered variance was found to be small (below 30%) compared to previous studies and more pronounced in the lower frequencies. 2012 Conference Paper http://hdl.handle.net/20.500.11937/17025 http://assta.org/sst/SST-12/SST2012/PDF/AUTHOR/ST120096.PDF Australasian Speech Science and Technology Association (ASSTA) restricted |
| spellingShingle | face motion electromagnetic articulography auditory-visual speech wavelets partial least squares Kroos, Christian Bundgaard-Nielsen, R. Best, C. Now you see it, now you don’t - frequency distribution of articulatory information reflected in speech face motion |
| title | Now you see it, now you don’t - frequency distribution of articulatory information reflected in speech face motion |
| title_full | Now you see it, now you don’t - frequency distribution of articulatory information reflected in speech face motion |
| title_fullStr | Now you see it, now you don’t - frequency distribution of articulatory information reflected in speech face motion |
| title_full_unstemmed | Now you see it, now you don’t - frequency distribution of articulatory information reflected in speech face motion |
| title_short | Now you see it, now you don’t - frequency distribution of articulatory information reflected in speech face motion |
| title_sort | now you see it, now you don’t - frequency distribution of articulatory information reflected in speech face motion |
| topic | face motion electromagnetic articulography auditory-visual speech wavelets partial least squares |
| url | http://assta.org/sst/SST-12/SST2012/PDF/AUTHOR/ST120096.PDF http://hdl.handle.net/20.500.11937/17025 |