Multilingual multimodal integration of sketch and speech: A generic speech representation model for spatial description
This paper details how multiple languages are accommodated in the multimodal integration of sketch and speech, specifically, in spatial applications. The study encompasses English, Malay, Mandarin, and two under-resourced languages in Malaysia, i.e. Melanau and Iban. The preliminary study revealed t...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2009
|
| Subjects: | |
| Online Access: | http://ir.unimas.my/id/eprint/18511/ http://ir.unimas.my/id/eprint/18511/1/05380790%20%28abstrak%29.pdf |
| _version_ | 1848838529799421952 |
|---|---|
| author | Lee-Na, Teh W. Yeo, Alvin |
| author_facet | Lee-Na, Teh W. Yeo, Alvin |
| author_sort | Lee-Na, Teh |
| building | UNIMAS Institutional Repository |
| collection | Online Access |
| description | This paper details how multiple languages are accommodated in the multimodal integration of sketch and speech, specifically, in spatial applications. The study encompasses English, Malay, Mandarin, and two under-resourced languages in Malaysia, i.e. Melanau and Iban. The preliminary study revealed that not all spatial terms (prepositions) appear in all languages. Based on these findings, we propose a method to assist in the design and development of multilingual multimodal applications. This method employs a generic representation model for spatial description. |
| first_indexed | 2025-11-15T06:57:01Z |
| format | Article |
| id | unimas-18511 |
| institution | Universiti Malaysia Sarawak |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T06:57:01Z |
| publishDate | 2009 |
| publisher | IEEE |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | unimas-185112022-09-30T03:12:30Z http://ir.unimas.my/id/eprint/18511/ Multilingual multimodal integration of sketch and speech: A generic speech representation model for spatial description Lee-Na, Teh W. Yeo, Alvin QA76 Computer software This paper details how multiple languages are accommodated in the multimodal integration of sketch and speech, specifically, in spatial applications. The study encompasses English, Malay, Mandarin, and two under-resourced languages in Malaysia, i.e. Melanau and Iban. The preliminary study revealed that not all spatial terms (prepositions) appear in all languages. Based on these findings, we propose a method to assist in the design and development of multilingual multimodal applications. This method employs a generic representation model for spatial description. IEEE 2009 Article PeerReviewed text en http://ir.unimas.my/id/eprint/18511/1/05380790%20%28abstrak%29.pdf Lee-Na, Teh and W. Yeo, Alvin (2009) Multilingual multimodal integration of sketch and speech: A generic speech representation model for spatial description. International Conference on Asian Language Processing: Recent Advances in Asian Language Processing, IALP 2009. pp. 17-22. ISSN 978-076953904-1 http://ieeexplore.ieee.org/document/5380790/ DOI: 10.1109/IALP.2009.13 |
| spellingShingle | QA76 Computer software Lee-Na, Teh W. Yeo, Alvin Multilingual multimodal integration of sketch and speech: A generic speech representation model for spatial description |
| title | Multilingual multimodal integration of sketch and speech: A generic speech representation model for spatial description |
| title_full | Multilingual multimodal integration of sketch and speech: A generic speech representation model for spatial description |
| title_fullStr | Multilingual multimodal integration of sketch and speech: A generic speech representation model for spatial description |
| title_full_unstemmed | Multilingual multimodal integration of sketch and speech: A generic speech representation model for spatial description |
| title_short | Multilingual multimodal integration of sketch and speech: A generic speech representation model for spatial description |
| title_sort | multilingual multimodal integration of sketch and speech: a generic speech representation model for spatial description |
| topic | QA76 Computer software |
| url | http://ir.unimas.my/id/eprint/18511/ http://ir.unimas.my/id/eprint/18511/ http://ir.unimas.my/id/eprint/18511/ http://ir.unimas.my/id/eprint/18511/1/05380790%20%28abstrak%29.pdf |