Multimodal research: Addressing the complexity of multimodal environments and the challenges for CALL
Multimodality, the study of the interaction of language with other semiotic resources such as images and sound resources, has significant implications for computer assisted language learning (CALL) with regards to understanding the impact of digital environments on language teaching and learning. In...
| Main Authors: | , , |
|---|---|
| Format: | Journal Article |
| Published: |
Cambridge University Press
2016
|
| Online Access: | http://hdl.handle.net/20.500.11937/38687 |
| _version_ | 1848755388046901248 |
|---|---|
| author | Tan, Sabine O'Halloran, Kay Wignell, Peter |
| author_facet | Tan, Sabine O'Halloran, Kay Wignell, Peter |
| author_sort | Tan, Sabine |
| building | Curtin Institutional Repository |
| collection | Online Access |
| description | Multimodality, the study of the interaction of language with other semiotic resources such as images and sound resources, has significant implications for computer assisted language learning (CALL) with regards to understanding the impact of digital environments on language teaching and learning. In this paper, we explore recent manifestations of CALL in 3-D virtual worlds, illustrated by the example of Second Life. The multimodal analyses of a conventional face-to-face lesson and three language learning activities in Second Life highlight some of the affordances and challenges presented by 3-D virtual environments. The results suggest that while multimodal resources integrate naturally to facilitate language teaching and learning in an orderly, structured and goal-orientated manner in classroom lessons, the often uncoordinated use (or absence) of avatars' gaze, facial expression, body posture, gesture, as well as the unclear proxemics and use of space pose problems for effective communication in a 3-D virtual world. In addition, a technology-oriented register, alongside traditional instructional and regulative genres and registers, is introduced to help students cope with the demands of learning a language in a 3-D virtual environment. The study raises the issue of the relative effectiveness of 3-D virtual worlds for language teaching and learning. In doing so, a digital approach to multimodal research is proposed in order to address the complexity of multimodal learning environments and the various challenges for CALL. |
| first_indexed | 2025-11-14T08:55:30Z |
| format | Journal Article |
| id | curtin-20.500.11937-38687 |
| institution | Curtin University Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-14T08:55:30Z |
| publishDate | 2016 |
| publisher | Cambridge University Press |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | curtin-20.500.11937-386872017-09-13T14:16:25Z Multimodal research: Addressing the complexity of multimodal environments and the challenges for CALL Tan, Sabine O'Halloran, Kay Wignell, Peter Multimodality, the study of the interaction of language with other semiotic resources such as images and sound resources, has significant implications for computer assisted language learning (CALL) with regards to understanding the impact of digital environments on language teaching and learning. In this paper, we explore recent manifestations of CALL in 3-D virtual worlds, illustrated by the example of Second Life. The multimodal analyses of a conventional face-to-face lesson and three language learning activities in Second Life highlight some of the affordances and challenges presented by 3-D virtual environments. The results suggest that while multimodal resources integrate naturally to facilitate language teaching and learning in an orderly, structured and goal-orientated manner in classroom lessons, the often uncoordinated use (or absence) of avatars' gaze, facial expression, body posture, gesture, as well as the unclear proxemics and use of space pose problems for effective communication in a 3-D virtual world. In addition, a technology-oriented register, alongside traditional instructional and regulative genres and registers, is introduced to help students cope with the demands of learning a language in a 3-D virtual environment. The study raises the issue of the relative effectiveness of 3-D virtual worlds for language teaching and learning. In doing so, a digital approach to multimodal research is proposed in order to address the complexity of multimodal learning environments and the various challenges for CALL. 2016 Journal Article http://hdl.handle.net/20.500.11937/38687 10.1017/S0958344016000124 Cambridge University Press fulltext |
| spellingShingle | Tan, Sabine O'Halloran, Kay Wignell, Peter Multimodal research: Addressing the complexity of multimodal environments and the challenges for CALL |
| title | Multimodal research: Addressing the complexity of multimodal environments and the challenges for CALL |
| title_full | Multimodal research: Addressing the complexity of multimodal environments and the challenges for CALL |
| title_fullStr | Multimodal research: Addressing the complexity of multimodal environments and the challenges for CALL |
| title_full_unstemmed | Multimodal research: Addressing the complexity of multimodal environments and the challenges for CALL |
| title_short | Multimodal research: Addressing the complexity of multimodal environments and the challenges for CALL |
| title_sort | multimodal research: addressing the complexity of multimodal environments and the challenges for call |
| url | http://hdl.handle.net/20.500.11937/38687 |