Multimodal analytics: Software and visualization techniques for analyzing and interpreting multimodal data

Multimodal analysis, the study of semantic patterns arising from the integration of language, images and audio resouces in multimodal texts, presents considerable challenges which are both theoretical and practical in nature. First, frameworks for modeling the semantic contributions of the different...

Full description

Bibliographic Details
Main Authors: O'Halloran, Kay, E, M.K.L., Tan, Sabine
Other Authors: Jewitt, C.
Format: Book Chapter
Published: Routledge 2014
Online Access:http://hdl.handle.net/20.500.11937/49563
_version_ 1848758266439401472
author O'Halloran, Kay
E, M.K.L.
Tan, Sabine
author2 Jewitt, C.
author_facet Jewitt, C.
O'Halloran, Kay
E, M.K.L.
Tan, Sabine
author_sort O'Halloran, Kay
building Curtin Institutional Repository
collection Online Access
description Multimodal analysis, the study of semantic patterns arising from the integration of language, images and audio resouces in multimodal texts, presents considerable challenges which are both theoretical and practical in nature. First, frameworks for modeling the semantic contributions of the different resources and the meaning arising from the interaction of choices in multimodal phenomena are required. Such frameworks also need to account for resemioticization of mulitmodal phenomena to investigate social practices over space and time (Iedema, 2001, 2003). In this repect, the social semiotic approach (Halliday, 1978; Halliday and Matthiese4n, 2004) developed by Kress and Van Leeuwen (2005 [1996] and O'Toole (2011 [1994]) has provided a powerful theoretical platform for investigating multimodal phenomena (eg. see this volume)
first_indexed 2025-11-14T09:41:15Z
format Book Chapter
id curtin-20.500.11937-49563
institution Curtin University Malaysia
institution_category Local University
last_indexed 2025-11-14T09:41:15Z
publishDate 2014
publisher Routledge
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-495632019-09-10T06:25:39Z Multimodal analytics: Software and visualization techniques for analyzing and interpreting multimodal data O'Halloran, Kay E, M.K.L. Tan, Sabine Jewitt, C. Multimodal analysis, the study of semantic patterns arising from the integration of language, images and audio resouces in multimodal texts, presents considerable challenges which are both theoretical and practical in nature. First, frameworks for modeling the semantic contributions of the different resources and the meaning arising from the interaction of choices in multimodal phenomena are required. Such frameworks also need to account for resemioticization of mulitmodal phenomena to investigate social practices over space and time (Iedema, 2001, 2003). In this repect, the social semiotic approach (Halliday, 1978; Halliday and Matthiese4n, 2004) developed by Kress and Van Leeuwen (2005 [1996] and O'Toole (2011 [1994]) has provided a powerful theoretical platform for investigating multimodal phenomena (eg. see this volume) 2014 Book Chapter http://hdl.handle.net/20.500.11937/49563 Routledge restricted
spellingShingle O'Halloran, Kay
E, M.K.L.
Tan, Sabine
Multimodal analytics: Software and visualization techniques for analyzing and interpreting multimodal data
title Multimodal analytics: Software and visualization techniques for analyzing and interpreting multimodal data
title_full Multimodal analytics: Software and visualization techniques for analyzing and interpreting multimodal data
title_fullStr Multimodal analytics: Software and visualization techniques for analyzing and interpreting multimodal data
title_full_unstemmed Multimodal analytics: Software and visualization techniques for analyzing and interpreting multimodal data
title_short Multimodal analytics: Software and visualization techniques for analyzing and interpreting multimodal data
title_sort multimodal analytics: software and visualization techniques for analyzing and interpreting multimodal data
url http://hdl.handle.net/20.500.11937/49563