The role of verbal and pictorial information in multimodal incidental acquisition of foreign language vocabulary

This study used eye tracking to investigate the allocation of attention to multimodal stimuli during an incidental learning situation, as well as its impact on subsequent explicit learning. Participants were exposed to foreign language (FL) auditory words on their own, in conjunction with written na...

Full description

Bibliographic Details
Main Authors: Bisson, Marie-Josée, van Heuven, Walter J.B., Conklin, Kathy, Tunney, Richard J.
Format: Article
Published: Taylor & Francis 2014
Subjects:
Online Access:https://eprints.nottingham.ac.uk/28438/
_version_ 1848793571152363520
author Bisson, Marie-Josée
van Heuven, Walter J.B.
Conklin, Kathy
Tunney, Richard J.
author_facet Bisson, Marie-Josée
van Heuven, Walter J.B.
Conklin, Kathy
Tunney, Richard J.
author_sort Bisson, Marie-Josée
building Nottingham Research Data Repository
collection Online Access
description This study used eye tracking to investigate the allocation of attention to multimodal stimuli during an incidental learning situation, as well as its impact on subsequent explicit learning. Participants were exposed to foreign language (FL) auditory words on their own, in conjunction with written native language (NL) translations, or with both written NL translations and pictures. Incidental acquisition of FL words was assessed the following day through an explicit learning task where participants learned to recognize translation equivalents, as well as one week later through recall and translation recognition tests. Results showed higher accuracy scores in the explicit learning task for FL words presented with meaning during incidental learning, whether written meaning or both written meaning and picture, than for FL words presented auditorily only. However, participants recalled significantly more FL words after a week delay if they had been presented with a picture during incidental learning. In addition, the time spent looking at the pictures during incidental learning significantly predicted recognition and recall scores one week later. Overall, results demonstrated the impact of exposure to multimodal stimuli on subsequent explicit learning, as well as the important role that pictorial information can play in incidental vocabulary acquisition.
first_indexed 2025-11-14T19:02:25Z
format Article
id nottingham-28438
institution University of Nottingham Malaysia Campus
institution_category Local University
last_indexed 2025-11-14T19:02:25Z
publishDate 2014
publisher Taylor & Francis
recordtype eprints
repository_type Digital Repository
spelling nottingham-284382020-05-04T16:59:04Z https://eprints.nottingham.ac.uk/28438/ The role of verbal and pictorial information in multimodal incidental acquisition of foreign language vocabulary Bisson, Marie-Josée van Heuven, Walter J.B. Conklin, Kathy Tunney, Richard J. This study used eye tracking to investigate the allocation of attention to multimodal stimuli during an incidental learning situation, as well as its impact on subsequent explicit learning. Participants were exposed to foreign language (FL) auditory words on their own, in conjunction with written native language (NL) translations, or with both written NL translations and pictures. Incidental acquisition of FL words was assessed the following day through an explicit learning task where participants learned to recognize translation equivalents, as well as one week later through recall and translation recognition tests. Results showed higher accuracy scores in the explicit learning task for FL words presented with meaning during incidental learning, whether written meaning or both written meaning and picture, than for FL words presented auditorily only. However, participants recalled significantly more FL words after a week delay if they had been presented with a picture during incidental learning. In addition, the time spent looking at the pictures during incidental learning significantly predicted recognition and recall scores one week later. Overall, results demonstrated the impact of exposure to multimodal stimuli on subsequent explicit learning, as well as the important role that pictorial information can play in incidental vocabulary acquisition. Taylor & Francis 2014-12-06 Article PeerReviewed Bisson, Marie-Josée, van Heuven, Walter J.B., Conklin, Kathy and Tunney, Richard J. (2014) The role of verbal and pictorial information in multimodal incidental acquisition of foreign language vocabulary. Quarterly Journal of Experimental Psychology . pp. 1-21. ISSN 1747-0218 Incidental learning Vocabulary acquisition Eye tracking Multimodalities Foreign language learning http://www.tandfonline.com/doi/full/10.1080/17470218.2014.979211#.VO3lenysWws doi:10.1080/17470218.2014.979211 doi:10.1080/17470218.2014.979211
spellingShingle Incidental learning
Vocabulary acquisition
Eye tracking
Multimodalities
Foreign language learning
Bisson, Marie-Josée
van Heuven, Walter J.B.
Conklin, Kathy
Tunney, Richard J.
The role of verbal and pictorial information in multimodal incidental acquisition of foreign language vocabulary
title The role of verbal and pictorial information in multimodal incidental acquisition of foreign language vocabulary
title_full The role of verbal and pictorial information in multimodal incidental acquisition of foreign language vocabulary
title_fullStr The role of verbal and pictorial information in multimodal incidental acquisition of foreign language vocabulary
title_full_unstemmed The role of verbal and pictorial information in multimodal incidental acquisition of foreign language vocabulary
title_short The role of verbal and pictorial information in multimodal incidental acquisition of foreign language vocabulary
title_sort role of verbal and pictorial information in multimodal incidental acquisition of foreign language vocabulary
topic Incidental learning
Vocabulary acquisition
Eye tracking
Multimodalities
Foreign language learning
url https://eprints.nottingham.ac.uk/28438/
https://eprints.nottingham.ac.uk/28438/
https://eprints.nottingham.ac.uk/28438/