Interference between gestures and words

This thesis explores the idea that a speaker's gestural and verbal behaviours are mutually influential in the comprehension process. A Stroop-type interference paradigm was adopted as a tool for investigating whether or not listeners process to-be-ignored gestural information and how this infor...

Full description

Bibliographic Details
Main Author: Langton, Stephen R. H.
Format: Thesis (University of Nottingham only)
Language:English
Published: 1996
Subjects:
Online Access:https://eprints.nottingham.ac.uk/11315/
_version_ 1848791247311863808
author Langton, Stephen R. H.
author_facet Langton, Stephen R. H.
author_sort Langton, Stephen R. H.
building Nottingham Research Data Repository
collection Online Access
description This thesis explores the idea that a speaker's gestural and verbal behaviours are mutually influential in the comprehension process. A Stroop-type interference paradigm was adopted as a tool for investigating whether or not listeners process to-be-ignored gestural information and how this information influences the processing of spoken words. In Experiments 1-4, static pointing (deictic) gestures and corresponding spoken and written words showed symmetrical interference. Incongruent words slowed responses to gestures, and incongruent gestures slowed responses to words, compared with congruent arrangements. These findings support the idea that both pointing gestures and words are processed in comprehension. Furthermore, the results of Experiments 5-11 suggest that the mutual influence of the two dimensions is largely independent of specific stimulus-response compatibilities. Collectively, these findings are difficult to reconcile with models of Stroop interference which place the locus of the effect at response selection. Instead, they are more consistent with the position that the two sources of information interact at a semantic stage of processing. Arrows (Experiment 12) and spatially positioned dots (Experiment 13) also produced symmetrical interference effects when paired with spoken words, raising the possibility that it is the spatial nature of the pointing gestures which is important in influencing the comprehension of spoken words. In support of this suggestion, other non-spatial gestures such as emblems (Experiment 14), iconics (Experiment 15) and facial gestures (Experiment 16) did not interfere with responses to verbal material. However, symmetrical effects did return when subjects were asked to make affective judgements to either emotional words or schematic facial gestures (Experiment 17). The results are discussed with reference to research on the orienting of social attention, the stimulus-driven "capture" of attention, models of integration, and a processing framework which incorporates the notion of informational integration at "semantic" levels of processing.
first_indexed 2025-11-14T18:25:28Z
format Thesis (University of Nottingham only)
id nottingham-11315
institution University of Nottingham Malaysia Campus
institution_category Local University
language English
last_indexed 2025-11-14T18:25:28Z
publishDate 1996
recordtype eprints
repository_type Digital Repository
spelling nottingham-113152025-02-28T11:12:40Z https://eprints.nottingham.ac.uk/11315/ Interference between gestures and words Langton, Stephen R. H. This thesis explores the idea that a speaker's gestural and verbal behaviours are mutually influential in the comprehension process. A Stroop-type interference paradigm was adopted as a tool for investigating whether or not listeners process to-be-ignored gestural information and how this information influences the processing of spoken words. In Experiments 1-4, static pointing (deictic) gestures and corresponding spoken and written words showed symmetrical interference. Incongruent words slowed responses to gestures, and incongruent gestures slowed responses to words, compared with congruent arrangements. These findings support the idea that both pointing gestures and words are processed in comprehension. Furthermore, the results of Experiments 5-11 suggest that the mutual influence of the two dimensions is largely independent of specific stimulus-response compatibilities. Collectively, these findings are difficult to reconcile with models of Stroop interference which place the locus of the effect at response selection. Instead, they are more consistent with the position that the two sources of information interact at a semantic stage of processing. Arrows (Experiment 12) and spatially positioned dots (Experiment 13) also produced symmetrical interference effects when paired with spoken words, raising the possibility that it is the spatial nature of the pointing gestures which is important in influencing the comprehension of spoken words. In support of this suggestion, other non-spatial gestures such as emblems (Experiment 14), iconics (Experiment 15) and facial gestures (Experiment 16) did not interfere with responses to verbal material. However, symmetrical effects did return when subjects were asked to make affective judgements to either emotional words or schematic facial gestures (Experiment 17). The results are discussed with reference to research on the orienting of social attention, the stimulus-driven "capture" of attention, models of integration, and a processing framework which incorporates the notion of informational integration at "semantic" levels of processing. 1996 Thesis (University of Nottingham only) NonPeerReviewed application/pdf en arr https://eprints.nottingham.ac.uk/11315/1/307813.pdf Langton, Stephen R. H. (1996) Interference between gestures and words. PhD thesis, University of Nottingham. Stroop interference Dimensional interaction Psychology
spellingShingle Stroop interference
Dimensional interaction
Psychology
Langton, Stephen R. H.
Interference between gestures and words
title Interference between gestures and words
title_full Interference between gestures and words
title_fullStr Interference between gestures and words
title_full_unstemmed Interference between gestures and words
title_short Interference between gestures and words
title_sort interference between gestures and words
topic Stroop interference
Dimensional interaction
Psychology
url https://eprints.nottingham.ac.uk/11315/