Speech Cues Contribute to Audiovisual Spatial Integration
Speech is the most important form of human communication but ambient sounds and competing talkers often degrade its acoustics. Fortunately the brain can use visual information, especially its highly precise spatial information, to improve speech comprehension in noisy environments. Previous studies...
| Main Authors: | , |
|---|---|
| Format: | Online |
| Language: | English |
| Published: |
Public Library of Science
2011
|
| Online Access: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3166076/ |
| id |
pubmed-3166076 |
|---|---|
| recordtype |
oai_dc |
| spelling |
pubmed-31660762011-09-09 Speech Cues Contribute to Audiovisual Spatial Integration Bishop, Christopher W. Miller, Lee M. Research Article Speech is the most important form of human communication but ambient sounds and competing talkers often degrade its acoustics. Fortunately the brain can use visual information, especially its highly precise spatial information, to improve speech comprehension in noisy environments. Previous studies have demonstrated that audiovisual integration depends strongly on spatiotemporal factors. However, some integrative phenomena such as McGurk interference persist even with gross spatial disparities, suggesting that spatial alignment is not necessary for robust integration of audiovisual place-of-articulation cues. It is therefore unclear how speech-cues interact with audiovisual spatial integration mechanisms. Here, we combine two well established psychophysical phenomena, the McGurk effect and the ventriloquist's illusion, to explore this dependency. Our results demonstrate that conflicting spatial cues may not interfere with audiovisual integration of speech, but conflicting speech-cues can impede integration in space. This suggests a direct but asymmetrical influence between ventral ‘what’ and dorsal ‘where’ pathways. Public Library of Science 2011-08-31 /pmc/articles/PMC3166076/ /pubmed/21909378 http://dx.doi.org/10.1371/journal.pone.0024016 Text en Bishop, Miller. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited. |
| repository_type |
Open Access Journal |
| institution_category |
Foreign Institution |
| institution |
US National Center for Biotechnology Information |
| building |
NCBI PubMed |
| collection |
Online Access |
| language |
English |
| format |
Online |
| author |
Bishop, Christopher W. Miller, Lee M. |
| spellingShingle |
Bishop, Christopher W. Miller, Lee M. Speech Cues Contribute to Audiovisual Spatial Integration |
| author_facet |
Bishop, Christopher W. Miller, Lee M. |
| author_sort |
Bishop, Christopher W. |
| title |
Speech Cues Contribute to Audiovisual Spatial Integration |
| title_short |
Speech Cues Contribute to Audiovisual Spatial Integration |
| title_full |
Speech Cues Contribute to Audiovisual Spatial Integration |
| title_fullStr |
Speech Cues Contribute to Audiovisual Spatial Integration |
| title_full_unstemmed |
Speech Cues Contribute to Audiovisual Spatial Integration |
| title_sort |
speech cues contribute to audiovisual spatial integration |
| description |
Speech is the most important form of human communication but ambient sounds and competing talkers often degrade its acoustics. Fortunately the brain can use visual information, especially its highly precise spatial information, to improve speech comprehension in noisy environments. Previous studies have demonstrated that audiovisual integration depends strongly on spatiotemporal factors. However, some integrative phenomena such as McGurk interference persist even with gross spatial disparities, suggesting that spatial alignment is not necessary for robust integration of audiovisual place-of-articulation cues. It is therefore unclear how speech-cues interact with audiovisual spatial integration mechanisms. Here, we combine two well established psychophysical phenomena, the McGurk effect and the ventriloquist's illusion, to explore this dependency. Our results demonstrate that conflicting spatial cues may not interfere with audiovisual integration of speech, but conflicting speech-cues can impede integration in space. This suggests a direct but asymmetrical influence between ventral ‘what’ and dorsal ‘where’ pathways. |
| publisher |
Public Library of Science |
| publishDate |
2011 |
| url |
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3166076/ |
| _version_ |
1611473472863600640 |