Effect of attentional load on audiovisual speech perception: evidence from ERPs
Seeing articulatory movements influences perception of auditory speech. This is often reflected in a shortened latency of auditory event-related potentials (ERPs) generated in the auditory cortex. The present study addressed whether this early neural correlate of audiovisual interaction is modulated...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Published: |
Frontiers Media
2014
|
| Subjects: | |
| Online Access: | https://eprints.nottingham.ac.uk/48528/ |
| _version_ | 1848797785254526976 |
|---|---|
| author | Alsius, Agnes Möttönen, Riikka Sams, Mikko E. Soto-Faraco, Salvador Tiippana, Kaisa |
| author_facet | Alsius, Agnes Möttönen, Riikka Sams, Mikko E. Soto-Faraco, Salvador Tiippana, Kaisa |
| author_sort | Alsius, Agnes |
| building | Nottingham Research Data Repository |
| collection | Online Access |
| description | Seeing articulatory movements influences perception of auditory speech. This is often reflected in a shortened latency of auditory event-related potentials (ERPs) generated in the auditory cortex. The present study addressed whether this early neural correlate of audiovisual interaction is modulated by attention. We recorded ERPs in 15 subjects while they were presented with auditory, visual, and audiovisual spoken syllables. Audiovisual stimuli consisted of incongruent auditory and visual components known to elicit a McGurk effect, i.e., a visually driven alteration in the auditory speech percept. In a Dual task condition, participants were asked to identify spoken syllables whilst monitoring a rapid visual stream of pictures for targets, i.e., they had to divide their attention. In a Single task condition, participants identified the syllables without any other tasks, i.e., they were asked to ignore the pictures and focus their attention fully on the spoken syllables. The McGurk effect was weaker in the Dual task than in the Single task condition, indicating an effect of attentional load on audiovisual speech perception. Early auditory ERP components, N1 and P2, peaked earlier to audiovisual stimuli than to auditory stimuli when attention was fully focused on syllables, indicating neurophysiological audiovisual interaction. This latency decrement was reduced when attention was loaded, suggesting that attention influences early neural processing of audiovisual speech. We conclude that reduced attention weakens the interaction between vision and audition in speech. |
| first_indexed | 2025-11-14T20:09:23Z |
| format | Article |
| id | nottingham-48528 |
| institution | University of Nottingham Malaysia Campus |
| institution_category | Local University |
| last_indexed | 2025-11-14T20:09:23Z |
| publishDate | 2014 |
| publisher | Frontiers Media |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | nottingham-485282020-05-04T16:50:57Z https://eprints.nottingham.ac.uk/48528/ Effect of attentional load on audiovisual speech perception: evidence from ERPs Alsius, Agnes Möttönen, Riikka Sams, Mikko E. Soto-Faraco, Salvador Tiippana, Kaisa Seeing articulatory movements influences perception of auditory speech. This is often reflected in a shortened latency of auditory event-related potentials (ERPs) generated in the auditory cortex. The present study addressed whether this early neural correlate of audiovisual interaction is modulated by attention. We recorded ERPs in 15 subjects while they were presented with auditory, visual, and audiovisual spoken syllables. Audiovisual stimuli consisted of incongruent auditory and visual components known to elicit a McGurk effect, i.e., a visually driven alteration in the auditory speech percept. In a Dual task condition, participants were asked to identify spoken syllables whilst monitoring a rapid visual stream of pictures for targets, i.e., they had to divide their attention. In a Single task condition, participants identified the syllables without any other tasks, i.e., they were asked to ignore the pictures and focus their attention fully on the spoken syllables. The McGurk effect was weaker in the Dual task than in the Single task condition, indicating an effect of attentional load on audiovisual speech perception. Early auditory ERP components, N1 and P2, peaked earlier to audiovisual stimuli than to auditory stimuli when attention was fully focused on syllables, indicating neurophysiological audiovisual interaction. This latency decrement was reduced when attention was loaded, suggesting that attention influences early neural processing of audiovisual speech. We conclude that reduced attention weakens the interaction between vision and audition in speech. Frontiers Media 2014-07-15 Article PeerReviewed Alsius, Agnes, Möttönen, Riikka, Sams, Mikko E., Soto-Faraco, Salvador and Tiippana, Kaisa (2014) Effect of attentional load on audiovisual speech perception: evidence from ERPs. Frontiers in Psychology, 5 . 727/1-727/9. ISSN 1664-1078 audiovisual speech perception multisensory integration McGurk effect attention event-related potentials https://www.frontiersin.org/articles/10.3389/fpsyg.2014.00727/full doi:10.3389/fpsyg.2014.00727 doi:10.3389/fpsyg.2014.00727 |
| spellingShingle | audiovisual speech perception multisensory integration McGurk effect attention event-related potentials Alsius, Agnes Möttönen, Riikka Sams, Mikko E. Soto-Faraco, Salvador Tiippana, Kaisa Effect of attentional load on audiovisual speech perception: evidence from ERPs |
| title | Effect of attentional load on audiovisual speech perception: evidence from ERPs |
| title_full | Effect of attentional load on audiovisual speech perception: evidence from ERPs |
| title_fullStr | Effect of attentional load on audiovisual speech perception: evidence from ERPs |
| title_full_unstemmed | Effect of attentional load on audiovisual speech perception: evidence from ERPs |
| title_short | Effect of attentional load on audiovisual speech perception: evidence from ERPs |
| title_sort | effect of attentional load on audiovisual speech perception: evidence from erps |
| topic | audiovisual speech perception multisensory integration McGurk effect attention event-related potentials |
| url | https://eprints.nottingham.ac.uk/48528/ https://eprints.nottingham.ac.uk/48528/ https://eprints.nottingham.ac.uk/48528/ |