Using virtual presence and survey instructions to minimize careless responding on Internet-based surveys
Internet-based survey data inform knowledge creation in research and justify work activities in organizations. While there are advantages to online surveys, this mode of administration comes with its own set of challenges. Survey respondents may engage in careless responding (i.e. insufficient effor...
| Main Authors: | , |
|---|---|
| Format: | Journal Article |
| Published: |
Elsevier
2015
|
| Online Access: | http://hdl.handle.net/20.500.11937/69866 |
| _version_ | 1848762154165993472 |
|---|---|
| author | Ward, Mary Pond, S. |
| author_facet | Ward, Mary Pond, S. |
| author_sort | Ward, Mary |
| building | Curtin Institutional Repository |
| collection | Online Access |
| description | Internet-based survey data inform knowledge creation in research and justify work activities in organizations. While there are advantages to online surveys, this mode of administration comes with its own set of challenges. Survey respondents may engage in careless responding (i.e. insufficient effort responding or satisficing) by intentionally or unintentionally responding in a manner that does not accurately reflect their true sentiments. Careless responding can create psychometric problems even after correctly removing careless respondents (i.e. mischievous responders). This study aimed to improve survey methodology by preventing careless responding. Using a 3 × 3 between-subjects experimental design, we manipulated both virtual presence (none, animated shape, and virtual human) and type of instructions (anonymous, warning, and feedback). Indicators of careless responding were the dependent variables. Results showed that beyond characteristics of survey items, survey design elements can prevent careless responding. The effects of interventions differed by type of careless responding. Instructions, and the interaction of instructions and virtual presence significantly reduced careless responding, but not virtual presence alone. Virtual human presence increased the salience of instructions. Although currently effective, instructions warning of punitive consequences may create difficulty in recruiting participants. Future research should continue investigating non-aversive ways to prevent careless responding on Internet-based surveys. |
| first_indexed | 2025-11-14T10:43:03Z |
| format | Journal Article |
| id | curtin-20.500.11937-69866 |
| institution | Curtin University Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-14T10:43:03Z |
| publishDate | 2015 |
| publisher | Elsevier |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | curtin-20.500.11937-698662018-10-08T04:48:10Z Using virtual presence and survey instructions to minimize careless responding on Internet-based surveys Ward, Mary Pond, S. Internet-based survey data inform knowledge creation in research and justify work activities in organizations. While there are advantages to online surveys, this mode of administration comes with its own set of challenges. Survey respondents may engage in careless responding (i.e. insufficient effort responding or satisficing) by intentionally or unintentionally responding in a manner that does not accurately reflect their true sentiments. Careless responding can create psychometric problems even after correctly removing careless respondents (i.e. mischievous responders). This study aimed to improve survey methodology by preventing careless responding. Using a 3 × 3 between-subjects experimental design, we manipulated both virtual presence (none, animated shape, and virtual human) and type of instructions (anonymous, warning, and feedback). Indicators of careless responding were the dependent variables. Results showed that beyond characteristics of survey items, survey design elements can prevent careless responding. The effects of interventions differed by type of careless responding. Instructions, and the interaction of instructions and virtual presence significantly reduced careless responding, but not virtual presence alone. Virtual human presence increased the salience of instructions. Although currently effective, instructions warning of punitive consequences may create difficulty in recruiting participants. Future research should continue investigating non-aversive ways to prevent careless responding on Internet-based surveys. 2015 Journal Article http://hdl.handle.net/20.500.11937/69866 10.1016/j.chb.2015.01.070 Elsevier restricted |
| spellingShingle | Ward, Mary Pond, S. Using virtual presence and survey instructions to minimize careless responding on Internet-based surveys |
| title | Using virtual presence and survey instructions to minimize careless responding on Internet-based surveys |
| title_full | Using virtual presence and survey instructions to minimize careless responding on Internet-based surveys |
| title_fullStr | Using virtual presence and survey instructions to minimize careless responding on Internet-based surveys |
| title_full_unstemmed | Using virtual presence and survey instructions to minimize careless responding on Internet-based surveys |
| title_short | Using virtual presence and survey instructions to minimize careless responding on Internet-based surveys |
| title_sort | using virtual presence and survey instructions to minimize careless responding on internet-based surveys |
| url | http://hdl.handle.net/20.500.11937/69866 |