Responding to the Severe Limitations of Cross-Sectional Surveys: Commenting on Rong and Wilkinson's Perspectives

While a meta-analysis is necessary to test the claim that the logic dominates the majority of studies, most studies by academic scholars on thinking and actions by executives appear to rely on cross-sectional surveys that use self-reports by executives via scaled (e.g., strongly disagree to strongly...

Full description

Bibliographic Details
Main Author: Woodside, Arch
Format: Journal Article
Published: Elsevier 2011
Subjects:
Online Access:http://hdl.handle.net/20.500.11937/26034
_version_ 1848751871385141248
author Woodside, Arch
author_facet Woodside, Arch
author_sort Woodside, Arch
building Curtin Institutional Repository
collection Online Access
description While a meta-analysis is necessary to test the claim that the logic dominates the majority of studies, most studies by academic scholars on thinking and actions by executives appear to rely on cross-sectional surveys that use self-reports by executives via scaled (e.g., strongly disagree to strongly agree) instruments whereby one executive per firm completes the instrument and data are collected for 50–500 firms. Useable response rates in these studies are almost always below 30% of the distributions of the surveys. While these studies are sometimes worthwhile for learning how respondents assess concepts and relationships among concepts, Rong and Wilkinson’s perspective on the severe limits to the value of such studies rings true: such surveys reveal more about executives’ sensemaking processes than the actual processes. The limitations of using one-shot, one-person-per-firm, self-reports as valid indicators of causal relationships of actual processes are so severe that academics should do more than think twice before using such surveys as the main method for collecting data – if scholars seek to understand and describe actual processes additional methods are necessary for data collection. The relevant literature includes several gems of exceptionally high quality, validity, and usefulness in the study of actual processes; identifying these studies is a useful step toward reducing the reliance on one-shot self-report surveys.
first_indexed 2025-11-14T07:59:37Z
format Journal Article
id curtin-20.500.11937-26034
institution Curtin University Malaysia
institution_category Local University
last_indexed 2025-11-14T07:59:37Z
publishDate 2011
publisher Elsevier
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-260342017-09-13T15:23:05Z Responding to the Severe Limitations of Cross-Sectional Surveys: Commenting on Rong and Wilkinson's Perspectives Woodside, Arch Executives fs/QCA.com Folk theory-of-mind Thinking Sensemaking Direct research Surveys While a meta-analysis is necessary to test the claim that the logic dominates the majority of studies, most studies by academic scholars on thinking and actions by executives appear to rely on cross-sectional surveys that use self-reports by executives via scaled (e.g., strongly disagree to strongly agree) instruments whereby one executive per firm completes the instrument and data are collected for 50–500 firms. Useable response rates in these studies are almost always below 30% of the distributions of the surveys. While these studies are sometimes worthwhile for learning how respondents assess concepts and relationships among concepts, Rong and Wilkinson’s perspective on the severe limits to the value of such studies rings true: such surveys reveal more about executives’ sensemaking processes than the actual processes. The limitations of using one-shot, one-person-per-firm, self-reports as valid indicators of causal relationships of actual processes are so severe that academics should do more than think twice before using such surveys as the main method for collecting data – if scholars seek to understand and describe actual processes additional methods are necessary for data collection. The relevant literature includes several gems of exceptionally high quality, validity, and usefulness in the study of actual processes; identifying these studies is a useful step toward reducing the reliance on one-shot self-report surveys. 2011 Journal Article http://hdl.handle.net/20.500.11937/26034 10.1016/j.ausmj.2011.04.004 Elsevier restricted
spellingShingle Executives
fs/QCA.com
Folk theory-of-mind
Thinking
Sensemaking
Direct research
Surveys
Woodside, Arch
Responding to the Severe Limitations of Cross-Sectional Surveys: Commenting on Rong and Wilkinson's Perspectives
title Responding to the Severe Limitations of Cross-Sectional Surveys: Commenting on Rong and Wilkinson's Perspectives
title_full Responding to the Severe Limitations of Cross-Sectional Surveys: Commenting on Rong and Wilkinson's Perspectives
title_fullStr Responding to the Severe Limitations of Cross-Sectional Surveys: Commenting on Rong and Wilkinson's Perspectives
title_full_unstemmed Responding to the Severe Limitations of Cross-Sectional Surveys: Commenting on Rong and Wilkinson's Perspectives
title_short Responding to the Severe Limitations of Cross-Sectional Surveys: Commenting on Rong and Wilkinson's Perspectives
title_sort responding to the severe limitations of cross-sectional surveys: commenting on rong and wilkinson's perspectives
topic Executives
fs/QCA.com
Folk theory-of-mind
Thinking
Sensemaking
Direct research
Surveys
url http://hdl.handle.net/20.500.11937/26034