A tool for addressing construct identity in literature reviews and meta-analyses
The problem of detecting whether two behavioral constructs reference the same real-world phenomenon has existed for over 100 years. Discordant naming of constructs is here termed the construct identity fallacy (CIF). We designed and evaluated the construct identity detector (CID), the first tool wit...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
University of Minnesota
2016
|
| Subjects: | |
| Online Access: | http://ir.unimas.my/id/eprint/14236/ http://ir.unimas.my/id/eprint/14236/2/A%20tool%20for%20addressing%20-%20Copy.pdf |
| _version_ | 1848837601245528064 |
|---|---|
| author | Larsen, Kai Rune T. Bong, Chih How |
| author_facet | Larsen, Kai Rune T. Bong, Chih How |
| author_sort | Larsen, Kai Rune T. |
| building | UNIMAS Institutional Repository |
| collection | Online Access |
| description | The problem of detecting whether two behavioral constructs reference the same real-world phenomenon has existed for over 100 years. Discordant naming of constructs is here termed the construct identity fallacy (CIF). We designed and evaluated the construct identity detector (CID), the first tool with large-scale construct identity detection properties and the first tool that does not require respondent data. Through the adaptation and combination of different natural language processing (NLP) algorithms, six designs were created and evaluated against human expert decisions. All six designs were found capable of detecting construct identity, and a design combining two existing algorithms significantly outperformed the other approaches. A set of follow-up studies suggests the tool is valuable as a supplement to expert efforts in literature review and metaanalysis. Beyond design science contributions, this article has important implications related to the taxonomic structure of social and behavioral science constructs, for the jingle and jangle fallacy, the core of the Information Systems nomological network, and the inaccessibility of social and behavioral science knowledge. In sum, CID represents an important, albeit tentative, step toward discipline-wide identification of construct identities |
| first_indexed | 2025-11-15T06:42:15Z |
| format | Article |
| id | unimas-14236 |
| institution | Universiti Malaysia Sarawak |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T06:42:15Z |
| publishDate | 2016 |
| publisher | University of Minnesota |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | unimas-142362022-05-26T03:14:27Z http://ir.unimas.my/id/eprint/14236/ A tool for addressing construct identity in literature reviews and meta-analyses Larsen, Kai Rune T. Bong, Chih How QA75 Electronic computers. Computer science The problem of detecting whether two behavioral constructs reference the same real-world phenomenon has existed for over 100 years. Discordant naming of constructs is here termed the construct identity fallacy (CIF). We designed and evaluated the construct identity detector (CID), the first tool with large-scale construct identity detection properties and the first tool that does not require respondent data. Through the adaptation and combination of different natural language processing (NLP) algorithms, six designs were created and evaluated against human expert decisions. All six designs were found capable of detecting construct identity, and a design combining two existing algorithms significantly outperformed the other approaches. A set of follow-up studies suggests the tool is valuable as a supplement to expert efforts in literature review and metaanalysis. Beyond design science contributions, this article has important implications related to the taxonomic structure of social and behavioral science constructs, for the jingle and jangle fallacy, the core of the Information Systems nomological network, and the inaccessibility of social and behavioral science knowledge. In sum, CID represents an important, albeit tentative, step toward discipline-wide identification of construct identities University of Minnesota 2016-09 Article PeerReviewed text en http://ir.unimas.my/id/eprint/14236/2/A%20tool%20for%20addressing%20-%20Copy.pdf Larsen, Kai Rune T. and Bong, Chih How (2016) A tool for addressing construct identity in literature reviews and meta-analyses. MIS Quarterly: Management Information Systems, 40 (3). pp. 529-551. ISSN 0276-7783 https://www.scopus.com/inward/record.uri?eid=2-s2.0-84990878570&partnerID=40&md5=addd492026ee3807b6193d5081e4af98 |
| spellingShingle | QA75 Electronic computers. Computer science Larsen, Kai Rune T. Bong, Chih How A tool for addressing construct identity in literature reviews and meta-analyses |
| title | A tool for addressing construct identity in literature reviews and meta-analyses |
| title_full | A tool for addressing construct identity in literature reviews and meta-analyses |
| title_fullStr | A tool for addressing construct identity in literature reviews and meta-analyses |
| title_full_unstemmed | A tool for addressing construct identity in literature reviews and meta-analyses |
| title_short | A tool for addressing construct identity in literature reviews and meta-analyses |
| title_sort | tool for addressing construct identity in literature reviews and meta-analyses |
| topic | QA75 Electronic computers. Computer science |
| url | http://ir.unimas.my/id/eprint/14236/ http://ir.unimas.my/id/eprint/14236/ http://ir.unimas.my/id/eprint/14236/2/A%20tool%20for%20addressing%20-%20Copy.pdf |