An Illustrative Example of the Benefits of Using a Rasch Analysis in an Experimental Design Investigation
The study compared the consequences of choosing to use either deterministic or probabilistic data analyses in an experimental investigation. The empirical research from which the data for these analyses was drawn applied computer assisted language learning (CALL) as the treatment in a one-group pret...
| Main Authors: | , , |
|---|---|
| Other Authors: | |
| Format: | Conference Paper |
| Published: |
AARE Inc.
2005
|
| Online Access: | http://www.aare.edu.au/data/publications/2005/cav05081.pdf http://hdl.handle.net/20.500.11937/22441 |
| _version_ | 1848750871542759424 |
|---|---|
| author | Cavanagh, Rob Romanoski, Joseph Kent, David |
| author2 | Ruth Jeffery |
| author_facet | Ruth Jeffery Cavanagh, Rob Romanoski, Joseph Kent, David |
| author_sort | Cavanagh, Rob |
| building | Curtin Institutional Repository |
| collection | Online Access |
| description | The study compared the consequences of choosing to use either deterministic or probabilistic data analyses in an experimental investigation. The empirical research from which the data for these analyses was drawn applied computer assisted language learning (CALL) as the treatment in a one-group pretest-posttest design. The empirical investigation concerned the effect of CALL on Korean university students’ ability to correctly identify the meaning of loanwords - native vernacular that originated in nonnative languages and is now part of the native vernacular. The empirical investigation is explained and the design of experimental research and analysis of experimental research data are discussed. Stochastic and deterministic measurement models are then examined followed by the application of these models to analyse data from the empirical investigation. Data analyses included a paired sample t-test, one-way analysis of variance (ANOVA) and a Rasch Unidimensional Measurement Model (RUMM) analysis of differential item functioning (DIF). The analyses and their respective results are assayed in terms of capacity to inform hypothesis confirmation. Parametric tests using non-interval data (raw test scores) were shown to be less sensitive than the RUMM DIF analysis of Rasch Model transformed scores when estimating the differences between the pretest and posttest data. |
| first_indexed | 2025-11-14T07:43:43Z |
| format | Conference Paper |
| id | curtin-20.500.11937-22441 |
| institution | Curtin University Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-14T07:43:43Z |
| publishDate | 2005 |
| publisher | AARE Inc. |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | curtin-20.500.11937-224412022-10-20T04:49:32Z An Illustrative Example of the Benefits of Using a Rasch Analysis in an Experimental Design Investigation Cavanagh, Rob Romanoski, Joseph Kent, David Ruth Jeffery Wendy Shilton Peter Jeffery The study compared the consequences of choosing to use either deterministic or probabilistic data analyses in an experimental investigation. The empirical research from which the data for these analyses was drawn applied computer assisted language learning (CALL) as the treatment in a one-group pretest-posttest design. The empirical investigation concerned the effect of CALL on Korean university students’ ability to correctly identify the meaning of loanwords - native vernacular that originated in nonnative languages and is now part of the native vernacular. The empirical investigation is explained and the design of experimental research and analysis of experimental research data are discussed. Stochastic and deterministic measurement models are then examined followed by the application of these models to analyse data from the empirical investigation. Data analyses included a paired sample t-test, one-way analysis of variance (ANOVA) and a Rasch Unidimensional Measurement Model (RUMM) analysis of differential item functioning (DIF). The analyses and their respective results are assayed in terms of capacity to inform hypothesis confirmation. Parametric tests using non-interval data (raw test scores) were shown to be less sensitive than the RUMM DIF analysis of Rasch Model transformed scores when estimating the differences between the pretest and posttest data. 2005 Conference Paper http://hdl.handle.net/20.500.11937/22441 http://www.aare.edu.au/data/publications/2005/cav05081.pdf AARE Inc. restricted |
| spellingShingle | Cavanagh, Rob Romanoski, Joseph Kent, David An Illustrative Example of the Benefits of Using a Rasch Analysis in an Experimental Design Investigation |
| title | An Illustrative Example of the Benefits of Using a Rasch Analysis in an Experimental Design Investigation |
| title_full | An Illustrative Example of the Benefits of Using a Rasch Analysis in an Experimental Design Investigation |
| title_fullStr | An Illustrative Example of the Benefits of Using a Rasch Analysis in an Experimental Design Investigation |
| title_full_unstemmed | An Illustrative Example of the Benefits of Using a Rasch Analysis in an Experimental Design Investigation |
| title_short | An Illustrative Example of the Benefits of Using a Rasch Analysis in an Experimental Design Investigation |
| title_sort | illustrative example of the benefits of using a rasch analysis in an experimental design investigation |
| url | http://www.aare.edu.au/data/publications/2005/cav05081.pdf http://hdl.handle.net/20.500.11937/22441 |