Factorial validity and invariance of the MUET essay writing rating scale: empirical and theoretical correspondence

Purpose – The validity of any performance assessment depends substantially on the rating scale used in the assessment procedure. It delineates the theoretical construct being measured and influences how performances are judged and interpreted. This study examined the factorial validity and invariance...

Full description

Bibliographic Details
Main Authors: Abu Kassim, Noor Lide, Badrasawi, Kamal J I, Nordin, Mohamad Sahari, Zubairi, Ainol Madziah, Mohd. Asraf, Ratnawati
Format: Article
Language:English
English
English
Published: Universiti Utara Malaysia Press 2018
Subjects:
Online Access:http://irep.iium.edu.my/66228/
http://irep.iium.edu.my/66228/7/66228_Factorial%20validity%20and%20invariance%20of%20the%20muet%20essay_scopus.pdf
http://irep.iium.edu.my/66228/13/66228%20Factorial%20validity%20and%20invariance%20of%20the%20muet%20essay%20writing%20rating%20scale_wos.pdf
http://irep.iium.edu.my/66228/19/66228_Fcatorial%2520Validity%2520and%2520Invariance%2520of%2520MUET%2520Essay%2520Writing%2520Scale_%2520Theoretical%2520and%2520Empirical%2520Correspondence.pdf
_version_ 1848786536712110080
author Abu Kassim, Noor Lide
Badrasawi, Kamal J I
Nordin, Mohamad Sahari
Zubairi, Ainol Madziah
Mohd. Asraf, Ratnawati
author_facet Abu Kassim, Noor Lide
Badrasawi, Kamal J I
Nordin, Mohamad Sahari
Zubairi, Ainol Madziah
Mohd. Asraf, Ratnawati
author_sort Abu Kassim, Noor Lide
building IIUM Repository
collection Online Access
description Purpose – The validity of any performance assessment depends substantially on the rating scale used in the assessment procedure. It delineates the theoretical construct being measured and influences how performances are judged and interpreted. This study examined the factorial validity and invariance of the rating scale used for the assessment of the essay writing component of the Malaysian University English Test (MUET) in terms of the correspondence to empirical data and the theoretical construct of ESL writing. Methodology – To determine the factorial validity of the MUET essay writing rating scale, a measurement model was developed based on the criteria description of the scale. Model-data ft was tested using CFA. The data comprised 392 essays, taken from a university English profciency examination. Factorial invariance was tested through consecutively more restrictive models. Results – A 3-factor structure model was found to produce the best ft to the data. Factorial invariance was tested by examining the comparability of the structure and values of parameters within the model across two groups. A more restrictive model was subsequently tested, where variances and covariances of the latent constructs together with factor loadings were constrained to be equal for the two groups. The resultant goodness-of-ft indices showed a better ft to the data, providing support for the factorial invariance of the 3-factor structure model. Significance – The results support a 3-factor structure model,congruent with the theory of ESL writing. However, further validation needs to be carried out across different ESL populations to ensure accurate representation and assessment of ESL writing performance.
first_indexed 2025-11-14T17:10:36Z
format Article
id iium-66228
institution International Islamic University Malaysia
institution_category Local University
language English
English
English
last_indexed 2025-11-14T17:10:36Z
publishDate 2018
publisher Universiti Utara Malaysia Press
recordtype eprints
repository_type Digital Repository
spelling iium-662282021-07-29T14:35:22Z http://irep.iium.edu.my/66228/ Factorial validity and invariance of the MUET essay writing rating scale: empirical and theoretical correspondence Abu Kassim, Noor Lide Badrasawi, Kamal J I Nordin, Mohamad Sahari Zubairi, Ainol Madziah Mohd. Asraf, Ratnawati H Social Sciences (General) L Education (General) Purpose – The validity of any performance assessment depends substantially on the rating scale used in the assessment procedure. It delineates the theoretical construct being measured and influences how performances are judged and interpreted. This study examined the factorial validity and invariance of the rating scale used for the assessment of the essay writing component of the Malaysian University English Test (MUET) in terms of the correspondence to empirical data and the theoretical construct of ESL writing. Methodology – To determine the factorial validity of the MUET essay writing rating scale, a measurement model was developed based on the criteria description of the scale. Model-data ft was tested using CFA. The data comprised 392 essays, taken from a university English profciency examination. Factorial invariance was tested through consecutively more restrictive models. Results – A 3-factor structure model was found to produce the best ft to the data. Factorial invariance was tested by examining the comparability of the structure and values of parameters within the model across two groups. A more restrictive model was subsequently tested, where variances and covariances of the latent constructs together with factor loadings were constrained to be equal for the two groups. The resultant goodness-of-ft indices showed a better ft to the data, providing support for the factorial invariance of the 3-factor structure model. Significance – The results support a 3-factor structure model,congruent with the theory of ESL writing. However, further validation needs to be carried out across different ESL populations to ensure accurate representation and assessment of ESL writing performance. Universiti Utara Malaysia Press 2018-06-01 Article PeerReviewed application/pdf en http://irep.iium.edu.my/66228/7/66228_Factorial%20validity%20and%20invariance%20of%20the%20muet%20essay_scopus.pdf application/pdf en http://irep.iium.edu.my/66228/13/66228%20Factorial%20validity%20and%20invariance%20of%20the%20muet%20essay%20writing%20rating%20scale_wos.pdf application/pdf en http://irep.iium.edu.my/66228/19/66228_Fcatorial%2520Validity%2520and%2520Invariance%2520of%2520MUET%2520Essay%2520Writing%2520Scale_%2520Theoretical%2520and%2520Empirical%2520Correspondence.pdf Abu Kassim, Noor Lide and Badrasawi, Kamal J I and Nordin, Mohamad Sahari and Zubairi, Ainol Madziah and Mohd. Asraf, Ratnawati (2018) Factorial validity and invariance of the MUET essay writing rating scale: empirical and theoretical correspondence. Malaysian Journal of Learning and Instruction, 15 (1). pp. 267-287. ISSN 1675-8110 E-ISSN 2180-2483 http://mjli.uum.edu.my/index.php/current-issues
spellingShingle H Social Sciences (General)
L Education (General)
Abu Kassim, Noor Lide
Badrasawi, Kamal J I
Nordin, Mohamad Sahari
Zubairi, Ainol Madziah
Mohd. Asraf, Ratnawati
Factorial validity and invariance of the MUET essay writing rating scale: empirical and theoretical correspondence
title Factorial validity and invariance of the MUET essay writing rating scale: empirical and theoretical correspondence
title_full Factorial validity and invariance of the MUET essay writing rating scale: empirical and theoretical correspondence
title_fullStr Factorial validity and invariance of the MUET essay writing rating scale: empirical and theoretical correspondence
title_full_unstemmed Factorial validity and invariance of the MUET essay writing rating scale: empirical and theoretical correspondence
title_short Factorial validity and invariance of the MUET essay writing rating scale: empirical and theoretical correspondence
title_sort factorial validity and invariance of the muet essay writing rating scale: empirical and theoretical correspondence
topic H Social Sciences (General)
L Education (General)
url http://irep.iium.edu.my/66228/
http://irep.iium.edu.my/66228/
http://irep.iium.edu.my/66228/7/66228_Factorial%20validity%20and%20invariance%20of%20the%20muet%20essay_scopus.pdf
http://irep.iium.edu.my/66228/13/66228%20Factorial%20validity%20and%20invariance%20of%20the%20muet%20essay%20writing%20rating%20scale_wos.pdf
http://irep.iium.edu.my/66228/19/66228_Fcatorial%2520Validity%2520and%2520Invariance%2520of%2520MUET%2520Essay%2520Writing%2520Scale_%2520Theoretical%2520and%2520Empirical%2520Correspondence.pdf