From Item Analysis to Assessment Analysis: Introducing New Formulae
Item analysis of individual multiple choice questions have been widely used for several decades. But formulae for analysis of manually-marked assessments are lacking. Evaluation and comparison of such assessments used in medical schools remain a guess work. In this study we have introduced new for...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
AMEE MedEdPublish
2017
|
| Subjects: | |
| Online Access: | http://ir.unimas.my/id/eprint/16234/ http://ir.unimas.my/id/eprint/16234/1/From%20Item%20Analysis%20to%20Assessment%20Analysis%20%28abstract%29.pdf |
| _version_ | 1848838014367694848 |
|---|---|
| author | Puthiaparampil, Thomas Rahman, M.R. Fong, Isabel Lim |
| author_facet | Puthiaparampil, Thomas Rahman, M.R. Fong, Isabel Lim |
| author_sort | Puthiaparampil, Thomas |
| building | UNIMAS Institutional Repository |
| collection | Online Access |
| description | Item analysis of individual multiple choice questions have been widely used for several decades. But formulae
for analysis of manually-marked assessments are lacking. Evaluation and comparison of such assessments used
in medical schools remain a guess work. In this study we have introduced new formulae aligned with item
analysis formulae, which can be used to analyse all assessment methods. While the existing formulae use a
binary (pass/fail) criterion, the new formulae have used actual scores. While the existing formulae use the
scores of a single assessment to rank the candidates to determine the high and low scorers for calculating the
discrimination index (DISi), the new formula used the grand total scores of the entire examination for it. It is
claimed that the new formulae, utilizing actual scores, would make the indexes more realistic. Eight
examinations, each comprising nine assessments, were used to validate this claim. The DISi and Difficulty
Index (DIFi) were calculated using the binary formulae and the new formulae. Comparisons were made using
parametric and non-parametric tests. The ensued positive correlation of indexes indicated that the new formulae
are feasible, realistic and easy to apply. More replicates are required to prove their validity and reliability. |
| first_indexed | 2025-11-15T06:48:49Z |
| format | Article |
| id | unimas-16234 |
| institution | Universiti Malaysia Sarawak |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T06:48:49Z |
| publishDate | 2017 |
| publisher | AMEE MedEdPublish |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | unimas-162342017-05-15T07:13:53Z http://ir.unimas.my/id/eprint/16234/ From Item Analysis to Assessment Analysis: Introducing New Formulae Puthiaparampil, Thomas Rahman, M.R. Fong, Isabel Lim L Education (General) Item analysis of individual multiple choice questions have been widely used for several decades. But formulae for analysis of manually-marked assessments are lacking. Evaluation and comparison of such assessments used in medical schools remain a guess work. In this study we have introduced new formulae aligned with item analysis formulae, which can be used to analyse all assessment methods. While the existing formulae use a binary (pass/fail) criterion, the new formulae have used actual scores. While the existing formulae use the scores of a single assessment to rank the candidates to determine the high and low scorers for calculating the discrimination index (DISi), the new formula used the grand total scores of the entire examination for it. It is claimed that the new formulae, utilizing actual scores, would make the indexes more realistic. Eight examinations, each comprising nine assessments, were used to validate this claim. The DISi and Difficulty Index (DIFi) were calculated using the binary formulae and the new formulae. Comparisons were made using parametric and non-parametric tests. The ensued positive correlation of indexes indicated that the new formulae are feasible, realistic and easy to apply. More replicates are required to prove their validity and reliability. AMEE MedEdPublish 2017 Article PeerReviewed text en http://ir.unimas.my/id/eprint/16234/1/From%20Item%20Analysis%20to%20Assessment%20Analysis%20%28abstract%29.pdf Puthiaparampil, Thomas and Rahman, M.R. and Fong, Isabel Lim (2017) From Item Analysis to Assessment Analysis: Introducing New Formulae. MedEdPublish. ISSN 2312–7996 https://www.mededpublish.org/manuscripts/760/v1 DOI: https://doi.org/10.15694/mep.2017.000007 |
| spellingShingle | L Education (General) Puthiaparampil, Thomas Rahman, M.R. Fong, Isabel Lim From Item Analysis to Assessment Analysis: Introducing New Formulae |
| title | From Item Analysis to Assessment Analysis: Introducing New Formulae |
| title_full | From Item Analysis to Assessment Analysis: Introducing New Formulae |
| title_fullStr | From Item Analysis to Assessment Analysis: Introducing New Formulae |
| title_full_unstemmed | From Item Analysis to Assessment Analysis: Introducing New Formulae |
| title_short | From Item Analysis to Assessment Analysis: Introducing New Formulae |
| title_sort | from item analysis to assessment analysis: introducing new formulae |
| topic | L Education (General) |
| url | http://ir.unimas.my/id/eprint/16234/ http://ir.unimas.my/id/eprint/16234/ http://ir.unimas.my/id/eprint/16234/ http://ir.unimas.my/id/eprint/16234/1/From%20Item%20Analysis%20to%20Assessment%20Analysis%20%28abstract%29.pdf |