A rubric based approach towards Automated Essay Grading : focusing on high level content issues and ideas
Assessment of a student’s work is by no means an easy task. Even if the student response is in the form of multiple choice answers, manually marking those answer sheets is a task that most teachers regard as rather tedious. The development of an automated method to grade these essays was thus an ine...
| Main Author: | |
|---|---|
| Format: | Thesis |
| Language: | English |
| Published: |
Curtin University
2012
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/20.500.11937/38 |
| _version_ | 1848743266310160384 |
|---|---|
| author | Lam, Sean Hon Wai |
| author_facet | Lam, Sean Hon Wai |
| author_sort | Lam, Sean Hon Wai |
| building | Curtin Institutional Repository |
| collection | Online Access |
| description | Assessment of a student’s work is by no means an easy task. Even if the student response is in the form of multiple choice answers, manually marking those answer sheets is a task that most teachers regard as rather tedious. The development of an automated method to grade these essays was thus an inevitable step.This thesis proposes a novel approach towards Automated Essay Grading through the use of various concepts found within the field of Narratology. Through a review of the literature, several methods in which essays are graded were identified together with some of the problems. Mainly, the issues and challenges that plague AEG systems were that those following the statistical approach needed a way to deal with more implicit features of free text, while other systems which did manage that were highly dependent on the type of student response, the systems having pre-knowledge pertaining to the subject domain in addition to requiring more computational power. It was also found that while narrative essays are one of the main methods in which a student might be able to showcase his/her mastery over the English language, no system thus far has attempted to incorporate narrative concepts into analysing these type of free text responses.It was decided that the proposed solution would be centred on the detection of Events, which was in turn used to determine the score an essay receives under the criteria of Audience, Ideas, Character and Setting and Cohesion, as defined by the NAPLAN rubric. From the results gathered from experiments conducted on the four criteria mentioned above, it was concluded that the concept of detecting Events as they were within a narrative type story when applied to essay grading, does have a relation towards the score the essay receives. All experiments achieved an average F-measure score of 0.65 and above while exact agreement rates were no lower than 70%. Chi-squared and paired T-test values all indicated that there was insufficient evidence to show that there was any significant difference between the scores generated by the computer and those of the human markers. |
| first_indexed | 2025-11-14T05:42:50Z |
| format | Thesis |
| id | curtin-20.500.11937-38 |
| institution | Curtin University Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-14T05:42:50Z |
| publishDate | 2012 |
| publisher | Curtin University |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | curtin-20.500.11937-382017-02-20T06:42:17Z A rubric based approach towards Automated Essay Grading : focusing on high level content issues and ideas Lam, Sean Hon Wai rubric based approach high level content issues and ideas Automated Essay Grading paired T-test values chi-squared Assessment of a student’s work is by no means an easy task. Even if the student response is in the form of multiple choice answers, manually marking those answer sheets is a task that most teachers regard as rather tedious. The development of an automated method to grade these essays was thus an inevitable step.This thesis proposes a novel approach towards Automated Essay Grading through the use of various concepts found within the field of Narratology. Through a review of the literature, several methods in which essays are graded were identified together with some of the problems. Mainly, the issues and challenges that plague AEG systems were that those following the statistical approach needed a way to deal with more implicit features of free text, while other systems which did manage that were highly dependent on the type of student response, the systems having pre-knowledge pertaining to the subject domain in addition to requiring more computational power. It was also found that while narrative essays are one of the main methods in which a student might be able to showcase his/her mastery over the English language, no system thus far has attempted to incorporate narrative concepts into analysing these type of free text responses.It was decided that the proposed solution would be centred on the detection of Events, which was in turn used to determine the score an essay receives under the criteria of Audience, Ideas, Character and Setting and Cohesion, as defined by the NAPLAN rubric. From the results gathered from experiments conducted on the four criteria mentioned above, it was concluded that the concept of detecting Events as they were within a narrative type story when applied to essay grading, does have a relation towards the score the essay receives. All experiments achieved an average F-measure score of 0.65 and above while exact agreement rates were no lower than 70%. Chi-squared and paired T-test values all indicated that there was insufficient evidence to show that there was any significant difference between the scores generated by the computer and those of the human markers. 2012 Thesis http://hdl.handle.net/20.500.11937/38 en Curtin University fulltext |
| spellingShingle | rubric based approach high level content issues and ideas Automated Essay Grading paired T-test values chi-squared Lam, Sean Hon Wai A rubric based approach towards Automated Essay Grading : focusing on high level content issues and ideas |
| title | A rubric based approach towards Automated Essay Grading : focusing on high level content issues and ideas |
| title_full | A rubric based approach towards Automated Essay Grading : focusing on high level content issues and ideas |
| title_fullStr | A rubric based approach towards Automated Essay Grading : focusing on high level content issues and ideas |
| title_full_unstemmed | A rubric based approach towards Automated Essay Grading : focusing on high level content issues and ideas |
| title_short | A rubric based approach towards Automated Essay Grading : focusing on high level content issues and ideas |
| title_sort | rubric based approach towards automated essay grading : focusing on high level content issues and ideas |
| topic | rubric based approach high level content issues and ideas Automated Essay Grading paired T-test values chi-squared |
| url | http://hdl.handle.net/20.500.11937/38 |