Automated essay grading systems applied to a first year university subject: how can we do it better?

Automated marking of assignments consisting of written text would doubtless be of advantage to teachers and education administrators alike. When large numbers of assignments are submitted at once, teachers find themselves bogged down in their attempt to provide consistent evaluations and high qualit...

Full description

Bibliographic Details
Main Authors: Palmer, John, Williams, Robert, Dreher, Heinz
Format: Conference Paper
Published: Informing Science Institute 2002
Subjects:
Online Access:http://proceedings.informingscience.org/IS2002Proceedings/papers/Palme026Autom.pdf
http://hdl.handle.net/20.500.11937/46166
_version_ 1848757483654348800
author Palmer, John
Williams, Robert
Dreher, Heinz
author_facet Palmer, John
Williams, Robert
Dreher, Heinz
author_sort Palmer, John
building Curtin Institutional Repository
collection Online Access
description Automated marking of assignments consisting of written text would doubtless be of advantage to teachers and education administrators alike. When large numbers of assignments are submitted at once, teachers find themselves bogged down in their attempt to provide consistent evaluations and high quality feedback to students within as short a timeframe as is reasonable, usually a matter of days rather than weeks. Educationaladministrators are also concerned with quality and timely feedback, but in addition must manage the cost of doing this work. Clearly an automated system would be a highly desirable addition to the educational tool-kit, particularly if it can provide less costly and more effective outcome.In this paper we present a description and evaluation of four automated essay grading systems. We then report on our trial of one of these systems which was undertaken at Curtin University of Technology in the first half of 2001. The purpose of the trial was to assess whether automated essay grading was feasible, economically viable and as accurate as manually grading the essays. Within the Curtin Business School we have not previously used automated grading systems but the benefit could be enormous giventhe very large numbers of students in some first year subjects.As we evaluate the results of our trial, a research and development direction is indicated which we believe will result in improvement over existing systems.
first_indexed 2025-11-14T09:28:49Z
format Conference Paper
id curtin-20.500.11937-46166
institution Curtin University Malaysia
institution_category Local University
last_indexed 2025-11-14T09:28:49Z
publishDate 2002
publisher Informing Science Institute
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-461662017-01-30T15:25:33Z Automated essay grading systems applied to a first year university subject: how can we do it better? Palmer, John Williams, Robert Dreher, Heinz assignment grading automatic essay marking plagiarism assessment Automated marking of assignments consisting of written text would doubtless be of advantage to teachers and education administrators alike. When large numbers of assignments are submitted at once, teachers find themselves bogged down in their attempt to provide consistent evaluations and high quality feedback to students within as short a timeframe as is reasonable, usually a matter of days rather than weeks. Educationaladministrators are also concerned with quality and timely feedback, but in addition must manage the cost of doing this work. Clearly an automated system would be a highly desirable addition to the educational tool-kit, particularly if it can provide less costly and more effective outcome.In this paper we present a description and evaluation of four automated essay grading systems. We then report on our trial of one of these systems which was undertaken at Curtin University of Technology in the first half of 2001. The purpose of the trial was to assess whether automated essay grading was feasible, economically viable and as accurate as manually grading the essays. Within the Curtin Business School we have not previously used automated grading systems but the benefit could be enormous giventhe very large numbers of students in some first year subjects.As we evaluate the results of our trial, a research and development direction is indicated which we believe will result in improvement over existing systems. 2002 Conference Paper http://hdl.handle.net/20.500.11937/46166 http://proceedings.informingscience.org/IS2002Proceedings/papers/Palme026Autom.pdf Informing Science Institute fulltext
spellingShingle assignment
grading
automatic
essay
marking
plagiarism
assessment
Palmer, John
Williams, Robert
Dreher, Heinz
Automated essay grading systems applied to a first year university subject: how can we do it better?
title Automated essay grading systems applied to a first year university subject: how can we do it better?
title_full Automated essay grading systems applied to a first year university subject: how can we do it better?
title_fullStr Automated essay grading systems applied to a first year university subject: how can we do it better?
title_full_unstemmed Automated essay grading systems applied to a first year university subject: how can we do it better?
title_short Automated essay grading systems applied to a first year university subject: how can we do it better?
title_sort automated essay grading systems applied to a first year university subject: how can we do it better?
topic assignment
grading
automatic
essay
marking
plagiarism
assessment
url http://proceedings.informingscience.org/IS2002Proceedings/papers/Palme026Autom.pdf
http://hdl.handle.net/20.500.11937/46166