Investigating the feasibility of using digital representations of work for performance assessment in engineering

This paper reports on the results of a 3-year study conducted at the Centre for Schooling and Learning Technologies (CSaLT) at Edith Cowan University in collaboration with the Curriculum Council of Western Australia which concerns the potential to use digital technologies to represent the output fro...

Full description

Bibliographic Details
Main Author: Williams, John
Format: Journal Article
Published: Kluwer Academic Publishers 2012
Online Access:http://hdl.handle.net/20.500.11937/35733
_version_ 1848754575584002048
author Williams, John
author_facet Williams, John
author_sort Williams, John
building Curtin Institutional Repository
collection Online Access
description This paper reports on the results of a 3-year study conducted at the Centre for Schooling and Learning Technologies (CSaLT) at Edith Cowan University in collaboration with the Curriculum Council of Western Australia which concerns the potential to use digital technologies to represent the output from assessment tasks in the senior secondary course, Engineering Studies. The general aim of this study is to explore the potential of various digitally-based forms for external assessment for senior secondary courses in terms of manageability, cost, validity and reliability. The problem being addressed was the need to provide students with assessment opportunities in new courses, that are on one hand authentic, where many outcomes do not lend themselves to being assessed using pen and paper over a three hour period, while on the other hand being able to be reliably and manageably assessed by external examiners. That is, the external assessment for a course needs to accurately and reliably assess the outcomes without a huge increase in the cost of assessment. A computer managed examination was designed that consisted of a design task that was broken down into a number of timed activities. Students were paced through each activity, recording their input in the form of a portfolio. Input consisted of text, graphics through a camera, video and voice. The exam outputs were uploaded to a online repository. The students' work was marked by external assessors using a standards based rubric that allowed the students work to be ranked though Rasch Modelling.
first_indexed 2025-11-14T08:42:36Z
format Journal Article
id curtin-20.500.11937-35733
institution Curtin University Malaysia
institution_category Local University
last_indexed 2025-11-14T08:42:36Z
publishDate 2012
publisher Kluwer Academic Publishers
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-357332019-02-19T05:36:13Z Investigating the feasibility of using digital representations of work for performance assessment in engineering Williams, John This paper reports on the results of a 3-year study conducted at the Centre for Schooling and Learning Technologies (CSaLT) at Edith Cowan University in collaboration with the Curriculum Council of Western Australia which concerns the potential to use digital technologies to represent the output from assessment tasks in the senior secondary course, Engineering Studies. The general aim of this study is to explore the potential of various digitally-based forms for external assessment for senior secondary courses in terms of manageability, cost, validity and reliability. The problem being addressed was the need to provide students with assessment opportunities in new courses, that are on one hand authentic, where many outcomes do not lend themselves to being assessed using pen and paper over a three hour period, while on the other hand being able to be reliably and manageably assessed by external examiners. That is, the external assessment for a course needs to accurately and reliably assess the outcomes without a huge increase in the cost of assessment. A computer managed examination was designed that consisted of a design task that was broken down into a number of timed activities. Students were paced through each activity, recording their input in the form of a portfolio. Input consisted of text, graphics through a camera, video and voice. The exam outputs were uploaded to a online repository. The students' work was marked by external assessors using a standards based rubric that allowed the students work to be ranked though Rasch Modelling. 2012 Journal Article http://hdl.handle.net/20.500.11937/35733 10.1007/s10798-011-9192-2 Kluwer Academic Publishers fulltext
spellingShingle Williams, John
Investigating the feasibility of using digital representations of work for performance assessment in engineering
title Investigating the feasibility of using digital representations of work for performance assessment in engineering
title_full Investigating the feasibility of using digital representations of work for performance assessment in engineering
title_fullStr Investigating the feasibility of using digital representations of work for performance assessment in engineering
title_full_unstemmed Investigating the feasibility of using digital representations of work for performance assessment in engineering
title_short Investigating the feasibility of using digital representations of work for performance assessment in engineering
title_sort investigating the feasibility of using digital representations of work for performance assessment in engineering
url http://hdl.handle.net/20.500.11937/35733