Data science in educational assessment
This article is the second of two articles in this special issue that were developed following discussions of the Assessment Working Group at EDUsummIT 2013. The article extends the analysis of assessments of collaborative problem solving (CPS) to examine the significance of the data concerning this...
| Main Authors: | , |
|---|---|
| Format: | Journal Article |
| Published: |
Springer New York LLC
2015
|
| Online Access: | http://hdl.handle.net/20.500.11937/18385 |
| _version_ | 1848749730011545600 |
|---|---|
| author | Gibson, David Webb, M. |
| author_facet | Gibson, David Webb, M. |
| author_sort | Gibson, David |
| building | Curtin Institutional Repository |
| collection | Online Access |
| description | This article is the second of two articles in this special issue that were developed following discussions of the Assessment Working Group at EDUsummIT 2013. The article extends the analysis of assessments of collaborative problem solving (CPS) to examine the significance of the data concerning this complex assessment problem and then for educational assessment more broadly. The article discusses four measurement challenges of data science or ‘big data’ in educational assessments that are enabled by technology: 1. Dealing with change over time via time-based data. 2. How a digital performance space’s relationships interact with learner actions, communications and products. 3. How layers of interpretation are formed from translations of atomistic data into meaningful larger units suitable for making inferences about what someone knows and can do. 4. How to represent the dynamics of interactions between and among learners who are being assessed by their interactions with each other as well as with digital resources and agents in digital performance spaces. Because of the movement from paper-based tests to online learning, and in order to make progress on these challenges, the authors call for the restructuring of training of the next generation of researchers and psychometricians to specialize in data science in technology enabled assessments. |
| first_indexed | 2025-11-14T07:25:34Z |
| format | Journal Article |
| id | curtin-20.500.11937-18385 |
| institution | Curtin University Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-14T07:25:34Z |
| publishDate | 2015 |
| publisher | Springer New York LLC |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | curtin-20.500.11937-183852017-09-13T13:43:07Z Data science in educational assessment Gibson, David Webb, M. This article is the second of two articles in this special issue that were developed following discussions of the Assessment Working Group at EDUsummIT 2013. The article extends the analysis of assessments of collaborative problem solving (CPS) to examine the significance of the data concerning this complex assessment problem and then for educational assessment more broadly. The article discusses four measurement challenges of data science or ‘big data’ in educational assessments that are enabled by technology: 1. Dealing with change over time via time-based data. 2. How a digital performance space’s relationships interact with learner actions, communications and products. 3. How layers of interpretation are formed from translations of atomistic data into meaningful larger units suitable for making inferences about what someone knows and can do. 4. How to represent the dynamics of interactions between and among learners who are being assessed by their interactions with each other as well as with digital resources and agents in digital performance spaces. Because of the movement from paper-based tests to online learning, and in order to make progress on these challenges, the authors call for the restructuring of training of the next generation of researchers and psychometricians to specialize in data science in technology enabled assessments. 2015 Journal Article http://hdl.handle.net/20.500.11937/18385 10.1007/s10639-015-9411-7 Springer New York LLC restricted |
| spellingShingle | Gibson, David Webb, M. Data science in educational assessment |
| title | Data science in educational assessment |
| title_full | Data science in educational assessment |
| title_fullStr | Data science in educational assessment |
| title_full_unstemmed | Data science in educational assessment |
| title_short | Data science in educational assessment |
| title_sort | data science in educational assessment |
| url | http://hdl.handle.net/20.500.11937/18385 |