Validation study of a method for assessing complex ill-structured problem solving by using causal representations
The important but little understood problem that motivated this study was the lack of research on valid assessment methods to determine progress in higher-order learning in situations involving complex and ill-structured problems. Without a valid assessment method, little progress can occur in instr...
| Main Authors: | , , |
|---|---|
| Format: | Journal Article |
| Published: |
Springer
2013
|
| Online Access: | http://hdl.handle.net/20.500.11937/18859 |
| _version_ | 1848749867640291328 |
|---|---|
| author | Eseryel, D. Ifenthaler, Dirk Ge, X. |
| author_facet | Eseryel, D. Ifenthaler, Dirk Ge, X. |
| author_sort | Eseryel, D. |
| building | Curtin Institutional Repository |
| collection | Online Access |
| description | The important but little understood problem that motivated this study was the lack of research on valid assessment methods to determine progress in higher-order learning in situations involving complex and ill-structured problems. Without a valid assessment method, little progress can occur in instructional design research with regard to designing effective learning environments to facilitate acquisition of expertise in complex, ill-structured knowledge domains. In this paper, we first present a method based on causal representations for assessing progress of learning in complex, ill-structured problem solving and discuss its theoretical framework. Then, we present an experimental study investigating its validity against adapted protocol analysis. This study explored the impact of a massively multiplayer online educational game, which was designed to support an interdisciplinary STEM education on ninth-grade students' complex, ill-structured problem solving skill acquisition. We identify conceptual similarities and differences between the two methods, present our comparative study and its results, and then discuss implications for diagnostics and applications. We conclude by determining how the two approaches could be used in conjunction for further research on complex and ill-structured problem solving. |
| first_indexed | 2025-11-14T07:27:46Z |
| format | Journal Article |
| id | curtin-20.500.11937-18859 |
| institution | Curtin University Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-14T07:27:46Z |
| publishDate | 2013 |
| publisher | Springer |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | curtin-20.500.11937-188592017-09-13T13:46:03Z Validation study of a method for assessing complex ill-structured problem solving by using causal representations Eseryel, D. Ifenthaler, Dirk Ge, X. The important but little understood problem that motivated this study was the lack of research on valid assessment methods to determine progress in higher-order learning in situations involving complex and ill-structured problems. Without a valid assessment method, little progress can occur in instructional design research with regard to designing effective learning environments to facilitate acquisition of expertise in complex, ill-structured knowledge domains. In this paper, we first present a method based on causal representations for assessing progress of learning in complex, ill-structured problem solving and discuss its theoretical framework. Then, we present an experimental study investigating its validity against adapted protocol analysis. This study explored the impact of a massively multiplayer online educational game, which was designed to support an interdisciplinary STEM education on ninth-grade students' complex, ill-structured problem solving skill acquisition. We identify conceptual similarities and differences between the two methods, present our comparative study and its results, and then discuss implications for diagnostics and applications. We conclude by determining how the two approaches could be used in conjunction for further research on complex and ill-structured problem solving. 2013 Journal Article http://hdl.handle.net/20.500.11937/18859 10.1007/s11423-013-9297-2 Springer restricted |
| spellingShingle | Eseryel, D. Ifenthaler, Dirk Ge, X. Validation study of a method for assessing complex ill-structured problem solving by using causal representations |
| title | Validation study of a method for assessing complex ill-structured problem solving by using causal representations |
| title_full | Validation study of a method for assessing complex ill-structured problem solving by using causal representations |
| title_fullStr | Validation study of a method for assessing complex ill-structured problem solving by using causal representations |
| title_full_unstemmed | Validation study of a method for assessing complex ill-structured problem solving by using causal representations |
| title_short | Validation study of a method for assessing complex ill-structured problem solving by using causal representations |
| title_sort | validation study of a method for assessing complex ill-structured problem solving by using causal representations |
| url | http://hdl.handle.net/20.500.11937/18859 |