Toward Automated Computer-Based Visualization and Assessment of Team-Based Performance
A considerable amount of research has been undertaken to provide insights into the valid assessment of team performance. However, in many settings, manual and therefore labor-intensive assessment instruments for team performance have limitations. Therefore, automated assessment instruments enable mo...
| Main Author: | |
|---|---|
| Format: | Journal Article |
| Published: |
American Psychological Association
2014
|
| Online Access: | http://hdl.handle.net/20.500.11937/36484 |
| _version_ | 1848754783258673152 |
|---|---|
| author | Ifenthaler, Dirk |
| author_facet | Ifenthaler, Dirk |
| author_sort | Ifenthaler, Dirk |
| building | Curtin Institutional Repository |
| collection | Online Access |
| description | A considerable amount of research has been undertaken to provide insights into the valid assessment of team performance. However, in many settings, manual and therefore labor-intensive assessment instruments for team performance have limitations. Therefore, automated assessment instruments enable more flexible and detailed insights into the complex processes influencing team performance. The central objective of this study was to advance knowledge in automated assessment of team-based performance using a language-oriented approach. Fifty-six teams of learners (N = 224) in 3 experimental conditions solved 2 tasks in an online learning environment. They were analyzed with the Automated Knowledge Visualization and Assessment (AKOVIA) methodology. AKOVIA integrates a natural language-oriented algorithm and enables a structural and semantic compression of individual- and team-based knowledge representations. Findings indicate initial evidence of the feasibility and validity of the fully automated methodology. A framework for integrating research and methodology development is suggested for improving educational technology innovations such as computer-based assessment environments in international large-scale assessments. |
| first_indexed | 2025-11-14T08:45:54Z |
| format | Journal Article |
| id | curtin-20.500.11937-36484 |
| institution | Curtin University Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-14T08:45:54Z |
| publishDate | 2014 |
| publisher | American Psychological Association |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | curtin-20.500.11937-364842017-09-13T15:28:50Z Toward Automated Computer-Based Visualization and Assessment of Team-Based Performance Ifenthaler, Dirk A considerable amount of research has been undertaken to provide insights into the valid assessment of team performance. However, in many settings, manual and therefore labor-intensive assessment instruments for team performance have limitations. Therefore, automated assessment instruments enable more flexible and detailed insights into the complex processes influencing team performance. The central objective of this study was to advance knowledge in automated assessment of team-based performance using a language-oriented approach. Fifty-six teams of learners (N = 224) in 3 experimental conditions solved 2 tasks in an online learning environment. They were analyzed with the Automated Knowledge Visualization and Assessment (AKOVIA) methodology. AKOVIA integrates a natural language-oriented algorithm and enables a structural and semantic compression of individual- and team-based knowledge representations. Findings indicate initial evidence of the feasibility and validity of the fully automated methodology. A framework for integrating research and methodology development is suggested for improving educational technology innovations such as computer-based assessment environments in international large-scale assessments. 2014 Journal Article http://hdl.handle.net/20.500.11937/36484 10.1037/a0035505 American Psychological Association restricted |
| spellingShingle | Ifenthaler, Dirk Toward Automated Computer-Based Visualization and Assessment of Team-Based Performance |
| title | Toward Automated Computer-Based Visualization and Assessment of Team-Based Performance |
| title_full | Toward Automated Computer-Based Visualization and Assessment of Team-Based Performance |
| title_fullStr | Toward Automated Computer-Based Visualization and Assessment of Team-Based Performance |
| title_full_unstemmed | Toward Automated Computer-Based Visualization and Assessment of Team-Based Performance |
| title_short | Toward Automated Computer-Based Visualization and Assessment of Team-Based Performance |
| title_sort | toward automated computer-based visualization and assessment of team-based performance |
| url | http://hdl.handle.net/20.500.11937/36484 |