Measuring the quality of occupational therapy students’ interviewing skills.

Introduction: Interviewing is an occupational therapy skill that is rich in dynamic and qualitative detail. However, the teaching and assessment of students’ performance in this key skill is often either left to examiner judgement, or reduced to component skills.Objectives: To develop and evaluate a...

Full description

Bibliographic Details
Main Authors: Brentnall, Jennie, Waters, Rebecca
Format: Conference Paper
Language:English
Published: Wiley-Blackwell 2021
Online Access:http://hdl.handle.net/20.500.11937/84447
_version_ 1848764650463690752
author Brentnall, Jennie
Waters, Rebecca
author_facet Brentnall, Jennie
Waters, Rebecca
author_sort Brentnall, Jennie
building Curtin Institutional Repository
collection Online Access
description Introduction: Interviewing is an occupational therapy skill that is rich in dynamic and qualitative detail. However, the teaching and assessment of students’ performance in this key skill is often either left to examiner judgement, or reduced to component skills.Objectives: To develop and evaluate a robust assessment rubric to measure the skilfulness of occupational therapy stu-dents’ interview performance.Method: We reviewed the outcomes of a viva assessment in which students (n=249) interviewed a standardised patient and were scored on a skills checklist and then awarded stand-ard grades (pass, credit, etc.). Based on Rasch analyses of student outcomes, we iteratively re- developed the assessment rubric to focus on the quality of performance. After piloting a revised rubric using modelled data and scoring video re-cordings of student examinations, we used it to assess a new cohort of students (n=235) and repeated the analyses.Results: Checklists alone proved inadequate to evaluate students’ performance directly or to support examiners’ judgements of quality among skilled performance beyond the pass level. The rich detail in the revised rubric proved feasible and resulted in vastly improved statistical measures of both reliability and range of measurement in the examination.Conclusion: We successfully developed a novel examination rubric that, for students and educators, provides an empirically supported yet rich, qualitative description of occupational therapy interviewing skills at a range of levels. This builds directly on prior work in defining interviewing skills to offer a quantifiable hierarchy of qualitative interviewing skills to inform student instruction as well as assessment and feedback
first_indexed 2025-11-14T11:22:44Z
format Conference Paper
id curtin-20.500.11937-84447
institution Curtin University Malaysia
institution_category Local University
language English
last_indexed 2025-11-14T11:22:44Z
publishDate 2021
publisher Wiley-Blackwell
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-844472021-07-18T11:23:12Z Measuring the quality of occupational therapy students’ interviewing skills. Brentnall, Jennie Waters, Rebecca Introduction: Interviewing is an occupational therapy skill that is rich in dynamic and qualitative detail. However, the teaching and assessment of students’ performance in this key skill is often either left to examiner judgement, or reduced to component skills.Objectives: To develop and evaluate a robust assessment rubric to measure the skilfulness of occupational therapy stu-dents’ interview performance.Method: We reviewed the outcomes of a viva assessment in which students (n=249) interviewed a standardised patient and were scored on a skills checklist and then awarded stand-ard grades (pass, credit, etc.). Based on Rasch analyses of student outcomes, we iteratively re- developed the assessment rubric to focus on the quality of performance. After piloting a revised rubric using modelled data and scoring video re-cordings of student examinations, we used it to assess a new cohort of students (n=235) and repeated the analyses.Results: Checklists alone proved inadequate to evaluate students’ performance directly or to support examiners’ judgements of quality among skilled performance beyond the pass level. The rich detail in the revised rubric proved feasible and resulted in vastly improved statistical measures of both reliability and range of measurement in the examination.Conclusion: We successfully developed a novel examination rubric that, for students and educators, provides an empirically supported yet rich, qualitative description of occupational therapy interviewing skills at a range of levels. This builds directly on prior work in defining interviewing skills to offer a quantifiable hierarchy of qualitative interviewing skills to inform student instruction as well as assessment and feedback 2021 Conference Paper http://hdl.handle.net/20.500.11937/84447 10.1111/1440-1630.12738 English Wiley-Blackwell restricted
spellingShingle Brentnall, Jennie
Waters, Rebecca
Measuring the quality of occupational therapy students’ interviewing skills.
title Measuring the quality of occupational therapy students’ interviewing skills.
title_full Measuring the quality of occupational therapy students’ interviewing skills.
title_fullStr Measuring the quality of occupational therapy students’ interviewing skills.
title_full_unstemmed Measuring the quality of occupational therapy students’ interviewing skills.
title_short Measuring the quality of occupational therapy students’ interviewing skills.
title_sort measuring the quality of occupational therapy students’ interviewing skills.
url http://hdl.handle.net/20.500.11937/84447