Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool

Purpose: To assess the inter-rater reliability and concurrent validity of the Communication Evaluation in Rehabilitation Tool, which aims to externally assess physiotherapists competency in using Self-Determination Theory-based communication strategies in practice. Materials and methods: Audio recor...

Full description

Bibliographic Details
Main Authors: Murray, A., Hall, A., Williams, G., McDonough, S., Ntoumanis, Nikos, Taylor, I., Jackson, B., Copsey, B., Hurley, D., Matthews, J.
Format: Journal Article
Published: Informa Healthcare 2018
Online Access:http://hdl.handle.net/20.500.11937/67687
_version_ 1848761631719292928
author Murray, A.
Hall, A.
Williams, G.
McDonough, S.
Ntoumanis, Nikos
Taylor, I.
Jackson, B.
Copsey, B.
Hurley, D.
Matthews, J.
author_facet Murray, A.
Hall, A.
Williams, G.
McDonough, S.
Ntoumanis, Nikos
Taylor, I.
Jackson, B.
Copsey, B.
Hurley, D.
Matthews, J.
author_sort Murray, A.
building Curtin Institutional Repository
collection Online Access
description Purpose: To assess the inter-rater reliability and concurrent validity of the Communication Evaluation in Rehabilitation Tool, which aims to externally assess physiotherapists competency in using Self-Determination Theory-based communication strategies in practice. Materials and methods: Audio recordings of initial consultations between 24 physiotherapists and 24 patients with chronic low back pain in four hospitals in Ireland were obtained as part of a larger randomised controlled trial. Three raters, all of whom had Ph.Ds in psychology and expertise in motivation and physical activity, independently listened to the 24 audio recordings and completed the 18-item Communication Evaluation in Rehabilitation Tool. Inter-rater reliability between all three raters was assessed using intraclass correlation coefficients. Concurrent validity was assessed using Pearson’s r correlations with a reference standard, the Health Care Climate Questionnaire. Results: The total score for the Communication Evaluation in Rehabilitation Tool is an average of all 18 items. Total scores demonstrated good inter-rater reliability (Intraclass Correlation Coefficient (ICC)?=?0.8) and concurrent validity with the Health Care Climate Questionnaire total score (range: r?=?0.7–0.88). Item-level scores of the Communication Evaluation in Rehabilitation Tool identified five items that need improvement. Conclusion: Results provide preliminary evidence to support future use and testing of the Communication Evaluation in Rehabilitation Tool.Implications for RehabilitationPromoting patient autonomy is a learned skill and while interventions exist to train clinicians in these skills there are no tools to assess how well clinicians use these skills when interacting with a patient. The lack of robust assessment has severe implications regarding both the fidelity of clinician training packages and resulting outcomes for promoting patient autonomy.This study has developed a novel measurement tool Communication Evaluation in Rehabilitation Tool and a comprehensive user manual to assess how well health care providers use autonomy-supportive communication strategies in real world-clinical settings.This tool has demonstrated good inter-rater reliability and concurrent validity in its initial testing phase.The Communication Evaluation in Rehabilitation Tool can be used in future studies to assess autonomy-supportive communication and undergo further measurement property testing as per our recommendations.
first_indexed 2025-11-14T10:34:45Z
format Journal Article
id curtin-20.500.11937-67687
institution Curtin University Malaysia
institution_category Local University
last_indexed 2025-11-14T10:34:45Z
publishDate 2018
publisher Informa Healthcare
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-676872020-07-23T07:34:42Z Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool Murray, A. Hall, A. Williams, G. McDonough, S. Ntoumanis, Nikos Taylor, I. Jackson, B. Copsey, B. Hurley, D. Matthews, J. Purpose: To assess the inter-rater reliability and concurrent validity of the Communication Evaluation in Rehabilitation Tool, which aims to externally assess physiotherapists competency in using Self-Determination Theory-based communication strategies in practice. Materials and methods: Audio recordings of initial consultations between 24 physiotherapists and 24 patients with chronic low back pain in four hospitals in Ireland were obtained as part of a larger randomised controlled trial. Three raters, all of whom had Ph.Ds in psychology and expertise in motivation and physical activity, independently listened to the 24 audio recordings and completed the 18-item Communication Evaluation in Rehabilitation Tool. Inter-rater reliability between all three raters was assessed using intraclass correlation coefficients. Concurrent validity was assessed using Pearson’s r correlations with a reference standard, the Health Care Climate Questionnaire. Results: The total score for the Communication Evaluation in Rehabilitation Tool is an average of all 18 items. Total scores demonstrated good inter-rater reliability (Intraclass Correlation Coefficient (ICC)?=?0.8) and concurrent validity with the Health Care Climate Questionnaire total score (range: r?=?0.7–0.88). Item-level scores of the Communication Evaluation in Rehabilitation Tool identified five items that need improvement. Conclusion: Results provide preliminary evidence to support future use and testing of the Communication Evaluation in Rehabilitation Tool.Implications for RehabilitationPromoting patient autonomy is a learned skill and while interventions exist to train clinicians in these skills there are no tools to assess how well clinicians use these skills when interacting with a patient. The lack of robust assessment has severe implications regarding both the fidelity of clinician training packages and resulting outcomes for promoting patient autonomy.This study has developed a novel measurement tool Communication Evaluation in Rehabilitation Tool and a comprehensive user manual to assess how well health care providers use autonomy-supportive communication strategies in real world-clinical settings.This tool has demonstrated good inter-rater reliability and concurrent validity in its initial testing phase.The Communication Evaluation in Rehabilitation Tool can be used in future studies to assess autonomy-supportive communication and undergo further measurement property testing as per our recommendations. 2018 Journal Article http://hdl.handle.net/20.500.11937/67687 10.1080/09638288.2018.1443159 Informa Healthcare fulltext
spellingShingle Murray, A.
Hall, A.
Williams, G.
McDonough, S.
Ntoumanis, Nikos
Taylor, I.
Jackson, B.
Copsey, B.
Hurley, D.
Matthews, J.
Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool
title Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool
title_full Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool
title_fullStr Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool
title_full_unstemmed Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool
title_short Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool
title_sort assessing physiotherapists’ communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool
url http://hdl.handle.net/20.500.11937/67687