A Mixed-Methods Evaluation of the Implementation of a Performance Measurement System for South Africa's Substance Use Treatment Services

OBJECTIVE: Minimal knowledge exists on the factors that affect implementation of performance measurement systems, particularly in low- and middle-income countries (LMICs). To address this, we describe the implementation of a performance measurement system for South Africa's substance abuse trea...

Full description

Bibliographic Details
Main Authors: Myers-Franchi, Bronwyn, Williams, P.P., Govender, R., Manderscheid, R., Koch, J.R.
Format: Journal Article
Language:English
Published: ALCOHOL RES DOCUMENTATION INC CENT ALCOHOL STUD RUTGERS UNIV 2019
Subjects:
Online Access:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6377018/
http://hdl.handle.net/20.500.11937/85654
_version_ 1848764758246817792
author Myers-Franchi, Bronwyn
Williams, P.P.
Govender, R.
Manderscheid, R.
Koch, J.R.
author_facet Myers-Franchi, Bronwyn
Williams, P.P.
Govender, R.
Manderscheid, R.
Koch, J.R.
author_sort Myers-Franchi, Bronwyn
building Curtin Institutional Repository
collection Online Access
description OBJECTIVE: Minimal knowledge exists on the factors that affect implementation of performance measurement systems, particularly in low- and middle-income countries (LMICs). To address this, we describe the implementation of a performance measurement system for South Africa's substance abuse treatment services known as the Service Quality Measures (SQM) initiative. METHOD: We conducted a mixed-methods evaluation of system implementation. We surveyed 81 providers about the extent of system implementation within their agencies and the factors that facilitated implementation. We conducted 26 in-depth interviews of providers' perceived barriers and facilitators to implementation. RESULTS: The overall penetration of this system was high. Almost all providers viewed the system as feasible to implement, acceptable, appropriate for use in their context, and useful for guiding service improvements. However, the extent of implementation varied significantly across sites (p < .05). Leadership support (p < .05) was associated with increased implementation in multivariable analyses. Providers reflected that high rates of patient attrition, variability in willingness to implement the system, and limited capacity for interpreting performance feedback affected the extent of system implementation. CONCLUSIONS: It is feasible to implement a performance measurement system in LMICs if the system is acceptable, appropriate, and useful to providers. To ensure the utility of this system for treatment service strengthening, system implementation must be optimized. Efforts to enhance target population coverage, strengthen leadership support for performance measurement, and build capacity for performance feedback utilization may enhance the implementation of this performance measurement system.
first_indexed 2025-11-14T11:24:26Z
format Journal Article
id curtin-20.500.11937-85654
institution Curtin University Malaysia
institution_category Local University
language English
last_indexed 2025-11-14T11:24:26Z
publishDate 2019
publisher ALCOHOL RES DOCUMENTATION INC CENT ALCOHOL STUD RUTGERS UNIV
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-856542021-11-26T07:37:28Z A Mixed-Methods Evaluation of the Implementation of a Performance Measurement System for South Africa's Substance Use Treatment Services Myers-Franchi, Bronwyn Williams, P.P. Govender, R. Manderscheid, R. Koch, J.R. Science & Technology Social Sciences Life Sciences & Biomedicine Substance Abuse Psychology QUALITY OBJECTIVE: Minimal knowledge exists on the factors that affect implementation of performance measurement systems, particularly in low- and middle-income countries (LMICs). To address this, we describe the implementation of a performance measurement system for South Africa's substance abuse treatment services known as the Service Quality Measures (SQM) initiative. METHOD: We conducted a mixed-methods evaluation of system implementation. We surveyed 81 providers about the extent of system implementation within their agencies and the factors that facilitated implementation. We conducted 26 in-depth interviews of providers' perceived barriers and facilitators to implementation. RESULTS: The overall penetration of this system was high. Almost all providers viewed the system as feasible to implement, acceptable, appropriate for use in their context, and useful for guiding service improvements. However, the extent of implementation varied significantly across sites (p < .05). Leadership support (p < .05) was associated with increased implementation in multivariable analyses. Providers reflected that high rates of patient attrition, variability in willingness to implement the system, and limited capacity for interpreting performance feedback affected the extent of system implementation. CONCLUSIONS: It is feasible to implement a performance measurement system in LMICs if the system is acceptable, appropriate, and useful to providers. To ensure the utility of this system for treatment service strengthening, system implementation must be optimized. Efforts to enhance target population coverage, strengthen leadership support for performance measurement, and build capacity for performance feedback utilization may enhance the implementation of this performance measurement system. 2019 Journal Article http://hdl.handle.net/20.500.11937/85654 10.15288/jsads.2019.s18.131 English https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6377018/ ALCOHOL RES DOCUMENTATION INC CENT ALCOHOL STUD RUTGERS UNIV restricted
spellingShingle Science & Technology
Social Sciences
Life Sciences & Biomedicine
Substance Abuse
Psychology
QUALITY
Myers-Franchi, Bronwyn
Williams, P.P.
Govender, R.
Manderscheid, R.
Koch, J.R.
A Mixed-Methods Evaluation of the Implementation of a Performance Measurement System for South Africa's Substance Use Treatment Services
title A Mixed-Methods Evaluation of the Implementation of a Performance Measurement System for South Africa's Substance Use Treatment Services
title_full A Mixed-Methods Evaluation of the Implementation of a Performance Measurement System for South Africa's Substance Use Treatment Services
title_fullStr A Mixed-Methods Evaluation of the Implementation of a Performance Measurement System for South Africa's Substance Use Treatment Services
title_full_unstemmed A Mixed-Methods Evaluation of the Implementation of a Performance Measurement System for South Africa's Substance Use Treatment Services
title_short A Mixed-Methods Evaluation of the Implementation of a Performance Measurement System for South Africa's Substance Use Treatment Services
title_sort mixed-methods evaluation of the implementation of a performance measurement system for south africa's substance use treatment services
topic Science & Technology
Social Sciences
Life Sciences & Biomedicine
Substance Abuse
Psychology
QUALITY
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6377018/
http://hdl.handle.net/20.500.11937/85654