Proportionate methods for evaluating a simple digital mental health tool
Background: Traditional evaluation methods are not keeping pace with rapid developments in mobile health. More flexible methodologies are needed to evaluate mHealth technologies, particularly simple, self-help tools. One approach is to combine a variety of methods and data to build a comprehensive...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Published: |
BMJ Publishing Group
2017
|
| Subjects: | |
| Online Access: | https://eprints.nottingham.ac.uk/47140/ |
| _version_ | 1848797475089940480 |
|---|---|
| author | Davies, Eleanor Bethan Craven, Michael P. Martin, Jennifer L. Simons, Lucy |
| author_facet | Davies, Eleanor Bethan Craven, Michael P. Martin, Jennifer L. Simons, Lucy |
| author_sort | Davies, Eleanor Bethan |
| building | Nottingham Research Data Repository |
| collection | Online Access |
| description | Background: Traditional evaluation methods are not keeping pace with rapid developments in mobile health. More flexible methodologies are needed to evaluate mHealth technologies, particularly simple, self-help tools. One approach is to combine a variety of methods and data to build a comprehensive picture of how a technology is used and its impact on users.
Objective: This paper aims to demonstrate how analytical data and user feedback can be triangulated to provide a proportionate and practical approach to the evaluation of a mental wellbeing smartphone app (‘In Hand’).
Methods: A three-part process was used to collect data: 1) app analytics; 2) an online user survey; and 3) interviews with users.
Findings: Analytics showed that >50% of user sessions counted as ‘meaningful engagement’. User survey findings (N=108) revealed that In Hand was perceived to be helpful on several dimensions of mental wellbeing. Interviews (N=8) provided insight into how these self-reported positive effects were understood by users.
Conclusions: This evaluation demonstrates how different methods can be combined to complete a real-world, naturalistic evaluation of a self-help digital tool and provide insights into how and why an app is used and its impact upon users’ wellbeing.
Clinical implications: This triangulation approach to evaluation provides insight into how wellbeing apps are used and their perceived impact on users’ mental wellbeing. This approach is useful for mental healthcare professionals and commissioners who wish to recommend simple digital tools to their patients and evaluate their uptake, use and benefits. |
| first_indexed | 2025-11-14T20:04:28Z |
| format | Article |
| id | nottingham-47140 |
| institution | University of Nottingham Malaysia Campus |
| institution_category | Local University |
| last_indexed | 2025-11-14T20:04:28Z |
| publishDate | 2017 |
| publisher | BMJ Publishing Group |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | nottingham-471402020-05-04T19:11:13Z https://eprints.nottingham.ac.uk/47140/ Proportionate methods for evaluating a simple digital mental health tool Davies, Eleanor Bethan Craven, Michael P. Martin, Jennifer L. Simons, Lucy Background: Traditional evaluation methods are not keeping pace with rapid developments in mobile health. More flexible methodologies are needed to evaluate mHealth technologies, particularly simple, self-help tools. One approach is to combine a variety of methods and data to build a comprehensive picture of how a technology is used and its impact on users. Objective: This paper aims to demonstrate how analytical data and user feedback can be triangulated to provide a proportionate and practical approach to the evaluation of a mental wellbeing smartphone app (‘In Hand’). Methods: A three-part process was used to collect data: 1) app analytics; 2) an online user survey; and 3) interviews with users. Findings: Analytics showed that >50% of user sessions counted as ‘meaningful engagement’. User survey findings (N=108) revealed that In Hand was perceived to be helpful on several dimensions of mental wellbeing. Interviews (N=8) provided insight into how these self-reported positive effects were understood by users. Conclusions: This evaluation demonstrates how different methods can be combined to complete a real-world, naturalistic evaluation of a self-help digital tool and provide insights into how and why an app is used and its impact upon users’ wellbeing. Clinical implications: This triangulation approach to evaluation provides insight into how wellbeing apps are used and their perceived impact on users’ mental wellbeing. This approach is useful for mental healthcare professionals and commissioners who wish to recommend simple digital tools to their patients and evaluate their uptake, use and benefits. BMJ Publishing Group 2017-10-09 Article PeerReviewed Davies, Eleanor Bethan, Craven, Michael P., Martin, Jennifer L. and Simons, Lucy (2017) Proportionate methods for evaluating a simple digital mental health tool. Evidence Based Mental Health, 20 (4). pp. 112-117. ISSN 1468-960X mHealth; Mixed methods; Evaluation; Co-design; Young people; Mental health; Apps; Mobile phones https://ebmh.bmj.com/content/20/4/112 doi:10.1136/eb-2017-102755 doi:10.1136/eb-2017-102755 |
| spellingShingle | mHealth; Mixed methods; Evaluation; Co-design; Young people; Mental health; Apps; Mobile phones Davies, Eleanor Bethan Craven, Michael P. Martin, Jennifer L. Simons, Lucy Proportionate methods for evaluating a simple digital mental health tool |
| title | Proportionate methods for evaluating a simple digital mental health tool |
| title_full | Proportionate methods for evaluating a simple digital mental health tool |
| title_fullStr | Proportionate methods for evaluating a simple digital mental health tool |
| title_full_unstemmed | Proportionate methods for evaluating a simple digital mental health tool |
| title_short | Proportionate methods for evaluating a simple digital mental health tool |
| title_sort | proportionate methods for evaluating a simple digital mental health tool |
| topic | mHealth; Mixed methods; Evaluation; Co-design; Young people; Mental health; Apps; Mobile phones |
| url | https://eprints.nottingham.ac.uk/47140/ https://eprints.nottingham.ac.uk/47140/ https://eprints.nottingham.ac.uk/47140/ |