Development, validity and reliability testing of the East Midlands Evaluation Tool (EMET) for measuring impacts on trainees’ confidence and competence following end of life care training
Objectives: To develop, test and validate a versatile questionnaire, the East Midlands Evaluation Tool (EMET), for measuring effects of end of life care training events on trainees’ self-reported confidence and competence. Methods: A paper-based questionnaire was designed on the basis of the Engl...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Published: |
BMJ Publishing Group
2017
|
| Online Access: | https://eprints.nottingham.ac.uk/41719/ |
| _version_ | 1848796339444383744 |
|---|---|
| author | Whittaker, B. Parry, R. Bird, L. Watson, S. Faull, Christina |
| author_facet | Whittaker, B. Parry, R. Bird, L. Watson, S. Faull, Christina |
| author_sort | Whittaker, B. |
| building | Nottingham Research Data Repository |
| collection | Online Access |
| description | Objectives: To develop, test and validate a versatile questionnaire, the East Midlands Evaluation Tool (EMET), for measuring effects of end of life care training events on trainees’ self-reported confidence and competence.
Methods: A paper-based questionnaire was designed on the basis of the English Department of Health's core competences for end of life care, with sections for completion pretraining, immediately post-training and also for longer term follow-up. Preliminary versions were field tested at 55 training events delivered by 13 organisations to 1793 trainees working in diverse health and social care backgrounds. Iterative rounds of development aimed to maximise relevance to events and trainees. Internal consistency was assessed by calculating interitem correlations on questionnaire responses during field testing. Content validity was assessed via qualitative content analysis of (1) responses to questionnaires completed by field tester trainers and (2) field notes from a workshop with a separate cohort of experienced trainers. Test–retest reliability was assessed via repeat administration to a cohort of student nurses.
Results: The EMET comprises 27 items with Likert-scaled responses supplemented with questions seeking free-text responses. It measures changes in self-assessed confidence and competence on 5 subscales: communication skills; assessment and care planning; symptom management; advance care planning; overarching values and knowledge. Test–retest reliability was found to be good, as was internal consistency: the questions successfully assess different aspects of the same underlying concept.
Conclusions: The EMET provides a time-efficient, reliable and flexible means of evaluating effects of training on self-reported confidence and competence in the key elements of end of life care. |
| first_indexed | 2025-11-14T19:46:25Z |
| format | Article |
| id | nottingham-41719 |
| institution | University of Nottingham Malaysia Campus |
| institution_category | Local University |
| last_indexed | 2025-11-14T19:46:25Z |
| publishDate | 2017 |
| publisher | BMJ Publishing Group |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | nottingham-417192020-05-04T18:36:05Z https://eprints.nottingham.ac.uk/41719/ Development, validity and reliability testing of the East Midlands Evaluation Tool (EMET) for measuring impacts on trainees’ confidence and competence following end of life care training Whittaker, B. Parry, R. Bird, L. Watson, S. Faull, Christina Objectives: To develop, test and validate a versatile questionnaire, the East Midlands Evaluation Tool (EMET), for measuring effects of end of life care training events on trainees’ self-reported confidence and competence. Methods: A paper-based questionnaire was designed on the basis of the English Department of Health's core competences for end of life care, with sections for completion pretraining, immediately post-training and also for longer term follow-up. Preliminary versions were field tested at 55 training events delivered by 13 organisations to 1793 trainees working in diverse health and social care backgrounds. Iterative rounds of development aimed to maximise relevance to events and trainees. Internal consistency was assessed by calculating interitem correlations on questionnaire responses during field testing. Content validity was assessed via qualitative content analysis of (1) responses to questionnaires completed by field tester trainers and (2) field notes from a workshop with a separate cohort of experienced trainers. Test–retest reliability was assessed via repeat administration to a cohort of student nurses. Results: The EMET comprises 27 items with Likert-scaled responses supplemented with questions seeking free-text responses. It measures changes in self-assessed confidence and competence on 5 subscales: communication skills; assessment and care planning; symptom management; advance care planning; overarching values and knowledge. Test–retest reliability was found to be good, as was internal consistency: the questions successfully assess different aspects of the same underlying concept. Conclusions: The EMET provides a time-efficient, reliable and flexible means of evaluating effects of training on self-reported confidence and competence in the key elements of end of life care. BMJ Publishing Group 2017-02-03 Article PeerReviewed Whittaker, B., Parry, R., Bird, L., Watson, S. and Faull, Christina (2017) Development, validity and reliability testing of the East Midlands Evaluation Tool (EMET) for measuring impacts on trainees’ confidence and competence following end of life care training. BMJ Supportive & Palliative Care . ISSN 2045-4368 doi:10.1136/-2016001100 doi:10.1136/-2016001100 |
| spellingShingle | Whittaker, B. Parry, R. Bird, L. Watson, S. Faull, Christina Development, validity and reliability testing of the East Midlands Evaluation Tool (EMET) for measuring impacts on trainees’ confidence and competence following end of life care training |
| title | Development, validity and reliability testing of the East Midlands Evaluation Tool (EMET) for measuring impacts on trainees’ confidence and competence following end of life care training |
| title_full | Development, validity and reliability testing of the East Midlands Evaluation Tool (EMET) for measuring impacts on trainees’ confidence and competence following end of life care training |
| title_fullStr | Development, validity and reliability testing of the East Midlands Evaluation Tool (EMET) for measuring impacts on trainees’ confidence and competence following end of life care training |
| title_full_unstemmed | Development, validity and reliability testing of the East Midlands Evaluation Tool (EMET) for measuring impacts on trainees’ confidence and competence following end of life care training |
| title_short | Development, validity and reliability testing of the East Midlands Evaluation Tool (EMET) for measuring impacts on trainees’ confidence and competence following end of life care training |
| title_sort | development, validity and reliability testing of the east midlands evaluation tool (emet) for measuring impacts on trainees’ confidence and competence following end of life care training |
| url | https://eprints.nottingham.ac.uk/41719/ https://eprints.nottingham.ac.uk/41719/ |