Instrument validation process: A case study using the Paediatric Pain Knowledge and Attitudes Questionnaire

Aims and objectives: To compare two methods of calculating interrater agreement while determining content validity of the Paediatric Pain Knowledge and Attitudes Questionnaire for use with Australian nurses. Background: Paediatric pain assessment and management documentation was found to be suboptim...

Full description

Bibliographic Details
Main Authors: Peirce, D., Brown, Janie, Corkish, V., Lane, M., Wilson, Sally
Format: Journal Article
Published: Wiley-Blackwell Publishing 2016
Online Access:http://hdl.handle.net/20.500.11937/19468
_version_ 1848750042512359424
author Peirce, D.
Brown, Janie
Corkish, V.
Lane, M.
Wilson, Sally
author_facet Peirce, D.
Brown, Janie
Corkish, V.
Lane, M.
Wilson, Sally
author_sort Peirce, D.
building Curtin Institutional Repository
collection Online Access
description Aims and objectives: To compare two methods of calculating interrater agreement while determining content validity of the Paediatric Pain Knowledge and Attitudes Questionnaire for use with Australian nurses. Background: Paediatric pain assessment and management documentation was found to be suboptimal revealing a need to assess paediatric nurses' knowledge and attitude to pain. The Paediatric Pain Knowledge and Attitudes Questionnaire was selected as it had been reported as valid and reliable in the United Kingdom with student nurses. The questionnaire required content validity determination prior to use in the Australian context. Design: A two phase process of expert review. Methods: Ten paediatric nurses completed a relevancy rating of all 68 questionnaire items. In phase two, five pain experts reviewed the items of the questionnaire that scored an unacceptable item level content validity. Item and scale level content validity indices and intraclass correlation coefficients were calculated. Results: In phase one, 31 items received an item level content validity index <0·78 and the scale level content validity index average was 0·80 which were below levels required for acceptable validity. The intraclass correlation coefficient was 0·47. In phase two, 10 items were amended and four items deleted. The revised questionnaire provided a scale level content validity index average <0·90 and an intraclass correlation coefficient of 0·94 demonstrating excellent agreement between raters therefore acceptable content validity. Conclusion: Equivalent outcomes were achieved using the content validity index and the intraclass correlation coefficient.
first_indexed 2025-11-14T07:30:32Z
format Journal Article
id curtin-20.500.11937-19468
institution Curtin University Malaysia
institution_category Local University
last_indexed 2025-11-14T07:30:32Z
publishDate 2016
publisher Wiley-Blackwell Publishing
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-194682017-09-13T13:46:47Z Instrument validation process: A case study using the Paediatric Pain Knowledge and Attitudes Questionnaire Peirce, D. Brown, Janie Corkish, V. Lane, M. Wilson, Sally Aims and objectives: To compare two methods of calculating interrater agreement while determining content validity of the Paediatric Pain Knowledge and Attitudes Questionnaire for use with Australian nurses. Background: Paediatric pain assessment and management documentation was found to be suboptimal revealing a need to assess paediatric nurses' knowledge and attitude to pain. The Paediatric Pain Knowledge and Attitudes Questionnaire was selected as it had been reported as valid and reliable in the United Kingdom with student nurses. The questionnaire required content validity determination prior to use in the Australian context. Design: A two phase process of expert review. Methods: Ten paediatric nurses completed a relevancy rating of all 68 questionnaire items. In phase two, five pain experts reviewed the items of the questionnaire that scored an unacceptable item level content validity. Item and scale level content validity indices and intraclass correlation coefficients were calculated. Results: In phase one, 31 items received an item level content validity index <0·78 and the scale level content validity index average was 0·80 which were below levels required for acceptable validity. The intraclass correlation coefficient was 0·47. In phase two, 10 items were amended and four items deleted. The revised questionnaire provided a scale level content validity index average <0·90 and an intraclass correlation coefficient of 0·94 demonstrating excellent agreement between raters therefore acceptable content validity. Conclusion: Equivalent outcomes were achieved using the content validity index and the intraclass correlation coefficient. 2016 Journal Article http://hdl.handle.net/20.500.11937/19468 10.1111/jocn.13130 Wiley-Blackwell Publishing restricted
spellingShingle Peirce, D.
Brown, Janie
Corkish, V.
Lane, M.
Wilson, Sally
Instrument validation process: A case study using the Paediatric Pain Knowledge and Attitudes Questionnaire
title Instrument validation process: A case study using the Paediatric Pain Knowledge and Attitudes Questionnaire
title_full Instrument validation process: A case study using the Paediatric Pain Knowledge and Attitudes Questionnaire
title_fullStr Instrument validation process: A case study using the Paediatric Pain Knowledge and Attitudes Questionnaire
title_full_unstemmed Instrument validation process: A case study using the Paediatric Pain Knowledge and Attitudes Questionnaire
title_short Instrument validation process: A case study using the Paediatric Pain Knowledge and Attitudes Questionnaire
title_sort instrument validation process: a case study using the paediatric pain knowledge and attitudes questionnaire
url http://hdl.handle.net/20.500.11937/19468