Validating and comparing stroke prognosis scales

Objective: To compare the prognostic accuracy of various acute stroke prognostic scales using a large, independent, clinical trials dataset. Methods: We directly compared 8 stroke prognostic scales, chosen based on focused literature review (Acute Stroke Registry and Analysis of Lausanne [ASTRAL]...

Full description

Bibliographic Details
Main Authors: Quinn, Terence J., Singh, Sarjit, Lees, Kennedy R., Bath, Philip M.W., Myint, Phyo K.
Format: Article
Published: American Academy of Neurology 2017
Online Access:https://eprints.nottingham.ac.uk/49017/
_version_ 1848797903689089024
author Quinn, Terence J.
Singh, Sarjit
Lees, Kennedy R.
Bath, Philip M.W.
Myint, Phyo K.
author_facet Quinn, Terence J.
Singh, Sarjit
Lees, Kennedy R.
Bath, Philip M.W.
Myint, Phyo K.
author_sort Quinn, Terence J.
building Nottingham Research Data Repository
collection Online Access
description Objective: To compare the prognostic accuracy of various acute stroke prognostic scales using a large, independent, clinical trials dataset. Methods: We directly compared 8 stroke prognostic scales, chosen based on focused literature review (Acute Stroke Registry and Analysis of Lausanne [ASTRAL]; iSCORE; iSCORE-revised; preadmission comorbidities, level of consciousness, age, and neurologic deficit [PLAN]; stroke subtype, Oxfordshire Community Stroke Project, age, and prestroke modified Rankin Scale [mRS] [SOAR]; modified SOAR; Stroke Prognosis Instrument 2 [SPI2]; and Totaled Health Risks in Vascular Events [THRIVE]) using individual patient-level data from a clinical trials archive (Virtual International Stroke Trials Archive [VISTA]). We calculated area under receiver operating characteristic curves (AUROC) for each scale against 90-day outcomes of mRS (dichotomized atmRS.2), Barthel Index (.85), and mortality. We performed 2 complementary analyses: the first limited to patients with complete data for all components of all scales (simultaneous) and the second using as many patients as possible for each individual scale (separate). We compared AUROCs and performed sensitivity analyses substituting extreme outcome values for missing data. Results: In total, 10,777 patients contributed to the analyses. Our simultaneous analyses suggested that ASTRAL had greatest prognostic accuracy for mRS, AUROC 0.78 (95% confidence interval [CI] 0.75–0.82), and SPI2 had poorest AUROC, 0.61 (95%CI 0.57–0.66). Our separate analyses confirmed these results: ASTRAL AUROC 0.79 (95% CI 0.78–0.80 and SPI2 AUROC 0.60 (95% CI 0.59–0.61). On formal comparative testing, there was a significant difference in modified Rankin Scale AUROC between ASTRAL and all other scales. Sensitivity analysis identified no evidence of systematic bias from missing data. Conclusions: Our comparative analyses confirm differences in the prognostic accuracy of stroke scales. However, even the best performing scale had prognostic accuracy that may not be sufficient as a basis for clinical decision-making.
first_indexed 2025-11-14T20:11:16Z
format Article
id nottingham-49017
institution University of Nottingham Malaysia Campus
institution_category Local University
last_indexed 2025-11-14T20:11:16Z
publishDate 2017
publisher American Academy of Neurology
recordtype eprints
repository_type Digital Repository
spelling nottingham-490172020-05-04T19:04:38Z https://eprints.nottingham.ac.uk/49017/ Validating and comparing stroke prognosis scales Quinn, Terence J. Singh, Sarjit Lees, Kennedy R. Bath, Philip M.W. Myint, Phyo K. Objective: To compare the prognostic accuracy of various acute stroke prognostic scales using a large, independent, clinical trials dataset. Methods: We directly compared 8 stroke prognostic scales, chosen based on focused literature review (Acute Stroke Registry and Analysis of Lausanne [ASTRAL]; iSCORE; iSCORE-revised; preadmission comorbidities, level of consciousness, age, and neurologic deficit [PLAN]; stroke subtype, Oxfordshire Community Stroke Project, age, and prestroke modified Rankin Scale [mRS] [SOAR]; modified SOAR; Stroke Prognosis Instrument 2 [SPI2]; and Totaled Health Risks in Vascular Events [THRIVE]) using individual patient-level data from a clinical trials archive (Virtual International Stroke Trials Archive [VISTA]). We calculated area under receiver operating characteristic curves (AUROC) for each scale against 90-day outcomes of mRS (dichotomized atmRS.2), Barthel Index (.85), and mortality. We performed 2 complementary analyses: the first limited to patients with complete data for all components of all scales (simultaneous) and the second using as many patients as possible for each individual scale (separate). We compared AUROCs and performed sensitivity analyses substituting extreme outcome values for missing data. Results: In total, 10,777 patients contributed to the analyses. Our simultaneous analyses suggested that ASTRAL had greatest prognostic accuracy for mRS, AUROC 0.78 (95% confidence interval [CI] 0.75–0.82), and SPI2 had poorest AUROC, 0.61 (95%CI 0.57–0.66). Our separate analyses confirmed these results: ASTRAL AUROC 0.79 (95% CI 0.78–0.80 and SPI2 AUROC 0.60 (95% CI 0.59–0.61). On formal comparative testing, there was a significant difference in modified Rankin Scale AUROC between ASTRAL and all other scales. Sensitivity analysis identified no evidence of systematic bias from missing data. Conclusions: Our comparative analyses confirm differences in the prognostic accuracy of stroke scales. However, even the best performing scale had prognostic accuracy that may not be sufficient as a basis for clinical decision-making. American Academy of Neurology 2017-09-05 Article PeerReviewed Quinn, Terence J., Singh, Sarjit, Lees, Kennedy R., Bath, Philip M.W. and Myint, Phyo K. (2017) Validating and comparing stroke prognosis scales. Neurology, 89 (10). pp. 997-1002. ISSN 1526-632X https://doi.org/10.1212/WNL.0000000000004332 doi:10.1212/WNL.0000000000004332 doi:10.1212/WNL.0000000000004332
spellingShingle Quinn, Terence J.
Singh, Sarjit
Lees, Kennedy R.
Bath, Philip M.W.
Myint, Phyo K.
Validating and comparing stroke prognosis scales
title Validating and comparing stroke prognosis scales
title_full Validating and comparing stroke prognosis scales
title_fullStr Validating and comparing stroke prognosis scales
title_full_unstemmed Validating and comparing stroke prognosis scales
title_short Validating and comparing stroke prognosis scales
title_sort validating and comparing stroke prognosis scales
url https://eprints.nottingham.ac.uk/49017/
https://eprints.nottingham.ac.uk/49017/
https://eprints.nottingham.ac.uk/49017/