Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR)

Systematic reviews (SR) are vital to health care, but have become complicated and time-consuming, due to the rapid expansion of evidence to be synthesised. Fortunately, many tasks of systematic reviews have the potential to be automated or may be assisted by automation. Recent advances in natural la...

Full description

Bibliographic Details
Main Authors: Beller, Elaine, Clark, Justin, Tsafnat, Guy, Adams, Clive E., Diehl, Heinz, Lund, Hans, Ouzzani, Mourad, Thayer, Kristina, Thomas, James, Turner, Tari, Xia, Jun, Robinson, Karen, Glasziou, Paul
Format: Article
Published: BioMed Central 2018
Subjects:
Online Access:https://eprints.nottingham.ac.uk/52027/
_version_ 1848798630595526656
author Beller, Elaine
Clark, Justin
Tsafnat, Guy
Adams, Clive E.
Diehl, Heinz
Lund, Hans
Ouzzani, Mourad
Thayer, Kristina
Thomas, James
Turner, Tari
Xia, Jun
Robinson, Karen
Glasziou, Paul
author_facet Beller, Elaine
Clark, Justin
Tsafnat, Guy
Adams, Clive E.
Diehl, Heinz
Lund, Hans
Ouzzani, Mourad
Thayer, Kristina
Thomas, James
Turner, Tari
Xia, Jun
Robinson, Karen
Glasziou, Paul
author_sort Beller, Elaine
building Nottingham Research Data Repository
collection Online Access
description Systematic reviews (SR) are vital to health care, but have become complicated and time-consuming, due to the rapid expansion of evidence to be synthesised. Fortunately, many tasks of systematic reviews have the potential to be automated or may be assisted by automation. Recent advances in natural language processing, text mining and machine learning have produced new algorithms that can accurately mimic human endeavour in systematic review activity, faster and more cheaply. Automation tools need to be able to work together, to exchange data and results. Therefore, we initiated the International Collaboration for the Automation of Systematic Reviews (ICASR), to successfully put all the parts of automation of systematic review production together. The first meeting was held in Vienna in October 2015. We established a set of principles to enable tools to be developed and integrated into toolkits. This paper sets out the principles devised at that meeting, which cover the need for improvement in efficiency of SR tasks, automation across the spectrum of SR tasks, continuous improvement, adherence to high quality standards, flexibility of use and combining components, the need for a collaboration and varied skills, the desire for open source, shared code and evaluation, and a requirement for replicability through rigorous and open evaluation. Automation has a great potential to improve the speed of systematic reviews. Considerable work is already being done on many of the steps involved in a review. The ‘Vienna Principles’ set out in this paper aim to guide a more coordinated effort which will allow the integration of work by separate teams and build on the experience, code and evaluations done by the many teams working across the globe.
first_indexed 2025-11-14T20:22:50Z
format Article
id nottingham-52027
institution University of Nottingham Malaysia Campus
institution_category Local University
last_indexed 2025-11-14T20:22:50Z
publishDate 2018
publisher BioMed Central
recordtype eprints
repository_type Digital Repository
spelling nottingham-520272020-05-04T19:37:01Z https://eprints.nottingham.ac.uk/52027/ Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR) Beller, Elaine Clark, Justin Tsafnat, Guy Adams, Clive E. Diehl, Heinz Lund, Hans Ouzzani, Mourad Thayer, Kristina Thomas, James Turner, Tari Xia, Jun Robinson, Karen Glasziou, Paul Systematic reviews (SR) are vital to health care, but have become complicated and time-consuming, due to the rapid expansion of evidence to be synthesised. Fortunately, many tasks of systematic reviews have the potential to be automated or may be assisted by automation. Recent advances in natural language processing, text mining and machine learning have produced new algorithms that can accurately mimic human endeavour in systematic review activity, faster and more cheaply. Automation tools need to be able to work together, to exchange data and results. Therefore, we initiated the International Collaboration for the Automation of Systematic Reviews (ICASR), to successfully put all the parts of automation of systematic review production together. The first meeting was held in Vienna in October 2015. We established a set of principles to enable tools to be developed and integrated into toolkits. This paper sets out the principles devised at that meeting, which cover the need for improvement in efficiency of SR tasks, automation across the spectrum of SR tasks, continuous improvement, adherence to high quality standards, flexibility of use and combining components, the need for a collaboration and varied skills, the desire for open source, shared code and evaluation, and a requirement for replicability through rigorous and open evaluation. Automation has a great potential to improve the speed of systematic reviews. Considerable work is already being done on many of the steps involved in a review. The ‘Vienna Principles’ set out in this paper aim to guide a more coordinated effort which will allow the integration of work by separate teams and build on the experience, code and evaluations done by the many teams working across the globe. BioMed Central 2018-05-19 Article PeerReviewed Beller, Elaine, Clark, Justin, Tsafnat, Guy, Adams, Clive E., Diehl, Heinz, Lund, Hans, Ouzzani, Mourad, Thayer, Kristina, Thomas, James, Turner, Tari, Xia, Jun, Robinson, Karen and Glasziou, Paul (2018) Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews, 7 . 77/1-77/7. ISSN 2046-4053 Systematic review; Automation; Collaboration https://doi.org/10.1186/s13643-018-0740-7 doi:10.1186/s13643-018-0740-7 doi:10.1186/s13643-018-0740-7
spellingShingle Systematic review; Automation; Collaboration
Beller, Elaine
Clark, Justin
Tsafnat, Guy
Adams, Clive E.
Diehl, Heinz
Lund, Hans
Ouzzani, Mourad
Thayer, Kristina
Thomas, James
Turner, Tari
Xia, Jun
Robinson, Karen
Glasziou, Paul
Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR)
title Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR)
title_full Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR)
title_fullStr Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR)
title_full_unstemmed Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR)
title_short Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR)
title_sort making progress with the automation of systematic reviews: principles of the international collaboration for the automation of systematic reviews (icasr)
topic Systematic review; Automation; Collaboration
url https://eprints.nottingham.ac.uk/52027/
https://eprints.nottingham.ac.uk/52027/
https://eprints.nottingham.ac.uk/52027/