-
Something wrong with this record ?
An exploration of available methods and tools to improve the efficiency of systematic review production: a scoping review
L. Affengruber, MM. van der Maten, I. Spiero, B. Nussbaumer-Streit, M. Mahmić-Kaknjo, ME. Ellen, K. Goossen, L. Kantorova, L. Hooft, N. Riva, G. Poulentzas, PN. Lalagkas, AG. Silva, M. Sassano, R. Sfetcu, ME. Marqués, T. Friessova, E. Baladia,...
Language English Country England, Great Britain
Document type Journal Article, Review
Grant support
CA17117
COST Action EVBRES
CA17117
COST Action EVBRES
SC17-012
Gesellschaft für Forschungsförderung Niederösterreich m.b.H.
NLK
BioMedCentral
from 2001-12-01
BioMedCentral Open Access
from 2001
Directory of Open Access Journals
from 2001
Free Medical Journals
from 2001
PubMed Central
from 2001
ProQuest Central
from 2009-01-01
Open Access Digital Library
from 2001-01-01
Open Access Digital Library
from 2001-01-01
Open Access Digital Library
from 2001-01-01
Medline Complete (EBSCOhost)
from 2001-01-01
Health & Medicine (ProQuest)
from 2009-01-01
ROAD: Directory of Open Access Scholarly Resources
from 2001
Springer Nature OA/Free Journals
from 2001-12-01
- MeSH
- Humans MeSH
- Systematic Reviews as Topic * methods MeSH
- Research Design MeSH
- Check Tag
- Humans MeSH
- Publication type
- Journal Article MeSH
- Review MeSH
BACKGROUND: Systematic reviews (SRs) are time-consuming and labor-intensive to perform. With the growing number of scientific publications, the SR development process becomes even more laborious. This is problematic because timely SR evidence is essential for decision-making in evidence-based healthcare and policymaking. Numerous methods and tools that accelerate SR development have recently emerged. To date, no scoping review has been conducted to provide a comprehensive summary of methods and ready-to-use tools to improve efficiency in SR production. OBJECTIVE: To present an overview of primary studies that evaluated the use of ready-to-use applications of tools or review methods to improve efficiency in the review process. METHODS: We conducted a scoping review. An information specialist performed a systematic literature search in four databases, supplemented with citation-based and grey literature searching. We included studies reporting the performance of methods and ready-to-use tools for improving efficiency when producing or updating a SR in the health field. We performed dual, independent title and abstract screening, full-text selection, and data extraction. The results were analyzed descriptively and presented narratively. RESULTS: We included 103 studies: 51 studies reported on methods, 54 studies on tools, and 2 studies reported on both methods and tools to make SR production more efficient. A total of 72 studies evaluated the validity (n = 69) or usability (n = 3) of one method (n = 33) or tool (n = 39), and 31 studies performed comparative analyses of different methods (n = 15) or tools (n = 16). 20 studies conducted prospective evaluations in real-time workflows. Most studies evaluated methods or tools that aimed at screening titles and abstracts (n = 42) and literature searching (n = 24), while for other steps of the SR process, only a few studies were found. Regarding the outcomes included, most studies reported on validity outcomes (n = 84), while outcomes such as impact on results (n = 23), time-saving (n = 24), usability (n = 13), and cost-saving (n = 3) were less often evaluated. CONCLUSION: For title and abstract screening and literature searching, various evaluated methods and tools are available that aim at improving the efficiency of SR production. However, only few studies have addressed the influence of these methods and tools in real-world workflows. Few studies exist that evaluate methods or tools supporting the remaining tasks. Additionally, while validity outcomes are frequently reported, there is a lack of evaluation regarding other outcomes.
Department of Health Sciences Faculty of Medicine Masaryk University Brno Czech Republic
Department of Medical and Surgical Sciences University of Bologna Bologna Italy
Department of Pathology Faculty of Medicine and Surgery University of Malta Msida Malta
Knowledge Institute of Federation of Medical Specialists Utrecht The Netherlands
McMaster Health Forum McMaster University Hamilton Canada
National Institute for Health Services Management Bucharest Romania
Red de Nutrición Basada en La Evidencia Academia Española de Nutrición y Dietética Pamplona Spain
RTI International Center for Public Health Methods Research Triangle Park Durham NC USA
School for Public Health and Primary Care Maastricht University Maastricht the Netherlands
Spiru Haret University Faculty of Psychology and Educational Sciences Bucharest Romania
University of Aveiro Campus Universitário de Santiago Aveiro Portugal
Witten Herdecke University Institute for Research in Operative Medicine Cologne Germany
Zenica Cantonal Hospital Department for Clinical Pharmacology Zenica Bosnia and Herzegovina
References provided by Crossref.org
- 000
- 00000naa a2200000 a 4500
- 001
- bmc24018889
- 003
- CZ-PrNML
- 005
- 20241024111054.0
- 007
- ta
- 008
- 241015s2024 enk f 000 0|eng||
- 009
- AR
- 024 7_
- $a 10.1186/s12874-024-02320-4 $2 doi
- 035 __
- $a (PubMed)39294580
- 040 __
- $a ABA008 $b cze $d ABA008 $e AACR2
- 041 0_
- $a eng
- 044 __
- $a enk
- 100 1_
- $a Affengruber, Lisa $u Cochrane Austria, Department for Evidence-Based Medicine and Clinical Epidemiology, University for Continuing Education Krems, Krems an der Donau, Austria. lisa.affengruber@donau-uni.ac.at $u School for Public Health and Primary Care (CAPHRI), Maastricht University, Maastricht, the Netherlands. lisa.affengruber@donau-uni.ac.at
- 245 13
- $a An exploration of available methods and tools to improve the efficiency of systematic review production: a scoping review / $c L. Affengruber, MM. van der Maten, I. Spiero, B. Nussbaumer-Streit, M. Mahmić-Kaknjo, ME. Ellen, K. Goossen, L. Kantorova, L. Hooft, N. Riva, G. Poulentzas, PN. Lalagkas, AG. Silva, M. Sassano, R. Sfetcu, ME. Marqués, T. Friessova, E. Baladia, AM. Pezzullo, P. Martinez, G. Gartlehner, R. Spijker
- 520 9_
- $a BACKGROUND: Systematic reviews (SRs) are time-consuming and labor-intensive to perform. With the growing number of scientific publications, the SR development process becomes even more laborious. This is problematic because timely SR evidence is essential for decision-making in evidence-based healthcare and policymaking. Numerous methods and tools that accelerate SR development have recently emerged. To date, no scoping review has been conducted to provide a comprehensive summary of methods and ready-to-use tools to improve efficiency in SR production. OBJECTIVE: To present an overview of primary studies that evaluated the use of ready-to-use applications of tools or review methods to improve efficiency in the review process. METHODS: We conducted a scoping review. An information specialist performed a systematic literature search in four databases, supplemented with citation-based and grey literature searching. We included studies reporting the performance of methods and ready-to-use tools for improving efficiency when producing or updating a SR in the health field. We performed dual, independent title and abstract screening, full-text selection, and data extraction. The results were analyzed descriptively and presented narratively. RESULTS: We included 103 studies: 51 studies reported on methods, 54 studies on tools, and 2 studies reported on both methods and tools to make SR production more efficient. A total of 72 studies evaluated the validity (n = 69) or usability (n = 3) of one method (n = 33) or tool (n = 39), and 31 studies performed comparative analyses of different methods (n = 15) or tools (n = 16). 20 studies conducted prospective evaluations in real-time workflows. Most studies evaluated methods or tools that aimed at screening titles and abstracts (n = 42) and literature searching (n = 24), while for other steps of the SR process, only a few studies were found. Regarding the outcomes included, most studies reported on validity outcomes (n = 84), while outcomes such as impact on results (n = 23), time-saving (n = 24), usability (n = 13), and cost-saving (n = 3) were less often evaluated. CONCLUSION: For title and abstract screening and literature searching, various evaluated methods and tools are available that aim at improving the efficiency of SR production. However, only few studies have addressed the influence of these methods and tools in real-world workflows. Few studies exist that evaluate methods or tools supporting the remaining tasks. Additionally, while validity outcomes are frequently reported, there is a lack of evaluation regarding other outcomes.
- 650 _2
- $a lidé $7 D006801
- 650 _2
- $a výzkumný projekt $7 D012107
- 650 12
- $a systematický přehled jako téma $x metody $7 D000078202
- 655 _2
- $a časopisecké články $7 D016428
- 655 _2
- $a přehledy $7 D016454
- 700 1_
- $a van der Maten, Miriam M $u Knowledge Institute of Federation of Medical Specialists, Utrecht, The Netherlands $u Cochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
- 700 1_
- $a Spiero, Isa $u Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
- 700 1_
- $a Nussbaumer-Streit, Barbara $u Cochrane Austria, Department for Evidence-Based Medicine and Clinical Epidemiology, University for Continuing Education Krems, Krems an der Donau, Austria
- 700 1_
- $a Mahmić-Kaknjo, Mersiha $u Zenica Cantonal Hospital, Department for Clinical Pharmacology, Zenica, Bosnia and Herzegovina
- 700 1_
- $a Ellen, Moriah E $u Department of Health Policy and Management, Guilford Glazer Faculty of Business and Management and Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer-Sheva, Israel $u Institute of Health Policy Management and Evaluation, Dalla Lana School Of Public Health, University of Toronto, Toronto, Canada $u McMaster Health Forum, McMaster University, Hamilton, Canada
- 700 1_
- $a Goossen, Käthe $u Witten/Herdecke University, Institute for Research in Operative Medicine (IFOM), Cologne, Germany
- 700 1_
- $a Kantorova, Lucia $u Czech National Centre for Evidence-Based Healthcare and Knowledge Translation (Cochrane Czech Republic, Czech CEBHC: JBI Centre of Excellence, Masaryk University GRADE Centre), Institute of Biostatistics and Analyses, Faculty of Medicine, Masaryk University, Brno, Czech Republic
- 700 1_
- $a Hooft, Lotty $u Cochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
- 700 1_
- $a Riva, Nicoletta $u Department of Pathology, Faculty of Medicine and Surgery, University of Malta, Msida, Malta
- 700 1_
- $a Poulentzas, Georgios $u Laboratory of Hygiene and Environmental Protection, Department of Medicine, Democritus University of Thrace, Alexandroupolis, Greece
- 700 1_
- $a Lalagkas, Panagiotis Nikolaos $u Laboratory of Hygiene and Environmental Protection, Department of Medicine, Democritus University of Thrace, Alexandroupolis, Greece
- 700 1_
- $a Silva, Anabela G $u CINTESIS.RISE@UA, University of Aveiro, Campus Universitário de Santiago, Aveiro, Portugal
- 700 1_
- $a Sassano, Michele $u Section of Hygiene, University Department of Life Sciences and Public Health, Università Cattolica del Sacro Cuore, Rome, Italy $u Department of Medical and Surgical Sciences, University of Bologna, Bologna, Italy
- 700 1_
- $a Sfetcu, Raluca $u National Institute for Health Services Management, Bucharest, Romania $u Spiru Haret University, Faculty of Psychology and Educational Sciences, Bucharest, Romania
- 700 1_
- $a Marqués, María E $u Red de Nutrición Basada en La Evidencia, Academia Española de Nutrición y Dietética, Pamplona, Spain
- 700 1_
- $a Friessova, Tereza $u Department of Health Sciences, Faculty of Medicine, Masaryk University, Brno, Czech Republic
- 700 1_
- $a Baladia, Eduard $u Red de Nutrición Basada en La Evidencia, Academia Española de Nutrición y Dietética, Pamplona, Spain
- 700 1_
- $a Pezzullo, Angelo Maria $u Section of Hygiene, University Department of Life Sciences and Public Health, Università Cattolica del Sacro Cuore, Rome, Italy
- 700 1_
- $a Martinez, Patricia $u Red de Nutrición Basada en La Evidencia, Academia Española de Nutrición y Dietética, Pamplona, Spain $u Techné Research Group, Department of Knowledge Engineering of the Faculty of Science, University of Granada, Granada, Spain
- 700 1_
- $a Gartlehner, Gerald $u Cochrane Austria, Department for Evidence-Based Medicine and Clinical Epidemiology, University for Continuing Education Krems, Krems an der Donau, Austria $u RTI International, Center for Public Health Methods, Research Triangle Park, Durham, NC, USA
- 700 1_
- $a Spijker, René $u Cochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands $u Amsterdam UMC, University of Amsterdam, Medical Library, Amsterdam Public Health, Amsterdam, the Netherlands
- 773 0_
- $w MED00006775 $t BMC medical research methodology $x 1471-2288 $g Roč. 24, č. 1 (2024), s. 210
- 856 41
- $u https://pubmed.ncbi.nlm.nih.gov/39294580 $y Pubmed
- 910 __
- $a ABA008 $b sig $c sign $y - $z 0
- 990 __
- $a 20241015 $b ABA008
- 991 __
- $a 20241024111048 $b ABA008
- 999 __
- $a ok $b bmc $g 2201635 $s 1230862
- BAS __
- $a 3
- BAS __
- $a PreBMC-MEDLINE
- BMC __
- $a 2024 $b 24 $c 1 $d 210 $e 20240918 $i 1471-2288 $m BMC medical research methodology $n BMC Med Res Methodol $x MED00006775
- GRA __
- $a CA17117 $p COST Action EVBRES
- GRA __
- $a CA17117 $p COST Action EVBRES
- GRA __
- $a SC17-012 $p Gesellschaft für Forschungsförderung Niederösterreich m.b.H.
- LZP __
- $a Pubmed-20241015