• Something wrong with this record ?

An exploration of available methods and tools to improve the efficiency of systematic review production: a scoping review

L. Affengruber, MM. van der Maten, I. Spiero, B. Nussbaumer-Streit, M. Mahmić-Kaknjo, ME. Ellen, K. Goossen, L. Kantorova, L. Hooft, N. Riva, G. Poulentzas, PN. Lalagkas, AG. Silva, M. Sassano, R. Sfetcu, ME. Marqués, T. Friessova, E. Baladia,...

. 2024 ; 24 (1) : 210. [pub] 20240918

Language English Country England, Great Britain

Document type Journal Article, Review

Grant support
CA17117 COST Action EVBRES
CA17117 COST Action EVBRES
SC17-012 Gesellschaft für Forschungsförderung Niederösterreich m.b.H.

BACKGROUND: Systematic reviews (SRs) are time-consuming and labor-intensive to perform. With the growing number of scientific publications, the SR development process becomes even more laborious. This is problematic because timely SR evidence is essential for decision-making in evidence-based healthcare and policymaking. Numerous methods and tools that accelerate SR development have recently emerged. To date, no scoping review has been conducted to provide a comprehensive summary of methods and ready-to-use tools to improve efficiency in SR production. OBJECTIVE: To present an overview of primary studies that evaluated the use of ready-to-use applications of tools or review methods to improve efficiency in the review process. METHODS: We conducted a scoping review. An information specialist performed a systematic literature search in four databases, supplemented with citation-based and grey literature searching. We included studies reporting the performance of methods and ready-to-use tools for improving efficiency when producing or updating a SR in the health field. We performed dual, independent title and abstract screening, full-text selection, and data extraction. The results were analyzed descriptively and presented narratively. RESULTS: We included 103 studies: 51 studies reported on methods, 54 studies on tools, and 2 studies reported on both methods and tools to make SR production more efficient. A total of 72 studies evaluated the validity (n = 69) or usability (n = 3) of one method (n = 33) or tool (n = 39), and 31 studies performed comparative analyses of different methods (n = 15) or tools (n = 16). 20 studies conducted prospective evaluations in real-time workflows. Most studies evaluated methods or tools that aimed at screening titles and abstracts (n = 42) and literature searching (n = 24), while for other steps of the SR process, only a few studies were found. Regarding the outcomes included, most studies reported on validity outcomes (n = 84), while outcomes such as impact on results (n = 23), time-saving (n = 24), usability (n = 13), and cost-saving (n = 3) were less often evaluated. CONCLUSION: For title and abstract screening and literature searching, various evaluated methods and tools are available that aim at improving the efficiency of SR production. However, only few studies have addressed the influence of these methods and tools in real-world workflows. Few studies exist that evaluate methods or tools supporting the remaining tasks. Additionally, while validity outcomes are frequently reported, there is a lack of evaluation regarding other outcomes.

Amsterdam UMC University of Amsterdam Medical Library Amsterdam Public Health Amsterdam the Netherlands

Cochrane Austria Department for Evidence Based Medicine and Clinical Epidemiology University for Continuing Education Krems Krems an der Donau Austria

Cochrane Netherlands Julius Center for Health Sciences and Primary Care University Medical Center Utrecht Utrecht University Utrecht the Netherlands

Czech National Centre for Evidence Based Healthcare and Knowledge Translation Institute of Biostatistics and Analyses Faculty of Medicine Masaryk University Brno Czech Republic

Department of Health Policy and Management Guilford Glazer Faculty of Business and Management and Faculty of Health Sciences Ben Gurion University of the Negev Beer Sheva Israel

Department of Health Sciences Faculty of Medicine Masaryk University Brno Czech Republic

Department of Medical and Surgical Sciences University of Bologna Bologna Italy

Department of Pathology Faculty of Medicine and Surgery University of Malta Msida Malta

Institute of Health Policy Management and Evaluation Dalla Lana School Of Public Health University of Toronto Toronto Canada

Julius Center for Health Sciences and Primary Care University Medical Center Utrecht Utrecht University Utrecht the Netherlands

Knowledge Institute of Federation of Medical Specialists Utrecht The Netherlands

Laboratory of Hygiene and Environmental Protection Department of Medicine Democritus University of Thrace Alexandroupolis Greece

McMaster Health Forum McMaster University Hamilton Canada

National Institute for Health Services Management Bucharest Romania

Red de Nutrición Basada en La Evidencia Academia Española de Nutrición y Dietética Pamplona Spain

RTI International Center for Public Health Methods Research Triangle Park Durham NC USA

School for Public Health and Primary Care Maastricht University Maastricht the Netherlands

Section of Hygiene University Department of Life Sciences and Public Health Università Cattolica del Sacro Cuore Rome Italy

Spiru Haret University Faculty of Psychology and Educational Sciences Bucharest Romania

Techné Research Group Department of Knowledge Engineering of the Faculty of Science University of Granada Granada Spain

University of Aveiro Campus Universitário de Santiago Aveiro Portugal

Witten Herdecke University Institute for Research in Operative Medicine Cologne Germany

Zenica Cantonal Hospital Department for Clinical Pharmacology Zenica Bosnia and Herzegovina

References provided by Crossref.org

000      
00000naa a2200000 a 4500
001      
bmc24018889
003      
CZ-PrNML
005      
20241024111054.0
007      
ta
008      
241015s2024 enk f 000 0|eng||
009      
AR
024    7_
$a 10.1186/s12874-024-02320-4 $2 doi
035    __
$a (PubMed)39294580
040    __
$a ABA008 $b cze $d ABA008 $e AACR2
041    0_
$a eng
044    __
$a enk
100    1_
$a Affengruber, Lisa $u Cochrane Austria, Department for Evidence-Based Medicine and Clinical Epidemiology, University for Continuing Education Krems, Krems an der Donau, Austria. lisa.affengruber@donau-uni.ac.at $u School for Public Health and Primary Care (CAPHRI), Maastricht University, Maastricht, the Netherlands. lisa.affengruber@donau-uni.ac.at
245    13
$a An exploration of available methods and tools to improve the efficiency of systematic review production: a scoping review / $c L. Affengruber, MM. van der Maten, I. Spiero, B. Nussbaumer-Streit, M. Mahmić-Kaknjo, ME. Ellen, K. Goossen, L. Kantorova, L. Hooft, N. Riva, G. Poulentzas, PN. Lalagkas, AG. Silva, M. Sassano, R. Sfetcu, ME. Marqués, T. Friessova, E. Baladia, AM. Pezzullo, P. Martinez, G. Gartlehner, R. Spijker
520    9_
$a BACKGROUND: Systematic reviews (SRs) are time-consuming and labor-intensive to perform. With the growing number of scientific publications, the SR development process becomes even more laborious. This is problematic because timely SR evidence is essential for decision-making in evidence-based healthcare and policymaking. Numerous methods and tools that accelerate SR development have recently emerged. To date, no scoping review has been conducted to provide a comprehensive summary of methods and ready-to-use tools to improve efficiency in SR production. OBJECTIVE: To present an overview of primary studies that evaluated the use of ready-to-use applications of tools or review methods to improve efficiency in the review process. METHODS: We conducted a scoping review. An information specialist performed a systematic literature search in four databases, supplemented with citation-based and grey literature searching. We included studies reporting the performance of methods and ready-to-use tools for improving efficiency when producing or updating a SR in the health field. We performed dual, independent title and abstract screening, full-text selection, and data extraction. The results were analyzed descriptively and presented narratively. RESULTS: We included 103 studies: 51 studies reported on methods, 54 studies on tools, and 2 studies reported on both methods and tools to make SR production more efficient. A total of 72 studies evaluated the validity (n = 69) or usability (n = 3) of one method (n = 33) or tool (n = 39), and 31 studies performed comparative analyses of different methods (n = 15) or tools (n = 16). 20 studies conducted prospective evaluations in real-time workflows. Most studies evaluated methods or tools that aimed at screening titles and abstracts (n = 42) and literature searching (n = 24), while for other steps of the SR process, only a few studies were found. Regarding the outcomes included, most studies reported on validity outcomes (n = 84), while outcomes such as impact on results (n = 23), time-saving (n = 24), usability (n = 13), and cost-saving (n = 3) were less often evaluated. CONCLUSION: For title and abstract screening and literature searching, various evaluated methods and tools are available that aim at improving the efficiency of SR production. However, only few studies have addressed the influence of these methods and tools in real-world workflows. Few studies exist that evaluate methods or tools supporting the remaining tasks. Additionally, while validity outcomes are frequently reported, there is a lack of evaluation regarding other outcomes.
650    _2
$a lidé $7 D006801
650    _2
$a výzkumný projekt $7 D012107
650    12
$a systematický přehled jako téma $x metody $7 D000078202
655    _2
$a časopisecké články $7 D016428
655    _2
$a přehledy $7 D016454
700    1_
$a van der Maten, Miriam M $u Knowledge Institute of Federation of Medical Specialists, Utrecht, The Netherlands $u Cochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
700    1_
$a Spiero, Isa $u Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
700    1_
$a Nussbaumer-Streit, Barbara $u Cochrane Austria, Department for Evidence-Based Medicine and Clinical Epidemiology, University for Continuing Education Krems, Krems an der Donau, Austria
700    1_
$a Mahmić-Kaknjo, Mersiha $u Zenica Cantonal Hospital, Department for Clinical Pharmacology, Zenica, Bosnia and Herzegovina
700    1_
$a Ellen, Moriah E $u Department of Health Policy and Management, Guilford Glazer Faculty of Business and Management and Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer-Sheva, Israel $u Institute of Health Policy Management and Evaluation, Dalla Lana School Of Public Health, University of Toronto, Toronto, Canada $u McMaster Health Forum, McMaster University, Hamilton, Canada
700    1_
$a Goossen, Käthe $u Witten/Herdecke University, Institute for Research in Operative Medicine (IFOM), Cologne, Germany
700    1_
$a Kantorova, Lucia $u Czech National Centre for Evidence-Based Healthcare and Knowledge Translation (Cochrane Czech Republic, Czech CEBHC: JBI Centre of Excellence, Masaryk University GRADE Centre), Institute of Biostatistics and Analyses, Faculty of Medicine, Masaryk University, Brno, Czech Republic
700    1_
$a Hooft, Lotty $u Cochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
700    1_
$a Riva, Nicoletta $u Department of Pathology, Faculty of Medicine and Surgery, University of Malta, Msida, Malta
700    1_
$a Poulentzas, Georgios $u Laboratory of Hygiene and Environmental Protection, Department of Medicine, Democritus University of Thrace, Alexandroupolis, Greece
700    1_
$a Lalagkas, Panagiotis Nikolaos $u Laboratory of Hygiene and Environmental Protection, Department of Medicine, Democritus University of Thrace, Alexandroupolis, Greece
700    1_
$a Silva, Anabela G $u CINTESIS.RISE@UA, University of Aveiro, Campus Universitário de Santiago, Aveiro, Portugal
700    1_
$a Sassano, Michele $u Section of Hygiene, University Department of Life Sciences and Public Health, Università Cattolica del Sacro Cuore, Rome, Italy $u Department of Medical and Surgical Sciences, University of Bologna, Bologna, Italy
700    1_
$a Sfetcu, Raluca $u National Institute for Health Services Management, Bucharest, Romania $u Spiru Haret University, Faculty of Psychology and Educational Sciences, Bucharest, Romania
700    1_
$a Marqués, María E $u Red de Nutrición Basada en La Evidencia, Academia Española de Nutrición y Dietética, Pamplona, Spain
700    1_
$a Friessova, Tereza $u Department of Health Sciences, Faculty of Medicine, Masaryk University, Brno, Czech Republic
700    1_
$a Baladia, Eduard $u Red de Nutrición Basada en La Evidencia, Academia Española de Nutrición y Dietética, Pamplona, Spain
700    1_
$a Pezzullo, Angelo Maria $u Section of Hygiene, University Department of Life Sciences and Public Health, Università Cattolica del Sacro Cuore, Rome, Italy
700    1_
$a Martinez, Patricia $u Red de Nutrición Basada en La Evidencia, Academia Española de Nutrición y Dietética, Pamplona, Spain $u Techné Research Group, Department of Knowledge Engineering of the Faculty of Science, University of Granada, Granada, Spain
700    1_
$a Gartlehner, Gerald $u Cochrane Austria, Department for Evidence-Based Medicine and Clinical Epidemiology, University for Continuing Education Krems, Krems an der Donau, Austria $u RTI International, Center for Public Health Methods, Research Triangle Park, Durham, NC, USA
700    1_
$a Spijker, René $u Cochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands $u Amsterdam UMC, University of Amsterdam, Medical Library, Amsterdam Public Health, Amsterdam, the Netherlands
773    0_
$w MED00006775 $t BMC medical research methodology $x 1471-2288 $g Roč. 24, č. 1 (2024), s. 210
856    41
$u https://pubmed.ncbi.nlm.nih.gov/39294580 $y Pubmed
910    __
$a ABA008 $b sig $c sign $y - $z 0
990    __
$a 20241015 $b ABA008
991    __
$a 20241024111048 $b ABA008
999    __
$a ok $b bmc $g 2201635 $s 1230862
BAS    __
$a 3
BAS    __
$a PreBMC-MEDLINE
BMC    __
$a 2024 $b 24 $c 1 $d 210 $e 20240918 $i 1471-2288 $m BMC medical research methodology $n BMC Med Res Methodol $x MED00006775
GRA    __
$a CA17117 $p COST Action EVBRES
GRA    __
$a CA17117 $p COST Action EVBRES
GRA    __
$a SC17-012 $p Gesellschaft für Forschungsförderung Niederösterreich m.b.H.
LZP    __
$a Pubmed-20241015

Find record

Citation metrics

Loading data ...

Archiving options

Loading data ...