What are the effects of teaching Evidence-Based Health Care (EBHC) at different levels of health professions education? An updated overview of systematic reviews
Language English Country United States Media electronic-ecollection
Document type Journal Article, Research Support, Non-U.S. Gov't, Systematic Review
Grant support
G0901530
Medical Research Council - United Kingdom
PubMed
34292986
PubMed Central
PMC8297776
DOI
10.1371/journal.pone.0254191
PII: PONE-D-21-06471
Knihovny.cz E-resources
- MeSH
- Evidence-Based Practice education MeSH
- Humans MeSH
- Education, Medical * MeSH
- Systematic Reviews as Topic MeSH
- Learning * MeSH
- Health Personnel education MeSH
- Check Tag
- Humans MeSH
- Publication type
- Journal Article MeSH
- Research Support, Non-U.S. Gov't MeSH
- Systematic Review MeSH
BACKGROUND: Evidence-based healthcare (EBHC) knowledge and skills are recognised as core competencies of healthcare professionals worldwide, and teaching EBHC has been widely recommended as an integral part of their training. The objective of this overview of systematic reviews (SR) was to update evidence and assess the effects of various approaches for teaching evidence-based health care (EBHC) at undergraduate (UG) and postgraduate (PG) medical education (ME) level on changes in knowledge, skills, attitudes and behaviour. METHODS AND FINDINGS: This is an update of an overview that was published in 2014. The process followed standard procedures specified for the previous version of the overview, with a modified search. Searches were conducted in Epistemonikos for SRs published from 1 January 2013 to 27 October 2020 with no language restrictions. We checked additional sources for ongoing and unpublished SRs. Eligibility criteria included: SRs which evaluated educational interventions for teaching EBHC compared to no intervention or a different strategy were eligible. Two reviewers independently selected SRs, extracted data and evaluated quality using standardised instrument (AMSTAR2). The effects of strategies to teach EBHC were synthesized using a narrative approach. Previously published version of this overview included 16 SR, while the updated search identified six additional SRs. We therefore included a total of 22 SRs (with a total of 141 primary studies) in this updated overview. The SRs evaluated different educational interventions of varying duration, frequency, and format to teach various components of EBHC at different levels of ME (UG, PG, mixed). Most SRs assessed a range of EBHC related outcomes using a variety of assessment tools. Two SRs included randomised controlled trials (RCTs) only, while 20 reviews included RCTs and various types of non-RCTs. Diversity of study designs and teaching activities as well as aggregated findings at the SR level prevented comparisons of the effects of different techniques. In general, knowledge was improved across all ME levels for interventions compared to no intervention or pre-test scores. Skills improved in UGs, but less so in PGs and were less consistent in mixed populations. There were positive changes in behaviour among UGs and PGs, but not in mixed populations, with no consistent improvement in attitudes in any of the studied groups. One SR showed improved patient outcomes (based on non-randomised studies). Main limitations included: poor quality and reporting of SRs, heterogeneity of interventions and outcome measures, and short-term follow up. CONCLUSIONS: Teaching EBHC consistently improved EBHC knowledge and skills at all levels of ME and behaviour in UGs and PGs, but with no consistent improvement in attitudes towards EBHC, and little evidence of the long term influence on processes of care and patient outcomes. EBHC teaching and learning should be interactive, multifaceted, integrated into clinical practice, and should include assessments. STUDY REGISTRATION: The protocol for the original overview was developed and approved by Stellenbosch University Research Ethics Committee S12/10/262. UPDATE OF THE OVERVIEW: Young T, Rohwer A, Volmink J, Clarke M. What are the effects of teaching evidence-based health care (EBHC)? Overview of systematic reviews. PLoS One. 2014;9(1):e86706. doi: 10.1371/journal.pone.0086706.
Chair of Epidemiology and Preventive Medicine Jagiellonian University Medical College Krakow Poland
Department of Health Professions Azienda USL IRCCS di Reggio Emilia Reggio Emilia Italy
GIMBE Foundation Bologna Italy
University of Turku Department of Nursing Science Turku Finland
See more in PubMed
Djulbegovic B, Guyatt GH. Progress in evidence-based medicine: a quarter century on. Lancet. 2017;390(10092):415–23. doi: 10.1016/S0140-6736(16)31592-6 PubMed DOI
Greenhalgh T, Macfarlane F. Towards a competency grid for evidence-based practice. J Eval Clin Pract. 1997;3(2):161–5. doi: 10.1046/j.1365-2753.1997.00082.x PubMed DOI
Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, et al.. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet. 2010;376(9756):1923–58. doi: 10.1016/S0140-6736(10)61854-5 PubMed DOI
Glasziou P, Burls A, Gilbert R. Evidence based medicine and the medical curriculum. BMJ. 2008;337:a1253. doi: 10.1136/bmj.a1253 PubMed DOI
Glasziou PP, Sawicki PT, Prasad K, Montori VM, Care ISfE-BH. Not a medical course, but a life course. Academic medicine: journal of the Association of American Medical Colleges. 2011;86(11):e4. doi: 10.1097/ACM.0b013e3182320ec9 PubMed DOI
Dawes MG. On the need for evidence-based general and family practice. BMJ Evidence-Based Medicine. 1996;1(3):68.
Dawes M, Summerskill W, Glasziou P, Cartabellotta A, Martin J, Hopayian K, et al.. Sicily statement on evidence-based practice. BMC Med Educ. 2005;5(1):1. doi: 10.1186/1472-6920-5-1 PubMed DOI PMC
Rohwer A, Motaze NV, Rehfuess E, Young T. E-Learning of Evidence-Based Health Care (EBHC) in Healthcare Professionals: A Systematic Review. Campbell Systematic Reviews 2017: 4. Campbell Collaboration. 2017.
Larsen CM, Terkelsen AS, Carlsen A-MF, Kristensen HK. Methods for teaching evidence-based practice: a scoping review. BMC Med Educ. 2019;19(1):259. doi: 10.1186/s12909-019-1681-0 PubMed DOI PMC
Skela-Savič B, Gotlib J, Panczyk M, Patelarou AE, Bole U, Ramos-Morcillo AJ, et al.. Teaching evidence-based practice (EBP) in nursing curricula in six European countries-A descriptive study. Nurse Educ Today. 2020;94:104561. doi: 10.1016/j.nedt.2020.104561 PubMed DOI
Khan KS, Coomarasamy A. A hierarchy of effective teaching and learning to acquire competence in evidenced-based medicine. BMC Med Educ. 2006;6(1):59. doi: 10.1186/1472-6920-6-59 PubMed DOI PMC
Coomarasamy A, Khan KS. What is the evidence that postgraduate teaching in evidence based medicine changes anything? A systematic review. BMJ. 2004;329(7473):1017. doi: 10.1136/bmj.329.7473.1017 PubMed DOI PMC
Kyriakoulis K, Patelarou A, Laliotis A, Wan AC, Matalliotakis M, Tsiou C, et al.. Educational strategies for teaching evidence-based practice to undergraduate health students: systematic review. J Educ Eval Health Prof. 2016;13. doi: 10.3352/jeehp.2016.13.13 PubMed DOI PMC
Patelarou AE, Mechili EA, Ruzafa-Martinez M, Dolezel J, Gotlib J, Skela-Savič B, et al.. Educational Interventions for Teaching Evidence-Based Practice to Undergraduate Nursing Students: A Scoping Review. International Journal of Environmental Research and Public Health. 2020;17(17):6351. doi: 10.3390/ijerph17176351 PubMed DOI PMC
Sackett DL, Rosenberg WM, Gray JM, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn’t. BMJ. 1996;312(7023):71. doi: 10.1136/bmj.312.7023.71 PubMed DOI PMC
Sackett DL, Straus SE, Richardson WS. Evidence-based medicine: how to practice and teach EBM. Edinburgh: Churchill Livingstone; 2000.
Scurlock-Evans L, Upton P, Rouse J, Upton D. To embed or not to embed? A longitudinal study exploring the impact of curriculum design on the evidence-based practice profiles of UK pre-registration nursing students. Nurse Educ Today. 2017;58:12–8. doi: 10.1016/j.nedt.2017.07.011 PubMed DOI
Johnson N, List-Ivankovic J, Eboh W, Ireland J, Adams D, Mowatt E, et al.. Research and evidence based practice: Using a blended approach to teaching and learning in undergraduate nurse education. Nurse Educ Pract. 2010;10(1):43–7. doi: 10.1016/j.nepr.2009.03.012 PubMed DOI
Aglen B. Pedagogical strategies to teach bachelor students evidence-based practice: A systematic review. Nurse Educ Today. 2016;36:255–63. doi: 10.1016/j.nedt.2015.08.025 PubMed DOI
Thomas A, Saroyan A, Dauphinee WD. Evidence-based practice: a review of theoretical assumptions and effectiveness of teaching and assessment interventions in health professions. Adv Health Sci Educ Theory Pract. 2011;16(2):253–76. PubMed
Young T, Rohwer A, Volmink J, Clarke M. What are the effects of teaching evidence-based health care (EBHC)? Overview of systematic reviews. PloS One. 2014;9(1):e86706. doi: 10.1371/journal.pone.0086706 PubMed DOI PMC
Kogan R, Shea A. Course evaluation in medical education. Teach Teach Educ. 2007;23:251–64.
Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097. doi: 10.1371/journal.pmed.1000097 PubMed DOI PMC
Campbell M, McKenzie JE, Sowden A, Katikireddi SV, Brennan SE, Ellis S, et al.. Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline. BMJ. 2020;368:l6890. doi: 10.1136/bmj.l6890 PubMed DOI PMC
Shea BJ, Reeves BC, Wells G, Thuku M, Hamel C, Moran J, et al.. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ. 2017;358:j4008. doi: 10.1136/bmj.j4008 PubMed DOI PMC
Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, et al.. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC medical research methodology. 2007;7:10. doi: 10.1186/1471-2288-7-10 PubMed DOI PMC
Pollock M FR, Becker LA, Pieper D, Hartling L. Overviews of Reviews. 2021. In: Cochrane Handbook for Systematic Reviews of Interventions version 62 (updated February 2021) [Internet]. Available from www.training.cochrane.org/handbook: Cochrane.
Horsley T, Hyde C, Santesso N, Parkes J, Milne R, Stewart R. Teaching critical appraisal skills in healthcare settings. The Cochrane database of systematic reviews. 2011(11). doi: 10.1002/14651858.CD001270.pub2 PubMed DOI PMC
Fiander M, McGowan J, Grad R, Pluye P, Hannes K, Labrecque M, et al.. Interventions to increase the use of electronic health information by healthcare practitioners to improve clinical practice and patient outcomes. The Cochrane database of systematic reviews. 2015;3(3). doi: 10.1002/14651858.CD004749.pub3 PubMed DOI PMC
Ahmadi SF, Baradaran HR, Ahmadi E. Effectiveness of teaching evidence-based medicine to undergraduate medical students: A BEME systematic review. Med Teach. 2015;37(1):1–10. doi: 10.3109/0142159X.2014.947925 PubMed DOI
Baradaran H AS-F, Ahmadi E Teaching evidence-based medicine to undergraduate medical students: A systematic review and meta-analysis. (under peer review with Best Evidence Medical Education (BEME)). 2013.
Ahmadi N, McKenzie ME, Maclean A, Brown CJ, Mastracci T, McLeod RS. Teaching evidence based medicine to surgery residents-is journal club the best format? A systematic review of the literature. Journal of surgical education. 2012;69(1):91–100. doi: 10.1016/j.jsurg.2011.07.004 PubMed DOI
Audet N, Gagnon R, Ladouceur R, Marcil M. L’enseignement de l’analyse critique des publications scientifiques médicales est-il efficace? Révision des études et de leur qualité méthodologique. CMAJ: Canadian Medical Association journal = journal de l’Association medicale canadienne. 1993;148(6):945–52. PubMed PMC
Deenadayalan Y, Grimmer-Somers K, Prior M, Kumar S. How to run an effective journal club: a systematic review. J Eval Clin Pract. 2008;14(5):898–911. doi: 10.1111/j.1365-2753.2008.01050.x PubMed DOI
Ebbert JO, Montori VM, Schultz HJ. The journal club in postgraduate medical education: a systematic review. Med Teach. 2001;23(5):455–61. doi: 10.1080/01421590120075670 PubMed DOI
Flores-Mateo G, Argimon JM. Evidence based practice in postgraduate healthcare education: a systematic review. BMC health services research. 2007;7:119. doi: 10.1186/1472-6963-7-119 PubMed DOI PMC
Green ML. Graduate medical education training in clinical epidemiology, critical appraisal, and evidence-based medicine: a critical review of curricula. Academic medicine: journal of the Association of American Medical Colleges. 1999;74(6):686–94. PubMed
Harris J, Kearley K, Heneghan C, Meats E, Roberts N, Perera R, et al.. Are journal clubs effective in supporting evidence-based decision making? A systematic review. BEME Guide No. 16. Med Teach. 2011;33(1):9–23. doi: 10.3109/0142159X.2011.530321 PubMed DOI
Hyde C, Parkes J, Deeks J, Milne R. Systematic Review Of Effectiveness Of Teaching—Critical Appraisal. ICRF/NHS Centre for Statistics in Medicine. 2000.
Ilic D. Teaching evidence-based practice: perspectives from the undergraduate and post-graduate viewpoint. Annals of the Academy of Medicine, Singapore. 2009;38(6):559–63. PubMed
Norman GR, Shannon SI. Effectiveness of instruction in critical appraisal (evidence-based medicine) skills: a critical appraisal. CMAJ: Canadian Medical Association journal = journal de l’Association medicale canadienne. 1998;158(2):177–81. PubMed PMC
Wong S, McEvoy M, Wiles L, Lewis L. Magnitude of change in outcomes following entry-level evidence-based practice training: a systematic review. Int J Evid Based Healthc. 2013;4:107–14.
Horsley T, O’Neill J, McGowan J, Perrier L, Kane G, Campbell C. Interventions to improve question formulation in professional practice and self-directed learning. The Cochrane database of systematic reviews. 2010(5):Cd007335. doi: 10.1002/14651858.CD007335.pub2 PubMed DOI
Taylor R, Reeves B, Ewings P, Binns S, Keast J, Mears R. A systematic review of the effectiveness of critical appraisal skills training for clinicians. Medical education. 2000;34(2):120–5. doi: 10.1046/j.1365-2923.2000.00574.x PubMed DOI
Hecht L, Buhse S, Meyer G. Effectiveness of training in evidence-based medicine skills for healthcare professionals: a systematic review. BMC Med Educ. 2016;16(1):103. doi: 10.1186/s12909-016-0616-2 PubMed DOI PMC
Hines S, Ramsbotham J, Coyer F. Interventions for improving the research literacy of nurses: a systematic review. JBI Database System Rev Implement Rep. 2016;14(2):256–94. doi: 10.11124/jbisrir-2016-2378 PubMed DOI
Ramis MA, Chang A, Conway A, Lim D, Munday J, Nissen L. Theory-based strategies for teaching evidence-based practice to undergraduate health students: a systematic review. BMC Med Educ. 2019;19(1):267. doi: 10.1186/s12909-019-1698-4 PubMed DOI PMC
Wu Y, Brettle A, Zhou C, Ou J, Wang Y, Wang S. Do educational interventions aimed at nurses to support the implementation of evidence-based practice improve patient outcomes? A systematic review. Nurse Educ Today. 2018;70:109–14. doi: 10.1016/j.nedt.2018.08.026 PubMed DOI
Ray A. Is the teaching of literature searching skills for medical students (undergraduates) an effective educational intervention to change their knowledge and skills (title registered with Best Evidence Medical Education (BEME) Collaboration). BEME. 2013.
Burls A. An evaluation of the impact of half-day workshops teaching critical appraisal skills 1997.
Powell J. A systematic review of journal club as a method for teaching critical appraisal in health care settings for evidence based health care decision making.
James C, Corral J, Daniel M, Erinc A, Mattick K, Smith E, et al. Teaching residents evidence-based medicine: a realist review of what works, for whom, and under what circumstances https://bemecollaboration.org/Reviews+In+Progress/Teaching+residents+evidence-based+medicine/: The BEME Collaboration; [
Pussegoda K, Turner L, Garritty C, Mayhew A, Skidmore B, Stevens A, et al.. Systematic review adherence to methodological or reporting quality. Syst Rev. 2017;6(1):1–14. doi: 10.1186/s13643-016-0385-3 PubMed DOI PMC
Albarqouni L, Hoffmann T, Glasziou P. Evidence-based practice educational intervention studies: a systematic review of what is taught and how it is measured. BMC Med Educ. 2018;18(1):177. doi: 10.1186/s12909-018-1284-1 PubMed DOI PMC
Kumaravel B, Hearn JH, Jahangiri L, Pollard R, Stocker CJ, Nunan D. A systematic review and taxonomy of tools for evaluating evidence-based medicine teaching in medical education. Syst Rev. 2020;9:1–12. doi: 10.1186/s13643-019-1259-2 PubMed DOI PMC
Kirpatrick D. Techniques for evaluating training programs. Journal of the American Society for Training and Development. 1959;13(11):3–9.
Jordan Z, Munn Z, Aromataris E, Lockwood C. Now that we’re here, where are we? The JBI approach to evidence-based healthcare 20 years on. Int J Evid Based Healthc. 2015;13(3):117–20. doi: 10.1097/XEB.0000000000000053 PubMed DOI
Phillips AC, Lewis LK, McEvoy MP, Galipeau J, Glasziou P, Moher D, et al.. Development and validation of the guideline for reporting evidence-based practice educational interventions and teaching (GREET). BMC Med Educ. 2016;16(1):237. doi: 10.1186/s12909-016-0759-1 PubMed DOI PMC
Fritsche L, Greenhalgh T, Falck-Ytter Y, Neumayer H, Kunz R. Do short courses in evidence based medicine improve knowledge and skills? Validation of Berlin questionnaire and before and after study of courses in evidence based medicine. BMJ. 2002;325(7376):1338–41. doi: 10.1136/bmj.325.7376.1338 PubMed DOI PMC
Ramos KD, Schafer S, Tracz SM. Validation of the Fresno test of competence in evidence based medicine. BMJ. 2003;326(7384):319–21. doi: 10.1136/bmj.326.7384.319 PubMed DOI PMC
Saunders H, Gallagher-Ford L, Kvist T, Vehviläinen-Julkunen K. Practicing healthcare professionals’ evidence-based practice competencies: An overview of systematic reviews. Worldviews on Evidence-Based Nursing. 2019;16(3):176–85. doi: 10.1111/wvn.12363 PubMed DOI