• This record comes from PubMed

What are the effects of teaching Evidence-Based Health Care (EBHC) at different levels of health professions education? An updated overview of systematic reviews

. 2021 ; 16 (7) : e0254191. [epub] 20210722

Language English Country United States Media electronic-ecollection

Document type Journal Article, Research Support, Non-U.S. Gov't, Systematic Review

Grant support
G0901530 Medical Research Council - United Kingdom

BACKGROUND: Evidence-based healthcare (EBHC) knowledge and skills are recognised as core competencies of healthcare professionals worldwide, and teaching EBHC has been widely recommended as an integral part of their training. The objective of this overview of systematic reviews (SR) was to update evidence and assess the effects of various approaches for teaching evidence-based health care (EBHC) at undergraduate (UG) and postgraduate (PG) medical education (ME) level on changes in knowledge, skills, attitudes and behaviour. METHODS AND FINDINGS: This is an update of an overview that was published in 2014. The process followed standard procedures specified for the previous version of the overview, with a modified search. Searches were conducted in Epistemonikos for SRs published from 1 January 2013 to 27 October 2020 with no language restrictions. We checked additional sources for ongoing and unpublished SRs. Eligibility criteria included: SRs which evaluated educational interventions for teaching EBHC compared to no intervention or a different strategy were eligible. Two reviewers independently selected SRs, extracted data and evaluated quality using standardised instrument (AMSTAR2). The effects of strategies to teach EBHC were synthesized using a narrative approach. Previously published version of this overview included 16 SR, while the updated search identified six additional SRs. We therefore included a total of 22 SRs (with a total of 141 primary studies) in this updated overview. The SRs evaluated different educational interventions of varying duration, frequency, and format to teach various components of EBHC at different levels of ME (UG, PG, mixed). Most SRs assessed a range of EBHC related outcomes using a variety of assessment tools. Two SRs included randomised controlled trials (RCTs) only, while 20 reviews included RCTs and various types of non-RCTs. Diversity of study designs and teaching activities as well as aggregated findings at the SR level prevented comparisons of the effects of different techniques. In general, knowledge was improved across all ME levels for interventions compared to no intervention or pre-test scores. Skills improved in UGs, but less so in PGs and were less consistent in mixed populations. There were positive changes in behaviour among UGs and PGs, but not in mixed populations, with no consistent improvement in attitudes in any of the studied groups. One SR showed improved patient outcomes (based on non-randomised studies). Main limitations included: poor quality and reporting of SRs, heterogeneity of interventions and outcome measures, and short-term follow up. CONCLUSIONS: Teaching EBHC consistently improved EBHC knowledge and skills at all levels of ME and behaviour in UGs and PGs, but with no consistent improvement in attitudes towards EBHC, and little evidence of the long term influence on processes of care and patient outcomes. EBHC teaching and learning should be interactive, multifaceted, integrated into clinical practice, and should include assessments. STUDY REGISTRATION: The protocol for the original overview was developed and approved by Stellenbosch University Research Ethics Committee S12/10/262. UPDATE OF THE OVERVIEW: Young T, Rohwer A, Volmink J, Clarke M. What are the effects of teaching evidence-based health care (EBHC)? Overview of systematic reviews. PLoS One. 2014;9(1):e86706. doi: 10.1371/journal.pone.0086706.

See more in PubMed

Djulbegovic B, Guyatt GH. Progress in evidence-based medicine: a quarter century on. Lancet. 2017;390(10092):415–23. doi: 10.1016/S0140-6736(16)31592-6 PubMed DOI

Greenhalgh T, Macfarlane F. Towards a competency grid for evidence-based practice. J Eval Clin Pract. 1997;3(2):161–5. doi: 10.1046/j.1365-2753.1997.00082.x PubMed DOI

Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, et al.. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet. 2010;376(9756):1923–58. doi: 10.1016/S0140-6736(10)61854-5 PubMed DOI

Glasziou P, Burls A, Gilbert R. Evidence based medicine and the medical curriculum. BMJ. 2008;337:a1253. doi: 10.1136/bmj.a1253 PubMed DOI

Glasziou PP, Sawicki PT, Prasad K, Montori VM, Care ISfE-BH. Not a medical course, but a life course. Academic medicine: journal of the Association of American Medical Colleges. 2011;86(11):e4. doi: 10.1097/ACM.0b013e3182320ec9 PubMed DOI

Dawes MG. On the need for evidence-based general and family practice. BMJ Evidence-Based Medicine. 1996;1(3):68.

Dawes M, Summerskill W, Glasziou P, Cartabellotta A, Martin J, Hopayian K, et al.. Sicily statement on evidence-based practice. BMC Med Educ. 2005;5(1):1. doi: 10.1186/1472-6920-5-1 PubMed DOI PMC

Rohwer A, Motaze NV, Rehfuess E, Young T. E-Learning of Evidence-Based Health Care (EBHC) in Healthcare Professionals: A Systematic Review. Campbell Systematic Reviews 2017: 4. Campbell Collaboration. 2017.

Larsen CM, Terkelsen AS, Carlsen A-MF, Kristensen HK. Methods for teaching evidence-based practice: a scoping review. BMC Med Educ. 2019;19(1):259. doi: 10.1186/s12909-019-1681-0 PubMed DOI PMC

Skela-Savič B, Gotlib J, Panczyk M, Patelarou AE, Bole U, Ramos-Morcillo AJ, et al.. Teaching evidence-based practice (EBP) in nursing curricula in six European countries-A descriptive study. Nurse Educ Today. 2020;94:104561. doi: 10.1016/j.nedt.2020.104561 PubMed DOI

Khan KS, Coomarasamy A. A hierarchy of effective teaching and learning to acquire competence in evidenced-based medicine. BMC Med Educ. 2006;6(1):59. doi: 10.1186/1472-6920-6-59 PubMed DOI PMC

Coomarasamy A, Khan KS. What is the evidence that postgraduate teaching in evidence based medicine changes anything? A systematic review. BMJ. 2004;329(7473):1017. doi: 10.1136/bmj.329.7473.1017 PubMed DOI PMC

Kyriakoulis K, Patelarou A, Laliotis A, Wan AC, Matalliotakis M, Tsiou C, et al.. Educational strategies for teaching evidence-based practice to undergraduate health students: systematic review. J Educ Eval Health Prof. 2016;13. doi: 10.3352/jeehp.2016.13.13 PubMed DOI PMC

Patelarou AE, Mechili EA, Ruzafa-Martinez M, Dolezel J, Gotlib J, Skela-Savič B, et al.. Educational Interventions for Teaching Evidence-Based Practice to Undergraduate Nursing Students: A Scoping Review. International Journal of Environmental Research and Public Health. 2020;17(17):6351. doi: 10.3390/ijerph17176351 PubMed DOI PMC

Sackett DL, Rosenberg WM, Gray JM, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn’t. BMJ. 1996;312(7023):71. doi: 10.1136/bmj.312.7023.71 PubMed DOI PMC

Sackett DL, Straus SE, Richardson WS. Evidence-based medicine: how to practice and teach EBM. Edinburgh: Churchill Livingstone; 2000.

Scurlock-Evans L, Upton P, Rouse J, Upton D. To embed or not to embed? A longitudinal study exploring the impact of curriculum design on the evidence-based practice profiles of UK pre-registration nursing students. Nurse Educ Today. 2017;58:12–8. doi: 10.1016/j.nedt.2017.07.011 PubMed DOI

Johnson N, List-Ivankovic J, Eboh W, Ireland J, Adams D, Mowatt E, et al.. Research and evidence based practice: Using a blended approach to teaching and learning in undergraduate nurse education. Nurse Educ Pract. 2010;10(1):43–7. doi: 10.1016/j.nepr.2009.03.012 PubMed DOI

Aglen B. Pedagogical strategies to teach bachelor students evidence-based practice: A systematic review. Nurse Educ Today. 2016;36:255–63. doi: 10.1016/j.nedt.2015.08.025 PubMed DOI

Thomas A, Saroyan A, Dauphinee WD. Evidence-based practice: a review of theoretical assumptions and effectiveness of teaching and assessment interventions in health professions. Adv Health Sci Educ Theory Pract. 2011;16(2):253–76. PubMed

Young T, Rohwer A, Volmink J, Clarke M. What are the effects of teaching evidence-based health care (EBHC)? Overview of systematic reviews. PloS One. 2014;9(1):e86706. doi: 10.1371/journal.pone.0086706 PubMed DOI PMC

Kogan R, Shea A. Course evaluation in medical education. Teach Teach Educ. 2007;23:251–64.

Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097. doi: 10.1371/journal.pmed.1000097 PubMed DOI PMC

Campbell M, McKenzie JE, Sowden A, Katikireddi SV, Brennan SE, Ellis S, et al.. Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline. BMJ. 2020;368:l6890. doi: 10.1136/bmj.l6890 PubMed DOI PMC

Shea BJ, Reeves BC, Wells G, Thuku M, Hamel C, Moran J, et al.. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ. 2017;358:j4008. doi: 10.1136/bmj.j4008 PubMed DOI PMC

Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, et al.. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC medical research methodology. 2007;7:10. doi: 10.1186/1471-2288-7-10 PubMed DOI PMC

Pollock M FR, Becker LA, Pieper D, Hartling L. Overviews of Reviews. 2021. In: Cochrane Handbook for Systematic Reviews of Interventions version 62 (updated February 2021) [Internet]. Available from www.training.cochrane.org/handbook: Cochrane.

Horsley T, Hyde C, Santesso N, Parkes J, Milne R, Stewart R. Teaching critical appraisal skills in healthcare settings. The Cochrane database of systematic reviews. 2011(11). doi: 10.1002/14651858.CD001270.pub2 PubMed DOI PMC

Fiander M, McGowan J, Grad R, Pluye P, Hannes K, Labrecque M, et al.. Interventions to increase the use of electronic health information by healthcare practitioners to improve clinical practice and patient outcomes. The Cochrane database of systematic reviews. 2015;3(3). doi: 10.1002/14651858.CD004749.pub3 PubMed DOI PMC

Ahmadi SF, Baradaran HR, Ahmadi E. Effectiveness of teaching evidence-based medicine to undergraduate medical students: A BEME systematic review. Med Teach. 2015;37(1):1–10. doi: 10.3109/0142159X.2014.947925 PubMed DOI

Baradaran H AS-F, Ahmadi E Teaching evidence-based medicine to undergraduate medical students: A systematic review and meta-analysis. (under peer review with Best Evidence Medical Education (BEME)). 2013.

Ahmadi N, McKenzie ME, Maclean A, Brown CJ, Mastracci T, McLeod RS. Teaching evidence based medicine to surgery residents-is journal club the best format? A systematic review of the literature. Journal of surgical education. 2012;69(1):91–100. doi: 10.1016/j.jsurg.2011.07.004 PubMed DOI

Audet N, Gagnon R, Ladouceur R, Marcil M. L’enseignement de l’analyse critique des publications scientifiques médicales est-il efficace? Révision des études et de leur qualité méthodologique. CMAJ: Canadian Medical Association journal = journal de l’Association medicale canadienne. 1993;148(6):945–52. PubMed PMC

Deenadayalan Y, Grimmer-Somers K, Prior M, Kumar S. How to run an effective journal club: a systematic review. J Eval Clin Pract. 2008;14(5):898–911. doi: 10.1111/j.1365-2753.2008.01050.x PubMed DOI

Ebbert JO, Montori VM, Schultz HJ. The journal club in postgraduate medical education: a systematic review. Med Teach. 2001;23(5):455–61. doi: 10.1080/01421590120075670 PubMed DOI

Flores-Mateo G, Argimon JM. Evidence based practice in postgraduate healthcare education: a systematic review. BMC health services research. 2007;7:119. doi: 10.1186/1472-6963-7-119 PubMed DOI PMC

Green ML. Graduate medical education training in clinical epidemiology, critical appraisal, and evidence-based medicine: a critical review of curricula. Academic medicine: journal of the Association of American Medical Colleges. 1999;74(6):686–94. PubMed

Harris J, Kearley K, Heneghan C, Meats E, Roberts N, Perera R, et al.. Are journal clubs effective in supporting evidence-based decision making? A systematic review. BEME Guide No. 16. Med Teach. 2011;33(1):9–23. doi: 10.3109/0142159X.2011.530321 PubMed DOI

Hyde C, Parkes J, Deeks J, Milne R. Systematic Review Of Effectiveness Of Teaching—Critical Appraisal. ICRF/NHS Centre for Statistics in Medicine. 2000.

Ilic D. Teaching evidence-based practice: perspectives from the undergraduate and post-graduate viewpoint. Annals of the Academy of Medicine, Singapore. 2009;38(6):559–63. PubMed

Norman GR, Shannon SI. Effectiveness of instruction in critical appraisal (evidence-based medicine) skills: a critical appraisal. CMAJ: Canadian Medical Association journal = journal de l’Association medicale canadienne. 1998;158(2):177–81. PubMed PMC

Wong S, McEvoy M, Wiles L, Lewis L. Magnitude of change in outcomes following entry-level evidence-based practice training: a systematic review. Int J Evid Based Healthc. 2013;4:107–14.

Horsley T, O’Neill J, McGowan J, Perrier L, Kane G, Campbell C. Interventions to improve question formulation in professional practice and self-directed learning. The Cochrane database of systematic reviews. 2010(5):Cd007335. doi: 10.1002/14651858.CD007335.pub2 PubMed DOI

Taylor R, Reeves B, Ewings P, Binns S, Keast J, Mears R. A systematic review of the effectiveness of critical appraisal skills training for clinicians. Medical education. 2000;34(2):120–5. doi: 10.1046/j.1365-2923.2000.00574.x PubMed DOI

Hecht L, Buhse S, Meyer G. Effectiveness of training in evidence-based medicine skills for healthcare professionals: a systematic review. BMC Med Educ. 2016;16(1):103. doi: 10.1186/s12909-016-0616-2 PubMed DOI PMC

Hines S, Ramsbotham J, Coyer F. Interventions for improving the research literacy of nurses: a systematic review. JBI Database System Rev Implement Rep. 2016;14(2):256–94. doi: 10.11124/jbisrir-2016-2378 PubMed DOI

Ramis MA, Chang A, Conway A, Lim D, Munday J, Nissen L. Theory-based strategies for teaching evidence-based practice to undergraduate health students: a systematic review. BMC Med Educ. 2019;19(1):267. doi: 10.1186/s12909-019-1698-4 PubMed DOI PMC

Wu Y, Brettle A, Zhou C, Ou J, Wang Y, Wang S. Do educational interventions aimed at nurses to support the implementation of evidence-based practice improve patient outcomes? A systematic review. Nurse Educ Today. 2018;70:109–14. doi: 10.1016/j.nedt.2018.08.026 PubMed DOI

Ray A. Is the teaching of literature searching skills for medical students (undergraduates) an effective educational intervention to change their knowledge and skills (title registered with Best Evidence Medical Education (BEME) Collaboration). BEME. 2013.

Burls A. An evaluation of the impact of half-day workshops teaching critical appraisal skills 1997.

Powell J. A systematic review of journal club as a method for teaching critical appraisal in health care settings for evidence based health care decision making.

James C, Corral J, Daniel M, Erinc A, Mattick K, Smith E, et al. Teaching residents evidence-based medicine: a realist review of what works, for whom, and under what circumstances https://bemecollaboration.org/Reviews+In+Progress/Teaching+residents+evidence-based+medicine/: The BEME Collaboration; [

Pussegoda K, Turner L, Garritty C, Mayhew A, Skidmore B, Stevens A, et al.. Systematic review adherence to methodological or reporting quality. Syst Rev. 2017;6(1):1–14. doi: 10.1186/s13643-016-0385-3 PubMed DOI PMC

Albarqouni L, Hoffmann T, Glasziou P. Evidence-based practice educational intervention studies: a systematic review of what is taught and how it is measured. BMC Med Educ. 2018;18(1):177. doi: 10.1186/s12909-018-1284-1 PubMed DOI PMC

Kumaravel B, Hearn JH, Jahangiri L, Pollard R, Stocker CJ, Nunan D. A systematic review and taxonomy of tools for evaluating evidence-based medicine teaching in medical education. Syst Rev. 2020;9:1–12. doi: 10.1186/s13643-019-1259-2 PubMed DOI PMC

Kirpatrick D. Techniques for evaluating training programs. Journal of the American Society for Training and Development. 1959;13(11):3–9.

Jordan Z, Munn Z, Aromataris E, Lockwood C. Now that we’re here, where are we? The JBI approach to evidence-based healthcare 20 years on. Int J Evid Based Healthc. 2015;13(3):117–20. doi: 10.1097/XEB.0000000000000053 PubMed DOI

Phillips AC, Lewis LK, McEvoy MP, Galipeau J, Glasziou P, Moher D, et al.. Development and validation of the guideline for reporting evidence-based practice educational interventions and teaching (GREET). BMC Med Educ. 2016;16(1):237. doi: 10.1186/s12909-016-0759-1 PubMed DOI PMC

Fritsche L, Greenhalgh T, Falck-Ytter Y, Neumayer H, Kunz R. Do short courses in evidence based medicine improve knowledge and skills? Validation of Berlin questionnaire and before and after study of courses in evidence based medicine. BMJ. 2002;325(7376):1338–41. doi: 10.1136/bmj.325.7376.1338 PubMed DOI PMC

Ramos KD, Schafer S, Tracz SM. Validation of the Fresno test of competence in evidence based medicine. BMJ. 2003;326(7384):319–21. doi: 10.1136/bmj.326.7384.319 PubMed DOI PMC

Saunders H, Gallagher-Ford L, Kvist T, Vehviläinen-Julkunen K. Practicing healthcare professionals’ evidence-based practice competencies: An overview of systematic reviews. Worldviews on Evidence-Based Nursing. 2019;16(3):176–85. doi: 10.1111/wvn.12363 PubMed DOI

Find record

Citation metrics

Logged in users only

Archiving options

Loading data ...