BACKGROUND: An international comparison of health system performance is a popular tool of health policy analysis. However, the efficiency evaluation of health systems is a practical example of an international comparison in which non-homogeneity is expected. The objective of this paper is to evaluate the efficiency of health systems by models in which a degree of non-homogeneity among countries is considered. METHODS: We study the problem of non-homogeneity of health systems in the theoretical framework of the data envelopment analysis (DEA), which is a popular method of efficiency evaluation with hundreds of applications from various fields. DEA assume the homogeneity of production units and the homogeneity of the environment in which the production units operate. Hence, we compiled a summary of 14 recommendations on how to deal with the non-homogeneity in the DEA models. The analysed sample includes 38 OECD member countries. The data are from the year 2019. RESULTS: As an example, we evaluated the health system efficiency of the Czech Republic. We used the DEA models with the neighbourhood measure of distance and the constraint limiting the comparison of countries with different levels of economic development. The health system inputs were the numbers of physicians, nurses, and hospital beds. In the production of the intermediate outputs (doctor consultations, inpatient care discharges), the Czech Republic should look at Poland, Slovakia and Slovenia. In the production of health outcomes (life expectancy), the peer countries are France, Italy and Switzerland. CONCLUSIONS: The results of the DEA analysis are only indicative because no single analytical method can determine whether a health system is better or worse than others. We need to combine different methods, and DEA is one of them. We consider DEA as an exploratory method, not a method providing definitive answers.

Faculty of Statistics and Informatics Prague University of Economics and Business Prague Czech Republic

Zobrazit více v PubMed

WHO. The World Health Report . Health Systems: Improving Performance. Geneva: World Health Organization; 2000. p. 2000.

WHO. Regional Office for Europe. Case studies on health system performance assessment: a long-standing development in Europe. World Health Organization. Regional Office for Europe; 2012. https://apps.who.int/iris/handle/10665/350279.

Smith PC, Mossialos E, Papanicolas I, Leatherman S., editors. Performance Measurement for Health System Improvement: Experiences, Challenges and Prospects. Cambridge: Cambridge University Press; 2009.

Rechel B, Maresso A, van Ginneken E. Health Systems in Transition: Template for Authors. Copenhagen: WHO Regional Office for Europe; 2019.

Papanicolas I, Rajan D, Karanikolos M, et al. Health system performance assessment: a framework for policy analysis. World Health Organization; 2022. PubMed

OECD . Health at a Glance: Europe 2022: State of Health in the EU Cycle. Paris: OECD Publishing; 2022.

European Commission, Directorate-General for Health and Food Safety. Tools and methodologies to assess the efficiency of health care services in Europe: an overview of current approaches and opportunities for improvement. Report by the Expert Group on Health System Performance Assessment. Luxembourg: Publications Office of the European Union; 2019. https://data.europa.eu/doi/10.2875/346480 DOI

Mackenbach JP, McKee M. A comparative analysis of health policy performance in 43 European countries. Eur J Public Health. 2013;23:195–201. doi: 10.1093/eurpub/cks192. PubMed DOI

Devos C, Cordon A, Lefèvre M, et al. Performance of the Belgian health system – Report 2019. Brussels: Belgian Health Care Knowledge Centre (KCE); 2019.

Schütte S, Acevedo PN, Flahault A. Health systems around the world – a comparison of existing health system rankings. J Global Health. 2018;8(1):010407. doi: 10.7189/jogh.08-010407. PubMed DOI PMC

Asandului L, Roman M, Fatulescu P. The efficiency of healthcare systems in Europe: a data envelopment analysis approach. Proc Econ Finance. 2014;31(10):261–268. doi: 10.1016/S2212-5671(14)00301-3. DOI

Schneider EC, Shah A, Doty MM, et al. Mirror, Mirror 2021: reflecting poorly: health care in the US compared to other high-income countries. The Commonwealth Fund; 2021. 10.26099/01dv-h208

Cetin VR, Bahce S. Measuring the efficiency of health systems of OECD countries by data envelopment analysis. Appl Econ. 2016;48(37):3497–3507. doi: 10.1080/00036846.2016.1139682. DOI

Health Consumer Powerhouse. Euro Health Consumer Index 2018. Health Consumer Powerhouse Ltd.; 2019.

Mbau R, Musiega A, Nyawira L, Tsofa B, Mulwa A, Molyneux S, Maina I, Jemutai J, Normand C, Hanson K, Barasa E. Analysing the efficiency of health systems: a systematic review of the literature. Appl Health Econ Health Pol. 2022;21(2):205–224. doi: 10.1007/s40258-022-00785-2. PubMed DOI PMC

Emrouznejad A, Yang G. A survey and analysis of the first 40 years of scholarly literature in DEA: 1978–2016. Soc Econ Plann Sci. 2018;61:4–8. doi: 10.1016/j.seps.2017.01.008. DOI

Charnes A, Cooper WW, Rhodes E. Measuring the efficiency of decision making units. Eur J Oper Res. 1978;2(6):429–444. doi: 10.1016/0377-2217(78)90138-8. DOI

Kumbhakar SC, Lovell CAK. Stochastic frontier analysis. Cambridge: Cambridge University Press; 2000.

Banker RD, Charnes A, Cooper WW. Some models for estimating technical and scale inefficiencies in data envelopment analysis. Manag Sci. 1984;30(9):1078–1092. doi: 10.1287/mnsc.30.9.1078. DOI

Cooper WW, Seiford LM, Tone K. Introduction to data envelopment analysis and its uses: With Dea-Solver software and references. Springer; 2006.

Cooper WW, Seiford LM, Zhu J. Handbook on Data Envelopment Analysis. Kluwer Academic; 2004.

Thanassoulis E. Introduction to the Theory and Application of Data Envelopment Analysis. Norwell: Kluwer Academic Publishers; 2001.

Dyson RG, Allen R, Camanho AS, Podinovski VV, Sarrico CS, Shale EA. Pitfalls and protocols in DEA. Eur J Oper Res. 2001;132(2):245–259. doi: 10.1016/s0377-2217(00)00149-1. DOI

Golany B, Thore S. Restricted best practice selection in DEA: an overview with a case study evaluating the socio-economic performance of nations. Ann Oper Res. 1997;73:117–140. doi: 10.1023/a:1018916925568. DOI

Coelli T, Rao DSP, Battese GE. An Introduction to Efficiency and Productivity Analysis. Boston/Dordrecht/London: Kluwer Academic Publishers; 1998.

GBD 2019 Healthcare Access and Quality Collaborators Assessing performance of the Healthcare Access and Quality Index, overall and by select age groups, for 204 countries and territories, 1990–2019: a systematic analysis from the Global Burden of Disease Study 2019. Lancet Glob Health. 2022;10(12):e1715–e1743. doi: 10.1016/S2214-109X(22)00429-6. PubMed DOI PMC

Hollingsworth B. Non-parametric and parametric applications measuring efficiency in health care. Health Care Manag Sci. 2003;6(4):203–218. doi: 10.1023/A:1026255523228. PubMed DOI

Retzlaff-Roberts D, Chang CF, Rubin RM. Technical efficiency in the use of health care resources: a comparison of OECD countries. Health Policy. 2004;69(1):55–72. doi: 10.1016/j.healthpol.2003.12.002. PubMed DOI

Cylus J, Papanicolas I, Smith PC. Using data envelopment analysis to address the challenges of comparing health system efficiency. Glob Policy. 2017;8:60–68. doi: 10.1111/1758-5899.12212. DOI

Gavurova B, Kocisova K, Sopko J. Health system efficiency in OECD countries: dynamic network analysis. Health Econ Rev. 2021;11:40. doi: 10.1186/s13561-021-00337-9. PubMed DOI PMC

Pereira MA, Dinis DC, Ferreira DC, Figueira JR, Marques RC. A network data envelopment analysis to estimate nations’ efficiency in the fight against SARS-CoV-2. Expert Syst Appl. 2022;210:118362. doi: 10.1016/j.eswa.2022.118362. PubMed DOI PMC

Behr A, Theune K. Health system efficiency: a fragmented picture based on OECD data. PharmacoEcon Open. 2017;1:203–221. doi: 10.1007/s41669-017-0010-y. PubMed DOI PMC

Spinks J, Hollingsworth B. Cross-country comparisons of technical efficiency of health production: a demonstration of pitfalls. Appl Econ. 2009;41(4):417–427. doi: 10.1080/00036840701604354. DOI

Daraio C, Simar L. Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach. J Prod Anal. 2007;28(1–2):13–32. doi: 10.1007/s11123-007-0049-3. DOI

Efficiency evaluation of 28 health systems by MCDA and DEA