The impact of digitalization of health services has been profound and is expected to be even more profound in the future. It is important to evaluate whether digital health services contribute to health system goals in an optimal way. This should be done at the level of the service, not the 'digital transformation'. Decisions to adopt new digital health services, at different levels of the health care system, are ideally based on evidence regarding their performance in light of health system goals. In order to evaluate this, a broad perspective should be taken in evaluations of digital health services. Attainment of the broad health system goals, including quality, efficiency and equity, are objectives against which to judge new digital health services. These goals in a broad sense are unaltered by the process of digitalization. Governance should be designed and tailored in such a way to capture all relevant changes in an adequate way. When evaluating digital health services many specific aspects need to be considered. Like for other innovations and (new) technologies, such promises may or may not materialize and potential benefits may also be accompanied by unintended and/or negative (side) effects in the short or long term. Hence, the introduction, implementation, use and funding of digital health technologies should be carefully evaluated and monitored. Governments should play a more active role in the further optimization both of the process of decision making (both at the central and decentral level) and the related outcomes. They need to find a balance between centralized and decentralized activity. Moreover, the broader preparation of the health care system to be able to deal with digitalization, from education, through financial and regulatory preconditions, to implementation of monitoring systems to monitor its effects on health system performance remains important.

Australian Digital Health Agency Sidney Australia

Department of Public Health Helsinki University Hospital and University of Helsinki Helsinki Finland

Department of Woman and Child Health and Public Health Public Health Area Fondazione Policlinico Universitario A Gemelli IRCCS Rome Italy

Erasmus School of Health Policy and Management Erasmus University Rotterdam The Netherlands

Hygiene section Public Health Institute Università Cattolica del Sacro Cuore Rome Italy

Masaryk University Faculty of Medicine Center for Healthcare Quality Brno Czech Republic

Nova School of Business and Economics Universidade Nova de Lisboa Portugal

Zobrazit více v PubMed

EXPH. Report on Assessing the Impact of Digital Transformation of Health Services, Expert Panel on Effective Ways of Investing in Health (EXPH). Luxembourg: Publications Office of the European Union, 2019.

WHO. Monitoring and Evaluating Digital Health Interventions: A Practical Guide to Conducting Research and Assessment. World Health Organization, 2016.

Marcolino MS, Oliveira JAQ, D'Agostino M, et al.The impact of mHealth interventions: systematic review of systematic reviews. JMIR Mhealth Uhealth 2018;6:e23. PubMed PMC

Iribarren SJ, Cato K, Falzon L, Stone PW. What is the economic evidence for mHealth? A systematic review of economic evaluations of mHealth solutions. PLoS One 2017;12:e0170581. PubMed PMC

World-Economic-Forum. World Economic Forum White Paper. Digital Transformation of Industries: In collaboration with Accenture, 2016.

Car J, Black A, Anandan C, Cresswell K, Pagliari C, McKinstry B, Procter R, Majeed A, Sheikh A The Impact of eHealth on the Quality & Safety of Healthcare. Report for the NHS Connecting for Health Evaluation Programme. The University of Edinburgh and The Imperial College of London, 2008.

Brettle AJ, et al. Telehealth: The Effects on Clinical Outcomes, Cost Effectiveness and the Patient Experience: A Systematic Overview of the Literature. University of Salford, 2013. Available at: http://usir.salford.ac.uk/29392/1/Telehealth_v8_.pdf (27 September 2019, date last accessed).

Inglis SC, et al.Structured telephone support or non-invasive telemonitoring for patients with heart failure. Cochrane Database Syst Rev 2015:CD007228. doi: 10.1002/14651858.CD007228.pub3. PubMed PMC

Flodgren G, et al.Interactive telemedicine: effects on professional practice and health care outcomes. Cochrane Database Syst Rev 2015:CD002098. doi: 10.1002/14651858.CD002098.pub2. PubMed PMC

Global Digital Health Partnership. Available at: www.gdhp.org (27 September 2019, date last accessed).

Azzolini E, Ricciardi W, Gray M. Health care organizational performance: why changing the culture really matters. Ann Ist Super Sanita 2018;54:6–8. PubMed

De Maeseneer J, Boeckxstaens P. James Mackenzie Lecture 2011: multimorbidity, goal-oriented care, and equity. Br J Gen Pract 2012;62:e522–4. PubMed PMC

Bourek A. How to make your work really influence future healthcare: from projects through policies to integration into health systems In: Moumtzoglou A. Design, Development, and Integration of Reliable Electronic Healthcare Platforms. Hershey, PA: IGI Global Publishing, 2017: 271–95.

Azzopardi-Muscat N, Sorensen K. Towards an equitable digital public health era: promoting equity through a health literacy perspective. Eur J Public Health 2019;29(Suppl 3):13–17. PubMed PMC

Latulippe K, Hamel C, Giroux D. Social health inequalities and eHealth: a literature review with qualitative synthesis of theoretical and empirical studies. J Med Internet Res 2017;19:e136. PubMed PMC

Weiss D, Rydland HT, Øversveen E, et al.Innovative technologies and social inequalities in health: a scoping review of the literature. PLoS One 2018;13:e0195447. PubMed PMC

Makeham M, Ryan A. Sharing information safely and securely: the foundation of a modern health care system. Med J Aust 2019;210(Suppl 6):S3–S4. doi: 10.5694/mja2.50038. PubMed

Greer S, Wismar M, Figueras J, editors. Strengthening Health Systems Governance: Better Policies, Stronger Performance. Brussels/Philadelphia: European Observatory on Health Systems and Policies/Open University Press, 2015.

McKee M, van Schalkwyk MCI, Stuckler D. The second information revolution: digitalization brings opportunities for public health. Eur J Public Health 2019;29(Suppl 3):7–12. PubMed PMC