From 2016 EBMT and JACIE developed an international risk-adapted benchmarking program of haematopoietic stem cell transplant (HSCT) outcome to provide individual EBMT Centers with a means of quality-assuring the HSCT process and meeting FACT-JACIE accreditation requirements relating to 1-year survival outcomes. Informed by previous experience from Europe, North America and Australasia, the Clinical Outcomes Group (COG) established criteria for patient and Center selection, and a set of key clinical variables within a dedicated statistical model adapted to the capabilities of the EBMT Registry. The first phase of the project was launched in 2019 to test the acceptability of the benchmarking model through assessment of Centers' performance for 1-year data completeness and survival outcomes of autologous and allogeneic HSCT covering 2013-2016. A second phase was delivered in July 2021 covering 2015-2019 and including survival outcomes. Reports of individual Center performance were shared directly with local principal investigators and their responses were assimilated. The experience thus far has supported the feasibility, acceptability and reliability of the system as well as identifying its limitations. We provide a summary of experience and learning so far in this 'work in progress', as well as highlighting future challenges of delivering a modern, robust, data-complete, risk-adapted benchmarking program across new EBMT Registry systems.

Agence de la Biomédecine Saint Denis France

Australasian Bone Marrow Transplant Recipient Registry Darlinghurst NSW Australia

Autoimmune Diseases Working Party EBMT Barcelona Spain

Belgian Transplant Registry Belgian Cancer Registry Brussels Belgium

Blood and Marrow Transplant Unit IRCCS San Raffaele Hospital Milan Italy

BMT unit Paris Cité University French reference center for aplastic anaemia and PNH French rare network for rare immunological and haematological disorders Saint Louis Hospital Paris France

British Society of Blood and Marrow Transplantation and Cellular Therapy Data Registry London United Kingdom

Cellular Therapy and Transfusion Medicine Unit Careggi University Hospital Florence Italy

Centre de Thérapie Cellulaire Institut Paoli Calmettes Comprehensive Cancer Centre Aix Marseille Université School of Medicine and Inserm CBT 1409 Centre d'Investigations Cliniques en Biothérapies Marseille France

Centre for Hematology and Oncology University Hospital Basel Basel Switzerland

Centre Hospitalier Universitaire Bordeaux Service d'Hematologie et Therapie Cellulaire Bordeaux France

CIBMTR Medical College of Wisconsin Milwaukee WI USA

CIC University of Salamanca IBSAL University Hospital of Salamanca Salamanca Spain

Czech registry Prague Czech Republic

Department of Biomedical Data Sciences Leiden University Medical Center Leiden the Netherlands

Department of Cellular Therapy and Allogeneic Stem Cell Transplantation Karolinska University Hospital Division of Hematology Department of Medicine Huddinge Karolinska Institutet Stockholm Sweden

Department of Haematology Sheffield Teaching Hospitals NHS Foundation Trust Sheffield United Kingdom

Department of Haematology St Vincent's Hospital Sydney Sydney NSW Australia

Department of Hematology CHU of Liège and University of Liège Liège Belgium

Department of Paediatric Oncology Haematology and Stem Cell Transplantation University Children's Hospital Regensburg Regensburg Germany

Department of Stem Cell Transplantation University Medical Center Hamburg Hamburg Germany

EBMT Executive Office Barcelona Spain

EBMT Paris Study Office Paris France

EBMT Registry Leiden the Netherlands

EBMT Statistical Unit Leiden Leiden the Netherlands

Edinburgh and SE Scotland Clinical Transfusion Centre Patient Services and the Edinburgh and SE Scotland Clinical Apheresis Unit Edinburgh United Kingdom

Grupo Español de Trasplantes Hematopoyéticos y Terapia Celular Madrid Spain

Hematology and Bone Marrow Transplantation Unit IRCCS San Raffaele Scientific Institute Milano Italy

Hematology Department Institut Català d'Oncologia Hospitalet Barcelona IDIBELL Universitat de Barcelona Barcelona Spain

Hematology Department Vall d'hebron Institut Oncologic Hospital Vall d'hebron Universitat Autònoma de Barcelona Barcelona Spain

Hematology division Basel University Hospital Basel Switzerland

Hospital Universitario Puerta de Hierro Majadahonda Universidad Autónoma de Madrid Madrid Spain

ICCBBA Barcelona Spain

Infectious Diseases Working Party Barcelona Spain

Italian National BMT Registry Bergamo Italy

JACIE EBMT Executive Office Barcelona Spain

Kenyon M Department of Haematology King's College Hospital NHS Foundation Trust London United Kingdom

King's College Hospital NHS Foundation Trust London United Kingdom

Laboratory of Hematology Department of Laboratory Medicine Radboud University Medical Center Nijmegen the Netherlands

School of Clinical Medicine UNSW Medicine and Health Kensington NSW Australia

School of Medicine Sydney University of Notre Dame Australia Sydney WA Australia

Sorbonne Université INSERM UMRs938 Service d'Hématologie Clinique et de Thérapie Cellulaire Hôpital Saint Antoine AP HP Paris France

Sorbonne University Department of Hematology Hôpital Saint Antoine and INSERM UMRs 938 Paris France

Sorbonne University Hôpital Saint Antoine and INSERM UMRs 938 Paris France

University Hospital Southampton NHS London United Kingdom

See more in PubMed

Craddock C, Hoelzer D, Komanduri KV. Current status and future clinical directions in the prevention and treatment of relapse following hematopoietic transplantation for acute myeloid and lymphoblastic leukemia. Bone Marrow Transpl. 2019;54:6–16. doi: 10.1038/s41409-018-0203-8. PubMed DOI

Saini N, Marin D, Ledesma C, Delgado R, Rondon G, Popat UR, et al. Impact of TKIs post-allogeneic hematopoietic cell transplantation in Philadelphia chromosome-positive ALL. Blood. 2020;136:1786–9. doi: 10.1182/blood.2019004685. PubMed DOI PMC

Schlenk RF, Weber D, Fiedler W, Salih HR, Wulf G, Salwender H, et al. Midostaurin added to chemotherapy and continued single-agent maintenance therapy in acute myeloid leukemia with FLT3-ITD. Blood. 2019;133:840–51.. doi: 10.1182/blood-2018-08-869453. PubMed DOI

Burchert A. Maintenance therapy for FLT3-ITD-mutated acute myeloid leukemia. Haematologica. 2021;106:664–70.. doi: 10.3324/haematol.2019.240747. PubMed DOI PMC

Chabannon C, Kuball J, Bondanza A, Dazzi F, Pedrazzoli P, Toubert A, et al. Hematopoietic stem cell transplantation in its 60s: A platform for cellular therapies. Sci Transl Med. 2018;10:eaap9630. doi: 10.1126/scitranslmed.aap9630. PubMed DOI

Passweg JR, Baldomero H, Bader P, Bonini C, Duarte RF, Dufour C, et al. Use of haploidentical stem cell transplantation continues to increase: the 2015 European Society for Blood and Marrow Transplant activity survey report. Bone Marrow Transpl. 2017;52:811–7. doi: 10.1038/bmt.2017.34. PubMed DOI PMC

Nagler A, Labopin M, Houhou M, Aljurf M, Mousavi A, Hamladji RM, et al. Outcome of haploidentical versus matched sibling donors in hematopoietic stem cell transplantation for adult patients with acute lymphoblastic leukemia: a study from the Acute Leukemia Working Party of the European Society for Blood and Marrow Transplantation. J Hematol Oncol. 2021;14:53. doi: 10.1186/s13045-021-01065-7. PubMed DOI PMC

Sanz J, Galimard JE, Labopin M, Afanasyev B, Sergeevich MI, Angelucci E, et al. Post-transplant cyclophosphamide containing regimens after matched sibling, matched unrelated and haploidentical donor transplants in patients with acute lymphoblastic leukemia in first complete remission, a comparative study of the ALWP of the EBMT. J Hematol Oncol. 2021;14:84. doi: 10.1186/s13045-021-01094-2. PubMed DOI PMC

Dongelmans DA, Pilcher D, Beane A, Soares M, Del Pilar Arias Lopez M, Fernandez A, et al. Linking of global intensive care (LOGIC): An international benchmarking in critical care initiative. J Crit Care. 2020;60:305–10.. doi: 10.1016/j.jcrc.2020.08.031. PubMed DOI

Reponen E, Rundall TG, Shortell SM, Blodgett JC, Juarez A, Jokela R, et al. Benchmarking outcomes on multiple contextual levels in lean healthcare: a systematic review, development of a conceptual framework, and a research agenda. BMC Health Serv Res. 2021;21:161. doi: 10.1186/s12913-021-06160-6. PubMed DOI PMC

von Eiff W. International benchmarking and best practice management: in search of health care and hospital excellence. Adv Health Care Manag. 2015;17:223–52. doi: 10.1108/S1474-823120140000017014. PubMed DOI

Snowden JA, Saccardi R, Orchard K, Ljungman P, Duarte RF, Labopin M, et al. Benchmarking of survival outcomes following haematopoietic stem cell transplantation: A review of existing processes and the introduction of an international system from the European Society for Blood and Marrow Transplantation (EBMT) and the Joint Accreditation Committee of ISCT and EBMT (JACIE) Bone Marrow Transpl. 2020;55:681–94.. doi: 10.1038/s41409-019-0718-7. PubMed DOI PMC

Armand P, Kim HT, Logan BR, Wang Z, Alyea EP, Kalaycio ME, et al. Validation and refinement of the Disease Risk Index for allogeneic stem cell transplantation. Blood. 2014;123:3664–71. doi: 10.1182/blood-2014-01-552984. PubMed DOI PMC

Grimwade D, Hills RK, Moorman AV, Walker H, Chatters S, Goldstone AH, et al. Refinement of cytogenetic classification in acute myeloid leukemia: determination of prognostic significance of rare recurring chromosomal abnormalities among 5876 younger adult patients treated in the United Kingdom Medical Research Council trials. Blood. 2010;116:354–65. doi: 10.1182/blood-2009-11-254441. PubMed DOI

Sorror ML, Storer B, Storb RF. Validation of the hematopoietic cell transplantation-specific comorbidity index (HCT-CI) in single and multiple institutions: limitations and inferences. Biol Blood Marrow Transpl. 2009;15:757–8. doi: 10.1016/j.bbmt.2009.02.007. PubMed DOI PMC

Berro M, Arbelbide JA, Rivas MM, Basquiera AL, Ferini G, Vitriu A, et al. Hematopoietic cell transplantation-specific comorbidity index predicts morbidity and mortality in autologous stem cell transplantation. Biol Blood Marrow Transpl. 2017;23:1646–50.. doi: 10.1016/j.bbmt.2017.06.014. PubMed DOI

Saad A, Mahindra A, Zhang MJ, Zhong X, Costa LJ, Dispenzieri A, et al. Hematopoietic cell transplant comorbidity index is predictive of survival after autologous hematopoietic cell transplantation in multiple myeloma. Biol Blood Marrow Transpl. 2014;20:402–8.e1. doi: 10.1016/j.bbmt.2013.12.557. PubMed DOI PMC

Sorror ML, Storb RF, Sandmaier BM, Maziarz RT, Pulsipher MA, Maris MB, et al. Comorbidity-age index: a clinical measure of biologic age before allogeneic hematopoietic cell transplantation. J Clin Oncol. 2014;32:3249–56. doi: 10.1200/JCO.2013.53.8157. PubMed DOI PMC

Putter H, Eikema DJ, de Wreede LC, McGrath E, Sanchez-Ortega I, Saccardi R, et al. Benchmarking survival outcomes: A funnel plot for survival data. Stat Methods Med Res. 2022;31:1171–1183. doi: 10.1177/09622802221084130. PubMed DOI PMC

van Buuren S, Boshuizen HC, Knook DL. Multiple imputation of missing blood pressure covariates in survival analysis. Stat Med. 1999;18:681–94. doi: 10.1002/(SICI)1097-0258(19990330)18:6<681::AID-SIM71>3.0.CO;2-R. PubMed DOI

White IR, Royston P. Imputing missing covariate values for the Cox model. Stat Med. 2009;28:1982–98. doi: 10.1002/sim.3618. PubMed DOI PMC

Dohner H, Estey E, Grimwade D, Amadori S, Appelbaum FR, Buchner T, et al. Diagnosis and management of AML in adults: 2017 ELN recommendations from an international expert panel. Blood. 2017;129:424–47.. doi: 10.1182/blood-2016-08-733196. PubMed DOI PMC

Gratwohl A, Brand R, McGrath E, van Biezen A, Sureda A, Ljungman P, et al. Use of the quality management system “JACIE” and outcome after hematopoietic stem cell transplantation. Haematologica. 2014;99:908–15. doi: 10.3324/haematol.2013.096461. PubMed DOI PMC

Marmor S, Begun JW, Abraham J, Virnig BA. The impact of center accreditation on hematopoietic cell transplantation (HCT) Bone Marrow Transpl. 2015;50:87–94. doi: 10.1038/bmt.2014.219. PubMed DOI

Shouval R, Labopin M, Bomze D, Baerlocher GM, Capria S, Blaise D, et al. Risk stratification using FLT3 and NPM1 in acute myeloid leukemia patients autografted in first complete remission. Bone Marrow Transpl. 2020;55:2244–53.. doi: 10.1038/s41409-020-0936-z. PubMed DOI

Shouval R, Fein JA, Labopin M, Cho C, Bazarbachi A, Baron F, et al. Development and validation of a disease risk stratification system for patients with haematological malignancies: a retrospective cohort study of the European Society for Blood and Marrow Transplantation registry. Lancet Haematol. 2021;8:e205–e15.. doi: 10.1016/S2352-3026(20)30394-X. PubMed DOI PMC

Snowden JA, McGrath E, Orchard K, Kroger N, Sureda A, Gratwohl A. Visions for a JACIE quality management system 4.0. Bone Marrow Transplant. 2021;56:2876–81. PubMed PMC