Federated learning enables big data for rare cancer boundary detection
Jazyk angličtina Země Anglie, Velká Británie Médium electronic
Typ dokumentu časopisecké články, Research Support, N.I.H., Extramural
Grantová podpora
MR/W021684/1
Medical Research Council - United Kingdom
R01 CA270027
NCI NIH HHS - United States
U01 CA080098
NCI NIH HHS - United States
U10 CA079778
NCI NIH HHS - United States
UL1 TR001409
NCATS NIH HHS - United States
UL1 TR001433
NCATS NIH HHS - United States
U01 CA242871
NCI NIH HHS - United States
P30 CA051008
NCI NIH HHS - United States
U01 CA248226
NCI NIH HHS - United States
U01 CA079778
NCI NIH HHS - United States
U10 CA037422
NCI NIH HHS - United States
U10 CA080098
NCI NIH HHS - United States
U24 CA189523
NCI NIH HHS - United States
U01 CA176110
NCI NIH HHS - United States
U10 CA180822
NCI NIH HHS - United States
U10 CA180868
NCI NIH HHS - United States
R21 EB030209
NIBIB NIH HHS - United States
R50 CA211270
NCI NIH HHS - United States
28832
Cancer Research UK - United Kingdom
R01 CA233888
NCI NIH HHS - United States
P50 CA211015
NCI NIH HHS - United States
R37 CA214955
NCI NIH HHS - United States
R01 CA082500
NCI NIH HHS - United States
S10 OD023495
NIH HHS - United States
R01 NS042645
NINDS NIH HHS - United States
U10 CA021661
NCI NIH HHS - United States
U10 CA180820
NCI NIH HHS - United States
Wellcome Trust - United Kingdom
R01 CA269948
NCI NIH HHS - United States
U10 CA180794
NCI NIH HHS - United States
U24 CA215109
NCI NIH HHS - United States
R01 LM013151
NLM NIH HHS - United States
PubMed
36470898
PubMed Central
PMC9722782
DOI
10.1038/s41467-022-33407-5
PII: 10.1038/s41467-022-33407-5
Knihovny.cz E-zdroje
- MeSH
- big data * MeSH
- glioblastom * MeSH
- lidé MeSH
- šíření informací MeSH
- strojové učení MeSH
- vzácné nemoci MeSH
- Check Tag
- lidé MeSH
- Publikační typ
- časopisecké články MeSH
- Research Support, N.I.H., Extramural MeSH
Although machine learning (ML) has shown promise across disciplines, out-of-sample generalizability is concerning. This is currently addressed by sharing multi-site data, but such centralization is challenging/infeasible to scale due to various limitations. Federated ML (FL) provides an alternative paradigm for accurate and generalizable ML, by only sharing numerical model updates. Here we present the largest FL study to-date, involving data from 71 sites across 6 continents, to generate an automatic tumor boundary detector for the rare disease of glioblastoma, reporting the largest such dataset in the literature (n = 6, 314). We demonstrate a 33% delineation improvement for the surgically targetable tumor, and 23% for the complete tumor extent, over a publicly trained model. We anticipate our study to: 1) enable more healthcare studies informed by large diverse data, ensuring meaningful results for rare diseases and underrepresented populations, 2) facilitate further analyses for glioblastoma by releasing our consensus model, and 3) demonstrate the FL effectiveness at such scale and task-complexity as a paradigm shift for multi-site collaborations, alleviating the need for data-sharing.
Alberta Machine Intelligence Institute Edmonton AB Canada
Athinoula A Martinos Center for Biomedical Imaging Massachusetts General Hospital Charlestown MA USA
Case Comprehensive Cancer Center Cleveland OH USA
Case Western Reserve University Cleveland OH USA
Catalan Institute of Oncology Badalona Spain
Center for Biomedical Image Computing and Analytics University of Pennsylvania Philadelphia PA USA
Center for Global Health Perelman School of Medicine University of Pennsylvania Philadelphia PA USA
Center for Research and Innovation American College of Radiology Philadelphia PA USA
Centre de Recherche du Centre Hospitalière Universitaire de Sherbrooke Sherbrooke QC Canada
Centre for Biomedical Image Analysis Faculty of Informatics Masaryk University Brno Czech Republic
Clínica Imbanaco Grupo Quirón Salud Cali Colombia
Clinical Cooperation Unit Neuropathology German Cancer Consortium Heidelberg Germany
Clinical Radiology Laboratory Department of Medicine University of Patras Patras Greece
Clinix Healthcare Lagos Lagos Nigeria
College of Medicine and Public Health Flinders University Bedford Park SA Australia
Consorci MAR Parc de Salut de Barcelona Catalonia Spain
Data Science Institute American College of Radiology Reston VA USA
Department of Biomedical and Molecular Sciences Queen's University Kingston ON Canada
Department of Biomedical Informatics Stony Brook University Stony Brook New York USA
Department of Biophysics Faculty of Medicine Masaryk University Brno Czech Republic
Department of Computational Medicine and Bioinformatics University of Michigan Ann Arbor MI USA
Department of Computer Science Université de Sherbrooke Sherbrooke QC Canada
Department of Computer Science Vanderbilt University Nashville TN USA
Department of Computing Imperial College London London UK
Department of Diagnostic Radiology University of Texas MD Anderson Cancer Center Houston TX USA
Department of Electrical and Computer Engineering University of Patras Patras Greece
Department of Electrical Engineering Qazvin Branch Islamic Azad University Qazvin Iran
Department of Industrial and Systems Engineering University of Iowa Iowa USA
Department of Informatics Technical University of Munich Munich Bavaria Germany
Department of Informatics Universidade Federal do Paraná Curitiba Paraná Brazil
Department of Neuro Oncology H Lee Moffitt Cancer Center and Research Institute Tampa FL USA
Department of Neuro Oncology University of Patras Patras Greece
Department of Neurological Surgery University Hospitals Seidman Cancer Center Cleveland OH USA
Department of Neurology Baylor College of Medicine Houston TX USA
Department of Neurology Brain Tumor Center Erasmus MC Cancer Institute Rotterdam Netherlands
Department of Neurooncology Neuromed Campus Kepler University Hospital Linz Linz Austria
Department of Neuropathology Heidelberg University Hospital Heidelberg Germany
Department of Neuroradiology Heidelberg University Hospital Heidelberg Germany
Department of Neuroradiology Ruskin Wing King's College Hospital NHS Foundation Trust London UK
Department of Neuroradiology University of Michigan Ann Arbor MI USA
Department of NeuroRadiology University of Patras Patras Greece
Department of Neurosurgery Anschutz Medical Campus University of Colorado Aurora CO USA
Department of Neurosurgery Case Western Reserve University School of Medicine Cleveland OH USA
Department of Neurosurgery NYU Grossman School of Medicine New York NY USA
Department of Neurosurgery University of Patras Patras Greece
Department of Neurosurgery Vanderbilt University Medical Center Nashville TN USA
Department of Oncology Queen's University Kingston ON Canada
Department of Pathology Brain Tumor Center Erasmus MC Cancer Institute Rotterdam Netherlands
Department of Quantitative Biomedicine University of Zurich Zurich Switzerland
Department of Radiation Oncology Christiana Care Health System Philadelphia PA USA
Department of Radiation Oncology Henry Ford Health System Detroit MI USA
Department of Radiation Oncology Icahn School of Medicine at Mount Sinai New York NY USA
Department of Radiation Oncology Stony Brook University Stony Brook NY USA
Department of Radiation Oncology University of Iowa Iowa City IA USA
Department of Radiation Oncology University of Maryland Baltimore MD USA
Department of Radiation Oncology University of Patras Patras Greece
Department of Radiology Asan Medical Center Seoul South Korea
Department of Radiology Baylor College of Medicine Houston TX USA
Department of Radiology Brigham and Women's Hospital Harvard Medical School Boston MA USA
Department of Radiology H Lee Moffitt Cancer Center and Research Institute Tampa FL USA
Department of Radiology Imperial College NHS Healthcare Trust London UK
Department of Radiology Josep Trueta University Hospital Girona Spain
Department of Radiology Muhammad Abdullahi Wase Teaching Hospital Kano Nigeria
Department of Radiology Netherlands Cancer Institute Amsterdam Netherlands
Department of Radiology Neuroradiology Division University of Pittsburgh Pittsburgh PA USA
Department of Radiology NYU Grossman School of Medicine New York NY USA
Department of Radiology Obafemi Awolowo University Ile Ife Ile Ife Osun Nigeria
Department of Radiology Perelman School of Medicine University of Pennsylvania Philadelphia PA USA
Department of Radiology School of Medicine and Public Health University of Wisconsin Madison WI USA
Department of Radiology Sidney Kimmel Cancer Center Thomas Jefferson University Philadelphia PA USA
Department of Radiology Stony Brook University Stony Brook NY USA
Department of Radiology University College Hospital Ibadan Oyo Nigeria
Department of Radiology University Hospitals Cleveland Cleveland OH USA
Department of Radiology University of Washington Seattle WA USA
Department of Radiology Washington University in St Louis St Louis MO USA
Division of Medical Image Computing German Cancer Research Center Heidelberg Germany
Division of Surgery and Perioperative Medicine Flinders Medical Centre Bedford Park SA Australia
Electrical and Computer Engineering Vanderbilt University Nashville TN USA
Escuela Superior Politecnica del Litoral Guayaquil Guayas Ecuador
Federal Institute of São Paulo Campinas São Paulo Brazil
GROW School of Oncology and Developmental Biology Maastricht Netherlands
Innovation Center for Biomedical Informatics Georgetown University Washington DC USA
Institute of Biomedical Engineering Department of Engineering Science University of Oxford Oxford UK
Institute of Computing University of Campinas Campinas São Paulo Brazil
Institute of Neuroradiology Neuromed Campus Kepler University Hospital Linz Linz Austria
Instituto de Neurologia de Curitiba Curitiba Paraná Brazil
Intel Corporation Santa Clara CA USA
Leeds Teaching Hospitals Trust Department of Radiology Leeds UK
Luxembourg Center of Neuropathology Laboratoire National De Santé Luxembourg Luxembourg
MD Anderson Cancer Center University of Texas Houston TX USA
Netherlands Cancer Institute Amsterdam Netherlands
Neurology Clinic Heidelberg University Hospital Heidelberg Germany
Public Health Sciences Henry Ford Health System Detroit MI USA
School of Biomedical Engineering and Imaging Sciences King's College London London UK
School of Computing Queen's University Kingston ON Canada
School of Electronic Engineering and Computer Science Queen Mary University of London London UK
Scientific Data Group Oak Ridge National Laboratory Oak Ridge TN USA
Sidney Kimmel Medical College Thomas Jefferson University Philadelphia PA USA
Sociedad de Lucha Contral el Cancer SOLCA Guayaquil Ecuador Guayaquil Ecuador
South Australia Medical Imaging Flinders Medical Centre Bedford Park SA Australia
Stoke Mandeville Hospital Mandeville Road Aylesbury UK
The Chinese University of Hong Kong Hong Kong China
The Clatterbridge Cancer Centre NHS Foundation Trust Pembroke Place Liverpool UK
The Faculty of Arts and Sciences Queen's University Kingston ON Canada
The University of Edinburgh Edinburgh UK
TranslaTUM Klinikum rechts der Isar Munich Germany
Universidad Católica de Cuenca Cuenca Ecuador
Universidad de Concepción Concepción Biobío Chile
Universidad del Valle Cali Colombia
University of Alabama in Birmingham Birmingham AL USA
University of Alberta Edmonton AB Canada
University of Bern Bern Switzerland
University of Cairo School of Medicine Giza Egypt
University of Pittsburgh Medical Center Pittsburgh PA USA
University of Texas Southwestern Medical Center Dallas TX USA
Zobrazit více v PubMed
Mårtensson G, et al. The reliability of a deep learning model in clinical out-of-distribution MRI data: a multicohort study. Med. Image Anal. 2020;66:101714. PubMed
Zech JR, et al. Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: a cross-sectional study. PLoS Med. 2018;15:e1002683. PubMed PMC
Obermeyer Z, Emanuel EJ. Predicting the future-big data, machine learning, and clinical medicine. New Engl. J. Med. 2016;375:1216. PubMed PMC
Marcus, G. Deep learning: a critical appraisal. arXiv preprint arXiv:1801.00631 (2018).
Aggarwal, C. C. et al. Neural Networks and Deep Learning Vol. 10, 978–983 (Springer, 2018).
Thompson PM, et al. The enigma consortium: large-scale collaborative analyses of neuroimaging and genetic data. Brain Imaging Behav. 2014;8:153–182. PubMed PMC
Consortium TG. Glioma through the looking GLASS: molecular evolution of diffuse gliomas and the Glioma Longitudinal Analysis Consortium. Neuro-Oncology. 2018;20:873–884. PubMed PMC
Davatzikos C, et al. Ai-based prognostic imaging biomarkers for precision neuro-oncology: the respond consortium. Neuro-oncology. 2020;22:886–888. PubMed PMC
Bakas S, et al. iglass: imaging integration into the glioma longitudinal analysis consortium. Neuro-oncology. 2020;22:1545–1546. PubMed PMC
Rieke N, et al. The future of digital health with federated learning. NPJ Digit. Med. 2020;3:1–7. PubMed PMC
Sheller MJ, et al. Federated learning in medicine: facilitating multi-institutional collaborations without sharing patient data. Sci. Rep. 2020;10:1–12. PubMed PMC
Annas GJ, et al. Hipaa regulations—a new era of medical-record privacy? New Engl. J. Med. 2003;348:1486–1490. PubMed
Voigt, P. & Von dem Bussche, A. The EU General Data Protection Regulation (GDPR). In A Practical Guide 1st edition, Vol. 10(3152676), 10-5555 (Springer, 2017).
McMahan, B., Moore, E., Ramage, D., Hampson, S. & y Arcas, B. A. Communication-efficient learning of deep networks from decentralized data. In Artificial Intelligence and Statistics (eds Singh, A. & Zhu, J.) 1273–1282 (PMLR, 2017).
Sheller, M. J., Reina, G. A., Edwards, B., Martin, J. & Bakas, S.Multi-institutional deep learning modeling without sharing patient data: a feasibility study on brain tumor segmentation. In International MICCAI Brainlesion Workshop (eds Crimi, A. et al.) 92–104 (Springer, 2018). PubMed PMC
Dayan I, et al. Federated learning for predicting clinical outcomes in patients with covid-19. Nat. Med. 2021;27:1735–1743. PubMed PMC
Chang K, et al. Distributed deep learning networks among institutions for medical imaging. J. Am. Med. Inform. Assoc. 2018;25:945–954. PubMed PMC
Nilsson, A., Smith, S., Ulm, G., Gustavsson, E. & Jirstrand, M. A performance evaluation of federated learning algorithms. In Proceedings of the Second Workshop on Distributed Infrastructures for Deep Learning, 1–8 (Association for Computing Machinery, New York, 2018).
Sarma KV, et al. Federated learning improves site performance in multicenter deep learning without data sharing. J. Am. Med. Inform. Assoc. 2021;28:1259–1264. PubMed PMC
Shen, C. et al. Multi-task federated learning for heterogeneous pancreas segmentation. In Clinical Image-Based Procedures, Distributed and Collaborative Learning, Artificial Intelligence for Combating COVID-19 and Secure and Privacy-Preserving Machine Learning (eds Laura, C. O. et al.) 101–110 (Springer, 2021). PubMed PMC
Yang D, et al. Federated semi-supervised learning for covid region segmentation in chest ct using multi-national data from China, Italy, Japan. Med. Image Anal. 2021;70:101992. PubMed PMC
De Fauw J, et al. Clinically applicable deep learning for diagnosis and referral in retinal disease. Nat. Med. 2018;24:1342–1350. PubMed
Hannun AY, et al. Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network. Nat. Med. 2019;25:65–69. PubMed PMC
Griggs RC, et al. Clinical research for rare disease: opportunities, challenges, and solutions. Mol. Genet. Metab. 2009;96:20–26. PubMed PMC
Shukla G, et al. Advanced magnetic resonance imaging in glioblastoma: a review. Chin. Clin. Oncol. 2017;6:40. PubMed
Brennan CW, et al. The somatic genomic landscape of glioblastoma. Cell. 2013;155:462–477. PubMed PMC
Verhaak RG, et al. Integrated genomic analysis identifies clinically relevant subtypes of glioblastoma characterized by abnormalities in pdgfra, idh1, egfr, and nf1. Cancer Cell. 2010;17:98–110. PubMed PMC
Sottoriva A, et al. Intratumor heterogeneity in human glioblastoma reflects cancer evolutionary dynamics. Proc. Natl Acad. Sci. USA. 2013;110:4009–4014. PubMed PMC
Ostrom QT, et al. Cbtrus statistical report: primary brain and other central nervous system tumors diagnosed in the United States in 2012–2016. Neuro-oncology. 2019;21:v1–v100. PubMed PMC
Louis DN, et al. The 2021 WHO classification of tumors of the central nervous system: a summary. Neuro-oncology. 2021;23:1231–1251. PubMed PMC
Han W, et al. Deep transfer learning and radiomics feature prediction of survival of patients with high-grade gliomas. Am. J. Neuroradiol. 2020;41:40–48. PubMed PMC
Roth, H. R. et al. Federated learning for breast density classification: a real-world implementation. In Domain Adaptation and Representation Transfer, and Distributed and Collaborative Learning (eds Albarqouni, S. et al.) 181–191 (Springer, 2020).
Chaichana KL, et al. Multi-institutional validation of a preoperative scoring system which predicts survival for patients with glioblastoma. J. Clin. Neurosci. 2013;20:1422–1426. PubMed PMC
Fathi Kazerooni A, et al. Cancer imaging phenomics via captk: multi-institutional prediction of progression-free survival and pattern of recurrence in glioblastoma. JCO Clin. Cancer Inform. 2020;4:234–244. PubMed PMC
Menze BH, et al. The multimodal brain tumor image segmentation benchmark (brats) IEEE Trans. Med. Imaging. 2014;34:1993–2024. PubMed PMC
Bakas S, et al. Advancing the cancer genome atlas glioma MRI collections with expert segmentation labels and radiomic features. Sci. data. 2017;4:1–13. PubMed PMC
Bakas, S. et al. Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment, and overall survival prediction in the brats challenge. arXiv preprint arXiv:1811.02629 (2018).
Baid, U. et al. The rsna-asnr-miccai brats 2021 benchmark on brain tumor segmentation and radiogenomic classification. arXiv preprint arXiv:2107.02314 (2021).
Pati S, et al. The federated tumor segmentation (FeTS) tool: an open-source solution to further solid tumor research. Phys Med Biol. 2022;67:204002. PubMed PMC
Raghu, M., Zhang, C., Kleinberg, J. & Bengio, S. Transfusion: Understanding transfer learning for medical imaging. Proceedings of the 33rd International Conference on Neural Information Processing Systems32, 3347–3357 (Association for Computing Machinery, 2019).
Young, J. C. & Suryadibrata, A. Applicability of various pre-trained deep convolutional neural networks for pneumonia classification based on x-ray images. Int. J. Adv. Trends Comput. Sci. Eng. 9, 2649–2654 (2020).
Stupp R, et al. Radiotherapy plus concomitant and adjuvant temozolomide for glioblastoma. New Engl. J. Med. 2005;352:987–996. PubMed
Beiko J, et al. Idh1 mutant malignant astrocytomas are more amenable to surgical resection and have a survival benefit associated with maximal surgical resection. Neuro-oncology. 2014;16:81–91. PubMed PMC
Olson, J. J. Congress of neurological surgeons systematic review and evidence-based guidelines for the treatment of adults with progressive glioblastoma update: introduction and methods. J. Neuro-oncol158, 133–137 (2022). PubMed
Curry WT, Barker FG. Racial, ethnic and socioeconomic disparities in the treatment of brain tumors. J. Neuro-oncol. 2009;93:25–39. PubMed
Marsland S. Novelty detection in learning systems. Neural Comput. Surv. 2003;3:157–195.
Mazzara GP, Velthuizen RP, Pearlman JL, Greenberg HM, Wagner H. Brain tumor target volume determination for radiation treatment planning through automated MRI segmentation. Int. J. Radiat. Oncol.* Biol.* Phys. 2004;59:300–312. PubMed
Mitchell JR, et al. Deep neural network to locate and segment brain tumors outperformed the expert technicians who created the training data. J. Med. Imaging. 2020;7:055501. PubMed PMC
Kamnitsas K, et al. Efficient multi-scale 3d CNN with fully connected CRF for accurate brain lesion segmentation. Med. Image Anal. 2017;36:61–78. PubMed
Rudie JD, et al. Multi-disease segmentation of gliomas and white matter hyperintensities in the brats data using a 3d convolutional neural network. Front. Comput. Neurosci. 2019;13:84. PubMed PMC
Davatzikos C, et al. Cancer imaging phenomics toolkit: quantitative imaging analytics for precision diagnostics and predictive modeling of clinical outcome. J. Med. Imaging. 2018;5:011018. PubMed PMC
Yushkevich PA, et al. User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage. 2006;31:1116–1128. PubMed
Kikinis, R., Pieper, S. D. & Vosburgh, K. G. 3d slicer: a platform for subject-specific image analysis, visualization, and clinical support. In Intraoperative imaging and Image-guided Therapy (ed. Jolesz, F. A.) 277–289 (Springer, 2014).
Kofler, F. et al. Brats toolkit: translating brats brain tumor segmentation algorithms into clinical and scientific practice. Front. Neurosci.125, 125–125 (2020). PubMed PMC
Kairouz P, et al. Advances and open problems in federated learning. Found. Trends® in Mach. Learn. 2021;14:1–210.
Nasr, M., Shokri, R. & Houmansadr, A. Comprehensive privacy analysis of deep learning: passive and active white-box inference attacks against centralized and federated learning. In 2019 IEEE Symposium on Security and Privacy (SP), 739–753 (IEEE, 2019).
Lam, M., Wei, G.-Y., Brooks, D., Reddi, V. J. & Mitzenmacher, M. Gradient disaggregation: breaking privacy in federated learning by reconstructing the user participant matrix. In International Conference on Machine Learning, 5959–5968 (PMLR, 2021).
Gentry, C. Fully homomorphic encryption using ideal lattices. In Proc. 41st Annual ACM Symposium on Theory of Computing, 169–178 (Association for Computing Machinery, New York, 2009).
Yao, A. C.Protocols for secure computations. In 23rd Annual Symposium on Foundations of Computer Science (SFCS 1982), 160–164 (IEEE, 1982).
Sabt, M., Achemlal, M. & Bouabdallah, A. Trusted execution environment: what it is, and what it is not. In 2015 IEEE Trustcom/BigDataSE/ISPA Vol. 1, 57–64 (IEEE, 2015).
Schneider, M., Masti, R. J., Shinde, S., Capkun, S. & Perez, R.Sok: Hardware-supported trusted execution environments. arXiv preprint arXiv:2205.12742 (2022).
Dwork, C. Differential privacy: a survey of results. In International Conference on Theory and Applications of Models of Computation 1–19 (Springer, 2008).
Wei K, et al. Federated learning with differential privacy: algorithms and performance analysis. IEEE Trans. Inf. Forensics Secur. 2020;15:3454–3469.
Adnan M, Kalra S, Cresswell JC, Taylor GW, Tizhoosh HR. Federated learning and differential privacy for medical image analysis. Sci. Rep. 2022;12:1–10. PubMed PMC
Tramer, F. & Boneh, D. Slalom: fast, verifiable and private execution of neural networks in trusted hardware. arXiv preprint arXiv:1806.03287 (2018).
Kalra, S., Wen, J., Cresswell, J. C., Volkovs, M. & Tizhoosh, H. R. Proxyfl: decentralized federated learning through proxy model sharing. arXiv preprint arXiv:2111.11343 (2021). PubMed PMC
Lu MY, et al. Federated learning for computational pathology on gigapixel whole slide images. Med. Image Anal. 2022;76:102298. PubMed PMC
Baid, U. et al. Federated learning for the classification of tumor infiltrating lymphocytes. arXiv preprint arXiv:2203.16622 (2022).
Linardos A, Kushibar K, Walsh S, Gkontra P, Lekadir K. Federated learning for multi-center imaging diagnostics: a simulation study in cardiovascular disease. Sci. Rep. 2022;12:1–12. PubMed PMC
Rathore, S. et al. Brain cancer imaging phenomics toolkit (brain-captk): an interactive platform for quantitative analysis of glioblastoma. In International MICCAI Brainlesion Workshop (eds Crimi, A. et al.) 133–145 (Springer, 2017). PubMed PMC
Pati, S. et al. The cancer imaging phenomics toolkit (captk): technical overview. In International MICCAI Brainlesion Workshop (eds Crimi, A. & Bakas, S.) 380–394 (Springer, 2019). PubMed PMC
Gilbert, M. R. et al. Rtog 0825: Phase iii double-blind placebo-controlled trial evaluating bevacizumab (bev) in patients (pts) with newly diagnosed glioblastoma (gbm). J. Clin. Oncol.31(18_suppl18), 1–1 (2013).
Gilbert MR, et al. A randomized trial of bevacizumab for newly diagnosed glioblastoma. New Engl. J. Med. 2014;370:699–708. PubMed PMC
Boxerman JL, et al. Prognostic value of contrast enhancement and flair for survival in newly diagnosed glioblastoma treated with and without bevacizumab: results from acrin 6686. Neuro-oncology. 2018;20:1400–1410. PubMed PMC
Schmainda KM, et al. Value of dynamic contrast perfusion mri to predict early response to bevacizumab in newly diagnosed glioblastoma: results from acrin 6686 multicenter trial. Neuro-oncology. 2021;23:314–323. PubMed PMC
Pianykh, O. S. Digital Imaging and Communications in Medicine (DICOM): a Practical Introduction and Survival Guide (Springer, 2012).
Kahn CE, Carrino JA, Flynn MJ, Peck DJ, Horii SC. Dicom and radiology: past, present, and future. J. Am. College Radiol. 2007;4:652–657. PubMed
Mustra, M., Delac, K. & Grgic, M. Overview of the dicom standard. In 2008 50th International Symposium ELMAR Vol. 1, 39–44 (IEEE, 2008).
Cox, R. et al. A (sort of) new image data format standard: Nifti-1. In: Proc. 10th Annual Meeting of the Organization for Human Brain Mapping 22 (Wiley, 2004).
Li X, Morgan PS, Ashburner J, Smith J, Rorden C. The first step for neuroimaging data analysis: Dicom to nifti conversion. J. Neurosci. Methods. 2016;264:47–56. PubMed
White, T., Blok, E. & Calhoun, V. D. Data sharing and privacy issues in neuroimaging research: opportunities, obstacles, challenges, and monsters under the bed. Hum. Brain Mapp43, 278–291 (2020). PubMed PMC
Rohlfing T, Zahr NM, Sullivan EV, Pfefferbaum A. The sri24 multichannel atlas of normal adult human brain structure. Hum. Brain Mapp. 2010;31:798–819. PubMed PMC
Song, S., Zheng, Y. & He, Y. A review of methods for bias correction in medical images. Biomed. Eng. Rev.1, 2375–9151 (2017).
Sled JG, Zijdenbos AP, Evans AC. A nonparametric method for automatic correction of intensity nonuniformity in mri data. IEEE Trans. Med. Imaging. 1998;17:87–97. PubMed
Tustison NJ, et al. N4itk: improved n3 bias correction. IEEE Trans. Med. Imaging. 2010;29:1310–1320. PubMed PMC
Schwarz CG, et al. Identification of anonymous mri research participants with face-recognition software. New Engl. J. Med. 2019;381:1684–1686. PubMed PMC
Thakur S, et al. Brain extraction on MRI scans in presence of diffuse glioma: Multi-institutional performance evaluation of deep learning methods and robust modality-agnostic training. NeuroImage. 2020;220:117081. PubMed PMC
McKinley, R., Meier, R. & Wiest, R. Ensembles of densely-connected cnns with label-uncertainty for brain tumor segmentation. In International MICCAI Brainlesion Workshop (eds Crimi, A. et al.) 456–465 (Springer, 2018).
Isensee F, Jaeger PF, Kohl SA, Petersen J, Maier-Hein KH. nnu-net: a self-configuring method for deep learning-based biomedical image segmentation. Nat. Methods. 2021;18:203–211. PubMed
Rohlfing T, Russakoff DB, Maurer CR. Performance-based classifier combination in atlas-based image segmentation using expectation-maximization parameter estimation. IEEE Trans. Med. Imaging. 2004;23:983–994. PubMed
Warfield SK, Zou KH, Wells WM. Simultaneous truth and performance level estimation (staple): an algorithm for the validation of image segmentation. IEEE Trans. Med. Imaging. 2004;23:903–921. PubMed PMC
Rohlfing T, Maurer Jr CR. Multi-classifier framework for atlas-based image segmentation. Pattern Recognit. Lett. 2005;26:2070–2079.
Huo, J., Wang, G., Wu, Q. J. & Thangarajah, A. Label fusion for multi-atlas segmentation based on majority voting. In International Conference Image Analysis and Recognition (eds Kamel, M. & Campilho, A.) 100–106 (Springer, 2015).
Langerak TR, et al. Label fusion in atlas-based segmentation using a selective and iterative method for performance level estimation (simple) IEEE Trans. Med. Imaging. 2010;29:2000–2008. PubMed
Pati, S. et al. Gandlf: a generally nuanced deep learning framework for scalable end-to-end clinical workflows in medical imaging. arXiv preprint arXiv:2103.01006 (2021).
Reinhold, J. C., Dewey, B. E., Carass, A. & Prince, J. L. Evaluating the impact of intensity normalization on MR image synthesis. In Medical Imaging 2019: Image Processing, Vol. 10949 (eds Angelini, E. D. & Landman, B. A.) 109493H (International Society for Optics and Photonics, 2019). PubMed PMC
Ronneberger, O., Fischer, P. & Brox, T. U-net: convolutional networks for biomedical image segmentation. In International Conference on Medical image Computing and Computer-assisted Intervention (eds Navab, N., Hornegger, J., Wells, W. M. & Frangi, A.) 234–241 (Springer, 2015).
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T. & Ronneberger, O. 3d u-net: learning dense volumetric segmentation from sparse annotation. In International Conference on Medical Image Computing and Computer-assisted Intervention (eds Ourselin, S. et al.) 424–432 (Springer, 2016).
He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 770–778 (IEEE, 2016).
Drozdzal, M., Vorontsov, E., Chartrand, G., Kadoury, S. & Pal, C. The importance of skip connections in biomedical image segmentation. In Deep Learning and Data Labeling for Medical Applications (eds Carneiro, G. et al.) 179–187 (Springer, 2016).
Bhalerao, M. & Thakur, S.Brain tumor segmentation based on 3d residual u-net. In International MICCAI Brainlesion Workshop (eds Crimi, A. & Bakas, S.) 218–225 (Springer, 2019).
Kingma, D. P. & Ba, J. Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
Sudre, C. H., Li, W., Vercauteren, T., Ourselin, S. & Cardoso, M. J. Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations. In Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support (eds Cardoso, M. J. et al.) 240–248 (Springer, 2017). PubMed PMC
Zijdenbos AP, Dawant BM, Margolin RA, Palmer AC. Morphometric analysis of white matter lesions in MR images: method and validation. IEEE Trans. Med. Imaging. 1994;13:716–724. PubMed
Chen L, Qu H, Zhao J, Chen B, Principe JC. Efficient and robust deep learning with correntropy-induced loss function. Neural Comput. Appl. 2016;27:1019–1031.
Salehi, S. S. M., Erdogmus, D. & Gholipour, A. Tversky loss function for image segmentation using 3d fully convolutional deep networks. In International Workshop on Machine Learning in Medical Imaging (eds Wang, Q., Shi, Y., Suk, H. & Suzuki, K.) 379–387 (Springer, 2017).
Caliva, F., Iriondo, C., Martinez, A. M., Majumdar, S. & Pedoia, V.Distance map loss penalty term for semantic segmentation. arXiv preprint arXiv:1908.03679 (2019).
Shamir, R. R., Duchin, Y., Kim, J., Sapiro, G. & Harel, N.Continuous dice coefficient: a method for evaluating probabilistic segmentations. arXiv preprint arXiv:1906.11031 (2019).
Horn, R. A. The hadamard product. In Proc. Symposium on Applied Mathematics, Vol. 40 (eds Berghel, H. & Talburt, J.) 87–169 (American Mathematical Society, 1990).
Barrodale I. L1 approximation and the analysis of data. J. R. Stat. Soc.: Ser. C (Appl. Stat.) 1968;17:51–57.
Knauth, T. et al. Integrating remote attestation with transport layer security. arXiv preprint arXiv:1801.05863 (2018).
Kaissis GA, Makowski MR, Rückert D, Braren RF. Secure, privacy-preserving and federated machine learning in medical imaging. Nat. Mach. Intell. 2020;2:305–311.
Ekberg J-E, Kostiainen K, Asokan N. The untapped potential of trusted execution environments on mobile devices. IEEE Secur. Priv. 2014;12:29–37.
Rodriguez A, et al. Lower numerical precision deep learning inference and training. Intel White Paper. 2018;3:1–19.
Lin, D., Talathi, S. & Annapureddy, S. Fixed point quantization of deep convolutional networks. In International Conference on Machine Learning (eds Balcan, M. F. & Weinberger, K. Q.) 2849–2858 (PMLR, 2016).
Vakili S, Langlois JP, Bois G. Enhanced precision analysis for accuracy-aware bit-width optimization using affine arithmetic. IEEE Trans. Comput.-Aided Design Integr. Circuits Syst. 2013;32:1853–1865.
Wilkinson MD, et al. The fair guiding principles for scientific data management and stewardship. Sci. data. 2016;3:1–9. PubMed PMC
Pati, S. & Bakas, S. S. Fets-ai/front-end: release for zenodo 10.5281/zenodo.7036038 (2022)
Yushkevich PA, et al. Fast automatic segmentation of hippocampal subfields and medial temporal lobe subregions in 3 tesla and 7 tesla t2-weighted MRI. Alzheimer’s Dement. 2016;12:P126–P127.
Pati, S. & Bakas, S. LabelFusion: medical Image label fusion of segmentations 10.5281/zenodo.4633206 (2021)
Paszke, A. et al. Pytorch: an imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems vol. 32(eds Wallach, H. M. et al.) 8026–8037 (Neural Information Processing Systems Foundation, Inc., 2019).
Pérez-García, F., Sparks, R. & Ourselin, S. Torchio: a python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learning. Comput. Methods Programs Biomed.208, 106236 (2021). PubMed PMC
Foley, P. et al. OpenFL: the open federated learning library. Physics in Medicine & Biology (2022). Online ahead of print. PubMed PMC
Gorbachev, Y. et al. Openvino deep learning workbench: Comprehensive analysis and tuning of neural networks inference. In Proc. IEEE/CVF International Conference on Computer Vision Workshops, 783–787 (IEEE, 2019).
Advanced MR Techniques for Preoperative Glioma Characterization: Part 2