Metaverse and Medical Diagnosis: A Blockchain-Based Digital Twinning Approach Based on MobileNetV2 Algorithm for Cervical Vertebral Maturation
Status PubMed-not-MEDLINE Jazyk angličtina Země Švýcarsko Médium electronic
Typ dokumentu časopisecké články
PubMed
37189587
PubMed Central
PMC10137959
DOI
10.3390/diagnostics13081485
PII: diagnostics13081485
Knihovny.cz E-zdroje
- Klíčová slova
- CNN, advanced mathematical models, artificial intelligence, deep learning, dental surgery, dentistry, digital twins, healthcare, metaverse,
- Publikační typ
- časopisecké články MeSH
Advanced mathematical and deep learning (DL) algorithms have recently played a crucial role in diagnosing medical parameters and diseases. One of these areas that need to be more focused on is dentistry. This is why creating digital twins of dental issues in the metaverse is a practical and effective technique to benefit from the immersive characteristics of this technology and adapt the real world of dentistry to the virtual world. These technologies can create virtual facilities and environments for patients, physicians, and researchers to access a variety of medical services. Experiencing an immersive interaction between doctors and patients can be another considerable advantage of these technologies, which can dramatically improve the efficiency of the healthcare system. In addition, offering these amenities through a blockchain system enhances reliability, safety, openness, and the ability to trace data exchange. It also brings about cost savings through improved efficiencies. In this paper, a digital twin of cervical vertebral maturation (CVM), which is a critical factor in a wide range of dental surgery, within a blockchain-based metaverse platform is designed and implemented. A DL method has been used to create an automated diagnosis process for the upcoming CVM images in the proposed platform. This method includes MobileNetV2, a mobile architecture that improves the performance of mobile models in multiple tasks and benchmarks. The proposed technique of digital twinning is simple, fast, and suitable for physicians and medical specialists, as well as for adapting to the Internet of Medical Things (IoMT) due to its low latency and computing costs. One of the important contributions of the current study is to use of DL-based computer vision as a real-time measurement method so that the proposed digital twin does not require additional sensors. Furthermore, a comprehensive conceptual framework for creating digital twins of CVM based on MobileNetV2 within a blockchain ecosystem has been designed and implemented, showing the applicability and suitability of the introduced approach. The high performance of the proposed model on a collected small dataset demonstrates that low-cost deep learning can be used for diagnosis, anomaly detection, better design, and many more applications of the upcoming digital representations. In addition, this study shows how digital twins can be performed and developed for dental issues with the lowest hardware infrastructures, reducing the costs of diagnosis and treatment for patients.
Dentistry School Babol University of Medical Sciences Babol 4717647745 Iran
Department of Anatomy Faculty of Medicine in Pilsen Charles University 323 00 Pilsen Czech Republic
Department of Computer Engineering Mashhad Branch Islamic Azad University Mashhad 9187147578 Iran
Zobrazit více v PubMed
Korde S.J., Daigavane P., Shrivastav S. Skeletal Maturity Indicators-Review Article. Int. J. Sci. Res. 2015;6:361–370.
Rolland-Cachera M.-F., Péneau S. Assessment of growth: Variations according to references and growth parameters used. Am. J. Clin. Nutr. 2011;94:1794S–1798S. doi: 10.3945/ajcn.110.000703. PubMed DOI
Fang D., Long Z., Hou J. Clinical application of concentrated growth factor fibrin combined with bone repair materials in jaw defects. J. Oral Maxillofac. Surg. 2020;78:882–892. doi: 10.1016/j.joms.2020.01.037. PubMed DOI
Ferrillo M., Curci C., Roccuzzo A., Migliario M., Invernizzi M., de Sire A. Reliability of cervical vertebral maturation compared to hand-wrist for skeletal maturation assessment in growing subjects: A systematic review. J. Back Musculoskelet. Rehabil. 2021;34:925–936. doi: 10.3233/BMR-210003. PubMed DOI
Hamet P., Tremblay J. Artificial intelligence in medicine. Metabolism. 2017;69:S36–S40. doi: 10.1016/j.metabol.2017.01.011. PubMed DOI
Jamshidi M.B., Daneshfar F. A Hybrid Echo State Network for Hypercomplex Pattern Recognition, Classification, and Big Data Analysis; Proceedings of the 2022 12th International Conference on Computer and Knowledge Engineering (ICCKE); Mashhad, Iran. 17–18 November 2022; pp. 7–12.
Jamshidi M.B., Ebadpour M., Moghani M.M. Cancer Digital Twins in Metaverse; Proceedings of the 2022 20th International Conference on Mechatronics-Mechatronika (ME); Pilsen, Czech Republic. 7–9 December 2022; pp. 1–6.
Kerdvibulvech C. Exploring the impacts of COVID-19 on digital and metaverse games; Proceedings of the HCI International 2022 Posters: 24th International Conference on Human-Computer Interaction, HCII 2022; Online. 26 June–1 July 2022; pp. 561–565.
Lee C.W. Application of Metaverse Service to Healthcare Industry: A Strategic Perspective. Int. J. Environ. Res. Public Health. 2022;19:13038. doi: 10.3390/ijerph192013038. PubMed DOI PMC
Jamshidi M., Lalbakhsh A., Talla J., Peroutka Z., Hadjilooei F., Lalbakhsh P., Jamshidi M., La Spada L., Mirmozafari M., Dehghani M. Artificial intelligence and COVID-19: Deep learning approaches for diagnosis and treatment. IEEE Access. 2020;8:109581–109595. doi: 10.1109/ACCESS.2020.3001973. PubMed DOI PMC
Jamshidi M.B., Talla J., Lalbakhsh A., Sharifi-Atashgah M.S., Sabet A., Peroutka Z. A conceptual deep learning framework for COVID-19 drug discovery; Proceedings of the 2021 IEEE 12th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON); New York, NY, USA. 1–4 December 2021; pp. 30–34.
Nguyen T.N. Toward human digital twins for cybersecurity simulations on the metaverse: Ontological and network science approach. JMIRx Med. 2022;3:e33502. doi: 10.2196/33502. DOI
De Moraes Rossetto A.G., Sega C., Leithardt V.R.Q. An Architecture for Managing Data Privacy in Healthcare with Blockchain. Sensors. 2022;22:8292. doi: 10.3390/s22218292. PubMed DOI PMC
Atici S.F., Ansari R., Allareddy V., Suhaym O., Cetin A.E., Elnagar M.H. Fully automated determination of the cervical vertebrae maturation stages using deep learning with directional filters. PLoS ONE. 2022;17:e0269198. doi: 10.1371/journal.pone.0269198. PubMed DOI PMC
Fishman L.S. Radiographic evaluation of skeletal maturation: A clinically oriented method based on hand-wrist films. Angle Orthod. 1982;52:88–112. PubMed
Hassel B., Farman A.G. Skeletal maturation evaluation using cervical vertebrae. Am. J. Orthod. Dentofac. Orthop. 1995;107:58–66. doi: 10.1016/S0889-5406(95)70157-5. PubMed DOI
Uysal T., Ramoglu S.I., Basciftci F.A., Sari Z. Chronologic age and skeletal maturation of the cervical vertebrae and hand-wrist: Is there a relationship? Am. J. Orthod. Dentofac. Orthop. 2006;130:622–628. doi: 10.1016/j.ajodo.2005.01.031. PubMed DOI
Sit M., Demiray B.Z., Xiang Z., Ewing G.J., Sermet Y., Demir I. A comprehensive review of deep learning applications in hydrology and water resources. Water Sci. Technol. 2020;82:2635–2670. doi: 10.2166/wst.2020.369. PubMed DOI
Zhang Z., Wen F., Sun Z., Guo X., He T., Lee C. Artificial intelligence-enabled sensing technologies in the 5G/internet of things era: From virtual reality/augmented reality to the digital twin. Adv. Intell. Syst. 2022;4:2100228. doi: 10.1002/aisy.202100228. DOI
Daneshfar F., Jamshidi M.B. An Octonion-Based Nonlinear Echo State Network for Speech Emotion Recognition in Metaverse. Neural Netw. 2023;163:108–121. doi: 10.1016/j.neunet.2023.03.026. PubMed DOI
Gadekallu T.R., Huynh-The T., Wang W., Yenduri G., Ranaweera P., Pham Q.-V., da Costa D.B., Liyanage M. Blockchain for the metaverse: A review. arXiv. 20222203.09738
Jeon H., Youn H., Ko S., Kim T. Advances in the Convergence of Blockchain and Artificial Intelligence. IntechOpen; Rijeka, Croatia: 2022. Blockchain and AI Meet in the Metaverse; p. 73.
Fu Y., Li C., Yu F.R., Luan T.H., Zhao P., Liu S. A survey of blockchain and intelligent networking for the metaverse. IEEE Internet Things J. 2022;10:3587–3610. doi: 10.1109/JIOT.2022.3222521. DOI
Khalaj O., Jamshidi M., Hassas P., Hosseininezhad M., Mašek B., Štadler C., Svoboda J. Metaverse and AI Digital Twinning of 42SiCr Steel Alloys. Mathematics. 2022;11:4. doi: 10.3390/math11010004. DOI
Ebadpour M., Jamshidi M., Talla J., Hashemi-Dezaki H., Peroutka Z. Digital Twin Model of Electric Drives Empowered by EKF. Sensors. 2023;23:2006. doi: 10.3390/s23042006. PubMed DOI PMC
Sandler M., Howard A., Zhu M., Zhmoginov A., Chen L.-C. Mobilenetv2: Inverted residuals and linear bottlenecks; Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; Salt Lake City, UT, USA. 18–23 June 2018; pp. 4510–4520.
Powers D.M.W. Evaluation: From precision, recall and f-measure to roc., informedness, markedness & correlation. J. Mach. Learn. Technol. 2011;2:37–63.
Buckland M., Gey F. The Relationship between Recall and Precision. J. Am. Soc. Inf. Sci. 1994;45:12–19. doi: 10.1002/(SICI)1097-4571(199401)45:1<12::AID-ASI2>3.0.CO;2-L. DOI
Predicting Chronic Hyperplastic Candidiasis Retro-Angular Mucosa Using Machine Learning