| 1. |
Proniewska K.♦, Kolecki R.♦, Grochowska A.♦, Popiela T.♦, Rogula T.♦, Malinowski K.♦, Dołęga-Dołęgowski D.♦, Kenig J.♦, Richter P.♦, Dąbrowa J.♦, Mortada M.J.♦, van Dam P.♦, Pręgowska A., The Application of the Preoperative Image-Guided 3D Visualization Supported by Machine Learning to the Prediction of Organs Reconstruction During Pancreaticoduodenectomy via a Head-Mounted Displays,
International Conference on eXtended Reality, XR SALENTO 2023, 2023-09-06/09-09, Lecce (IT), DOI: 10.1007/978-3-031-43401-3_21, No.14218, pp.321-344, 2023 Abstract:
Early pancreatic cancer diagnosis and therapy drastically increase the chances of survival. Tumor visualization using CT scan images is an important part of these processes. In this paper, we apply Mixed Reality (MR) and Artificial Intelligence, in particular, Machine Learning (ML) to prepare image-guided 3D models of pancreatic cancer in a population of oncology patients. Object detection was based on the convolution neural network, i.e. the You Only Look Once (YOLO) version 7 algorithm, while the semantic segmentation has been done with the 3D-UNET algorithm. Next, the 3D holographic visualization of this model as an interactive, MR object was performed using the Microsoft HoloLens2. The results indicated that the proposed MR and ML-based approach can precisely segment the pancreas along with suspected lesions, thus providing a reliable tool for diagnostics and surgical planning, especially when considering organ reconstruction during pancreaticoduodenectomy. Keywords:
Extended Reality, Mixed Reality, Augmented Reality, Head-Mounted Displays, Artificial Intelligence, Image-guided surgery Affiliations:
| Proniewska K. | - | Jagiellonian University (PL) | | Kolecki R. | - | other affiliation | | Grochowska A. | - | other affiliation | | Popiela T. | - | other affiliation | | Rogula T. | - | other affiliation | | Malinowski K. | - | Warsaw University of Technology (PL) | | Dołęga-Dołęgowski D. | - | Jagiellonian University (PL) | | Kenig J. | - | other affiliation | | Richter P. | - | Jagiellonian University (PL) | | Dąbrowa J. | - | other affiliation | | Mortada M.J. | - | other affiliation | | van Dam P. | - | PEACS BV, Nieuwerbrug (NL) | | Pręgowska A. | - | IPPT PAN |
|  |
