Medizinische Universität Graz - Research portal

Go directly to the nagivation.
Go directly to the content.

Navigation/Search

SHR Neuro Cancer Cardio Metab Microb Lipid

Virtual and Augmented Reality Module for 3D Reconstruction

Abstract: This interdisciplinary research project between computer science and medicine targets the development of a comprehensive image-guided tool for head and neck surgery with the main focus on mandibular and mid-facial fractures. The tool supports the physicians in all treatment stages (diagnosis, planning, intervention and monitoring) and can also be used during clinical traineeship. A key point is the development of an algorithm for the semi-automatic and automatic segmentation of bone structures and soft tissue in CT and MRI acquisitions. A segmentation enables a three-dimensional localization, quantification and visualization of biological structures in a very short time. Based on the radiological images from the clinical routine, treatment diagnosis can be visualized, and surgical planning processes or alternative surgery options can be simulated. In addition, the postoperative simulation results can be presented preoperatively in a photo-realistic manner. In particular, this will be applied in the reposition of bony structures, the reconstruction of facial defects and the removal of tumors in complex anatomical areas. Moreover, we plan the development of patient-individual three-dimensional implants, which will 3D printed in-house for comparison with the external manufactured ones and for clinical usage. Furthermore, the medical personnel can be supported in real-time during surgery by an interactive navigation, where Augmented Reality integrates computer-generated objects into the operation field. The application reduces surgical complications and ensures a successful treatment result by pre- and intraoperative simulations. Hence, the number of necessary corrective surgeries and the operation time needed can be reduced, and a higher patient survival rate can be achieved. In addition, the combination with Virtual Reality glasses allows the virtual training of operations during medical education. The objective of the project is the establishment of an open source tool as basis for further research and developments for the participating universities. Currently, comparable tools are protected by strict licensing conditions and not accessible without restrictions for academic research. Existing software for clinical practice is not functionally stable enough and has too high error rates. Additionally, the usage imposes high financial costs, which makes a widespread application not possible. Finally, Augmented Reality in the clinical routine is an important topic for current surgical research and cannot be ignored by modern medical universities.

Keywords: Augmentierte und Virtuelle Realität; Knochen Defekt Rekonstruktion; Navigation; Segmentierung; 3D gedruckte Implantate

Project Leader:: Wallner Jürgen

Duration:: 01.07.2018-30.09.2021

Programme:: KLIF

Type of Research: clinical trial

Further information:

Staff: Wallner, Jürgen, Project Leader; Egger, Jan, Co-worker; Schwarz-Gsaxner, Christina, Co-worker

MUG Research Units: Division of Oral-, Maxillofacial Surgery

Project partners: Graz University of Technology, Austria

Funded by: FWF, Fonds zur Förderung der Wissenschaftlichen Forschung, Wien, Austria

Project results published: > Synthetic skull bone defects for automatic patient... Sci Data. 2021; 8(1):36-36; > A review on the applications of virtual reality, a... Expert Rev Med Devices. 2021; 18(1):47-62; > Augmented Reality for Head and Neck Carcinoma Imag... Comput Methods Programs Biomed. 2021; 200(1):105854-105854; > A review on patient-specific facial and cranial im... EXPERT REV MED DEVIC. 2021;; > AutoImplant 2020-First MICCAI Challenge on Automat... IEEE Trans Med Imaging. 2021; 40(9):2329-2342; > Effects of Pre-Operative Risk Factors on Intensive... Cancers (Basel). 2021; 13(16):; > Automatic skull defect restoration and cranial imp... MED IMAGE ANAL. 2021; 73: 102171; > MUG500+: Database of 500 high-resolution he... Data Brief. 2021; 39: 107524; > Deep learning-a first meta-survey of selected revi... PEERJ COMPUT SCI. 2021; 7: e773; > A review on computer-aided design and manufacturin... Expert Rev Med Devices. 2020; 17(4):345-356; > Detection, segmentation, simulation and visualizat... MED IMAGE ANAL. 2020; 65(1): 101773-101773.; > Facial model collection for medical augmented real... Sci Data. 2019; 6(1):310-310; > A Marker-Less Registration Approach for Mixed Real... J Digit Imaging. 2019; 32(6):1008-1018; > Free thoracodorsal, perforator-scapular flap based... J Craniomaxillofac Surg. 2019; 47(10):1617-1625; > Exploit fully automatic low-level segmented PET da... PLoS One. 2019; 14(3):e0212550-e0212550; > A review on multiplatform evaluations of semi-auto... Comput Methods Programs Biomed. 2019; 182(1):105102-105102; > Clinical evaluation of semi-automatic open-source ... PLoS One. 2018; 13(5):e0196378-e0196378; > Anatomy of the Le Fort I segment: Are arterial var... J Craniomaxillofac Surg. 2018; 46(8):1285-1295