Application of mixed reality technique for the surgery of oral and maxillofacial tumors

  • Zu-nan TANG ,
  • Yuh SOH Hui ,
  • Lei-hao HU ,
  • Yao YU ,
  • Wen-bo ZHANG ,
  • Xin PENG
Expand
  • Department of Oral and Maxillofacial Surgery, Peking University School and Hospital of Stomatology & National Clinical Research Center for Oral Diseases & National Engineering Laboratory for Digital and Material Technology of Stomatology & Beijing Key Laboratory of Digital Stomatology, Beijing 100081, China

Received date: 2020-02-20

  Online published: 2020-12-13

Supported by

Key Research and Development Program of Ningxia Hui Autonomous Region(2018BEG02012)

Abstract

Objective: To explore the application of mixed reality technique for the surgery of oral and maxillofacial tumors. Methods: In this study, patients with a diagnosis of an oral and maxillofacial tumor who were referred to Department of Oral and Maxillofacial Surgery, Peking University School and Hospital of Stomatology from December 2018 to January 2020 were selected. The preoperative contrast-enhanced computed tomography data of the patients were imported into StarAtlas Holographic Medical Imaging System (Visual 3D Corp., Beijing, China). Three-dimensional (3D) model of tumor and key structures, such as skeleton and vessels were reconstructed to three-dimensionally present the spatial relationship between them, followed with the key structures delineation and preoperative virtual surgical planning. By using mixed reality technique, the real-time 3D model was displayed stereotactically in the surgical site. While keeping sterile during operation, the surgeon could use simple gestures to adjust the 3D model, and observed the location, range, and size of tumor and the key structures adjacent to the tumor. Mixed reality technique was used to assist the operation: 3D model registration was performed for guidance before tumor excision; intraoperative real-time verification was performed during tumor exposure and after excision of the tumor. The Likert scale was used to evaluate the application of mixed reality technique after the operation. Results: Eight patients underwent mixed reality assisted tumor resection, and all of them successfully completed the operation. The average time of the 3D model registration was 12.0 minutes. In all the cases, the surgeon could intuitively and three-dimensionally observe the 3D model of the tumor and the surrounding anatomical structures, and could adjust the model during the operation. The results of the Likert scale showed that mixed reality technique got high scores in terms of perceptual accuracy, helping to locate the anatomical parts, the role of model guidance during surgery, and the potential for improving surgical safety (4.22, 4.19, 4.16, and 4.28 points respectively). Eight patients healed well without perioperative complications. Conclusion: By providing real-time stereotactic visualization of anatomy of surgical site and guiding the operation process through 3D model, mixed reality technique could improve the accuracy and safety of the excision of oral and maxillofacial tumors.

Cite this article

Zu-nan TANG , Yuh SOH Hui , Lei-hao HU , Yao YU , Wen-bo ZHANG , Xin PENG . Application of mixed reality technique for the surgery of oral and maxillofacial tumors[J]. Journal of Peking University(Health Sciences), 2020 , 52(6) : 1124 -1129 . DOI: 10.19723/j.issn.1671-167X.2020.06.023

References

[1] 章文博, 于尧, 王洋, 等. 数字化外科技术在上颌骨缺损重建中的应[J]. 北京大学学报(医学版), 2017,49(1):1-5.
[2] Bouchard C, Magill JC, Nikonovskiy V, et al. Osteomark: a surgical navigation system for oral and maxillofacial surgery[J]. Int J Oral Maxillofac Surg, 2012,41(2):265-270.
[3] Haddock NT, Monaco C, Weimer KA, et al. Increasing bony contact and overlap with computer-designed offset cuts in free fibula mandible reconstruction[J]. J Craniofac Surg, 2012,23(6):1592-1595.
[4] Pietruski P, Majak M, wiatek-Najwer E, et al. Navigation-guided fibula free flap for mandibular reconstruction: A proof of concept study[J]. J Plast Reconstr Aesthet Surg, 2019,72(4):572-580.
[5] Tepper OM, Rudy HL, Lefkowitz A, et al. Mixed reality with holoLens: where virtual reality meets augmented reality in the operating room[J]. Plast Reconstr Surg, 2017,140(5):1066-1070.
[6] Mitsuno D, Ueda K, Hirota Y, et al. Effective application of mixed reality device hololens: simple manual alignment of surgical field and holograms[J]. Plast Reconstr Surg, 2019,143(2):647-651.
[7] Incekara F, Smits M, Dirven C, et al. Clinical feasibility of a wearable mixed-reality device in neurosurgery[J]. World Neurosurg, 2018,118:e422-e427.
[8] Zhu H, Li Y, Wang C, et al. A first attempt of inferior vena cava filter successfully guided by a mixed-reality system: a case report[J]. J Geriatr Cardiol, 2019,16(7):575-577.
[9] Saito Y, Sugimoto M, Imura S, et al. Intraoperative 3d hologram support with mixed reality techniques in liver surgery[J]. Ann Surg, 2020,271(1):e4-e7.
[10] Rose AS, Kim H, Fuchs H, et al. Development of augmented-reality applications in otolaryngology-head and neck surgery[J]. Laryngoscope, 2019,129(S3):S1-S11.
[11] 乔晨. 增强现实牙科虚拟手术的关键技术研究[D]. 北京理工大学, 2011.
[12] 张益. 数字化外科技术及眼眶骨折精确重建[J]. 中华口腔医学杂志, 2012,47(8):463-465.
[13] 于尧, 章文博, 王洋, 等. iPlan CMF软件辅助下增强CT三维重建在头颈部肿瘤治疗中的应用[J]. 北京大学学报(医学版), 2017,49(5):878-882.
[14] 赵峰, 高勃, 刘震侠, 等. Dicom标准和Mimics软件辅助建立下颌骨三维有限元模型[J]. 西南国防医药, 2005,15(5):479-481.
[15] Sauer IM, Queisner M, Tang P, et al. Mixed reality in visceral surgery: development of a suitable workflow and evaluation of intraoperative use-cases[J]. Ann Surg, 2017,266(5):706-712.
[16] Léger é, Drouin S, Collins DL, et al. Quantifying attention shifts in augmented reality image-guided neurosurgery[J]. Healthc Technol Lett, 2017,4(5):188-192.
[17] Khor WS, Baker B, Amin K, et al. Augmented and virtual reality in surgery-the digital surgical environment: applications, limitations and legal pitfalls[J]. Ann Transl Med, 2016,4(23):454.
[18] Gregory TM, Gregory J, Sledge J, et al. Surgery guided by mixed reality: presentation of a proof of concept[J]. Acta Orthop, 2018,89(5):480-483.
[19] McJunkin JL, Jiramongkolchai P, Chung W, et al. Development of a mixed reality platform for lateral skull base anatomy[J]. Otol Neurotol, 2018,39(10):e1137-e1142.
[20] 叶哲伟, 吴星火. 混合现实技术在骨科的最新应用进展[J]. 临床外科杂志, 2018,26(1):13-14.
[21] Zhang WB, Mao C, Liu XJ, et al. Outcomes of orbital floor reconstruction after extensive maxillectomy using the computer-assisted fabricated individual titanium mesh technique[J]. J Oral Maxillofac Surg, 2015,73(10):2065.
[22] Sukegawa S, Kanno T, Furuki Y. Application of computer-assisted navigation systems in oral and maxillofacial surgery[J]. Jpn Dent Sci Rev, 2018,54(3):139-149.
[23] 陈宝权, 秦学英. 混合现实中的虚实融合与人机智能交融[J]. 中国科学(信息科学), 2016,46(12):1737-1747.
[24] Likert R. A technique for the measurement of attitudes[J]. Arch Psychol, 1932,22:5-55.
Outlines

/