Journal of Peking University(Health Sciences) >
Deep learning algorithms for intelligent construction of a three-dimensional maxillofacial symmetry reference plane
Received date: 2024-10-09
Online published: 2025-01-25
Supported by
the National Natural Science Foundation of China(82071171);the National Natural Science Foundation of China(82271039);National Key Research and Development Program of China(2022YFC2405401);Beijing Natural Science Foundation(L232100);Beijing Natural Science Foundation(L242132);Open Subject Foundation of Peking University Hospital of Stomatology(PKUSS20230201)
Copyright
Objective: To develop an original-mirror alignment associated deep learning algorithm for intelligent registration of three-dimensional maxillofacial point cloud data, by utilizing a dynamic graph-based registration network model (maxillofacial dynamic graph registration network, MDGR-Net), and to provide a valuable reference for digital design and analysis in clinical dental applications. Methods: Four hundred clinical patients without significant deformities were recruited from Peking University School of Stomatology from October 2018 to October 2022. Through data augmentation, a total of 2 000 three-dimensional maxillofacial datasets were generated for training and testing the MDGR-Net algorithm. These were divided into a training set (1 400 cases), a validation set (200 cases), and an internal test set (200 cases). The MDGR-Net model constructed feature vectors for key points in both original and mirror point clouds (X, Y), established correspondences between key points in the X and Y point clouds based on these feature vectors, and calculated rotation and translation matrices using singular value decomposition (SVD). Utilizing the MDGR-Net model, intelligent registration of the original and mirror point clouds were achieved, resulting in a combined point cloud. The principal component analysis (PCA) algorithm was applied to this combined point cloud to obtain the symmetry reference plane associated with the MDGR-Net methodology. Model evaluation for the translation and rotation matrices on the test set was performed using the coefficient of determination (R2). Angle error evaluations for the three-dimensional maxillofacial symmetry reference planes were constructed using the MDGR-Net-associated method and the "ground truth" iterative closest point (ICP)-associated method were conducted on 200 cases in the internal test set and 40 cases in an external test set. Results: Based on testing with the three-dimensional maxillofacial data from the 200-case internal test set, the MDGR-Net model achieved an R2 value of 0.91 for the rotation matrix and 0.98 for the translation matrix. The average angle error on the internal and external test sets were 0.84°±0.55° and 0.58°±0.43°, respectively. The construction of the three-dimensional maxillofacial symmetry reference plane for 40 clinical cases took only 3 seconds, with the model performing optimally in the patients with skeletal Class Ⅲ malocclusion, high angle cases, and Angle Class Ⅲ orthodontic patients. Conclusion: This study proposed the MDGR-Net association method based on intelligent point cloud registration as a novel solution for constructing three-dimensional maxillofacial symmetry reference planes in clinical dental applications, which can significantly enhance diagnostic and therapeutic efficiency and outcomes, while reduce expert dependence.
Yujia ZHU , Hua SHEN , Aonan WEN , Zixiang GAO , Qingzhao QIN , Shenyao SHAN , Wenbo LI , Xiangling FU , Yijiao ZHAO , Yong WANG . Deep learning algorithms for intelligent construction of a three-dimensional maxillofacial symmetry reference plane[J]. Journal of Peking University(Health Sciences), 2025 , 57(1) : 113 -120 . DOI: 10.19723/j.issn.1671-167X.2025.01.017
| 1 | Khambay BS , Lowney CJ , Hsung T , et al. Fluctuating asymmetry of dynamic smiles in normal individuals[J]. Int J Oral Maxillofac Surg, 2019, 48 (10): 1372- 1379. |
| 2 | Hoenn M , Goez G . The ideal of facial beauty: A review[J]. J Orofac Orthop, 2007, 68 (1): 6- 16. |
| 3 | Huang CS , Liu XQ , Chen YR . Facial asymmetry index in normal young adults[J]. Orthod Craniofac Res, 2013, 16 (2): 97- 104. |
| 4 | Arora KS , Bansal R , Mohapatra S , et al. Review and classification update: Unilateral condylar hyperplasia[J]. BMJ Case Rep, 2019, 12 (2): e227569. |
| 5 | Brown JS , Barry C , Ho M , et al. A new classification for mandi-bular defects after oncological resection[J]. Lancet Oncol, 2016, 17 (1): E23- E30. |
| 6 | Li Y , Shao Z , Zhu Y , et al. Virtual surgical planning for successful second-stage mandibular defect reconstruction using vascula-rized iliac crest bone flap a valid and reliable method[J]. Ann Plast Surg, 2020, 84 (2): 183- 187. |
| 7 | 顾晓宇, 陈晓波, 焦婷, 等. 三维打印数字化阴模辅助制作口腔颌面缺损赝复体的临床应用[J]. 中华口腔医学杂志, 2017, 52 (6): 336- 341. |
| 8 | Maesschalck TD , Courvoisier DS , Scolozzi P . Computer-assisted versus traditional freehand technique in fibular free flap mandibular reconstruction: A morphological comparative study[J]. Eur Arch Otorhinolaryngol, 2017, 274 (1): 517- 526. |
| 9 | Shin SM , Kim Y , Kim N , et al. Statistical shape analysis-based determination of optimal midsagittal reference plane for evaluation of facial asymmetry[J]. Am J Orthod Dentofacial Orthop, 2016, 150 (2): 252- 260. |
| 10 | Dobai A , Markella Z , Vizkelety T , et al. Landmark-based midsagittal plane analysis in patients with facial symmetry and asymmetry based on CBCT analysis tomography[J]. J Orofac Orthop, 2018, 79 (6): 371- 379. |
| 11 | Klingenberg CP , Barluenga M , Meyer A . Shape analysis of symmetric structures: Quantifying variation among individuals and asymmetry[J]. Evolution, 2002, 56 (10): 1909- 1920. |
| 12 | Hartmann J , Meyer-Marcotty P , Benz M , et al. Reliability of a method for computing facial symmetry plane and degree of asymmetry based on 3D-data[J]. J Orofac Orthop, 2007, 68 (6): 477- 490. |
| 13 | 刘筱菁, 李倩倩, 王晓霞, 等. 基于本体-镜像关联的三维头颅正中矢状面自动构建法[J]. 中华口腔正畸学杂志, 2014, 21 (3): 148- 150. |
| 14 | Djordjevic J , Pirttiniemi P , Harila V , et al. Three-dimensional longitudinal assessment of facial symmetry in adolescents[J]. Eur J Orthod, 2013, 35 (2): 143- 151. |
| 15 | 浙江大学, 中国食品药品检定研究院, 海军军医大学第二附属医院. 人工智能医疗器械性能评价通用方法专家共识(2023)[J]. 协和医学杂志, 2023, 14 (3): 494- 503. |
| 16 | Du S , Xu Y , Wan T , et al. Robust iterative closest point algorithm based on global reference point for rotation invariant registration[J]. PLoS One, 2017, 12 (11): e18803911. |
| 17 | Xiong Y , Zhao Y , Yang H , et al. Comparison between interactive closest point and procrustes analysis for determining the median sagittal plane of three-dimensional facial data[J]. J Craniofac Surg, 2016, 27 (2): 441- 444. |
| 18 | Zelditch , Leah M . Geometric morphometrics for biologists: A primer[M]. New York and London: Elsevier Academic Press, 2004. |
| 19 | Redmon J, Divvala S, Girshick R, et al. You only look once: Unified, real-time object detection[C]/ /Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016. Las Vegas, Nevada, USA: Institute of Electrical and Electronics Engineers, 2016: 779-788. |
| 20 | Ronneberger O, Fischer P, Brox T. U-Net: Convolutional networks for biomedical image segmentation[C]/ /Navab N, Hornegger J, Wells WM, et al. Proccedings of the International Confe-rence on Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2015. Germany: Springer International Publishing, 2015: 234-241. |
| 21 | Schwendicke F , Singh T , Lee J , et al. Artificial intelligence in dental research: Checklist for authors, reviewers, readers[J]. J Dent, 2021, 107, 103610. |
| 22 | Schwendicke F , Samek W , Krois J . Artificial intelligence in dentistry: Chances and challenges[J]. J Dent Res, 2020, 99 (7): 769- 774. |
| 23 | Wang Y , Sun Y , Liu Z , et al. Dynamic graph CNN for learning on point clouds[J]. ACM Transactions On Graphics (TOG), 2019, 38 (5): 1- 12. |
| 24 | Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need[C]/ /Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS 2017). Red Hook, NY, USA: Curran Associates, Inc., 2017. |
| 25 | Wu J , Heike C , Birgfeld C , et al. Measuring symmetry in children with unrepaired cleft lip: Defining a standard for the three-dimensional midfacial reference plane[J]. Cleft Palate Craniofac J, 2016, 53 (6): 695- 704. |
/
| 〈 |
|
〉 |