Email Alert | RSS

Journal of Peking University (Health Sciences) ›› 2020, Vol. 52 ›› Issue (6): 1107-1111. doi: 10.19723/j.issn.1671-167X.2020.06.020

Previous Articles     Next Articles

Evaluation of the reproducibility of non-verbal facial expressions in normal persons using dynamic stereophotogrammetric system

Tian-cheng QIU,Xiao-jing LIU,Zhu-lin XUE,Zi-li LI()   

  1. Department of Oral and Maxillofacial Surgery, Peking University School and Hospital of Stomatology & National Clinical Research Center for Oral Diseases & National Engineering Laboratory for Digital and Material Technology of Stomatology & Beijing Key Laboratory of Digital Stomatology, Beijing 100081, China
  • Received:2018-10-10 Online:2020-12-18 Published:2020-12-13
  • Contact: Zi-li LI E-mail:kqlzl@sina.com

RICH HTML

   

PDF (PC)

Abstract:

Objective: To assess the reproducibility of non-verbal facial expressions (smile lips closed, smile lips open, lip purse, cheek puff) in normal persons using dynamic three-dimensional (3D) imaging and provide reference data for future research. Methods: In this study, 15 adults (7 males and 8 females) without facial asymmetry and facial nerve dysfunction were recruited. Each participant was seated upright in front of the 3D imaging system in natural head position. The whole face could be captured in all six cameras. The dynamic 3D system captured 60 3D images per second. Four facial expressions were included: smile lips closed, smile lips open, lip purse, and cheek puff. Before starting, we instructed the subjects to make facial expressions to develop muscle memory. During recording, each facial expression took about 3 to 4 seconds. At least 1 week later, the procedure was repeated. The rest position (T0) was considered as the base frame. The first quartile of expressions (T1), just after reaching the maximum state of expressions (T2), just before the end of maximum state of expressions (T3), the third quartile of expressions (T4), and the end of motion (T5) were selected as key frames. Using the stable part of face such as forehead, each key frame (T1-T5) of the different expressions was aligned on the corresponding frame at rest (T0). The root mean square (RMS) between each key frame and its corresponding frame at rest were calculated. The Wilcoxon signed ranks test was applied to assess statistical differences between the corresponding frames of the different facial expressions. Results: Facial expressions like smile lips closed, smile lips open, and cheek puff were reproducible. Lip purse was not reproducible. The statistically significant differences were found on the T2 frame of the repeated lip purse movement. Conclusion: The dynamic 3D imaging can be used to evaluate the reproducibility of facial expressions. Compared with the qualitative analysis and two-dimensions analysis, dynamic 3D images can be able to more truly represent the facial expressions which make the research more reliable.

Key words: Three-dimensional images, Facial expression, Reproducibility of results

CLC Number: 

  • R782.2

Figure 1

Four facial expressions recorded by dynamic 3D imaging A, smile lips closed; B, smile lips open; C, lip purse; D, cheek puff."

Figure 2

Six important 3D facial frames of facial expressions A, the start of motion (T0); B, the first quartile of expressions (T1); C, just after reaching the maximum state of expressions (T2); D, just before the end of maximum state of expressions (T3); E, the third quartile of expressions (T4); F, the end of motion (T5)."

Figure 3

Key frame (T2) of smile lips closed expression was aligned on the corresponding frame at rest (T0), and the root mean square values of all corresponding collection points were calculated"

Table 1

Corresponding RMS values of all subjects at the T3 frame of smile lip closed motion"

No. of subject RMS/mm
First time Second time
Participant 1 1.80 1.13
Participant 2 1.04 1.29
Participant 3 1.11 1.10
Participant 4 1.71 1.23
Participant 5 1.13 2.06
Participant 6 1.09 1.48
Participant 7 1.17 1.18
Participant 8 0.88 0.82
Participant 9 1.55 1.80
Participant 10 3.14 2.68
Participant 11 2.69 1.34
Participant 12 0.79 1.03
Participant 13 1.18 0.80
Participant 14 2.33 1.93
Participant 15 1.43 1.82

Table 2

Reproducibility of facial expressions"

Items P values
T1 T2 T3 T4 T5
Standard smile 0.173 0.256 0.477 0.394 0.140
Maximum smile 0.132 0.069 0.124 0.460 0.776
Lip purse 0.079 0.027 0.932 0.513 0.093
Cheek puff 0.570 0.691 0.118 0.691 0.233
[1] Mehrabian A, Ferris SR. Inference of attitudes from nonverbal communication in two channels[J]. J Consult Psychol, 1967,31(3):248-252.
doi: 10.1037/h0024648 pmid: 6046577
[2] House JW, Brackmann DE. Facial nerve grading system[J]. Otolaryngol Head Neck Surg, 1985,93(2):146-147.
doi: 10.1177/019459988509300202 pmid: 3921901
[3] Popat H, Richmond S, Zhurov AI, et al. A geometric morphometric approach to the analysis of lip shape during speech: Development of a clinical outcome measure[J]. PLoS One, 2013,8(2):e57368.
doi: 10.1371/journal.pone.0057368 pmid: 23451213
[4] Hallac RR, Feng J, Kane AA, et al. Dynamic facial asymmetry in patients with repaired cleft lip using 4D imaging (video stereophotogrammetry)[J]. J Craniomaxillofac Surg, 2017,45(1):8-12.
doi: 10.1016/j.jcms.2016.11.005 pmid: 28011182
[5] Al-Hiyali A, Ayoub A, Ju X, et al. The impact of orthognathic surgery on facial expressions[J]. J Oral Maxillofac Surg, 2015,73(12):2380-2390.
doi: 10.1016/j.joms.2015.05.008 pmid: 26044608
[6] Popat H, Richmond S, Marshall D, et al. Three-dimensional assessment of functional change following class 3 orthognathic correction: A preliminary report[J]. J Craniomaxillofac Surg, 2012,40(1):36-42.
doi: 10.1016/j.jcms.2010.12.005 pmid: 21377887
[7] Shujaat S, Khambay BS, Ju X, et al. The clinical application of three-dimensional motion capture (4D): A novel approach to quantify the dynamics of facial animations[J]. Int J Oral Maxillofac Surg, 2014,43(7):907-916.
pmid: 24583138
[8] Bell A, Lo TW, Brown D, et al. Three-dimensional assessment of facial appearance following surgical repair of unilateral cleft lip and palate[J]. Cleft Palate Craniofac J, 2014,51(4):462-471.
doi: 10.1597/12-140 pmid: 23369016
[9] Sawyer AR, See M, Nduka C. Assessment of the reproducibility of facial expressions with 3-d stereophotogrammetry[J]. Otolaryngol Head Neck Surg, 2009,140(1):76-81.
doi: 10.1016/j.otohns.2008.09.007 pmid: 19130966
[10] Johnson PC, Brown H, Kuzon WM, et al. Simultaneous quantitation of facial movements: The maximal static response assay of facial nerve function[J]. Ann Plast Surg, 1994,32(2):171-179.
doi: 10.1097/00000637-199402000-00013 pmid: 8192368
[11] Gross MM, Trotman CA, Moffatt KS. A comparison of three-dimensional and two-dimensional analyses of facial motion[J]. Angle Orthod, 1996,66(3):189-194.
doi: 10.1043/0003-3219(1996)066<0189:ACOTDA>2.3.CO;2 pmid: 8805913
[12] Trotman CA, Faraway JJ, Silvester KT, et al. Sensitivity of a method for the analysis of facial mobility. I. Vector of displacement[J]. Cleft Palate Craniofac J, 1998,35(2):132-141.
pmid: 9527310
[13] Alagha MA, Ju X, Morley S, et al. Reproducibility of the dyna-mics of facial expressions in unilateral facial palsy[J]. Int J Oral Maxillofac Surg, 2018,47(2):268-275.
pmid: 28882498
[14] Alqattan M, Djordjevic J, Zhurov AI, et al. Comparison between landmark and surface-based three-dimensional analyses of facial asymmetry in adults[J]. Eur J Orthod, 2015,37(1):1-12.
doi: 10.1093/ejo/cjt075 pmid: 24152377
[15] Ju X, O’Leary E, Peng M, et al. Evaluation of the reproducibility of nonverbal facial expressions using a 3D motion capture system[J]. Cleft Palate Craniofac J, 2016,53(1):22-29.
doi: 10.1597/14-090r
[1] Aonan WEN, Xiaohui ZHANG, Yongtao YANG, Zixiang GAO, Wenbo LI, Shenyao SHAN, Xiangyi SHANG, Yuwen TIAN, Shuwei GUO, Yizhen WANG, Yong WANG, Yijiao ZHAO. Method of constructing 3D facial smile simulation sequence data based on non-rigid registration [J]. Journal of Peking University (Health Sciences), 2026, 58(1): 139-144.
[2] Shuangyun ZHAO, Siyu ZOU, Xueying LI, Lijuan SHEN, Hong ZHOU. Evaluation of reliability and validity of Chinese version of a short-form of Health Literacy Dental scale (HeLD-14) in the application among parents of preschool children [J]. Journal of Peking University (Health Sciences), 2024, 56(5): 828-832.
[3] Ning XIAO,Yu-chun SUN,Yi-jiao ZHAO,Yong WANG. A method to evaluate the trueness of reconstructed dental models made with photo-curing 3D printing technologies [J]. Journal of Peking University(Health Sciences), 2019, 51(1): 120-130.
[4] ZHENG Bang, LI Man, WANG Kai-lu, LV Jun. Analysis of the reliability and validity of the Chinese version of Pittsburgh sleep qua-lity index among medical college students [J]. Journal of Peking University(Health Sciences), 2016, 48(3): 424-428.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright © Journal of Peking University (Health Sciences), All Rights Reserved.
Powered by Beijing Magtech Co. Ltd