Next Article in Journal
Recognition of Postoperative Cystography Features by Artificial Intelligence to Predict Recovery from Postprostatectomy Urinary Incontinence: A Rapid and Easy Way to Predict Functional Outcome
Previous Article in Journal
FairEmbo Concept for Postpartum Hemorrhage: Evaluation of the Efficacy of Suture Fragment Compared with Gelatin Sponge Torpedo Embolization in a Post-Gravid Swine Model
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
JPM
Volume 13
Issue 1
10.3390/jpm13010125
jpm-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Three-Dimensional Accuracy and Stability of Personalized Implants in Orthognathic Surgery: A Systematic Review and a Meta-Analysis

by
Alexandru Diaconu
1,
Michael Boelstoft Holte
1,2,*,
Gabriele Berg-Beckhoff
3 and
Else Marie Pinholt
1,2
1
3D Lab Denmark, Department of Oral and Maxillofacial Surgery, University Hospital of Southern Denmark, Finsensgade 35, 6700 Esbjerg, Denmark
2
Department of Regional Health Research, Faculty of Health Sciences, University of Southern Denmark, Finsensgade 35, 6700 Esbjerg, Denmark
3
Department of Public Health, Faculty of Health Sciences, University of Southern Denmark, Degnevej 14, 6705 Esbjerg, Denmark
*
Author to whom correspondence should be addressed.
J. Pers. Med. 2023, 13(1), 125; https://doi.org/10.3390/jpm13010125
Submission received: 13 December 2022 / Revised: 30 December 2022 / Accepted: 4 January 2023 / Published: 7 January 2023
(This article belongs to the Section Methodology, Drug and Device Discovery)
Browse Figures
Review Reports Versions Notes

Abstract

:
This systematic review aimed to determine the accuracy/stability of patient-specific osteosynthesis (PSI) in orthognathic surgery according to three-dimensional (3D) outcome analysis and in comparison to conventional osteosynthesis and computer-aided designed and manufactured (CAD/CAM) splints or wafers. The PRISMA guidelines were followed and six academic databases and Google Scholar were searched. Records reporting 3D accuracy/stability measurements of bony segments fixated with PSI were included. Of 485 initial records, 21 met the eligibility (566 subjects), nine of which also qualified for a meta-analysis (164 subjects). Six studies had a high risk of bias (29%), and the rest were of low or moderate risk. Procedures comprised either single-piece or segmental Le Fort I and/or mandibular osteotomy and/or genioplasty. A stratified meta-analysis including 115 subjects with single-piece Le Fort I PSI showed that the largest absolute mean deviations were 0.5 mm antero-posteriorly and 0.65° in pitch. PSIs were up to 0.85 mm and 2.35° more accurate than conventional osteosynthesis with CAD/CAM splint or wafer (p < 0.0001). However, the clinical relevance of the improved accuracy has not been shown. The literature on PSI for multi-piece Le Fort I, mandibular osteotomies and genioplasty procedure is characterized by high methodological heterogeneity and a lack of randomized controlled trials. The literature is lacking on the 3D stability of bony segments fixated with PSI.

1. Introduction

Titanium patient-specific fixation plates (PSI) are becoming more frequently used in orthognathic surgery (OS), due to accurate positioning and fixation for osteosynthesis and the supposedly resultant reduced operation time [1,2,3,4,5]. Nevertheless, the challenge of PSI usage lies in the expertise and labor required in their design manufacturing for each orthognathic case, thereby adding to operative costs [1,3,4,5]. In order to justify their use, the literature on the accuracy of PSIs, especially in comparison with the less expensive computer-aided design/computer-aided manufacturing (CAD/CAM) inter-occlusal wafers, has been developed in recent years. Studies have highlighted the use of PSI in OS for mono- and bimaxillary procedures, as well as for genioplasty, in combination with a three-dimensional (3D) virtual surgical planning (VSP) workflow [1,2,3,4,5]. However, due to the heterogeneous methodology and a lack of controlled trials in the literature [1,2], the most recent developments have yet to offer a precise recommendation on the use of PSI in OS.
Standardization in measurements of craniofacial surgery’s accuracy and stability, and skeletal movement at follow-up longer than one year postoperatively, creates challenges, an issue raised by Zavattero et al. [6]. Computer-assisted surgical assessment using voxel-based registration (VBR) [7,8,9] is superior to the traditional technique for the assessment of the surgical outcome [10], offering accurate superimposition methods for measurements and comparisons [7,8,9]. Virtual surgical planning is an accurate approach to OS [11], creating virtual results with deviations less than 2 mm/4°, which are considered clinically acceptable [12,13,14,15,16,17,18]—although standardization lacks consensus [15,19]. A standardized protocol for accuracy and stability measurements in OS implying VBR and a validated automated analysis of outcomes in 3D has already been established [20] and implemented in the literature [21,22,23,24]. The purpose of this study was, therefore, to perform a literature review evaluating whether the use of PSI in OS is examined for accuracy and stability by established 3D methods such as VBR and a validated automated analysis of outcomes in 3D—and compared to the use of CAD/CAM splints. The specific aim of this systematic review was to answer the following research question: Is PSI accurate/stable in OS, and more so than the use of CAD/CAM splints, as evaluated by the established standardized 3D methods [20,21,22,23,24]?

2. Materials and Methods

2.1. Study Design

For this review, the authors followed the criteria established in the Preferred Reporting Items for Systematic Reviews and Meta Analyses (PRISMA) guidelines [25].
The predictor variable was the use of PSI in OS, and the outcome variables were the translational (antero-posterior, transversal and vertical) and rotational (pitch, roll, yaw) accuracy and stability measurements performed by the standardized 3D methods [20,21,22,23,24].

2.2. Eligibility Criteria

Inclusion criteria: (1) studies on humans undergoing (2) corrective orthognathic procedures employing the use of Le Fort I (either single-piece or segmental) and/or mandibular osteotomy (BSSO, Inverted-L or vertical) and/or genioplasty procedures with (3) patient-specific titanium fixation plates, and (4) measurements of accuracy of the bone movements in 3D must be present.
Exclusion criteria: in vitro studies, studies including patients under the age of 14, procedures of reconstructive surgery (e.g., trauma, oncology-related, temporomandibular joint replacement, mandibular free flap reconstruction), studies not in the English language, reviews that contain already identified records (excluded only after full text consideration), case reports of a single patient, abstracts and letters.

2.3. Search Strategy

A systematic electronic search was conducted on the following databases: Cochrane Library, Embase (Ovid), Medline (Ovid), PubMed, Scopus and Web of Science. Additionally, a hand search was performed on Google Scholar. The search strings can be found in Table A1 (Appendix A). Furthermore, the reference lists of the selected records were hand-searched for potentially omitted relevant entries. All records were managed using EndNote X9 (Clarivate, Philadelphia, PA, USA).

2.4. Data Collection

The author, year published, study design, number of patients, demographic data, treatment, location of PSI, accuracy measurements and software used were recorded. The records were evaluated by the lead authors (A.D. and M.H.), noting weaknesses in study design and analysis. The senior author (E.P.) independently reviewed the potential records, and the final selection of included studies is the result of this process.

2.5. Risk of Bias Assessment

The studies that were non-randomized were assessed for risk of bias using the methodological index for non-randomized studies (MINORS) [26]. The MINORS system scores individual studies as “not reported” (0 points), “reported but inadequate” (1 point) or “reported and adequate” (2 points). Final scores in the ideal scenario would be 16 points for non-comparative studies and 24 points for comparative studies.
The studies that were randomized were assessed using the Cochrane Collaboration’s tool for assessing the risk of bias in randomized trials [27], using the following quality criteria: random sequence generation, allocation concealment, blinding of participants, blinding of outcome, incomplete data addressed and selective reporting. The possible assessments were a low, high or unclear risk of bias, respectively.

2.6. Meta-Analysis

Where permitted by the resemblance and homogeneity of the study design and measured outcomes of the records, a meta-analysis was conducted using STATA version 17.0 (StataCorp, College Station, TX, USA). In the cases where the mean value was not provided, the median was used instead. After checking for normal distribution, the standard deviation was calculated using the interquartile range [28]. A random effect model was used for the overall estimate to consider potential variation in the data.

3. Results

3.1. Liteature Search

The results of the literature search performed on 14 July 2022 and updated in October 2022 are summarized in Figure 1. The database searches yielded 485 results, with an additional five records identified through manual searching. After deduplication, 142 records were removed, leaving 348 records for title and abstract screening. After screening the titles and abstracts, 294 irrelevant records were removed, leaving 54 records for full text assessment. Thirty-three full text records were excluded, as they did not meet the eligibility criteria. The remaining 21 studies were included in the analysis. The references of these studies were appraised (552 titles) and no additional articles were selected.

3.2. Characteristics of Eligible Studies

All included studies were published between 2017 and 2022. A total of 566 patients from 21 articles were included for this systematic review. Eleven articles had a prospective study design [13,29,30,31,32,33,34,35,36,37,38], of which five were randomized [31,34,36,37,38], four were clinical trials [31,34,36,38] and two were multi-center [34,38]. The study characteristics are presented in Table 1.
The number of patients ranged from 4 to 82 [39,40]. Two of the records used the same cohort as part of a study performing different accuracy measurements [29,30]. Another two records consisted of different time-points of the same study [34,38], where a subset of the cohort had the measurements of the first time-point reported again for stability assessment [38]. These patients have only been included once in the total count for this review.
Sixteen records evaluated the accuracy of PSI for the maxilla [13,31,32,33,34,36,37,38,39,40,41,42,43,44,45,46], out of which eight exclusively focused on non-segmental Le Fort I procedures [31,32,34,36,38,43,45,46] and two on non-segmental Le Fort I procedures in conjunction with the accuracy of PSI for mandibular osteotomies [13,39]. Six studies included mixed single and segmental Le Fort I osteotomies [33,37,40,41,42]. One of the included studies investigated exclusively segmental Le Fort I osteotomies [44]. Three records reported the accuracy of PSI for mandibular osteotomies exclusively [29,30,47]. Two studies investigated the accuracy of PSI for genioplasty. Table 2 contains the accuracy measurements and Figure 2 contains a Venn diagram of the study distribution.

3.3. Risk of Bias

MINORS scores ranged between 8 and 12 for the non-comparative studies, showing a moderate risk of bias (mean: 10 points), and they were 16–22 for the comparative studies, showing a low risk of bias (mean: 17 points) (Table 3).
The risk of bias assessment for randomized trials indicated an overall low risk of bias. In only one case, there was a high risk of attrition bias due to the previously established sample size not being achieved at the outcome reported one year postoperatively [38] (Table 4 and Appendix B).

3.4. Meta-Analysis: PSI Accuracy in Single Le Fort I Osteotomy Procedures

The studies were divided into categories based on the PSI location: at the Le Fort I level, mandible or genioplasty. The only subset that had sufficient data for a meta-analysis comprised those studies employing single Le Fort I osteotomies exclusively. The studies reporting absolute values were analyzed [32,34,36,39,43,45]. A stratification of the meta-analysis on absolute and signed values was done to allow correct interpretation of the estimates on two studies [13,46]. Furthermore, to allow a similar presentation of all values in one estimate, one stratum was used for a study that provided a very narrow standard deviation that was an outlier among other studies [31].
The outcome variables and the antero-posterior, transversal and vertical error measurements were registered. An analysis was also conducted on the subset of studies that included pitch, roll and yaw error measurements [34,36,39,43,45,46]. This analysis was also stratified, with a stratum for the studies reporting signed values separate from the rest.
The main results for the analysis with absolute values are presented in the following and shown in Table 5, Table 6, Table 7 and Table 8. The absolute values are considered the most relevant results, because signed results are not representative of the magnitude of errors of bony movements. However, the signed results are representative of the direction of the errors.
The mean (standard deviation) absolute translational deviation was 0.30 (0.18) mm laterally, 0.50 (0.13) mm antero-posteriorly and 0.42 (0.14) mm vertically. The mean absolute rotational deviation was 0.65° (0.35) for pitch, 0.36° (0.17) for roll and 0.26° (0.12) for yaw. All translation and rotation deviations were statistically significant (p < 0.0001). Figure 3, Figure 4, Figure 5, Figure 6, Figure 7, Figure 8, Figure 9, Figure 10, Figure 11, Figure 12, Figure 13 and Figure 14 show the meta-analysis forest plots.
A meta-analysis was also possible on four records containing comparison data between procedures with PSI and a control group undergoing a CAD/CAM splint or wafer-based procedure [31,34,35,36,45]. This was also presented in a stratified manner, as it included the study by Hanafy et al., with a very narrow standard deviation [31]. The average translational difference between the PSI and the control was −0.85 mm laterally, −0.68 mm antero-posteriorly and −0.39 mm vertically; the average rotational difference was −2.35° for pitch, −0.47° for roll and −0.56° for yaw. The negative differences indicate that Le Fort I osteotomies with PSI deviate less from the planned bone position than procedures using CAD/CAM splints or wafers. All differences were statistically significant (p < 0.0001).
All of these results were considered acceptably below the thresholds of clinical relevance of 2 mm and 4°.
Some of the included records could not be included in the meta-analysis due to the following reasons: the relevant data from one study were redundant [38] because it originated in a cohort that was already included in the meta-analysis [34]; five records had mixed results from single and segmental Le Fort I procedures [33,37,40,41,42].

3.5. Mixed Le Fort I Procedures

Five studies reported the PSI accuracy on cohorts containing mixed single and segmental Le Fort I osteotomies [33,37,40,41,42], respectively. The main findings of these studies were below the clinically relevant thresholds of 2 mm of translational deviation and 4° rotational deviation. Individually, they indicated that PSI procedures were at least as accurate as splint-based procedures, and, in the case of particular landmarks, more accurate. However, due to heterogeneity in methodology, a meta-analysis could not be performed on this group.
Karanxha et al. compared PSI with a control group using CAD/CAM splints, and the PSI group was found to be more accurate in the translational movement at the A point (p = 0.008) and anterior nasal spine (ANS) (p = 0.045), and in the rotational movement in roll (p = 0.04) and yaw (p = 0.04) [33]. Furthermore, the PSI procedures were found to be accurate, with no statistically significant differences in either translational or rotational movements between the actual outcome and the planned result [33].
Jones et al. reported, on a cohort of 82 patients, that repositioning of the maxilla with PSI versus CAD/CAM splints resulted in a smaller mean error for PSI, which was statistically significant for lateral and vertical movements and incisor angulation [40]. Furthermore, statistically significant differences were reported for the sagittal movement of the UI between cranial and caudal repositioning of the maxillae in the PSI group, with upward movement affecting the sagittal position of the UI less (p = 0.02) [40].
Sanchez-Jauregui et al. reported significant differences in the antero-posterior and vertical accuracy, with PSI procedures being more accurate than CAD/CAM splint procedures (p < 0.05) [37].
Abel et al. reported discrepancies below 0.6 mm in all dimensions at the A point when comparing the planned result with the outcome achieved with PSI on maxillae, which were considered statistically significant against a threshold of 2 mm, rendering PSI procedures highly accurate [41].

3.6. Segmental Le Fort I

Rios et al. (2022) reported accuracy levels below the clinically relevant 2 mm deviation between the planned and postoperative result using PSI on a cohort of segmental Le Fort I maxillae in all three dimensions. Furthermore, no statistically significant differences were found in the average discrepancies between the lateral, antero-posterior and vertical axes [44].

3.7. Mandibular Osteotomy Procedures

Six of the included records investigated the accuracy of PSI in mandibular osteotomy procedures [13,29,30,33,41,47]: three reported exclusively mandibular PSI accuracy measurements [29,30,47], and three of them as part of procedures applying PSI to both the maxilla and the mandible [13,33,41]. Abel et al. [41] studied mandible-first and maxilla-first procedures separately, and reported mean errors below 1.15 mm at the B point and below 1.29 mm at the pogonion (p < 0.01), with no significant differences with respect to the sequencing. Karanxha et al. [33] concluded that PSI yields more accurate transfer results than the conventional method, with significant differences at the B point and both lower canines (p = 0.049) for translation and no significant differences for rotation. Li et al. [13] reported deviations for the mandibular dental arch, mandibular body and proximal segments separately. All reported vales were below 2 mm and 4°, highlighting the PSI as accurate, but no statistical test assessed the significance of the discrepancies.
In two studies, Badiali et al. [29,30] reported separately on the tooth bearing fragment of the mandible, the Rami and plates and found that all discrepancies were below the clinically significant thresholds of 2 mm and 4°.

3.8. Genioplasty Procedures

Li et al. and Ruckschloss et al. found PSI for genioplasty accurate and within the clinical limits of 2 mm and 4° of error [35,48]. However, according to Ruckschloss et al. [48], the aesthetic outcomes, including the soft tissue, are not evidently quantifiable; thus, no conclusion could be drawn on the superiority of PSI over conventional osteosynthesis for genioplasty.

3.9. Stability

Van der Wel et al. analyzed the discrepancy in bone movements with PSI one year postoperatively and concluded that there is no clinically relevant difference in the use of PSI or conventional osteosynthesis for OS on single Le Fort I maxillae [38]: both methods yielded relapse lower than 1 mm and 1 degree.

4. Discussion

The purpose of this review was to investigate in the literature whether the use of PSI in OS is accurate and stable, and more so than the use of CAD/CAM splints. Not all studies were homogenous in their methodology. As a result, they were grouped. The most homogenous grouping comprised records measuring the translational and rotational accuracy of one-piece Le Fort I maxillae. Hence, a meta-analysis was performed on this group.
According to the meta-analysis, PSIs are accurate within the clinically acceptable thresholds of 2 mm/4° in the use of OS on single-piece Le Fort I maxillae, and more accurate than a conventional osteosynthesis and CAD/CAM splint workflow. According to the qualitative synthesis, the use of PSI in OS on segmental le Fort I procedures, mandibular osteotomies and genioplasties is accurate within the clinically acceptable thresholds of 2 mm/4°. However, the heterogeneity in methodology and a lack of prospective randomized clinical trials prevent a definitive conclusion. The stability of PSI in OS has been sparsely investigated, with a single study concluding that PSI use on nonsegmental Le Fort I maxilla fixation is comparable to conventional fixation in terms of stability [38].
The studies investigating PSIs’ accuracy in genioplasty procedures and mandibular osteotomies were not sufficient in magnitude and in homogeneity to be fit for a meta-analysis. Further studies are required. However, a qualitative synthesis indicates discrepancies below 2 mm and 4° for the existing studies.
One randomized controlled trial was available on the stability of PSI on non-segmental Le Fort I maxillae. The novel findings indicate that PSI is stable and comparable with conventional fixation methods [38]. The results of the study are limited only by the sample size, and they provide a first view in an area where the literature is lacking.
The risk of bias assessments reveal a wide range of bias levels, pertaining especially to non-randomized, retrospective study designs with a lack of control groups. In the case of stability, the single long-term follow-up study fitting the criteria of the systematic review, although providing novel data, had a high risk of attrition bias, leading to skewness in group sizes.
To the authors’ knowledge, this is the first meta-analysis of studies reporting complete 3D measurements of PSI accuracy of maxillae. The results corroborate previous reviews that there is a need for high-quality studies on the accuracy and stability of PSI in OS [1,2,5]. Although the literature on the topic has accelerated recently, a complete meta-analysis on the accuracy of PSI for all maxillary and mandibular segments is still infeasible due to the heterogeneous methodology and lack of randomized clinical trials. Additionally, the recommended standardized method for the 3D accuracy and stability assessment of OS is not employed in the majority of these works, and neither are the processes automated. Lastly, the prospective calculation of the sample size is sparsely performed.
There are several limitations to the presented meta-analysis. Within the included records, translational error measurements are performed at the upper incisors, at the geometrical center of the bone segment, or are derived from a rigid transformation matrix of the bone segment. These records have been pooled together for the analysis while acknowledging the potential weakness of not using the same exact anatomical landmarks. It is considered less informative to have further stratified the analysis based on this difference in the specificity of the measurement point, as the analysis of such reduced groups would prevent any meaningful conclusions from being drawn. Furthermore, some of the mean values required in the analysis were estimated from the available median values and interquartile range values. Lastly, the stratum of the meta-analysis with controlled studies contains only five records, and it is further stratified by one of the studies reporting an unusually narrow standard deviation. Despite these potential limitations, the heterogeneity estimates (I2) of the chosen groups were low.
Regarding the issue of the standardization of accuracy measurements in OS, the literature seems to move towards the full 3D measurement of translation and rotation. However, heterogeneity persists in methodologies with respect to the points/landmarks at which measurements are performed. Future research is required to focus on PSI accuracy in OS, in regard to multi-piece Le Fort I procedures, mandibular osteotomies, genioplasty and long-term stability measurements, with a prospective study design and control groups. To ensure high-quality results and comparability, future researchers are also encouraged to focus on automatic 3D analysis according to standardized methods [20,21,22,23,24].
It should be noted that surface-based registration (SBR) provides an alternative method to VBR for the 3D assessment of the surgical accuracy and stability of orthognathic surgery, which has been applied in several of the included studies in the present systematic literature review [13,29,30,31,32,35,36,40,43,45,46,47,48]. Surface-based registration aligns two 3D surfaces using the iterative closest point algorithm [49], and SBR has been shown to be a reproducible method [50,51]. Both registration methods have been found to be reliable and accurate [52,53,54]. Although VBR has been shown to be more consistent and efficient than SBR, the differences between the two methods were statistically insignificant [52,53,54]. Another comparative study proved that SBR was more accurate and reliable than VBR on the mandibular ramus for the long-term 3D assessment of condylar remodeling following orthognathic surgery [55]. However, it was concluded that the performance difference might have been caused by the application of an inappropriate reference structure proposed in the literature [55,56]. Hence, according to the literature, no statistically significant or clinically relevant differences have yet been shown in the performance of the two methods. Consequently, both methods have been found to be applicable for the 3D assessment of the surgical accuracy and stability of orthognathic surgery.

5. Conclusions

The purpose of this systematic review was to determine whether PSIs are accurate and stable, and more so than conventional CAD/CAM-based wafers and conventional osteosynthesis in OS. The results of the meta-analysis indicate that single-piece Le Fort I osteotomy outcomes are accurate in 3D when compared to the planned movements, falling within the clinically acceptable thresholds of 2 mm and 4°. PSIs are more accurate than the conventional repositioning and fixation methods for single-piece Le Fort I repositioning, with statistical significance favoring PSIs in all three dimensions of translation and rotation. However, the clinical relevance of this improvement has not been shown. Statistical analysis of PSI accuracy for segmental Le Fort I osteotomies, mandibular osteotomies and genioplasty was not possible due to heterogeneity in the literature. However, a qualitative synthesis indicates that PSIs are a viable and accurate method for these procedures in OS. The results are comparable to or better than the conventional methods, but further research is required in the form of randomized controlled trials in order to draw definitive conclusions. The literature on the 3D stability of PSI in OS is sparse, with one novel randomized controlled trial indicating that PSI use in segmental Le Fort I osteotomies provides comparable stability to conventional fixation. Further research is required on the stability of PSI use in OS.

Author Contributions

Conceptualization, A.D., M.B.H. and E.M.P.; methodology, M.B.H. and E.M.P.; validation, M.B.H. and E.M.P.; formal analysis, A.D. and G.B.-B.; investigation, A.D. and M.B.H.; data curation, A.D.; writing—original draft preparation, A.D.; writing—review and editing, A.D., M.B.H., G.B.-B. and E.M.P.; visualization, A.D.; supervision, M.B.H. and E.M.P.; project administration, M.B.H. and E.M.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A. Database Search Strings

Table
Table A1. Database search strings.
Table A1. Database search strings.
DatabaseSearch phrase
Ovid Embase(exp “orthognathic surgery”/OR exp “orthognathic surgical procedures”/OR genioplasty)
AND
(accuracy OR precision OR stability)
AND
(((“patient specific” OR patient-specific OR customized) AND (implant OR instrument)) OR PSI OR splintless OR waferless)
Ovid Medline(exp “orthognathic surgery”/OR exp “orthognathic surgical procedures”/OR genioplasty)
AND
(accuracy OR precision OR stability)
AND
(((“patient specific” OR patient-specific OR customized) AND (implant OR instrument)) OR PSI OR splintless OR waferless)
PubMed(“orthognathic surgery”[Mesh] OR “orthognathic surgical procedures”[Mesh] OR genioplasty) AND (accuracy OR precision OR stability) AND (((“patient specific” OR patient-specific OR customized) AND (implant OR instrument)) OR PSI OR splintless OR waferless)
Web of ScienceALL = ((“orthognathic surgery” OR “orthognathic surgical procedures” OR genioplasty) AND (accuracy OR precision OR stability) AND (((“patient specific” OR patient-specific OR customized) AND (implant OR instrument)) OR PSI OR splintless OR waferless))
Scopus(INDEXTERMS(“orthognathic surgery”) OR INDEXTERMS(“orthognathic surgical procedures”) OR genioplasty)
AND (accuracy OR precision OR stability) AND (((“patient specific” OR patient-specific OR customized) AND (implant OR instrument)) OR PSI OR splintless OR waferless)
Cochrane Library[mh “orthognathic surgery”] OR [mh “orthognathic surgical procedures”] OR genioplasty AND accuracy OR precision OR stability AND ((“patient specific” OR patient-specific OR customized) AND (implant OR instrument)) OR PSI OR splintless OR waferless

Appendix B. Risk of Bias Assessment with Author’s Judgement

Table
Table A2. Risk of bias analysis of Hanafy et al. (2020) using Cochrane Collaboration’s risk of bias tool.
Table A2. Risk of bias analysis of Hanafy et al. (2020) using Cochrane Collaboration’s risk of bias tool.
BiasAuthor’s JudgementSupport for Judgement
Random sequence generationLow risk“The patients were divided randomly into two equal groups using computer software” (p. 64)
Allocation concealmentLow risk“numbers were concealed in closed envelopes” (p. 64)
Blinding of participantsLow risk“Only the patients and the statistician were blinded, as the operator and the assessor would know the group allocation from the shape of the plate.” (p. 64)
It is unlikely any present bias would affect the outcome.
Blinding of outcomeLow risk“Only the patients and the statistician were blinded, as the operator and the assessor would know the group allocation from the shape of the plate.” (p. 64)
It is unlikely any preset bias would affect the objective 3D measurements.
Incomplete outcome data addressedLow riskNo loss of participants.
Selective reportingLow riskAll pre-specified outcomes reported.
Table
Table A3. Risk of bias analysis of Kraeima et al. (2020) using Cochrane Collaboration’s risk of bias tool.
Table A3. Risk of bias analysis of Kraeima et al. (2020) using Cochrane Collaboration’s risk of bias tool.
BiasAuthor’s JudgementSupport for Judgement
Random sequence generationLow risk“Included patients were assigned to either the control group or the intervention group by means of blocked
randomization.” (p. 455)
Allocation concealmentUnclearAllocation concealment is unclear and may present a low risk of bias.
Blinding of participantsUnclearIt is unspecified whether there was blinding. However, any present bias is unlikely to affect the outcome of the procedure.
Blinding of outcomeUnclearIt is unspecified whether there was blinding. However, it is unlikely any preset bias would affect the objective 3D measurements.
Incomplete outcome data addressedLow risk“A total of 64 patients agreed to participate in the study and provided informed consent. However, only 58 completed the study protocol. Six patients were excluded from the PP analysis due to late changes in surgical planning (n = 1); damaged or in complete guides or PSO materials after sterilization (n = 4); and perioperative conversion to the control group protocol (n = 1).” (p. 457)
Acceptable loss of 7%.
Selective reportingLow riskAll pre-specified outcomes reported.
Table
Table A4. Risk of bias analysis of Li et al. (2021) using Cochrane Collaboration’s risk of bias tool.
Table A4. Risk of bias analysis of Li et al. (2021) using Cochrane Collaboration’s risk of bias tool.
BiasAuthor’s JudgementSupport for Judgement
Random sequence generationLow risk“The patients were assigned randomly by means of a block randomization procedure with the use of a computer-generated list of random numbers” (p. 1102)
Allocation concealmentLow risk“The allocation sequence was concealed from the surgeons, enrolled patients, and the researcher” (p. 1102)
Blinding of participantsLow risk“It was impossible to blind the patient and surgeon to the treatment group for the whole study, espe- cially during the operation. However, the surgeons and researchers were blinded to the treatment group during the virtual planning phase.” (p. 1102)
Blinding of outcomeLow risk“The doctor performing the clinical examination after the operation was also blinded to the grouping” (p. 1102)
Incomplete outcome data addressedLow risk“A total of 64 patients were recruited and assigned randomly and equally to both groups. After exclud- ing those lost to follow-up (n = 1) and those who refused the operation (n = 5), 58 patients were included in the primary analysis (27 in the patient-specific implant group and 31 in the control group).” (p. 1106)
Acceptable loss of 7%
Selective reportingLow riskAll pre-specified outcomes reported.
Table
Table A5. Risk of bias analysis of Van der Wel et al. (2022) using Cochrane Collaboration’s risk of bias tool.
Table A5. Risk of bias analysis of Van der Wel et al. (2022) using Cochrane Collaboration’s risk of bias tool.
BiasAuthor’s JudgementSupport for Judgement
Random sequence generationLow risk“The included patients were divided into two groups by means of block randomization” (p. 2)
Allocation concealmentUnclearAllocation concealment is unclear and may present a low risk of bias.
Blinding of participantsUnclearIt is unspecified whether there was blinding. However, any present bias is unlikely to affect the out- come of the procedure.
Blinding of outcomeUnclearIt is unspecified whether there was blinding. However, any present bias is unlikely to affect the accuracy measurements.
Incomplete outcome data addressedHigh risk“A total of 64 patients provided informed consent to participate in the RCT. Fifty-eight patients completed the protocol for the 2-week postoperative analysis, but unfortunately only 27 patients completed the 1-year follow-up study protocol. Reasons for drop-out between the 2-week and 1-year protocol were as follows: no CBCT dataset available due to ‘no show’ of the patient (n = 25) or CBCT scan was per- formed outside the follow up period (n = 6).” (pp. 3,4)
“the statistical comparison between the directional and rotational sub-groups suffered from the skewed ness in group sizes. Considering the prevalence of relapse, the skewedness in group sizes might have influenced the results of the statistical comparison. Generally, the results of this study are limited by a relatively small sample size due to the large number of patients lost during follow-up.” (p. 6)
At the one-year time point, a loss of 31 patients is reported. This is difficult to oversee and it may pre- sent a high risk of attrition bias. The previously established adequate sample size not achieved.
At the two-week time point, the results for 31 patients are omitted in order to enable the comparison with the one-year time point. As such, it is incomplete outcome data, deemed as high risk of bias.
Selective reportingLow riskAll pre-specified outcomes reported.

References

  1. Figueiredo, C.E.; Paranhos, L.R.; da Silva, R.P.; Herval, Á.M.; Blumenberg, C.; Zanetta-Barbosa, D. Accuracy of orthognathic surgery with customized titanium plates—Systematic review. J. Stomatol. Oral Maxillofac. Surg. 2021, 122, 88–97. [Google Scholar] [CrossRef] [PubMed]
  2. Williams, A.; Walker, K.; Hughes, D.; Goodson, A.M.C.; Mustafa, S.F. Accuracy and cost effectiveness of a waferless osteotomy approach, using patient specific guides and plates in orthognathic surgery: A systematic review. Br. J. Oral Maxillofac. Surg. 2022, 60, 537–546. [Google Scholar] [CrossRef] [PubMed]
  3. Huang, M.F.; Alfi, D.; Alfi, J.; Huang, A.T. The Use of Patient-Specific Implants in Oral and Maxillofacial Surgery. Oral Maxillofac. Surg. Clin. N. Am. 2019, 31, 593–600. [Google Scholar] [CrossRef]
  4. Pascal, E.; Majoufre, C.; Bondaz, M.; Courtemanche, A.; Berger, M.; Bouletreau, P. Current status of surgical planning and transfer methods in orthognathic surgery. J. Stomatol. Oral Maxillofac. Surg. 2018, 119, 245–248. [Google Scholar] [CrossRef]
  5. Van den Bempt, M.; Liebregts, J.; Maal, T.; Bergé, S.; Xi, T. Toward a higher accuracy in orthognathic surgery by using intraoperative computer navigation, 3D surgical guides, and/or customized osteosynthesis plates: A systematic review. J. Cranio-Maxillofac. Surg. 2018, 46, 2108–2119. [Google Scholar] [CrossRef]
  6. Zavattero, E.; Gerbino, G.; Borbon, C.; Ramieri, G. Conformity of the Virtual Surgical Plan to the Actual Result Comparing Five Craniofacial Procedure Types. Plast. Reconstr. Surg. 2022, 150, 484e–485e. [Google Scholar] [CrossRef] [PubMed]
  7. Cevidanes, L.H.; Styner, M.A.; Proffit, W.R. Image analysis and superimposition of 3-dimensional cone-beam computed tomography models. Am. J. Orthod. Dentofac. Orthop. 2006, 129, 611–618. [Google Scholar] [CrossRef] [Green Version]
  8. Maes, F.; Collignon, A.; Vandermeulen, D.; Marchal, G.; Suetens, P. Multimodality image registration by maximization of mutual information. IEEE Trans. Med. Imaging 1997, 16, 187–198. [Google Scholar] [CrossRef] [Green Version]
  9. Andriola, F.O.; Junior, O.L.H.; Guijarro-Martínez, R.; Hernández-Alfaro, F.; de Oliveira, R.B.; Pagnoncelli, R.M.; Swennen, G.R. Computed tomography imaging superimposition protocols to assess outcomes in orthognathic surgery: A systematic review with comprehensive recommendations. Dentomaxillofac. Radiol. 2022, 51, 20210340. [Google Scholar] [CrossRef]
  10. Apostolakis, D.; Michelinakis, G.; Kamposiora, P.; Papavasiliou, G. The current state of computer assisted orthognathic surgery: A narrative review. J. Dent. 2022, 119, 104052. [Google Scholar] [CrossRef]
  11. Zoabi, A.; Redenski, I.; Oren, D.; Kasem, A.; Zigron, A.; Daoud, S.; Moskovich, L.; Kablan, F.; Srouji, S. 3D Printing and Virtual Surgical Planning in Oral and Maxillofacial Surgery. J. Clin. Med. 2022, 11, 2385. [Google Scholar] [CrossRef]
  12. Hsu, S.S.; Gateno, J.; Bell, R.B.; Hirsch, D.L.; Markiewicz, M.R.; Teichgraeber, J.F.; Zhou, X.; Xia, J.J. Accuracy of a computer-aided surgical simulation protocol for orthognathic surgery: A prospective multicenter study. J. Oral Maxillofac. Surg. 2013, 71, 128–142. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Li, B.; Shen, S.; Jiang, W.; Li, J.; Jiang, T.; Xia, J.J.; Shen, S.G.; Wang, X. A new approach of splint-less orthognathic surgery using a personalized orthognathic surgical guide system: A preliminary study. Int. J. Oral Maxillofac. Surg. 2017, 46, 1298–1305. [Google Scholar] [CrossRef] [Green Version]
  14. Shaheen, E.; Shujaat, S.; Saeed, T.; Jacobs, R.; Politis, C. Three-dimensional planning accuracy and follow-up protocol in orthognathic surgery: A validation study. Int. J. Oral Maxillofac. Surg. 2019, 48, 71–76. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Tondin, G.M.; Leal, M.; Costa, S.T.; Grillo, R.; Jodas, C.R.P.; Teixeira, R.G. Evaluation of the accuracy of virtual planning in bimaxillary orthognathic surgery: A systematic review. Br. J. Oral Maxillofac. Surg. 2022, 60, 412–421. [Google Scholar] [CrossRef]
  16. Tonin, R.H.; Filho, L.I.; Yamashita, A.L.; Ferraz, F.W.D.S.; Tolentino, E.D.S.; Previdelli, I.T.D.S.; Brum, B.; Iwaki, L.C.V. Accuracy of 3D virtual surgical planning for maxillary positioning and orientation in orthognathic surgery. Orthod. Craniofac. Res. 2020, 23, 229–236. [Google Scholar] [CrossRef]
  17. Tran, N.H.; Tantidhnazet, S.; Raocharernporn, S.; Kiattavornchareon, S.; Pairuchvej, V.; Wongsirichat, N. Accuracy of Three-Dimensional Planning in Surgery-First Orthognathic Surgery: Planning Versus Outcome. J. Clin. Med. Res. 2018, 10, 429–436. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Zhang, N.; Liu, S.; Hu, Z.; Hu, J.; Zhu, S.; Li, Y. Accuracy of virtual surgical planning in two-jaw orthognathic surgery: Comparison of planned and actual results. Oral Surgery Oral Med. Oral Pathol. Oral Radiol. 2016, 122, 143–151. [Google Scholar] [CrossRef]
  19. Alkhayer, A.; Piffko, J.; Lippold, C.; Segatto, E. Accuracy of virtual planning in orthognathic surgery: A systematic review. Head Face Med. 2020, 16, 34. [Google Scholar] [CrossRef] [PubMed]
  20. Gaber, R.M.; Shaheen, E.; Falter, B.; Araya, S.; Politis, C.; Swennen, G.R.; Jacobs, R. A Systematic Review to Uncover a Universal Protocol for Accuracy Assessment of 3-Dimensional Virtually Planned Orthognathic Surgery. J. Oral Maxillofac. Surg. 2017, 75, 2430–2440. [Google Scholar] [CrossRef]
  21. Baan, F.; Sabelis, J.F.; Schreurs, R.; van de Steeg, G.; Xi, T.; van Riet, T.C.T.; Becking, A.G.; Maal, T.J.J. Validation of the OrthoGnathicAnalyser 2.0-3D accuracy assessment tool for bimaxillary surgery and genioplasty. PLoS ONE 2021, 16, e0246196. [Google Scholar] [CrossRef] [PubMed]
  22. da Senior, O.C.; Vaes, L.; Mulier, D.; Jacobs, R.; Politis, C.; Shaheen, E. Three dimensional assessment of segmented Le Fort I osteotomy planning and follow-up: A validation study. J. Dent. 2021, 111, 103707. [Google Scholar] [CrossRef] [PubMed]
  23. Holte, M.B.; Diaconu, A.; Ingerslev, J.; Thorn, J.J.; Pinholt, E.M. Virtual Analysis of Segmental Bimaxillary Surgery: A Validation Study. J. Oral Maxillofac. Surg. 2021, 79, 2320–2333. [Google Scholar] [CrossRef]
  24. Holte, M.B.; Diaconu, A.; Ingerslev, J.; Thorn, J.J.; Pinholt, E.M. Virtual surgical analysis: Long-term cone beam computed tomography stability assessment of segmental bimaxillary surgery. Int. J. Oral Maxillofac. Surg. 2022, 51, 1188–1196. [Google Scholar] [CrossRef]
  25. Liberati, A.; Altman, D.G.; Tetzlaff, J.; Mulrow, C.; Gøtzsche, P.C.; Ioannidis, J.P.A.; Clarke, M.; Devereaux, P.J.; Kleijnen, J.; Moher, D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. PLoS Med. 2009, 6, e1000100. [Google Scholar] [CrossRef]
  26. Slim, K.; Nini, E.; Forestier, D.; Kwiatkowski, F.; Panis, Y.; Chipponi, J. Methodological index for non-randomized studies (minors): Development and validation of a new instrument. ANZ J. Surg. 2003, 73, 712–716. [Google Scholar] [CrossRef]
  27. Higgins, J.P.; Altman, D.G.; Gotzsche, P.C.; Juni, P.; Moher, D.; Oxman, A.D.; Savovic, J.; Schulz, K.F.; Weeks, L.; Sterne, J.A.; et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ 2011, 343, d5928. [Google Scholar] [CrossRef] [Green Version]
  28. Luo, D.; Wan, X.; Liu, J.; Tong, T. Optimally estimating the sample mean from the sample size, median, mid-range, and/or mid-quartile range. Stat. Methods Med. Res. 2018, 27, 1785–1805. [Google Scholar] [CrossRef] [Green Version]
  29. Badiali, G.; Bevini, M.; Lunari, O.; Lovero, E.; Ruggiero, F.; Bolognesi, F.; Feraboli, L.; Bianchi, A.; Marchetti, C. PSI-Guided Mandible-First Orthognathic Surgery: Maxillo-Mandibular Position Accuracy and Vertical Dimension Adjustability. J. Pers. Med. 2021, 11, 1237. [Google Scholar] [CrossRef] [PubMed]
  30. Badiali, G.; Bevini, M.; Ruggiero, F.; Cercenelli, L.; Lovero, E.; De Simone, E.; Marchetti, C. Validation of a patient-specific system for mandible-first bimaxillary surgery: Ramus and implant positioning precision assessment and guide design comparison. Sci. Rep. 2020, 10, 13317. [Google Scholar] [CrossRef]
  31. Hanafy, M.; Akoush, Y.; Abou-ElFetouh, A.; Mounir, R.M. Precision of orthognathic digital plan transfer using patient-specific cutting guides and osteosynthesis versus mixed analogue-digitally planned surgery: A randomized controlled clinical trial. Int. J. Oral Maxillofac. Surg. 2020, 49, 62–68. [Google Scholar] [CrossRef] [PubMed]
  32. Heufelder, M.; Wilde, F.; Pietzka, S.; Mascha, F.; Winter, K.; Schramm, A.; Rana, M. Clinical accuracy of waferless maxillary positioning using customized surgical guides and patient specific osteosynthesis in bimaxillary orthognathic surgery. J. Cranio-Maxillofac. Surg. 2017, 45, 1578–1585. [Google Scholar] [CrossRef]
  33. Karanxha, L.; Rossi, D.; Hamanaka, R.; Giannì, A.B.; Baj, A.; Moon, W.; Del Fabbro, M.; Romano, M. Accuracy of splint vs splintless technique for virtually planned orthognathic surgery: A voxel-based three-dimensional analysis. J. Cranio-Maxillofac. Surg. 2021, 49, 1–8. [Google Scholar] [CrossRef] [PubMed]
  34. Kraeima, J.; Schepers, R.H.; Spijkervet, F.K.L.; Maal, T.J.J.; Baan, F.; Witjes, M.J.H.; Jansma, J. Splintless surgery using patient-specific osteosynthesis in Le Fort I osteotomies: A randomized controlled multi-centre trial. Int. J. Oral Maxillofac. Surg. 2020, 49, 454–460. [Google Scholar] [CrossRef] [PubMed]
  35. Li, B.; Wang, S.; Wei, H.; Zeng, F.; Wang, X. The use of patient-specific implants in genioplasty and its clinical accuracy: A preliminary study. Int. J. Oral Maxillofac. Surg. 2020, 49, 461–465. [Google Scholar] [CrossRef]
  36. Li, B.; Wei, H.; Jiang, T.; Qian, Y.; Zhang, T.; Yu, H.; Zhang, L.; Wang, X. Randomized Clinical Trial of the Accuracy of Patient-Specific Implants versus CAD/CAM Splints in Orthognathic Surgery. Plast. Reconstr. Surg. 2021, 148, 1101–1110. [Google Scholar] [CrossRef] [PubMed]
  37. Sanchez-Jauregui, E.; Baranda-Manterola, E.; Ranz-Colio, A.; de Vicente, A.B.; Acero-Sanz, J. Custom made cutting guides and osteosynthesis plates versus CAD/CAM occlusal splints in positioning and fixation of the maxilla in orthognathic surgery: A prospective randomized study. J. Cranio Maxillofac. Surg. 2022, 50, 609–614. [Google Scholar] [CrossRef] [PubMed]
  38. van der Wel, H.; Kraeima, J.; Spijkervet, F.K.L.; Schepers, R.H.; Jansma, J. Postoperative skeletal stability at the one-year follow-up after splintless Le Fort I osteotomy using patient-specific osteosynthesis versus conventional osteosynthesis: A randomized controlled trial. Int. J. Oral Maxillofac. Surg. 2022. [Google Scholar] [CrossRef]
  39. Ho, J.P.T.F.; Schreurs, R.; Baan, F.; de Lange, J.; Becking, A.G. Splintless orthognathic surgery in edentulous patients—A pilot study. Int. J. Oral Maxillofac. Surg. 2020, 49, 587–594. [Google Scholar] [CrossRef]
  40. Jones, J.P.; Amarista, F.J.; Jeske, N.A.; Szalay, D.; Ellis, E. Comparison of the Accuracy of Maxillary Positioning with Interim Splints Versus Patient-Specific Guides and Plates in Executing a Virtual Bimaxillary Surgical Plan. J. Oral Maxillofac. Surg. 2022, 80, 827–837. [Google Scholar] [CrossRef]
  41. Abel, A.R.; Ho, K.; Neugarten, J.M. What Is the Accuracy of Bimaxillary Orthognathic Surgery Using Occlusally and Patient-Specific Fixation in Both Jaws? A Cohort Study and Discussion of Surgical Techniques. J. Oral Maxillofac. Surg. 2022, 80, 1912–1926. [Google Scholar] [CrossRef]
  42. Greenberg, S.; Buchbinder, D.; Turner, M.D.; Dhillon, P.; Afshar, A.A. Three-Dimensional Repositioning of the Maxilla in Orthognathic Surgery Using Patient-Specific Titanium Plates: A Case Series. J. Oral Maxillofac. Surg. 2021, 79, 902–913. [Google Scholar] [CrossRef] [PubMed]
  43. Liu, K.; Sun, H.; Zhang, L.; Li, B.; Chakraborty, S.; Wang, X. Do patient-specific cutting guides and plates improve the accuracy of maxillary repositioning in hemifacial microsomia? Br. J. Oral Maxillofac. Surg. 2020, 58, 590–596. [Google Scholar] [CrossRef]
  44. Rios, O.; Lerhe, B.; Chamorey, E.; Savoldelli, C. Accuracy of Segmented Le Fort I Osteotomy with Virtual Planning in Orthognathic Surgery Using Patient-Specific Implants: A Case Series. J. Clin. Med. 2022, 11, 5495. [Google Scholar] [CrossRef] [PubMed]
  45. Ruckschloss, T.; Ristow, O.; Muller, M.; Kuhle, R.; Zingler, S.; Engel, M.; Hoffmann, J.; Freudlsperger, C. Accuracy of patient-specific implants and additive-manufactured surgical splints in orthognathic surgery—A three-dimensional retrospective study. J. Cranio-Maxillofac. Surg. 2019, 47, 847–853. [Google Scholar] [CrossRef] [PubMed]
  46. Wong, A.; Goonewardene, M.S.; Allan, B.P.; Mian, A.S.; Rea, A. Accuracy of maxillary repositioning surgery using CAD/CAM customized surgical guides and fixation plates. Int. J. Oral Maxillofac. Surg. 2021, 50, 494–500. [Google Scholar] [CrossRef]
  47. Harding, J.; Hartsfield, J.K., Jr.; Mian, A.S.; Allan, B.P.; Naoum, S.; Lee, R.J.H.; Goonewardene, M.S. Accuracy of mandibular proximal segment position using virtual surgical planning and custom osteosynthesis plates. Int. J. Oral Maxillofac. Surg. 2022, 51, 219–225. [Google Scholar] [CrossRef]
  48. Ruckschloss, T.; Ristow, O.; Kuhle, R.; Weichel, F.; Roser, C.; Aurin, K.; Engel, M.; Hoffmann, J.; Freudlsperger, C. Accuracy of laser-melted patient-specific implants in genioplasty—A three-dimensional retrospective study. J. Cranio-Maxillofac. Surg. 2020, 48, 653–660. [Google Scholar] [CrossRef]
  49. Besl, P.J.; McKay, N.D. A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. 1992, 14, 239–256. [Google Scholar] [CrossRef] [Green Version]
  50. Cassoni, A.; Manganiello, L.; Barbera, G.; Priore, P.; Fadda, M.T.; Pucci, R.; Valentini, V. Three-Dimensional Comparison of the Maxillary Surfaces through ICP-Type Algorithm: Accuracy Evaluation of CAD/CAM Technologies in Orthognathic Surgery. Int. J. Environ. Res. Public Health 2022, 19, 11834. [Google Scholar] [CrossRef] [PubMed]
  51. Marliere, D.A.A.; Demetrio, M.S.; Verner, F.S.; Asprino, L.; Netto, H.D.M.C. Feasibility of iterative closest point algorithm for accuracy between virtual surgical planning and orthognathic surgery outcomes. J. Cranio-Maxillofac. Surg. 2019, 47, 1031–1040. [Google Scholar] [CrossRef] [PubMed]
  52. Han, G.; Li, J.; Wang, S.; Wang, L.; Zhou, Y.; Liu, Y. A comparison of voxel- and surface-based cone-beam computed tomography mandibular superimposition in adult orthodontic patients. J. Int. Med. Res. 2021, 49, 300060520982708. [Google Scholar] [CrossRef] [PubMed]
  53. Ghoneima, A.; Cho, H.; Farouk, K.; Kula, K. Accuracy and reliability of landmark-based, surface-based and voxel-based 3D cone-beam computed tomography superimposition methods. Orthod. Craniofac. Res. 2017, 20, 227–236. [Google Scholar] [CrossRef]
  54. Almukhtar, A.; Ju, X.; Khambay, B.; McDonald, J.; Ayoub, A. Comparison of the accuracy of voxel based registration and surface based registration for 3D assessment of surgical change following orthognathic surgery. PLoS ONE 2014, 9, e93402. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Holte, M.B.; Saederup, H.; Pinholt, E.M. Comparison of surface- and voxel-based registration on the mandibular ramus for long-term three-dimensional assessment of condylar remodelling following orthognathic surgery. Dentomaxillofac. Radiol. 2022, 51, 20210499. [Google Scholar] [CrossRef]
  56. Verhelst, P.J.; Shaheen, E.; Vasconcelos, K.D.F.; Van der Cruyssen, F.; Shujaat, S.; Coudyzer, W.; Salmon, B.; Swennen, G.; Politis, C.; Jacobs, R. Validation of a 3D CBCT-based protocol for the follow-up of mandibular condyle remodeling. Dentomaxillofac. Radiol. 2020, 49, 20190364. [Google Scholar] [CrossRef]
Jpm 13 00125 g001 550
Figure 1. PRISMA flow diagram.
Figure 1. PRISMA flow diagram.
Jpm 13 00125 g001
Jpm 13 00125 g002 550
Figure 2. Venn diagram of anatomical location of PSI in the included records with 3D assessment.
Figure 2. Venn diagram of anatomical location of PSI in the included records with 3D assessment.
Jpm 13 00125 g002
Jpm 13 00125 g003 550
Figure 3. Forest plot showing mean lateral deviation.
Figure 3. Forest plot showing mean lateral deviation.
Jpm 13 00125 g003
Jpm 13 00125 g004 550
Figure 4. Forest plot showing mean antero-posterior deviation.
Figure 4. Forest plot showing mean antero-posterior deviation.
Jpm 13 00125 g004
Jpm 13 00125 g005 550
Figure 5. Forest plot showing mean vertical deviation.
Figure 5. Forest plot showing mean vertical deviation.
Jpm 13 00125 g005
Jpm 13 00125 g006 550
Figure 6. Forest plot showing mean pitch deviation.
Figure 6. Forest plot showing mean pitch deviation.
Jpm 13 00125 g006
Jpm 13 00125 g007 550
Figure 7. Forest plot showing mean roll deviation.
Figure 7. Forest plot showing mean roll deviation.
Jpm 13 00125 g007
Jpm 13 00125 g008 550
Figure 8. Forest plot showing mean yaw deviation.
Figure 8. Forest plot showing mean yaw deviation.
Jpm 13 00125 g008
Jpm 13 00125 g009 550
Figure 9. Forest plot showing differences in lateral deviation between PSI and control (conventional osteosynthesis and CAD/CAM splint or wafer).
Figure 9. Forest plot showing differences in lateral deviation between PSI and control (conventional osteosynthesis and CAD/CAM splint or wafer).
Jpm 13 00125 g009
Jpm 13 00125 g010 550
Figure 10. Forest plot showing differences in antero-posterior deviation between PSI and control (conventional osteosynthesis and CAD/CAM splint or wafer).
Figure 10. Forest plot showing differences in antero-posterior deviation between PSI and control (conventional osteosynthesis and CAD/CAM splint or wafer).
Jpm 13 00125 g010
Jpm 13 00125 g011 550
Figure 11. Forest plot showing differences in vertical deviation between PSI and control (conventional osteosynthesis and CAD/CAM splint or wafer).
Figure 11. Forest plot showing differences in vertical deviation between PSI and control (conventional osteosynthesis and CAD/CAM splint or wafer).
Jpm 13 00125 g011
Jpm 13 00125 g012 550
Figure 12. Forest plot showing differences in pitch deviation between PSI and control (conventional osteosynthesis and CAD/CAM splint or wafer).
Figure 12. Forest plot showing differences in pitch deviation between PSI and control (conventional osteosynthesis and CAD/CAM splint or wafer).
Jpm 13 00125 g012
Jpm 13 00125 g013 550
Figure 13. Forest plot showing differences in roll deviation between PSI and control (conventional osteosynthesis and CAD/CAM splint or wafer).
Figure 13. Forest plot showing differences in roll deviation between PSI and control (conventional osteosynthesis and CAD/CAM splint or wafer).
Jpm 13 00125 g013
Jpm 13 00125 g014 550
Figure 14. Forest plot showing differences in yaw deviation between PSI and control (conventional osteosynthesis and CAD/CAM splint or wafer).
Figure 14. Forest plot showing differences in yaw deviation between PSI and control (conventional osteosynthesis and CAD/CAM splint or wafer).
Jpm 13 00125 g014
Table
Table 1. Summary of records.
Table 1. Summary of records.
Author, YearStudy DesignNMean Age (Range)TreatmentPSI Component
Abel et al. (2022)Cohort (retrospective)49F: 24
M: 25.6		Bimaxillary osteotomyMaxilla (single or split) and mandible
Badiali et al. (2021)Cohort (prospective)22 *26 (18–43)Bimaxillary osteotomyMandible
Badiali et al. (2020)Cohort (prospective)2226 (18–43)Bimaxillary osteotomyMandible
Greenberg et al. (2021)Series (retrospective)1025.7Bimaxillary osteotomyMaxilla (single or segmental)
Hanafy et al. (2020)RCT (prospective)1821.2 (19–24)Bimaxillary osteotomyMaxilla (single)
Harding et al. (2022)Cohort (retrospective)55PSI: 28.0 (16–52)
Splint: 25.9 (16–47)		Bimaxillary osteotomyMandible
Heufelder et al. (2017)Series (prospective)22NS (17–59)Bimaxillary osteotomyMaxilla (single)
Ho et al. (2020)Cohort (retrospective)455 (48–62)Bimaxillary osteotomy
bilateral sagittal split osteotomy		Maxilla (single)
Jones et al. (2022)Cohort (retrospective)8223.2 (14–54)Bimaxillary osteotomyMaxilla (single or segmental)
Karanxha et al. (2021)Cohort (prospective)1626.4Bimaxillary osteotomyMaxilla (single or segmental) and mandible
Kraeima et al. (2020)RCMCT (prospective)5827.6 (19–60)Le Fort I osteotomyMaxilla (single)
Li et al. (2017)Series (prospective)10NS (18–27)Bimaxillary osteotomyMaxilla (single) and mandible
Li et al. (2020)Cohort (prospective)15NS (18–30)Genioplasty, with or without simultaneous Le Fort I and/or bilateral sagittal split osteotomyChin
Li et al. (2021)RCT (prospective)58PSI: 23.8 (19–32)
Splint: 23.6 (19–33)		Bimaxillary osteotomyMaxilla (single)
Liu et al. (2020)Cohort (retrospective)18NS (17–30)Bimaxillary osteotomyMaxilla (single)
Rios et al. (2022)Series (retrospective)2227.4Bimaxillary osteotomyMaxilla (segmental)
Ruckschloss et al. (2020)Cohort (retrospective)2924.2Bimaxillary osteotomyChin
Ruckschloss et al. (2019)Cohort (retrospective)18F: 23.3
M: 19.8		Le Fort I osteotomy (single) or
bimaxillary osteotomy		Maxilla (single)
Sanchez-Jauregui et al. (2020)Cohort (prospective)30NSLe Fort I osteotomy (single or split)Maxilla (single or segmental)
van der Wel et al. (2022)RCMCT (prospective)27 †PSI: 28.6 (9.7)
Splint: 26.8 (6.9)		Le Fort I osteotomy (single) with or without mandibular osteotomyMaxilla (single)
Wong et al. (2021)Series (retrospective)30F: 25.5
M: 29.2		Le Fort I osteotomy (single) with or without mandibular osteotomy and genioplastyMaxilla (single)
* Same cohort as Badiali et al. (2020); RCT: randomized controlled trial; RCMCT: randomized controlled multi-center trial; PSI; patient-specific implant; F/M: female/male; NS: not specified; † sub-group of cohort in Kraeima et al. (2020).
Table
Table 2. Accuracy measurements.
Table 2. Accuracy measurements.
Author, YearPSI Component (s)TranslationRotation
Abel et al. (2022)Maxilla and mandible         A-point:
Lateral: 0.37 (0.45), AP: 0.57 (0.57), vertical: 0.45 (0.42)
         B-point:
Lateral: 0.62 (0.54), AP: 1.15 (1.28), vertical: 1.14 (0.83)
         Pogonion:
Lateral: 0.85 (0.73), AP: 1.29 (1.50), vertical: 1.24 (0.85)
Badiali et al. (2021)Mandible         Mandible:
Lateral: 1.14 (1.00), AP: 1.49 (1.59), vertical: −1.05 (1.23)		      Mandible:
Pitch: 1.53 (1.34), roll: 0.96 (0.85), yaw: 1.13 (0.99)
Badiali et al. (2020)Mandible         Rami:
Lateral: 0.49 (1.05), AP: 0.32 (0.92), vertical: −0.04 (0.94)
         Plates:
Lateral: 0.20 (0.64), AP: −0.68 (1.18), vertical: 0.26 (0.79)		         Rami:
Pitch: 0.52 (2.39), roll: 0.90 (2.15), yaw: −1.91 (2.70)
         Plates:
Pitch: −1.93 (3.89), roll: 0.13 (3.04), yaw: 0.20 (1.41)
Greenberg et al. (2021)Maxilla         UI:
Lateral: 0.66 (0.51), AP: 0.80 (0.56), vertical: 0.48 (0.27)
Hanafy et al. (2020)Maxilla         PSI UI:
Lateral: 0.07 (0.02), AP: 0.17 (0.04), vertical: 0.26 (0.08)
        Wafer UI:
Lateral: 0.71 (0.21), AP: 1.31 (0.51), vertical: 1.45 (0.58)
Harding et al. (2022)Mandible      R ramus PSI:
Lateral: 1.18, AP: 0.62, vertical: 0.58
      R ramus control:
Lateral: 0.83, AP: 0.78, vertical: 0.70
      L ramus PSI:
Lateral: 1.20, AP: 0.45, vertical: 0.44
      L ramus control:
Lateral: 0.83, AP: 0.68, vertical: 0.56		      R ramus PSI:
Pitch: 1.00, roll: 1.43, yaw: 1.53
      R ramus control:
Pitch: 1.50, roll: 2.42, yaw: 2.98
     L ramus PSI:
Pitch: 1.32, roll: 1.62, yaw: 1.59
      L ramus control:
Pitch: 1.41, roll: 1.39, yaw: 2.45
Heufelder et al. (2017)Maxilla         UI:
Lateral: 0.2, AP: 0.35, vertical: 0.85
Ho et al. (2020)Maxilla         Maxilla:
Lateral: 0.3, AP: 1.1, vertical: 0.5		         Maxilla:
Pitch: 1.9, roll: 0.4, yaw: 0.1
Jones et al. (2022)Maxilla         PSI UI:
Lateral: 0.41, AP: 0.94, vertical: 0.54
         Splint UI:
Lateral: 1.01, AP: 0.93, vertical: 1.23
Karanxha et al. (2021)Maxilla and mandible         PSI UI:
Lateral: 0.32 (0.27), AP: 1.43 (0.81), vertical: 0.85 (0.59)
         Splint UI:
Lateral: 0.45 (0.43), AP: 1.53 (0.63), vertical: 1.73 (0.90)
         PSI LI:
Lateral: 0.94 (0.74), AP: 1.99 (1.84), vertical: 1.99 (1.39)
         Splint LI:
Lateral: 1.78 (1.11), AP: 1.34 (1.2), vertical: 3.68 (4.62)		         PSI Maxilla:
Pitch: 2.87 (1.52), roll: 0.49 (0.51), yaw: 0.17 (0.05)
         Splint maxilla:
Pitch: 2.30 (1.31), roll: 1.62 (0.78), yaw: 0.63 (0.45)
         PSI mandible:
Pitch: 2.85 (1.68), roll: 0.84 (0.82), yaw: 1.68 (1.00)
         Splint mandible:
Pitch: 2.48 (2.30), roll: 1.54 (1.85), yaw: 1.62 (1.36)
Kraeima et al. (2020)Maxilla         PSI UI:
Lateral: 0.46, AP: 1.05, vertical: 0.87
         Splint UI:
Lateral: 1.07, AP: 1.74, vertical: 0.98		         PSI Maxilla:
Pitch: 2.33, roll: 0.53, yaw: 0.21
         Splint maxilla:
Pitch: 2.17, roll: 0.60, yaw: 0.44
Li et al. (2017)Maxilla and mandible         UI:
Lateral: −0.18 (0.35), AP: −0.54 (0.53), vertical: 0.33 (0.53)
         LI:
Lateral: −0.33 (0.50), AP: −0.67 (0.92), vertical: 0.38 (0.72)
         Left ramus:
Lateral: −0.10 (1.03), AP: 0.23 (0.82), vertical: −0.10 (0.79)
         Right ramus:
Lateral: −0.18 (0.70), AP: 0.05 (0.54), vertical: −0.28 (0.94)		         UI:
Pitch: 0.11 (0.69), roll: 0.02 (0.60), yaw: −0.83 (1.83)
         LI:
Pitch: 0.45 (1.67), roll: −0.07 (0.95), yaw: 0.26 (0.96)
         Left ramus:
Pitch: 1.39 (2.12), roll: 0.01 (1.14), yaw: 0.49 (2.06)
         Right ramus:
Pitch: −1.66 (1.85), roll: −0.59 (1.73), yaw: 0.26 (2.20)
Li et al. (2020)Chin         Chin centroid:
Lateral: 0.06 (0.71), AP: −0.49 (0.46), vertical: 0.39 (0.55)		         Chin centroid:
Pitch: 0.68 (1.68), roll: −0.10 (1.67), yaw: −0.17 (2.08)
Li et al. (2021)Maxilla         PSI maxilla centroid:
Lateral: 0.37 (0.40), AP: 1.02 (0.66), vertical: 0.61 (0.44)
         Splint maxilla centroid:
Lateral: 1.23 (0.93), AP: 1.12 (0.82), vertical: 0.96 (0.74)		         PSI maxilla:
Pitch: 1.85 (1.42), roll: 1.63 (0.52), yaw: 0.63 (0.44)
         Splint maxilla:
Pitch: 1.72 (1.56), roll: 1.25 (1.18), yaw: 0.88 (0.71)
Liu et al. (2020)Maxilla         PSI:
Lateral: 0.30 (0.18), AP: 0.50 (0.18), vertical: 0.33 (0.18)
         Splint:
Lateral: 1.05 (0.75), AP: 1.37 (0.84), vertical: 1.32 (1.40)		         PSI:
Pitch: 0.40 (0.31), roll: 0.28 (0.21), yaw: 0.82 (0.60)
         Splint:
Pitch: 3.56 (3.26), roll: 1.53 (1.05), yaw: 8.84 (7.73)
Rios et al. (2022)Maxilla         UI:
Lateral: 0.54 (0.44), AP: 0.74 (0.51), vertical: 0.35 (0.24)
Ruckschloss et al. (2020)Chin         Chin:
Lateral: 0.25 (0.28), AP: 0.70 (0.64), vertical: 0.45 (0.38)		         Chin:
Pitch: 1.76 (0.98), roll: 0.89 (0.74), yaw: 0.83 (0.57)
Ruckschloss et al. (2019)Maxilla         PSI:
Lateral: 0.51 (0.48), AP: 0.39 (0.26), vertical: 0.37 (0.40)
         Splint:
Lateral: 1.11 (1.32), AP: 1.42 (0.87), vertical: 0.62 (0.47)		         PSI:
Pitch: 1.04 (0.97), roll: 0.43 (0.49), yaw: 0.57 (0.26)
         Splint:
Pitch: 1.84 (1.48), roll: 0.46 (0.64), yaw: 1.31 (1.11)
Sanchez-Jauregui et al. (2020)Maxilla         PSI:
Lateral: 0.2, AP: 0.8, vertical: 0.4
         Splint:
Lateral: 0.2, AP: 1.7, vertical: 1.8
van der Wel et al. (2022)Maxilla         Accuracy:
         PSI UI:
Lateral: 0.5, AP: 3.8, vertical: 2.1
         Splint UI:
Lateral: 1.2, AP: 2.8, vertical: 1.5

         Stability:
         PSI UI:
Lateral: 0.3, AP: 0.5, vertical: 0.3
         Splint UI:
Lateral: 0.2, AP: 0.2, vertical: 0.3		         Accuracy:
         PSI:
Pitch: 2.6, roll: 0.7, yaw: 0.2
         Splint:
Pitch: 1.8, roll: 0.9, yaw: 0.6

         Stability:
         PSI:
Pitch: 0.1, roll: 0.2, yaw: 0.0
         Splint:
Pitch: 0.0, roll: 0.2, yaw: 0.0
Wong et al. (2021)Maxilla         UI:
Lateral: −0.14 (0.22), AP: −0.09 (0.38), vertical: −0.26 (0.32)		         UI:
Pitch: −0.28 (1.03), roll: 0.09 (0.47), yaw: −0.21 (0.45)
UI: upper incisor midpoint; PSI: patient-specific implant; R: right; L: left.
Table
Table 3. Risk of bias analysis using the revised methodological items for non-randomized studies [26].
Table 3. Risk of bias analysis using the revised methodological items for non-randomized studies [26].
RecordMINORS Score
Karanxha et al. (2021)18
Harding et al. (2022)17
Jones et al. (2022)16
Liu et al. (2020)16
Ruckschloss et al. (2019)16
Heufelder et al. (2017)12
Li et al. (2020)12
Abel et al. (2022)10
Ho et al. (2020)10
Li et al. (2017)10
Rios et al. (2022)10
Wong et al. (2021)10
Badiali et al. (2021)9
Badiali et al. (2020)9
Greenberg et al. (2021)9
Kim et al. (2019)9
Ruckschloss et al. (2020)8
Table
Table 4. Risk of bias analysis using Cochrane Collaboration’s risk of bias tool.
Table 4. Risk of bias analysis using Cochrane Collaboration’s risk of bias tool.
Record123456
Hanafy et al. (2020)++++++
Li et al. (2021)++++++
Sanchez-Jauregui et al. (2020)+???++
Kraeima et al. (2020)+???++
van der Wel et al. (2022)+???- *+
1. Random sequence generation; 2. Allocation concealment; 3. Blinding of participants; 4. Blinding of outcome; 5. Incomplete outcome data addressed; 6. Selective reporting; +: low risk; ?: unclear risk; -: high risk; * sub-group of Kraeima et al. (2020) cohort: new time-point of outcome (1 year postoperatively).
Table
Table 5. Descriptive results on translational error and significance at 2 mm threshold.
Table 5. Descriptive results on translational error and significance at 2 mm threshold.
Summarized ResultsLateralAntero-PosteriorVertical
MeanSDp *MeanSDp *MeanSDp *
Absolute values0.300.18<0.00010.500.13<0.00010.420.14<0.0001
Hanafy et al.0.070.02<0.00010.170.04<0.00010.260.08<0.0001
Signed values−0.170.41<0.0001−0.240.31<0.0001−0.100.28<0.0001
Overall0.070.02<0.00010.300.08<0.00010.280.07<0.0001
* simple one-sample t-test for the estimated mean <2 mm.
Table
Table 6. Descriptive results on rotational error and significance at 4° threshold.
Table 6. Descriptive results on rotational error and significance at 4° threshold.
Summarized ResultsPitchRollYaw
MeanSDp *MeanSDp *MeanSDp *
Absolute values0.650.35<0.00010.360.17<0.00010.260.12<0.0001
Signed values−0.010.57<0.00010.060.37<0.0001−0.240.44<0.0001
Overall0.450.25<0.00010.150.15<0.00010.100.10<0.0001
* simple one-sample t-test for the estimated mean <4°.
Table
Table 7. Translational differences and significance between PSI and conventional osteosynthesis.
Table 7. Translational differences and significance between PSI and conventional osteosynthesis.
DimensionMean Difference (mm)p-Value *
LateralAbsolute values only: −0.852Absolute values only: <0.0001
Overall: −0.852Overall: <0.0001
Antero-posteriorAbsolute values only: −0.677Absolute values only: <0.0001
Overall: −1.127Overall: <0.0001
VerticalAbsolute values only: −0.393Absolute values only: <0.0001
Overall: −0.811Overall: <0.0001
* two-sample t-test.
Table
Table 8. Rotational differences and significance between PSI and conventional osteosynthesis.
Table 8. Rotational differences and significance between PSI and conventional osteosynthesis.
DimensionMean Difference (Degrees)p-Value *
Pitch−2.352<0.0001
Roll−0.472<0.0001
Yaw−0.568<0.0001
* two-sample t-test.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Diaconu, A.; Holte, M.B.; Berg-Beckhoff, G.; Pinholt, E.M. Three-Dimensional Accuracy and Stability of Personalized Implants in Orthognathic Surgery: A Systematic Review and a Meta-Analysis. J. Pers. Med. 2023, 13, 125. https://doi.org/10.3390/jpm13010125

AMA Style

Diaconu A, Holte MB, Berg-Beckhoff G, Pinholt EM. Three-Dimensional Accuracy and Stability of Personalized Implants in Orthognathic Surgery: A Systematic Review and a Meta-Analysis. Journal of Personalized Medicine. 2023; 13(1):125. https://doi.org/10.3390/jpm13010125

Chicago/Turabian Style

Diaconu, Alexandru, Michael Boelstoft Holte, Gabriele Berg-Beckhoff, and Else Marie Pinholt. 2023. "Three-Dimensional Accuracy and Stability of Personalized Implants in Orthognathic Surgery: A Systematic Review and a Meta-Analysis" Journal of Personalized Medicine 13, no. 1: 125. https://doi.org/10.3390/jpm13010125

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop