Next Article in Journal
Autologous Breast Reconstruction with Free Nipple–Areola Graft after Circumareolar (Skin Reducing) Mastectomy
Next Article in Special Issue
Implementation of Routine Endoscopy with Narrow Band Imaging in the Evaluation of Oral and Upper Airways Lesions in Oral Chronic Graft-Versus-Host Disease: A Preliminary Study
Previous Article in Journal
Comparative Analysis between Individual, Centralized, and Federated Learning for Smartwatch Based Stress Detection
Previous Article in Special Issue
Effectiveness of Dupilumab in the Treatment of Patients with Uncontrolled Severe CRSwNP: A “Real-Life” Observational Study in Naïve and Post-Surgical Patients
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Reliability of a Multidisciplinary Multiparametric Approach in the Surgical Planning of Laryngeal Squamous Cell Carcinomas: A Retrospective Observational Study

1
Department of Medical, Surgical and Experimental Science, University of Sassari, 07100 Sassari, Italy
2
Division of Otolaryngology, Azienda Ospedaliero Universitaria, 07100 Sassari, Italy
3
Residency Program in Otolaryngology, University of Cagliari, 09124 Cagliari, Italy
4
Institute of Pathology, Azienda Ospedaliero Universitaria, 07100 Sassari, Italy
5
Institute of Radiology, Azienda Ospedaliero Universitaria, 07100 Sassari, Italy
*
Author to whom correspondence should be addressed.
J. Pers. Med. 2022, 12(10), 1585; https://doi.org/10.3390/jpm12101585
Submission received: 29 August 2022 / Revised: 14 September 2022 / Accepted: 20 September 2022 / Published: 26 September 2022
(This article belongs to the Special Issue Personalized Medicine in Otorhinolaryngology)

Abstract

:
(1) Background: Endoscopy and morphological imaging are the mainstay of the diagnostic work up of laryngeal squamous cell carcinomas (LSCCs), which can be integrated in a multidisciplinary discussion to obtain a shared pretreatment staging. (2) Methods: A retrospective evaluation of patients, managed at a tertiary university hospital in Italy and submitted to major laryngeal surgery, has been performed. Four different stagings have been defined and compared: epTN (based on endoscopy and physical ENT examination); radTN (based on CT scan); cTN (based on multidisciplinary integration of the two above); pTN based on pathology on surgical samples. Oncological outcomes have been assessed. (3) Results: Three-year relapse free and disease specific survival were 88% and 92.5%, respectively, without significant differences between partial surgeries (n = 13) and total laryngectomies (n = 32). As for the pretreatment staging, and in particular the T classification, the cTN has been revealed as more reliable than epTN and radTN alone in predicting the final pT (Cohen kappa coefficient: 0.7 for cT, 0.44 for radT, 0.32 for epT). In the partial surgery group, we did not record any positive margin nor local recurrence, with a 100% overall and disease-specific survival. (4) Conclusions: The multidisciplinary approach is fundamental in the definition of the primary lesion in LSCC, in particular in order to safely perform surgical preservation of laryngeal function, which is associated with a higher laryngectomy-free survival than irradiation but to a lower salvageability in case of recurrence.

Graphical Abstract

1. Introduction

Laryngeal cancer, mostly squamous cell carcinomas (LSCC), represents one-third of all head and neck cancers, which are the sixth most common cancer worldwide, and can arise in different subsites of larynx, with specific clinical features and therapeutic options [1].
A certain decrease in incidence has been recorded in Western countries, proportional to the success of antismoking campaigns [2,3], which has been more evident in the US, where the incidence of laryngeal cancer has been 2.8/100,000 in 2020, with a constant decrease over the last 30 years. The death rate is around 0.9/100,000 [4].
However, LSCC remains the only human malignancy with uterine body adenocarcinoma without a clear prognostic improvement over the past 30 years [5].
This can derive at least in part from the increasing attention to quality-of-life issues and functional outcomes, which, in the case of larynx, mean speech and swallowing. In fact, in the last 30 years, functional outcomes in LSCC have become almost as important as the fundamental oncological endpoints (survival, relapse) and have produced pressure towards function-preserving therapeutic strategies, that is, the attempt to avoid primary total laryngectomy (the mainstay of laryngeal oncology).
Data from non-surgical organ preservation strategies raised great enthusiasm in the 1990s as they showed that LSCC (with the exclusion of cT4 cases) was highly curable by non-surgical preservation protocols, thus anatomically preserving the larynx [6,7,8,9,10,11].
However, such anatomical preservation through non-surgical strategies often does not correspond to a satisfying functional preservation [12]. In addition, the long-term oncological results of cT2 and cT3 cases are less outstanding than initially estimated [6,7,8,9,10,11,13], with an increased rate of non-cancer-related deaths in patients treated by chemoradiotherapy [14] and laryngectomy after non-surgical preservation failures is notoriously affected by a higher rate of complications and worse short and long-term outcomes [15,16].
Such considerations, combined with emerging data mostly from European groups, describing a markedly higher total laryngectomy-free survival associated with open partial horizontal laryngectomies (OPHL), and endoscopic horizontal supraglottic laryngectomies (eHSL), when indicated [17,18,19,20], contributed to an increasing popularity of surgical functional preservation.
Nevertheless, an inappropriate indication to partial surgery—most often deriving from inappropriate presurgical assessment—is associated with the almost constant need for larynx sacrifice and much higher mortality than non-surgical approaches, as post-surgical recurrences have a definitively lower salvageability [17,18].
Therefore, pretreatment staging, which is of utmost importance in oncology in general, is definitely the key for success in laryngeal oncology in the era of function preservation. Endoscopy is the gold standard for the assessment of mucosal surfaces, but it has not been shown to be reliable for the evaluation of submucosal and paraglottic spaces [21] and, most of all, of cartilages and extralaryngeal deep spaces, which are fundamental parameters both for staging and surgical planning. Hence, morphological imaging is also mandatory (CT scan and/or MRI) for preoperative assessment [21,22].
Multidisciplinary management in tumor boards has become a standard in oncology, and has been demonstrated to significantly improve prognosis in head and neck oncology [23,24]. Tumor boards are also meant to integrate radiological, clinical, and endoscopic data for obtaining the most reliable staging and, therefore, treatment planning.
The aim of the present study is to assess and compare the effectiveness of physical examination/endoscopy (fibrolaryngoscopy), contrast enhanced CT scan, and multidisciplinary evaluation during tumor board meetings based on the integration of the above information in presurgical assessment of laryngeal squamous cell carcinoma (LSCC).

2. Materials and Methods

This is a retrospective observational cohort study based on the retrieval of clinical, oncological, and radiological data and of tumor board meeting reports of patients affected by primary and recurrent laryngeal and hypopharyngeal SCCs and treated at the ENT division of AOU Sassari, a tertiary University Hospital in Sardinia, Italy, between August 2017 and December 2020 through a major laryngeal surgery (partial horizontal laryngectomy or total laryngectomy). M+ patients as well as non-surgical cases and cases treated through minor laryngeal surgery (cordectomy for T1-2 glottic primaries) have been excluded from the present analysis. Staging workup has been performed according to the NCCN guidelines for the cancers of the larynx [25] which also included a neck and chest CT scan with iodine i.v. contrast and thin-angled cuts through the larynx, a complete head and neck exam with mirror and fiberoptic examination, and an evaluation of pulmonary function.

2.1. Tumor Board Discussion and Treatment Selection

Every head and neck cancer patient in our institution is evaluated at a multidisciplinary tumor board, which completes and defines the clinical staging and gives treatment recommendations, as described also by other groups [26]. The cTNM always results from a multidisciplinary discussion involving different expertises (e.g., head and neck surgeons, radiologists, radiation oncologists, medical oncologists, histopathologists) and using all the clinical as well as radiological data available. In the tumor board, choice of treatment is always based on three orders of parameters:
  • The staging according to American Joint Committee on Cancer (AJCC);
  • Patterns of local spread not included in the AJCC T staging (such as the posterior paraglottic space involvement) as previously described [17,18,20];
  • Patient-related parameters such as age, comorbidities, and preferences.
Namely, with the intent of organ preservation, in most cT3 cases, we suggested a horizontal laryngectomy (type II OPHL or eHSL) when feasible according to previously described criteria [17,20]. Alternatively, radiochemotherapy has been recommended, when indicated, with the intent of organ preservation (cases not included in the present series) [17]. In cT3 cases with a low compliance to surgical or non-surgical organ preservation protocols as a result of comorbidity, social factors, or personal preference, we performed a total laryngectomy. For patients with cT4a SCCs, we usually recommend a total laryngectomy, with the exception of cT4N0 cases with exclusive involvement of the anterior commissure and/or of the anterior part of the thyroid laminae in the absence of extensive extralaryngeal invasion; in these cases, a CHP was sometimes recommended.
All patients underwent bilateral neck dissection, elective/selective (levels II, III, IV) in cN0 cases, comprehensive (levels II-VI) in cN+.
Follow-up visits were scheduled every 3 months in the first year, every 4 months in the second, every 6 months in the third and fourth, and every year from the fifth on and included ceCT (including the chest once a year), endoscopy, and complete head and neck physical examination in order to monitor relapses and detect second primary tumors early.

2.2. Data Collection

The present work is substantially an audit aimed at evaluating the effectiveness, strengths, and the weaknesses of a multidisciplinary team in the surgical planning for laryngeal cancers.
Several parameters (see results section), have been collected and analyzed as assessed by history collection, endoscopy and physical examination, follow-up visits, radiology, multidisciplinary discussion, and histopathology. More in detail, parameters concerning the pattern of spread of primary tumor, as assessed by endoscopy, ceCTscan and pathology on the surgical sample, have been recorded and compared (see results section).
Four different stagings have been defined and compared (see results section):
  • epTN (based on endoscopy and physical ENT examination);
  • radTN based on CT scan;
  • cTN (based on multidisciplinary discussion);
  • pTN based on pathology on surgical sample.

2.3. Statistical Analysis

Statistical analysis was performed using the JMP in software, release 7.0.1, from the SAS Institute (Cary, NC, USA).
Survival has been evaluated using Kaplan–Meyer curves, which were compared by Log-rank test.
The agreement between epTN, radTN, and cTN and the reference pTN, and therefore their reliability, has been determined by calculating the Cohen kappa coefficient, a measure that takes a value of zero if there is no correlation between the different assessments. To score the significance, the kappa values are ranked. Values less than 0.4, between 0.4 and 0.75, or higher than 0.75 represent poor, fair-to-good, or excellent correlations, respectively.

3. Results

Forty-five consecutive patients have been included.
Descriptive statistics are shown in Table 1.
In total, 41 out of 45 patients were operated on for a primary tumor and 4 for recurrences; among these, two had been treated primarily through non-surgical modality and two through surgery.
Twelve patients underwent type-2 OPHL; one underwent EHSL; the remaining 32 patients underwent total laryngectomy. Four recurrences were recorded in the total laryngectomy population (1 local; 1 regional, level VI; 2 distant). One recurrence was recorded in the partial laryngectomy population (regional at level VII).
The exclusion of patients treated after 2020 allowed a reasonable and reliable follow-up in order to assess oncological outcome (average follow-up, 24 months).
Relapse-free survival (RFS, Figure 1A), overall (OS, Figure 1B), and disease-specific (DSS, Figure 1C) survival were 88%, 74%, and 92.5%. respectively, at 3 years (Figure 1).
When comparing patients submitted to partial laryngeal surgery (n = 13) with those submitted to total laryngectomy (n = 32), no differences are found as for 3-year RFS and DSS, while partial laryngectomies are associated with a significantly longer OS (Figure 2C, p = 0.04 at Log-rank test). This finding is expected because partial laryngectomies are indicated in patients with no neck nodes and no massive extralaryngeal extension (usually lower stages), less comorbidities (in particular CPOD), and younger age.
The results concerning the primary endpoints of the present study are shown in Table 2. The ability to predict the pTN with the different pretreatment stagings (epTN, radTN, cTN) as estimated by the calculation of kappa value is always fair to good for radTN and cTN, while it remains poor for epTN, both in the assessment of T and N classification. However, interestingly, the ability to predict the pathological T classification of LSCC, which is key for the success of surgery, and in particular of partial surgery, is increased after discussion and integration of endoscopy/physical exam (epTN) and radiology (radTN) in the multidisciplinary tumor board (cTN, kappa 0.7).

4. Discussion

The careful and extensive data collection and the long follow-up compensate for the relative smallness of the sample and allowed to obtain clear and interesting results. The “real world” setting, with only contrast-enhanced CT scan and endoscopy available for staging and definition of the primary lesion and of N, allows one to appreciate the real impact of multidisciplinary management in daily clinical practice.
In fact, the present work clearly confirms that integration of clinical, endoscopic, and radiological data in the multidisciplinary discussion of tumor boards drastically increases the reliability of the pretreatment definition of T classification and the definition of anatomical pattern of spread of the primary lesion in LSCCs, as demonstrated by the higher kappa value and by the extremely low rate of local recurrence (0 in the partial surgery group). Even if the necessity of multidisciplinary management of head and neck cancers has been clearly and extensively proven, its utility for this specific aim in laryngeal oncology had never been previously evaluated.
The indication to partial laryngeal surgery, that is, surgical functional preservation, takes into account patient-related parameters and tumor-related parameters [17,18,27]. Information related to the spread of the primary lesion, partly directly contributing to T classification, and partly not, are critical for an oncologically safe indication to partial laryngeal surgery both in primary and in recurrent LSCC. We previously reported that a careful workup and rigid criteria for the recommendation of OPHL lead to similar disease-specific but markedly higher laryngectomy-free survival than non-surgical preservation protocols (radiochemotherapy) [17]. On the other hand, it is common experience that inappropriate indications to partial laryngeal surgery and OPHL in particular, resulting in positive resection margins, not only compromise organ preservation but also, most importantly, disease-specific survival [28,29,30,31,32]. Therefore, one can affirm that a multidisciplinary shared definition of the primary tumor is mandatory to perform surgical preservation in laryngeal oncology [33]. In the present series, we recorded only one positive margin and subsequent local recurrence in a total laryngectomy performed for a post-surgical recurrence, and no positive margins nor local recurrences in the partial surgery group (with a 100% overall and disease-specific survival), confirming the effectiveness of a methodical multidisciplinary assessment of the primary lesion in avoiding local failures in head and neck oncology and its decisive impact on disease specific survival. Notably, in the partial surgery group of the present series, cT and cN classification corresponded perfectly to pT and pN classification, and this was the main key for the clear oncological success.
The markedly higher overall survival in partial surgery patients in the present series is of course influenced by selection biases, that is, patient-related parameters, and mainly more severe comorbidities, in particular in the lung, which contraindicate partial surgeries.
As for N, the added value of multidisciplinary integration of clinical and radiological data is definitely less beneficial, as one mostly relyinf almost exclusively on radiological findings kappa value of radN is the same as cN as obtained through the multidisciplinary discussion. As a consequence, the prediction by the tumor board of pN is less reliable than that of pT, with potential issues in patients submitted to OPHL in case of histopathological node involvement, which may be an indication for an adjuvant radio+/-chemotherapy, potentially compromising functional results [17,34,35]. This finding, on one hand, confirms the appropriateness of the attitude to always perform bilateral neck dissection in advanced LSCC and, on the other hand, suggests that tools allowing an increase in the sensitivity and specificity in the diagnosis of nodal metastasis should be considered in the work up, including ultrasound-guided fine needle aspiration cytology (FNAC) [36] and PET-CT, whose interpretation pitfalls should be carefully taken into account anyway [36,37,38,39]. However, in the present series, when only presence vs. absence of regional metastasis is considered, which is the decisive parameter in indicating adjuvant irradiation, the reliability of radTN and of cTN increased, and none of the partial surgeries had indication to postoperative treatment because of unexpected nodal spread (nor because of positive margins).
In the definition of the primary lesion, in order to safely recommend partial surgery, some features need to be accurately excluded independently from T classification, and in particular true arytenoid fixation, involvement of the base of the tongue, massive pre-epiglottic space or vallecular invasion, posterior lateral paraglottic space invasion, interarytenoid diffusion, extensive thyroid cartilage invasion, significant subglottic involvement for type II OPHL (in general down to the level of the superior border of the cricoid), and glottic plane involvement for HSL (see Table 2). For some of these parameters, such as as true arytenoid fixation, even its ability to predict the pT classification alone is insufficient basing upon the computed kappa value. The role of head and neck exam with mirror and fiberoptic examination is prominent: in particular we believe it should be the only base for the assessment of laryngeal motility, which is eventually the main information for a safe recommendation of partial surgery as the probability of crico-arytenoid joint infiltration and of posterior paraglottic space invasion is proportional to the laryngeal motion impairment [40,41], and these are in turn the main factors impacting local failure in partial laryngeal surgery [17,32]. For other fundamental parameters, such as extensive cartilage invasion, the information comes exclusively from radiological evaluation. Anyway, for most of the parameters, our results confirm that the information from the two modalities is complementary, and their systematic integration has a decisive added value [22].
Among the limitations of the present study, there is the absence of MRI data. This is due to the difficulties in our institution to plan MRIs in due time, but it probably reflects the reality of most institutions worldwide and makes the present work a real-world study, which is, in our opinion, an added value. Furthermore, according to many authors, CT scan is usually preferred for laryngeal lesions because of a shorter scanning time, an excellent anatomic resolution, and a wide availability. Recently, emerging dual-energy CT techniques have been investigated for head and neck cancer imaging with the potential for improved tumor visualization and characterization [42].
In addition, LSCC patients may be non-compliant to performing MRI due to their difficulty in breathing and swallowing. In addition, the long acquisition time needed for MRI scans increases the risk of motion artifacts and consequently yields poor-quality images [43,44]. MRI is often reserved for selected cases, when CT results are not conclusive or there is an issue with CT or iodine contrast medium [43]. NCCN guidelines do not deem MRI study as mandatory in the work up of laryngeal cancer but consider it an alternative or an integration of CT scan information [45]. Our results show that no gross nor fatal mistakes have been made in treatment planning also without MRI.
However, in case of doubts concerning mostly the involvement of paraglottic or pre-epiglottic spaces, critical for the safe indications to surgical preservation [8,32,45], the MRI has been reported to bring an added value [46], but only with the availability of adequate technology and most of all of specifically trained skilled professionals. Without the availability of MRI and of specific skills and competence for exploiting its potential in laryngeal oncology, which is a frequent situation in the real-world setting, we feel comfortable in simply conservatively not indicating a partial surgery when there is a doubt concerning the above-mentioned features (most of all posterior lateral paraglottic space involvement). The oncological outcomes (in particular in terms of DSS) recorded in the present study confirm it is a wise attitude.

Author Contributions

Conceptualization, D.R. and F.B.; methodology, P.C.; validation, A.C., S.P. and M.S.; formal analysis, C.C., D.R. and F.B.; investigation, D.R., P.T., L.M.D.L., N.T., A.M., C.R.T. and A.F.; data curation, C.C. and P.T.; writing—original draft preparation, D.R., C.C., P.T., L.M.D.L., N.T., A.M., P.C., C.R.T. and A.F.; writing—review and editing, A.C., S.P., M.S. and F.B.; supervision, F.B.; project administration, F.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Ethical review and approval were waived for this study due to observational retrospective design of the study, and in this case, a mandatory ethical approval is not required by the Italian law (GU No. 76 31/Mar/2008).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data are available upon request to the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Piotrowski, I.; Zhu, X.; Saccon, T.D.; Ashiqueali, S.; Schneider, A.; de Carvalho Nunes, A.D.; Noureddine, S.; Sobecka, A.; Barczak, W.; Szewczyk, M.; et al. miRNAs as Biomarkers for Diagnosing and Predicting Survival of Head and Neck Squamous Cell Carcinoma Patients. Cancers 2021, 13, 3980. [Google Scholar] [CrossRef] [PubMed]
  2. Bradley, P.J.; Piazza, C.; Paderno, A. A roadmap of six different pathways to improve survival in laryngeal cancer patients. Curr. Opin. Otolaryngol. Head Neck Surg. 2020, 29, 65–78. [Google Scholar] [CrossRef] [PubMed]
  3. Sung, H.; Ferlay, J.; Siegel, R.L.; Laversanne, M.; Soerjomataram, I.; Jemal, A.; Bray, F. Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA A Cancer J. Clin. 2021, 71, 209–249. [Google Scholar] [CrossRef] [PubMed]
  4. National Cancer Institute, SEER. Available online: http://seer.cancer.gov/statfacts/html/laryn.html (accessed on 23 August 2022).
  5. Siegel, R.L.; Miller, K.D.; Fuchs, H.E.; Jemal, A. Cancer Statistics, 2022. CA Cancer J. Clin. 2022, 72, 7–33. [Google Scholar] [CrossRef]
  6. Forastiere, A.A.; Goepfert, H.; Maor, M.; Pajak, T.F.; Weber, R.; Morrison, W.; Glisson, B.; Trotti, A.; Ridge, J.A.; Chao, C.; et al. Concurrent Chemotherapy and Radiotherapy for Organ Preservation in Advanced Laryngeal Cancer. N. Engl. J. Med. 2003, 349, 2091–2098. [Google Scholar] [CrossRef]
  7. Department of Veterans Affairs Laryngeal Cancer Study Group; Wolf, G.T.; Fisher, S.G.; Hong, W.K.; Hillman, R.; Spaulding, M.; Laramore, G.E.; Endicott, J.W.; McClatchey, K.; Henderson, W.G. Induction Chemotherapy plus Radiation Compared with Surgery plus Radiation in Patients with Advanced Laryngeal Cancer. N. Engl. J. Med. 1991, 324, 1685–1690. [Google Scholar] [CrossRef]
  8. Bussu, F.; Miccichè, F.; Rigante, M.; Dinapoli, N.; Parrilla, C.; Bonomo, P.; Cadoni, G.; Mantini, G.; Galli, J.; Rufini, V.; et al. Oncologic Outcomes in Advanced Laryngeal Squamous Cell Carcinomas Treated with Different Modalities in a Single Institution: A Retrospective Analysis of 65 Cases. Head Neck 2012, 34, 573–579. [Google Scholar] [CrossRef]
  9. De Virgilio, A.; Bussu, F.; De Vincentiis, M. Evidence-Based Review of Treatment Options for Patients with Glottic Cancer. Acta Otorhinolaryngol. Ital. 2012, 32, 256–257. [Google Scholar]
  10. Dinapoli, N.; Parrilla, C.; Galli, J.; Autorino, R.; Miccichè, F.; Bussu, F.; Balducci, M.; D’Alatri, L.; Marchese, R.; Rigante, M.; et al. Multidisciplinary Approach in the Treatment of T1 Glottic Cancer. The Role of Patient Preference in a Homogenous Patient Population. Strahlenther. Onkol. 2010, 186, 607–613. [Google Scholar] [CrossRef]
  11. Koroulakis, A.; Agarwal, M. Laryngeal Cancer. In StatPearls; StatPearls Publishing: Treasure Island, FL, USA, 2022. [Google Scholar]
  12. Hutcheson, K.A.; Lewin, J.S. Functional Outcomes after Chemoradiotherapy of Laryngeal and Pharyngeal Cancers. Curr. Oncol. Rep. 2012, 14, 158–165. [Google Scholar] [CrossRef]
  13. Cooper, J.S.; Zhang, Q.; Pajak, T.F.; Forastiere, A.A.; Jacobs, J.; Saxman, S.B.; Kish, J.A.; Kim, H.E.; Cmelak, A.J.; Rotman, M.; et al. Long-Term Follow-up of the RTOG 9501/intergroup Phase III Trial: Postoperative Concurrent Radiation Therapy and Chemotherapy in High-Risk Squamous Cell Carcinoma of the Head and Neck. Int. J. Radiat. Oncol. Biol. Phys. 2012, 84, 1198–1205. [Google Scholar] [CrossRef] [Green Version]
  14. Forastiere, A.A.; Zhang, Q.; Weber, R.S.; Maor, M.H.; Goepfert, H.; Pajak, T.F.; Morrison, W.; Glisson, B.; Trotti, A.; Ridge, J.A.; et al. Long-Term Results of RTOG 91-11: A Comparison of Three Nonsurgical Treatment Strategies to Preserve the Larynx in Patients with Locally Advanced Larynx Cancer. J. Clin. Oncol. 2013, 31, 845–852. [Google Scholar] [CrossRef]
  15. Silverman, D.A.; Puram, S.V.; Rocco, J.W.; Old, M.O.; Kang, S.Y. Salvage laryngectomy following organ-preservation therapy—An evidence-based review. Oral Oncol. 2018, 88, 137–144. [Google Scholar] [CrossRef]
  16. Tsetsos, N.; Poutoglidis, A.; Vlachtsis, K.; Stavrakas, M.; Nikolaou, A.; Fyrmpas, G. Twenty-Year Experience with Salvage Total Laryngectomy: Lessons Learned. J. Laryngol. Otol. 2021, 135, 729–736. [Google Scholar] [CrossRef]
  17. Bussu, F.; Paludetti, G.; Almadori, G.; De Virgilio, A.; Galli, J.; Miccichè, F.; Tombolini, M.; Rizzo, D.; Gallo, A.; Giglia, V.; et al. Comparison of Total Laryngectomy with Surgical (cricohyoidopexy) and Nonsurgical Organ-Preservation Modalities in Advanced Laryngeal Squamous Cell Carcinomas: A Multicenter Retrospective Analysis. Head Neck 2013, 35, 554–561. [Google Scholar] [CrossRef]
  18. de Vincentiis, M.; De Virgilio, A.; Bussu, F.; Gallus, R.; Gallo, A.; Bastanza, G.; Parrilla, C.; Greco, A.; Galli, J.; Turchetta, R.; et al. Oncologic Results of the Surgical Salvage of Recurrent Laryngeal Squamous Cell Carcinoma in a Multicentric Retrospective Series: Emerging Role of Supracricoid Partial Laryngectomy. Head Neck 2015, 37, 84–91. [Google Scholar] [CrossRef]
  19. Forastiere, A.A.; Ismaila, N.; Lewin, J.S.; Nathan, C.A.; Adelstein, D.J.; Eisbruch, A.; Fass, G.; Fisher, S.G.; Laurie, S.A.; Le, Q.-T.; et al. Use of Larynx-Preservation Strategies in the Treatment of Laryngeal Cancer: American Society of Clinical Oncology Clinical Practice Guideline Update. J. Clin. Oncol. 2018, 36, 1143–1169. [Google Scholar] [CrossRef]
  20. Bussu, F.; Almadori, G.; De Corso, E.; Rizzo, D.; Rigante, M.; Parrilla, C.; Valentini, V.; Paludetti, G. Endoscopic Horizontal Partial Laryngectomy by CO(2) Laser in the Management of Supraglottic Squamous Cell Carcinoma. Head Neck 2009, 31, 1196–1206. [Google Scholar] [CrossRef]
  21. Banko, B.; Dukić, V.; Milovanović, J.; Kovač, J.D.; Artiko, V.; Maksimović, R. Diagnostic Significance of Magnetic Resonance Imaging in Preoperative Evaluation of Patients with Laryngeal Tumors. Eur. Arch. Otorhinolaryngol. 2011, 268, 1617–1623. [Google Scholar] [CrossRef]
  22. Ryu, I.S.; Lee, J.H.; Roh, J.-L.; Choi, S.-H.; Nam, S.Y.; Kim, S.Y.; Cho, K.-J. Clinical Implication of Computed Tomography Findings in Patients with Locally Advanced Squamous Cell Carcinoma of the Larynx and Hypopharynx. Eur. Arch. Otorhinolaryngol. 2015, 272, 2939–2945. [Google Scholar] [CrossRef]
  23. Friedland, P.L.; Bozic, B.; Dewar, J.; Kuan, R.; Meyer, C.; Phillips, M. Impact of Multidisciplinary Team Management in Head and Neck Cancer Patients. Br. J. Cancer 2011, 104, 1246–1248. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Liu, J.C.; Kaplon, A.; Blackman, E.; Miyamoto, C.; Savior, D.; Ragin, C. The Impact of the Multidisciplinary Tumor Board on Head and Neck Cancer Outcomes. Laryngoscope 2020, 130, 946–950. [Google Scholar] [CrossRef] [PubMed]
  25. Caudell, J.J.; Gillison, M.L.; Maghami, E.; Spencer, S.; Pfister, D.G.; Adkins, D.; Birkeland, A.C.; Brizel, D.M.; Busse, P.M.; Cmelak, A.J.; et al. NCCN Guidelines® Insights: Head and Neck Cancers, Version 1.2022: Featured Updates to the NCCN Guidelines. J. Natl. Compr. Cancer Netw. 2022, 20, 224–234. [Google Scholar] [CrossRef] [PubMed]
  26. Li, H.Y.; Chen, X.H. Diagnostic value of enhanced CT/MRI for thyroid cartilage invasion by malignant tumor. Zhonghua Er Bi Yan Hou Tou Jing Wai Ke Za Zhi 2017, 52, 372–376. [Google Scholar] [CrossRef]
  27. Bussu, F.; Galli, J.; Valenza, V.; D’Alatri, L.; Pizzuto, D.A.; Almadori, G.; Giordano, A.; Paludetti, G. Evaluation of Swallowing Function after Supracricoid Laryngectomy as a Primary or Salvage Procedure. Dysphagia 2015, 30, 686–694. [Google Scholar] [CrossRef]
  28. Acevedo Ortiz, L.; Aguilera Aguilera, G.A.; Lasierra Concellón, M.; Carboni Muñoz, M.A.; Andreu Mencia, L.; Soteras Olle, J.; Garcia Gonzalez, B.; Galindo Ortego, F.J. Comparison of Patients with Total and Salvage Laryngectomy. Acta Otorrinolaringol. Esp. 2021, 72, 352–358. [Google Scholar] [CrossRef]
  29. Soudry, E.; Hadar, T.; Shvero, J.; Segal, K.; Shpitzer, T.; Nageris, B.I.; Feinmesser, R. The Impact of Positive Resection Margins in Partial Laryngectomy for Advanced Laryngeal Carcinomas and Radiation Failures. Clin. Otolaryngol. 2010, 35, 402–408. [Google Scholar] [CrossRef]
  30. León, X.; Montoro, V.; Rovira, C.; Neumann, E.; López, M.; García, J.; Quer, M. Oncological Results of Salvage Laryngectomy in Patients with Laryngeal Carcinoma. Acta Otorrinolaringol. Esp. 2020, 71, 70–77. [Google Scholar] [CrossRef]
  31. Rizzotto, G.; Crosetti, E.; Lucioni, M.; Bertolin, A.; Monticone, V.; Sprio, A.E.; Berta, G.N.; Succo, G. Oncologic Outcomes of Supratracheal Laryngectomy: Critical Analysis. Head Neck 2015, 37, 1417–1424. [Google Scholar] [CrossRef]
  32. Succo, G.; Crosetti, E.; Bertolin, A.; Piazza, C.; Molteni, G.; Cirillo, S.; Petracchini, M.; Tascone, M.; Sprio, A.E.; Berta, G.N.; et al. Treatment for T3 to T4a Laryngeal Cancer by Open Partial Horizontal Laryngectomies: Prognostic Impact of Different Pathologic Tumor Subcategories. Head Neck 2018, 40, 1897–1908. [Google Scholar] [CrossRef]
  33. American Society of Clinical Oncology; Pfister, D.G.; Laurie, S.A.; Weinstein, G.S.; Mendenhall, W.M.; Adelstein, D.J.; Ang, K.K.; Clayman, G.L.; Fisher, S.G.; Forastiere, A.A.; et al. American Society of Clinical Oncology Clinical Practice Guideline for the Use of Larynx-Preservation Strategies in the Treatment of Laryngeal Cancer. J. Clin. Oncol. 2006, 24, 3693–3704. [Google Scholar] [CrossRef]
  34. Alicandri-Ciufelli, M.; Piccinini, A.; Grammatica, A.; Chiesi, A.; Bergamini, G.; Luppi, M.P.; Nizzoli, F.; Ghidini, A.; Tassi, S.; Presutti, L. Voice and Swallowing after Partial Laryngectomy: Factors Influencing Outcome. Head Neck 2013, 35, 214–219. [Google Scholar] [CrossRef]
  35. Laccourreye, O.; Hans, S.; Borzog-Grayeli, A.; Maulard-Durdux, C.; Brasnu, D.; Housset, M. Complications of Postoperative Radiation Therapy after Partial Laryngectomy in Supraglottic Cancer: A Long-Term Evaluation. Otolaryngol. Head Neck Surg. 2000, 122, 752–757. [Google Scholar] [CrossRef]
  36. Petrone, G.; Rossi, E.D.; Gallus, R.; Petrelli, L.; Marrone, S.; Rizzo, D.; Piras, A.; Garofalo, G.; Rindi, G.; Galli, J.; et al. Utility of Ultrasound-Guided Fine Needle Aspiration Cytology in Assessing Malignancy in Head and Neck Pathology. Cytopathology 2021, 32, 407–415. [Google Scholar] [CrossRef]
  37. Castaldi, P.; Rufini, V.; Bussu, F.; Miccichè, F.; Dinapoli, N.; Autorino, R.; Lago, M.; De Corso, E.; Almadori, G.; Galli, J.; et al. Can “Early” and “late”18F-FDG PET-CT Be Used as Prognostic Factors for the Clinical Outcome of Patients with Locally Advanced Head and Neck Cancer Treated with Radio-Chemotherapy? Radiother. Oncol. 2012, 103, 63–68. [Google Scholar] [CrossRef]
  38. Castaldi, P.; Leccisotti, L.; Bussu, F.; Miccichè, F.; Rufini, V. Role of (18)F-FDG PET-CT in Head and Neck Squamous Cell Carcinoma. Acta Otorhinolaryngol. Ital. 2013, 33, 1–8. [Google Scholar]
  39. Tsetsos, N.; Poutoglidis, A.; Arsos, G.; Tsentemeidou, A.; Kilmpasanis, A.; Katsampoukas, D.; Fyrmpas, G. 18F-FDG-PET/CT Interpretation Pitfalls in Patients with Head and Neck Cancer. Am. J. Otolaryngol. 2022, 43, 103209. [Google Scholar] [CrossRef]
  40. Locatello, L.G.; Pietragalla, M.; Taverna, C.; Bonasera, L.; Massi, D.; Mannelli, G. A Critical Reappraisal of Primary and Recurrent Advanced Laryngeal Cancer Staging. Ann. Otol. Rhinol. Laryngol. 2019, 128, 36–43. [Google Scholar] [CrossRef]
  41. Pietragalla, M.; Nardi, C.; Bonasera, L.; Mungai, F.; Verrone, G.B.; Calistri, L.; Taverna, C.; Novelli, L.; Locatello, L.G.; Mannelli, G.; et al. Current Role of Computed Tomography Imaging in the Evaluation of Cartilage Invasion by Laryngeal Carcinoma. Radiol. Med. 2020, 125, 1301–1310. [Google Scholar] [CrossRef]
  42. Kuno, H.; Sakamaki, K.; Fujii, S.; Sekiya, K.; Otani, K.; Hayashi, R.; Yamanaka, T.; Sakai, O.; Kusumoto, M. Comparison of MR Imaging and Dual-Energy CT for the Evaluation of Cartilage Invasion by Laryngeal and Hypopharyngeal Squamous Cell Carcinoma. AJNR Am. J. Neuroradiol. 2018, 39, 524–531. [Google Scholar] [CrossRef]
  43. Agnello, F.; Cupido, F.; Sparacia, G.; Midiri, F.; Miroddi, M.; Grassedonio, E.; Galia, M. Computerised Tomography and Magnetic Resonance Imaging of Laryngeal Squamous Cell Carcinoma: A Practical Approach. Neuroradiol. J. 2017, 30, 197–204. [Google Scholar] [CrossRef] [PubMed]
  44. Havsteen, I.; Ohlhues, A.; Madsen, K.H.; Nybing, J.D.; Christensen, H.; Christensen, A. Are Movement Artifacts in Magnetic Resonance Imaging a Real Problem?-A Narrative Review. Front. Neurol. 2017, 8, 232. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Wu, J.-H.; Zhao, J.; Li, Z.-H.; Yang, W.-Q.; Liu, Q.-H.; Yang, Z.-Y.; Liao, B.; Li, X.-L.; Wang, B.; Qin, H.; et al. Comparison of CT and MRI in Diagnosis of Laryngeal Carcinoma with Anterior Vocal Commissure Involvement. Sci. Rep. 2016, 6, 30353. [Google Scholar] [CrossRef] [PubMed]
  46. Maroldi, R.; Ravanelli, M.; Farina, D. Magnetic Resonance for Laryngeal Cancer. Curr. Opin. Otolaryngol. Head Neck Surg. 2014, 22, 131–139. [Google Scholar] [CrossRef]
Figure 1. The very high relapse-free (panel (A), RFS: 88% at 3 years) and disease-specific survival (Panel (C), DSS: 92.5% at 3 years) rate in the present series of mostly advanced LSCC confirms the adequacy of the multidisciplinary work up. The markedly lower (74 % at 3 years) overall survival (OS, panel (B)) derives from the frequent comorbidities in these patients, usually heavy smokers and/or drinkers, which are a more common cause of death than LSCC itself.
Figure 1. The very high relapse-free (panel (A), RFS: 88% at 3 years) and disease-specific survival (Panel (C), DSS: 92.5% at 3 years) rate in the present series of mostly advanced LSCC confirms the adequacy of the multidisciplinary work up. The markedly lower (74 % at 3 years) overall survival (OS, panel (B)) derives from the frequent comorbidities in these patients, usually heavy smokers and/or drinkers, which are a more common cause of death than LSCC itself.
Jpm 12 01585 g001
Figure 2. Comparison between survival curves in partial horizontal surgeries (n = 13, continuous line) versus total laryngectomies (n = 32, dotted line). No significant differences can be detected as for relapse-free (A) and disease-specific survival (B). Patients submitted to total laryngectomy have a significantly lower overall survival (C); this finding is expected because of the more advanced stage at diagnosis (and in particular nodal involvement) and the higher (in particular respiratory) comorbidity rate, which are both selection criteria for recommending a total laryngectomy versus a partial surgery.
Figure 2. Comparison between survival curves in partial horizontal surgeries (n = 13, continuous line) versus total laryngectomies (n = 32, dotted line). No significant differences can be detected as for relapse-free (A) and disease-specific survival (B). Patients submitted to total laryngectomy have a significantly lower overall survival (C); this finding is expected because of the more advanced stage at diagnosis (and in particular nodal involvement) and the higher (in particular respiratory) comorbidity rate, which are both selection criteria for recommending a total laryngectomy versus a partial surgery.
Jpm 12 01585 g002
Table 1. Descriptive statistics.
Table 1. Descriptive statistics.
Surgical Treatment (n,%)
ParametersWhole SeriesTotal laryngectomy
32 (71.1%)
Partial laryngeal surgery
13 (28.8%)
OPHL II 12 (26.6%)EHSL 1 (2.2%)
Age (mean +/− SD)65.7 +/− 10.665.9 +/− 10.664.3 +/− 8.375
Gender (n, %)
Male41 (91.1%)29 (90.6%)12 (100%)0
Female4 (8.9%)3 (9.4%)01 (100%)
Smoking status (n, %)
Current21 (46.7%)16 (50%)4 (34%)0
Former22 (48.9%)16 (50%)6 (50%)1 (100%)
Never2 (4.4%)02 (16%)0
Drinking status (n, %)
Current29 (64.5%)19 (59.4%)10 (84%)0
Former5 (11.1%)5 (15.6%)00
Never11 (24.4%)8 (25%)2 (16%)1 (100%)
Relevant comorbidities (n, %)
yes38 (84.4%)25 (78.1%)12 (100%)1 (100%)
no7 (15.6%)7 (21.9%)00
Renal failure 2 (5.2%)
Liver failure 2 (5.2%)
Diabetes 8 (21%)
CPDO 4 (10.5%)
Cardiovascular disease 11 (28.9%)
Addiction 1 (2.6%)
Other 10 (26.3%)
Tumor site (n, %)
Glottic larynx29 (64.5%)18 (56.3%)11 (91.7%)0
Supraglottic larynx10 (22.2%)8 (25%)1 (8.3%)1 (100%)
Hypopharynx5 (11.1%)5 (15.6%)00
Subglottic larynx1 (2.2%)1 (3.1%)00
Histology (n, %) SCC45 (100%)32 (100%)12 (100%)1 (100%)
Primary/Recurrence (n, %)
Primary41 (91.1%)28 (87.5%)12 (100%)1 (100%)
Recurrence4 (8.9%)4 (12.5%)00
Margins (n, %)
R038 (84.4%)26 (81.3%)11 (91.7%)1 (100%)
R11 (2.2%)1 (3.1%)00
Close6 (13.4%)5 (15.6%)1 (8.3%)0
Voice prosthesis (n, %)
Yes15 (33.3%)15 (46.9%)00
no30 (66.7%)17 (53.1%)12 (100%)1 (100%)
Pectoralis major flap (n, %)
Yes3 (6.7%)3 (9.4%)00
no42 (93.3%)29 (90.6%)12 (100%)1 (100%)
follow up +/− SD (months)24.24 +/− 14.8224.24 +/− 14.8227.29 +/− 13.9645.07
Recurrence (n, %)
local1 (2.2%)1 (3.1%)00
regional2 (4.4%)1 (3.1%)1 (8.3%)0
distant2 (4.4%)2 (6.3%)00
no40 (89%)28 (87.5%)11 (91.7%)1 (100%)
Status (n, %)
alive35 (77.8%)22 (68.7%)12 (100%)1 (100%)
dead10 (22.2%)10 (31.3%)00
Cause of dead (n, %)
tumor3 (6.7%)3 (9.4%)00
other causes7 (15.6%)7 (21.9%)00
cT
T11 (2.2%)001 (100%)
T1a0000
T1b0000
T214 (31.1%)7 (21.9%)7 (58.3%)0
T325 (55.6%)20 (62.5%)5 (41.7%)0
T4a5 (11.1%)5 (15.6%)00
T4b0000
cN
N034 (75.5%)21 (65.6%)12 (100%)0
N18 (17.8%)8 (25%)00
N2a0000
N2b3 (6.7%)3 (9.4%)00
N2c0000
N3a0000
N3b0000
pT
T11 (2.2%)001 (100%)
T213 (28.9%)6 (18.7%)7 (58.3%)0
T321 (46.7%)16 (50%)5 (41.7%)0
T4a10 (22.2%)10 (31.3%)00
pN
N033 (73.3%)20 (62.5%)12 (100%)1 (100%)
N15 (11.1%)5 (15.6%)00
N2a1 (2.2%)1 (3.1%)00
N2b3 (6.7%)3 (9.4%)00
N2c0000
N3b3 (6.7%)3 (9.4%)00
Clinical stage
I0000
II21 (46.7%)8 (25%)12 (100%)1 (100%)
III22 (48.9%)22 (68.7%)00
IVa2 (4.4%)2 (6.3%)00
IVb0000
IVc0000
Comparison of T and N classifications
ep TNrad TNc TNp TN
T n%N n%T n%N n%T n%N n%T n%N n%
T1 1 (2.2%)N0 40 (88.9%)T1 1 (2.2%)N0 34 (75.5%)T1 1 (2.2%)N0 34 (75.5%)T1 1 (2.2%)N0 33 (73.3%)
T2 22 (48.9%)N1 4 (8.9%)T1a 5 (11.1%)N1 8 (17.8%)T2 14 (31.1%)N1 8 (17.8%)T2 13 (28.9%)N1 5 (11.1%)
T3 22 (48.9%)N2b 1 (2.2%)T1b 2 (4.5%)N2b 3 (6.7%)T3 25 (55.6%)N2b 3 (6.7%)T3 21 (46.7%)N2a 1 (2.2%)
T2 6 (13.3%) T4a 5 (11.1%) T4a 10 (22.2%)N2b 3 (6.7%)
T3 26 (57.8%) N3b 3 (6.7%)
T4a 5 (11.1%)
Table 2. The analysis of reliability of the 3 different stagings obtained with endoscopy and physical exam (epTN), ceCT scans of the neck (chest CT was always performed, but M+ cases have not been included in the present work), (radTN), and with the integration of the first two order of data in the multidisciplinary discussion of the tumor board (cTN). Such reliability can be quantified with the concordance rate with the final histopathological exam (pT) as well as by the calculation of the Cohen kappa coefficient, which is an acknowledged measure of the interrater agreement and of the validity of a certain assay. Kappa values less than 0.4, between 0.4 and 0.75, or higher than 0.75 represent poor, fair-to-good, or excellent correlations, respectively. Kappa values of the cTN are always fair to good, cTN is better in the estimate of T classification than in that of N classification, even if the score improves if the simple assessment of nodal involvement and not the exact N classification is considered. When comparing the single parameters of the primary lesion as assessed by endoscopy and by ceCTscan, in comparison with the final histopathologic findings, a wide variation in the estimates can be appreciated, with better performance of endoscopy in some respects (superficial spread) and of morphological imaging in others (deep invasion). Some parameters, such as laryngeal mobility, can be properly assessed only with clinical assessment, and not even at final histopathological exam.
Table 2. The analysis of reliability of the 3 different stagings obtained with endoscopy and physical exam (epTN), ceCT scans of the neck (chest CT was always performed, but M+ cases have not been included in the present work), (radTN), and with the integration of the first two order of data in the multidisciplinary discussion of the tumor board (cTN). Such reliability can be quantified with the concordance rate with the final histopathological exam (pT) as well as by the calculation of the Cohen kappa coefficient, which is an acknowledged measure of the interrater agreement and of the validity of a certain assay. Kappa values less than 0.4, between 0.4 and 0.75, or higher than 0.75 represent poor, fair-to-good, or excellent correlations, respectively. Kappa values of the cTN are always fair to good, cTN is better in the estimate of T classification than in that of N classification, even if the score improves if the simple assessment of nodal involvement and not the exact N classification is considered. When comparing the single parameters of the primary lesion as assessed by endoscopy and by ceCTscan, in comparison with the final histopathologic findings, a wide variation in the estimates can be appreciated, with better performance of endoscopy in some respects (superficial spread) and of morphological imaging in others (deep invasion). Some parameters, such as laryngeal mobility, can be properly assessed only with clinical assessment, and not even at final histopathological exam.
ep TNrad TNc TN
T classification (agreement rate % with pT; kappa coefficient)58%; 0.3264%; 0.4482%; 0.7
N classification (agreement rate % with pN; kappa coefficient)76%; 0.2776%; 0.4276%; 0.42
N0 vs. N+ (agreement rate % with pN; kappa coefficient)80%; 0.3780%; 0.4780%; 0.47
Single parameter (rate %)
Endoscopy/Physical examRadiologyPathology
Laryngeal vestibule/Piriform sinus inlet (Arytenoid/Aryepiglottic fold/suprahyoid epiglottis) involvement35%42%37%
Lateral wall/apex of piriform sinus involvement16%20%15%
Infrahyoid epiglottis involvement26%24%23%
True vocal fold involvement85%80%84%
Anterior commissure77%47%60%
False vocal fold involvement59%62%53%
Laryngeal mobilityHypomobility 36%
True vocal fold/arytenoid fixation 51%
--
Anterior paraglottic space involvement8%60%58%
Posterior paraglottic space involvement10%27%12%
Cricoid cartilage involvement-11%11%
Thyroid cartilage involvement-24% *21%
Subglottic extension31%18%26%
Base of tongue involvement8%10%10%
* Through cartilage invasion in 13%.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Rizzo, D.; Crescio, C.; Tramaloni, P.; De Luca, L.M.; Turra, N.; Manca, A.; Crivelli, P.; Tiana, C.R.; Fara, A.; Cossu, A.; et al. Reliability of a Multidisciplinary Multiparametric Approach in the Surgical Planning of Laryngeal Squamous Cell Carcinomas: A Retrospective Observational Study. J. Pers. Med. 2022, 12, 1585. https://doi.org/10.3390/jpm12101585

AMA Style

Rizzo D, Crescio C, Tramaloni P, De Luca LM, Turra N, Manca A, Crivelli P, Tiana CR, Fara A, Cossu A, et al. Reliability of a Multidisciplinary Multiparametric Approach in the Surgical Planning of Laryngeal Squamous Cell Carcinomas: A Retrospective Observational Study. Journal of Personalized Medicine. 2022; 12(10):1585. https://doi.org/10.3390/jpm12101585

Chicago/Turabian Style

Rizzo, Davide, Claudia Crescio, Pierangela Tramaloni, Laura M. De Luca, Nicola Turra, Alessandra Manca, Paola Crivelli, Chiara R. Tiana, Alberto Fara, Antonio Cossu, and et al. 2022. "Reliability of a Multidisciplinary Multiparametric Approach in the Surgical Planning of Laryngeal Squamous Cell Carcinomas: A Retrospective Observational Study" Journal of Personalized Medicine 12, no. 10: 1585. https://doi.org/10.3390/jpm12101585

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop