Next Article in Journal
Therapeutic Effects of Human Mesenchymal Stem Cells in a Mouse Model of Cerebellar Ataxia with Neuroinflammation
Previous Article in Journal
Prediction of Recurrent Emergency Department Visits among Patients with Crohn’s Disease: A Retrospective Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Predicting the Risk of Malignancy of Lung Nodules Diagnosed as Indeterminate on Radial Endobronchial Ultrasound-Guided Biopsy

1
Division of Pulmonary and Critical Care Medicine, Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Korea
2
Statistics and Data Center, Samsung Medical Center, Seoul 06351, Korea
3
Division of Nephrology, Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Korea
4
Department of Radiology and Center for Imaging Science, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Korea
*
Authors to whom correspondence should be addressed.
J. Clin. Med. 2020, 9(11), 3652; https://doi.org/10.3390/jcm9113652
Submission received: 9 October 2020 / Revised: 5 November 2020 / Accepted: 11 November 2020 / Published: 13 November 2020
(This article belongs to the Section Pulmonology)

Abstract

:
The next diagnostic step in cases of indeterminate radial probe endobronchial ultrasound (radial EBUS)-guided biopsy results remains uncertain. This study aimed to identify risk factors for malignancy based on clinical findings, chest computed tomography (CT), and radial EBUS images, and to estimate the risk of malignancy in lung nodules that showed indeterminate radial EBUS-guided biopsy results by constructing a nomogram. This retrospective study included 157 patients with indeterminate results on an initial radial EBUS biopsy performed at the Samsung Medical Center from January 2017 to December 2018, but with a definitive final diagnosis. Medical records, chest CT, radial EBUS images, and the final diagnoses were reviewed. Patients were randomly divided into training and validation sets. Factors related to malignancy were identified through logistic regression analysis, and a nomogram was constructed using the training set and subsequently applied to the validation set. Six factors in univariable and multivariable analyses, including upper lobe location, spiculation, satellite nodules, echogenicity, presence of dots or linear arcs, and patency of vessels and bronchi predicted malignancy. A nomogram was constructed based on these predictors. The area under the curve (AUC) value of the nomogram was 0.858 using the chest CT factors, which improved to 0.952 when radial EBUS factors were added. The calibration curve showed good agreement between the actual and nomogram-predicted malignancy outcomes. The utility of radial EBUS images for revealing risk factors of malignancy was confirmed. Furthermore, our nomogram was able to predict the probability of malignancy in lung nodules with indeterminate radial EBUS-guided biopsy results.

1. Introduction

Diagnosing peripheral pulmonary nodules remains a significant challenge for pulmonologists. Several quantitative models have been developed to estimate the pretest probability of malignancy of pulmonary nodules, to expedite treatment of malignant nodules and minimize procedures for benign ones [1]. Classical models for determining the probability of malignancy constructed by the Mayo Clinic [2], the Veterans Association (VA) [3], and Brock University [4] include clinical factors, such as age, smoking history, cancer history, and radiological characteristics on chest computed tomography (CT), such as the diameter and location of the nodule. Many attempts have been made to identify risk factors for malignancy of pulmonary nodules, which may inform the next diagnostic step.
With the detection of pulmonary nodules rising, this has led to improve diagnostic sensitivity of advanced bronchoscopic techniques, including radial probe endobronchial ultrasound (radial EBUS) [5]. In a meta-analysis performed in 2017, the overall diagnostic yield for radial EBUS was 70.6% [6].
Apart from its role in improving the bronchoscopic biopsy yield for peripheral lung nodules, the image findings of radial EBUS provide clues regarding the nature of the lesions [7]. Kurimoto et al. [8] analyzed radial EBUS images by focusing on internal echoes, vascular and bronchial patency, and the morphology of hyperechoic areas, and correlated the results with the histopathologic findings of surgical resection. Their research suggested that radial EBUS images can provide additional information, thus enhancing predictions of the malignancy potential of lesions relative to previously identified clinical and chest CT findings.
However, there are limitations when interpreting radial EBUS-guided biopsy results. In clinical practice, when the biopsy result is “positive for malignancy”, clinicians can manage the nodules as cancer. On the other hand, remaining “indeterminate” results, which may involve atypical cells, fibrosis, and inflammation, do not completely exclude the possibility of cancer. There is no consensus regarding whether invasive procedures, such as biopsy or surgery, or clinical surveillance should be applied in such cases. The best diagnostic approach in cases with indeterminate results has not been determined.
In this study, we hypothesized that radial EBUS image findings may provide useful information for predicting the risk of malignancy in lung nodules and focused on the malignant potential of indeterminate radial EBUS-guided biopsy results. First, along with identifying risk factors for malignancy from clinical findings and chest CT, we also examined radial EBUS images. Second, based on the identified risk factors, we developed a nomogram to estimate the risk of malignancy in indeterminate radial EBUS-guided biopsy results, which enables us to identify patients who may receive greater benefit from additional procedures.

2. Material and Methods

2.1. Study Patients

We retrospectively reviewed the medical records of 494 patients who underwent radial EBUS biopsy at the Samsung Medical Center, Seoul, Korea from January 2017 to December 2018. Among these patients, 212 initial radial EBUS-guided biopsy results were indeterminate. Eight patients were excluded due to missing radial EBUS images or poor image quality. An additional 47 patients without a definitive diagnosis were excluded, leaving a total of 157 patients included in this study. Definitive diagnoses were those (1) pathologically confirmed as cancerous by surgical specimen analysis, endobronchial ultrasound-guided transbronchial needle aspiration (EBUS-TBNA), a core needle biopsy, or additional radial EBUS, or (2) with culture results of sputum or bronchial washing that revealed tuberculosis or atypical mycobacteria with adequate antibiotics response, or (3) with follow-up chest CT suggesting resolved or improved lesions with reassessment of radiologist confirming the possibility of benign. In these cases, the patients were observed for at least 6 months.
The Institutional Review Board of Samsung Medical Center approved this study and permitted the review and publication of patient records (IRB No. 2019-03-106). The requirement for informed consent was waived given the retrospective nature of the study.

2.2. Variables

Demographics, clinical characteristics and final diagnoses were obtained through electronic chart review. The clinical factors included age, sex, cancer history, and smoking history. All chest CT images were reviewed by a pulmonologist and a radiologist to determine the maximum diameter, location (upper lobe), type (solid or sub-solid), and shape (round or complex) of nodules, presence of emphysema with nodules, spiculation, bronchus sign, and presence of satellite nodules. Satellite nodules were defined as small discrete shadows near the main lesion [9]. All radial EBUS image findings were evaluated for the following features: echogenicity (homogeneous or heterogeneous); attenuation (maintenance of echogenicity considering midline as a fiducial line); margin (regular or irregular); shape (round or complex); presence of dots or linear arcs; and patency of vessels and bronchi.

2.3. Statistical Analysis

To develop a nomogram for predicting the malignant potential of lung nodules that showed indeterminate biopsy results on radial EBUS, a model was built using a training set and a validation set. For this, independent cohorts were devised by randomly dividing the patients into training (70%) and validation sets (30%).
The nonparametric Mann–Whitney U test was used to compare continuous variables, and the chi-square test or Fisher’s exact test was used to compare categorical variables between the benign group and malignant group in the total data and between training set and validation set.
Univariable logistic regression analysis of the training set was used to identify potential predictors of malignancy. Using the variables with the result of p < 0.1 from univariable logistic regression, backward selection multivariable logistic regression analysis was used to analyze the associations among potential predictors. Selected factors with statistical significance were used to develop the nomogram.
The ability of the nomogram to discriminate (i.e., distinguish among patients with different outcomes) and calibrate (i.e., the degree of correspondence between predictions and actual outcomes) was quantified [10,11,12]. Discrimination performance was quantified based on the area under the curve (AUC). Calibration performance was measured by plotting the predicted malignancy against the actual outcomes, as tertiles, with 1000 bootstrap resamples [1,13].
In addition, the AUC of the nomogram constructed based only on chest CT factors was compared with that constructed using chest CT and radial EBUS factors, to verify the radial EBUS features as risk factors for malignancy.
All reported p values were two-sided and p < 0.05 was considered statistically significant. All analyses were performed using R software (version 3.2.2; R Foundation for Statistical Computing, Vienna, Austria).

3. Results

Among the 494 patients who underwent radial EBUS biopsy, 157 patients with indeterminate radial EBUS-guided biopsy results were included in this study (Figure 1). The indeterminate results included fibrosis, inflammation, atypical cells, and negative for malignancy. Among the 157 patients, 90 were additionally diagnosed as malignant using other modalities, such as repeat radial EBUS, EBUS-TBNA, a core needle biopsy or surgical specimen analysis. The remaining 67 were diagnosed as benign based on culture results or radiological follow-up for at least 6 months.
The clinical characteristics, chest CT and radial EBUS image features of 157 patients with indeterminate radial EBUS-guided biopsy results are described in Table 1. Overall, 91 (58.0%) males and 66 (42.0%) females, with a mean age of 66.0 years, were included in the study. The prevalence of malignant lung nodules was 57.3%.
In total, 108 (70%) of 157 lung nodules were randomly included in the training set. No significant difference was observed in the clinical, chest CT, or radial EBUS factors between the training and validation sets (Table 2). The clinical characteristics, chest CT, and radial EBUS features of the training set are described in Table 3.
Table 4 summarizes the results of the univariable and multivariable logistic regression analyses of the clinical, chest CT and radial EBUS factors in the training set. The multivariable analysis revealed that chest CT factors, including upper lobe location, spiculation, and absence of satellite nodules were associated with malignancy. Furthermore, malignant nodules tended to be more heterogeneous in terms of echogenicity, had more dots or linear arcs, and had vessels and bronchi that were not patent on radial EBUS images. However, no significant differences were observed in clinical factors between malignant and non-malignant cases.
A nomogram was constructed using the six factors related to malignancy identified by multivariable regression (Figure 2). Through this nomogram, it became possible to calculate the probability of malignancy of lung nodules diagnosed as indeterminate.
Based on analysis of the training set, the AUC for the nomogram was 0.952 (95% confidence interval [CI] 0.914–0.990) (Figure 3). Based on analysis of the validation set, discrimination performance of the nomogram was good (AUC = 0.836; 95% CI 0.711–0.960). Calibration plots of the training and validation sets indicated good agreement between the predicted and observed outcomes, with close correspondence between the predicted and actual malignancy outcomes.
In addition, as shown in Figure 4, the AUC improved from 0.858 to 0.952 after adding the radial EBUS factors to the nomogram, verifying the role of radial EBUS features as risk factors for malignancy.

4. Discussion

Our study was motivated by the lack of definitive guidelines for proceeding in cases with “indeterminate” radial EBUS-guided biopsy results, which do not exclude malignancy. We focused on the clinical utility of radial EBUS images for distinguishing between malignant and benign lesions, which has also been discussed in previous studies [7,8,14].
First, we evaluated the radial EBUS images of pulmonary nodules, as well as clinical findings and chest CT images, to determine diverse risk factors for malignancy. Based on previous radial EBUS image studies [7,8,14], echogenicity, attenuation, margin, nodule shape, the presence of dots or linear arcs, and the patency of vessels and bronchi were evaluated on radial EBUS images. Logistic regression analysis revealed that echogenicity, the presence of dots or linear arcs, and the patency of vessels and bronchi were significantly associated with malignancy.
Echogenicity on radial EBUS images is closely associated with the arrangement of cells and the quantity of fibrous stroma [7]. Several studies [15,16,17,18] on gastrointestinal tract lesions have revealed that heterogeneous echogenicity is more likely to indicate malignancy than homogeneous echogenicity. It is believed that loss of normal tissue and chaotic tumor cell growth with central fibrosis, necrosis, and hemorrhage leads to heterogeneity in the internal structure of lung masses on EBUS images [8]. Dots and linear arcs denote an irregular hyperechoic pattern within lesions, primarily around the radial probe [8]. Kurimoto et al. [8] analyzed radial EBUS images and surgical specimens and found that dots and linear arcs correspond to residual air in the alveoli, which is characteristic of a well-differentiated adenocarcinoma, indicating malignancy. The patency of vessels and bronchi is believed to reflect the degree to which anatomic structures are preserved in cases of lung parenchyma. Tumor cells grow to form a solid mass invading the lung parenchyma in cases of peripheral lung cancer, and the patency of the bronchi seldom remains intact as the tumor increases in volume [18]. Therefore, a lesion with patent vessels and bronchi based on radial EBUS probe is likely to be benign, as in our results.
According to our results, an upper lobe location, spiculation, and an absence of satellite nodules were, withal, the chest CT factors associated with malignancy. An upper lobe location and spiculation of pulmonary nodules are well known independent predictors of malignancy [2,4,19]. The National Lung Screening Trial data set showed 65.7% of all lung cancers were located in the upper lobe [20]. Furthermore, the result of NELSON trial [21], the largest European lung cancer CT screening trial, observed that 64.1% of all lung cancers were localized in the upper lobe. Especially, 45.0% were localized in the right upper lobe. This is a known phenomenon explained by the fact that the airflow at the beginning of the breath is the largest toward the right upper lobe bronchus that eventually causes more deposition of particles in tobacco smoke and their carcinogenic effects in the right upper lobe [22,23]. Spiculation is caused by an obstruction of pulmonary vessels, or by the filling of lymphatic channels with tumor cells; in turn, this results in interlobular septal thickening and fibrosis, and is highly predictive of malignancy (positive predictive value of up to 90%) [24,25]. In contrast, the satellite lesions frequently observed in patients with tuberculoma, or accompanied by organizing pneumonia, tended to be benign in a tuberculosis (TB)-endemic area [26]. In that study, in cases with satellite lesions around a solitary pulmonary nodule, the rate of benign status was 90.9%.
Based on the significant predictors of malignancy in univariable and multivariable analyses, we constructed a nomogram to calculate the probability of malignancy of pulmonary nodules with indeterminate radial EBUS-guided biopsy results. Our results are expected to be useful for patients and clinicians with respect to the decision between an invasive diagnostic procedure or observational follow-up.
The average predictive accuracy regarding the malignancy of pulmonary nodules was reported as 80% using current models based on clinical findings and chest CT factors [2,3]. In our study, the AUC of the nomogram using only chest CT factors was 0.858, but this improved to 0.952 after adding the radial EBUS factors. This confirmed the potential of radial EBUS factors for predicting malignancy.
Our study had several limitations. First, since our cohort comprised only patients with indeterminate radial EBUS-guided biopsy results, it showed a relatively homogeneous nature. For this reason, although several studies [2,3,4] have demonstrated the importance of clinical factors such as age, smoking history, and cancer history for predicting malignancy, these factors were not significantly associated with malignancy in our study. Furthermore, our nomogram could only be applied to patients with indeterminate radial EBUS-guided biopsy results and could not be used in calculating the malignant potential of general patients with pulmonary nodules. Second, even though our nomogram calculated the probability of malignancy of indeterminate radial EBUS-guided biopsy results, precise cut-off values indicating the need for an additional invasive procedure are still lacking; further studies are, therefore, required. British Thoracic Society guidelines [19] suggest patients with a low risk (<10%) of malignancy should undergo CT surveillance. When the risk is moderate-to-high (>10%), additional testing should include fine-needle aspiration, endobronchial ultrasonography, and positron emission tomography. Surgery is recommended for high risk (>70%) patients. Since our study included not only clinical and chest CT factors, but also radial EBUS factors, larger population-based studies should be performed to determine cut-offs specifically for radial EBUS. Third, this study was performed at a single center; further studies including multiple centers and larger populations and controlling of operator factors are needed to validate our results. Fourth, although presence of the satellite nodules was found to be highly predictive of benign pulmonary nodules, this finding was restricted to TB-endemic areas and may not apply elsewhere. Finally, this is a retrospective study that requires prospective validation, and a constructed nomogram must be confirmed through other group of patients with indeterminate radial EBUS-guided biopsy results. For this reason, a further study involving patients that had undergone radial EBUS from 2019 to 2020 in our center, is in progress to apply and validate our nomogram.
In conclusion, we identified six risk factors for malignancy based on analysis of radial EBUS images, as well as clinical findings and chest CT. Thus, radial EBUS may provide additional information to complement other clinical and radiological data. Furthermore, we developed a nomogram to estimate the probability of malignancy in patients with indeterminate initial radial EBUS findings, which may facilitate identification of patients at higher risk for malignancy.

Author Contributions

S.Z., H.Y.L., K.L.: conception and design of the study, acquisition of data, analysis and interpretation of data, and drafting and revising the article; S.-y.W., S.K., J.E.L.: statistical analysis and interpretation of data; B.-H.J., S.-W.U., H.K., O.J.K.: analysis and interpretation of data. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

AUC: area under the curve; CT: computed tomography; EBUS-TBNA: endobronchial ultrasound-guided transbronchial needle aspiration; Radial EBUS: radial probe endobronchial ultrasound; TB: tuberculosis.

References

  1. She, Y.; Zhao, L.; Dai, C.; Ren, Y.; Jiang, G.; Xie, H.; Zhu, H.; Sun, X.; Yang, P.; Chen, Y.; et al. Development and validation of a nomogram to estimate the pretest probability of cancer in Chinese patients with solid solitary pulmonary nodules: A multi-institutional study. J. Surg. Oncol. 2017, 116, 756–762. [Google Scholar] [CrossRef]
  2. Swensen, S.J.; Silverstein, M.D.; Ilstrup, D.M.; Schleck, C.D.; Edell, E.S. The probability of malignancy in solitary pulmonary nodules. Application to small radiologically indeterminate nodules. Arch. Intern. Med. 1997, 157, 849–855. [Google Scholar] [CrossRef] [PubMed]
  3. Gould, M.K.; Ananth, L.; Barnett, P.G.; Veterans Affairs Snap Cooperative Study Group. A clinical model to estimate the pretest probability of lung cancer in patients with solitary pulmonary nodules. Chest 2007, 131, 383–388. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. McWilliams, A.; Tammemagi, M.C.; Mayo, J.R.; Roberts, H.; Liu, G.; Soghrati, K.; Yasufuku, K.; Martel, S.; Laberge, F.; Gingras, M.; et al. Probability of cancer in pulmonary nodules detected on first screening CT. N. Engl. J. Med. 2013, 369, 910–919. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Chen, A.; Chenna, P.; Loiselle, A.; Massoni, J.; Mayse, M.; Misselhorn, D. Radial probe endobronchial ultrasound for peripheral pulmonary lesions. A 5-year institutional experience. Ann. Am. Thorac. Soc. 2014, 11, 578–582. [Google Scholar] [CrossRef] [PubMed]
  6. Ali, M.S.; Trick, W.; Mba, B.I.; Mohananey, D.; Sethi, J.; Musani, A.I. Radial endobronchial ultrasound for the diagnosis of peripheral pulmonary lesions: A systematic review and meta-analysis. Respirology 2017, 22, 443–453. [Google Scholar] [CrossRef] [Green Version]
  7. Kuo, C.H.; Lin, S.M.; Chen, H.C.; Chou, C.L.; Yu, C.T.; Kuo, H.P. Diagnosis of peripheral lung cancer with three echoic features via endobronchial ultrasound. Chest 2007, 132, 922–929. [Google Scholar] [CrossRef] [PubMed]
  8. Kurimoto, N.; Murayama, M.; Yoshioka, S.; Nishisaka, T. Analysis of the internal structure of peripheral pulmonary lesions using endobronchial ultrasonography. Chest 2002, 122, 1887–1894. [Google Scholar] [CrossRef]
  9. Iversen, M. Synopsis of diseases of the chest (2nd edn). Respir. Med. 1995, 89, 643–644. [Google Scholar] [CrossRef] [Green Version]
  10. Graesslin, O.; Abdulkarim, B.S.; Coutant, C.; Huguet, F.; Gabos, Z.; Hsu, L.; Marpeau, O.; Uzan, S.; Pusztai, L.; Strom, E.A.; et al. Nomogram to predict subsequent brain metastasis in patients with metastatic breast cancer. J. Clin. Oncol. 2010, 28, 2032–2037. [Google Scholar] [CrossRef]
  11. Iasonos, A.; Schrag, D.; Raj, G.V.; Panageas, K.S. How to build and interpret a nomogram for cancer prognosis. J. Clin. Oncol. 2008, 26, 1364–1370. [Google Scholar] [CrossRef] [PubMed]
  12. Reid, M.; Choi, H.K.; Han, X.; Wang, X.; Mukhopadhyay, S.; Kou, L.; Ahmad, U.; Wang, X.; Mazzone, P.J. Development of a Risk Prediction Model to Estimate the Probability of Malignancy in Pulmonary Nodules Being Considered for Biopsy. Chest 2019, 156, 367–375. [Google Scholar] [CrossRef] [PubMed]
  13. Harrel, F.E.J. Regression Modeling Strategies: With Application to Linear Models, Logistic and Ordinal Regression, and Survival Analysis; Springer: Berlin/Heidelberg, Germany, 2015. [Google Scholar]
  14. Chao, T.Y.; Lie, C.H.; Chung, Y.H.; Wang, J.L.; Wang, Y.H.; Lin, M.C. Differentiating peripheral pulmonary lesions based on images of endobronchial ultrasonography. Chest 2006, 130, 1191–1197. [Google Scholar] [CrossRef] [PubMed]
  15. Lee, S.J.; Paik, Y.H.; Lee, D.K.; Lee, K.S.; Lee, S.I. The diagnostic value of endoprobe for small esophageal leiomyomas derived from the muscularis mucosae. Yonsei Med. J. 2005, 46, 61–65. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Yamao, K.; Ohashi, K.; Nakamura, T.; Suzuki, T.; Watanabe, Y.; Shimizu, Y.; Nakamura, Y.; Ozden, I. Evaluation of various imaging methods in the differential diagnosis of intraductal papillary-mucinous tumor (IPMT) of the pancreas. Hepatogastroenterology 2001, 48, 962–966. [Google Scholar]
  17. Melzer, E.; Fidder, H. The natural course of upper gastrointestinal submucosal tumors: An endoscopic ultrasound survey. Isr. Med. Assoc. J. 2000, 2, 430–432. [Google Scholar] [PubMed]
  18. Wang, J.C.; Sone, S.; Feng, L.; Yang, Z.G.; Takashima, S.; Maruyama, Y.; Hasegawa, M.; Kawakami, S.; Honda, T.; Yamanda, T. Rapidly growing small peripheral lung cancers detected by screening CT: Correlation between radiological appearance and pathological features. Br. J. Radiol. 2000, 73, 930–937. [Google Scholar] [CrossRef]
  19. Callister, M.E.; Baldwin, D.R.; Akram, A.R.; Barnard, S.; Cane, P.; Draffan, J.; Franks, K.; Gleeson, F.; Graham, R.; Malhotra, P.; et al. British Thoracic Society guidelines for the investigation and management of pulmonary nodules. Thorax 2015, 70 (Suppl. 2), ii1–ii54. [Google Scholar] [CrossRef] [Green Version]
  20. Winter, A.; Aberle, D.R.; Hsu, W. External validation and recalibration of the Brock model to predict probability of cancer in pulmonary nodules using NLST data. Thorax 2019, 74, 551–563. [Google Scholar] [CrossRef]
  21. Horeweg, N.; van der Aalst, C.M.; Thunnissen, E.; Nackaerts, K.; Weenink, C.; Groen, H.J.; Lammers, J.W.; Aerts, J.G.; Scholten, E.T.; van Rosmalen, J.; et al. Characteristics of lung cancers detected by computer tomography screening in the randomized NELSON trial. Am. J. Respir. Crit. Care Med. 2013, 187, 848–854. [Google Scholar] [CrossRef]
  22. Subramaniam, R.P.; Asgharian, B.; Freijer, J.I.; Miller, F.J.; Anjilvel, S. Analysis of lobar differences in particle deposition in the human lung. Inhal. Toxicol. 2003, 15, 1–21. [Google Scholar] [CrossRef] [PubMed]
  23. Churg, A.; Stevens, B. Association of lung cancer and airway particle concentration. Environ. Res. 1988, 45, 58–63. [Google Scholar] [CrossRef]
  24. Winer-Muram, H.T. The solitary pulmonary nodule. Radiology 2006, 239, 34–49. [Google Scholar] [CrossRef] [PubMed]
  25. Zwirewich, C.V.; Vedal, S.; Miller, R.R.; Muller, N.L. Solitary pulmonary nodule: High-resolution CT and radiologic-pathologic correlation. Radiology 1991, 179, 469–476. [Google Scholar] [CrossRef]
  26. Kim, H.; Kang, S.J.; Suh, G.Y.; Chung, M.P.; Kwon, O.J.; Rhee, C.H.; Jung, K.J.; Kim, T.S.; Lee, K.S. Predictors for benign solitary pulmonary nodule in tuberculosis-endemic area. Korean J. Intern. Med. 2001, 16, 236–241. [Google Scholar] [CrossRef]
Figure 1. Initial radial EBUS-guided biopsy results and final diagnosis. “Other” includes cryptococcosis, Toxocara canis, sarcoidosis, mucocele, and sarcoidosis. radial EBUS: radial probe endobronchial ultrasound.
Figure 1. Initial radial EBUS-guided biopsy results and final diagnosis. “Other” includes cryptococcosis, Toxocara canis, sarcoidosis, mucocele, and sarcoidosis. radial EBUS: radial probe endobronchial ultrasound.
Jcm 09 03652 g001
Figure 2. Nomogram for predicting the probability of malignancy. Nomogram for predicting the probability of malignancy of pulmonary nodules diagnosed as indeterminate on initial radial EBUS-guided biopsy, based on clinical, chest CT, and radial EBUS factors. To obtain the nomogram-predicted probability, chest CT and radial EBUS factors of the patient must be placed on a nomogram scale. Then by drawing a vertical line up to the “Points” axis, corresponding prognostic points are obtained. Using the sum of the point acquired from each factor, another vertical line can be drawn from the “Total points” axis down to the “Probability of malignancy” axis, providing the probability of lung cancer.
Figure 2. Nomogram for predicting the probability of malignancy. Nomogram for predicting the probability of malignancy of pulmonary nodules diagnosed as indeterminate on initial radial EBUS-guided biopsy, based on clinical, chest CT, and radial EBUS factors. To obtain the nomogram-predicted probability, chest CT and radial EBUS factors of the patient must be placed on a nomogram scale. Then by drawing a vertical line up to the “Points” axis, corresponding prognostic points are obtained. Using the sum of the point acquired from each factor, another vertical line can be drawn from the “Total points” axis down to the “Probability of malignancy” axis, providing the probability of lung cancer.
Jcm 09 03652 g002
Figure 3. Performance of the nomogram. (A) Discrimination performance in training set was high (AUC = 0.952; 95% CI, 0.917–0.990). (B) Discrimination performance in validation set was good (AUC = 0.836; 95% CI, 0.711–0.960). (C) Calibration curve for the relationship between the predicted and actual malignancy outcomes. The x-axis represents the nomogram-predicted malignancy probability, and the y-axis indicates the actual outcome. The “calibration curve” (dotted line) closely approximates the “logistic calibration curve” (solid line), demonstrating good agreement between the nomogram-predicted and actual malignancy outcomes for indeterminate lung nodules. AUC = area under the curve; CI = confidence interval.
Figure 3. Performance of the nomogram. (A) Discrimination performance in training set was high (AUC = 0.952; 95% CI, 0.917–0.990). (B) Discrimination performance in validation set was good (AUC = 0.836; 95% CI, 0.711–0.960). (C) Calibration curve for the relationship between the predicted and actual malignancy outcomes. The x-axis represents the nomogram-predicted malignancy probability, and the y-axis indicates the actual outcome. The “calibration curve” (dotted line) closely approximates the “logistic calibration curve” (solid line), demonstrating good agreement between the nomogram-predicted and actual malignancy outcomes for indeterminate lung nodules. AUC = area under the curve; CI = confidence interval.
Jcm 09 03652 g003
Figure 4. The AUC of the nomogram based only on chest CT factors compared to that based on both chest CT and radial EBUS factors (training set). The ROC curve of the chest CT factors-only nomogram (solid line) and the ROC curve of both chest CT and radial EBUS factors-based nomogram (dotted line). The AUC increased from 0.858 (95% CI, 0.786–0.930) to 0.952 (95% CI, 0.914–0.990) after adding the radial EBUS factors. AUC = area under the curve; CT = Computed tomography; CI = confidence interval; radial EBUS = radial probe endobronchial ultrasound; ROC = receiver operating characteristic.
Figure 4. The AUC of the nomogram based only on chest CT factors compared to that based on both chest CT and radial EBUS factors (training set). The ROC curve of the chest CT factors-only nomogram (solid line) and the ROC curve of both chest CT and radial EBUS factors-based nomogram (dotted line). The AUC increased from 0.858 (95% CI, 0.786–0.930) to 0.952 (95% CI, 0.914–0.990) after adding the radial EBUS factors. AUC = area under the curve; CT = Computed tomography; CI = confidence interval; radial EBUS = radial probe endobronchial ultrasound; ROC = receiver operating characteristic.
Jcm 09 03652 g004
Table 1. Baseline characteristics of the patients by malignancy status.
Table 1. Baseline characteristics of the patients by malignancy status.
Total (n = 157)Benign (n = 67)Malignant (n = 90)p Value
Clinical factors
Age, y66.0 (59.0–73.0)66.0 (58.0–72.5)66.5 (59.0–73.0)0.757
Sex 0.384
Male91 (58.0)42 (62.7)49 (54.4)
Female66 (42.0)25 (37.3)41 (45.6)
History of malignancy30 (19.1)10 (14.9)20 (22.2)0.345
History of smoking69 (43.9)29 (43.3)40 (44.4)1.000
Chest CT findings
Size, mm30.0 (21.0–41.0)31.0 (21.5–45.0)29.5 (21.0–38.0)0.408
Upper lobe84 (53.5)28 (41.8)56 (62.2)0.017
Type 0.108
Solid110 (70.1)52 (77.6)58 (64.4)
Sub-solid47 (29.9)15 (22.4)32 (35.6)
Emphysema with nodules27 (17.2)6 (9.0)21 (23.3)0.032
Spiculation92 (58.6)22 (32.8)70 (77.8)<0.001
Bronchus sign48 (30.6)12 (17.9)36 (40.0)0.005
Shape 0.817
Round/Oval33 (21.0)13 (19.4)20 (22.2)
Complex124 (79.0)54 (80.6)70 (77.8)
Satellite nodules47 (29.9)37 (55.2)10 (11.1)<0.001
Radial EBUS findings
Echogenicity <0.001
Homogeneous90 (57.3)52 (77.6)38 (42.2)
Heterogeneous67 (42.7)15 (22.4)52 (57.8)
Attenuation59 (37.6)18 (26.9)41 (45.6)0.026
Margin 0.017
Regular22 (14.0)15 (22.4)7 (7.8)
Irregular135 (86.0)52 (77.6)83 (92.2)
Shape 1.000
Round/Oval71 (45.2)30 (44.8)41 (45.6)
Complex86 (54.8)37 (55.2)49 (54.4)
Dots or linear arcs60 (38.2)10 (14.9)50 (55.6)<0.001
Vessels and bronchi <0.001
Patent28 (17.8)23 (34.3)5 (5.6)
Not patent129 (82.2)44 (65.7)85 (94.4)
Data are presented as number (%), median (interquartile range). Abbreviations: CT = Computed tomography; Radial EBUS = radial probe endobronchial ultrasound.
Table 2. Baseline characteristics of the patients in the training and validation sets.
Table 2. Baseline characteristics of the patients in the training and validation sets.
Training Set (n = 108)Validation Set (n = 49)p Value
Final diagnosis 1.000
Benign46 (42.6)21 (42.9)
Malignant62 (57.4)28 (57.1)
Clinical factors
Age, y66.5 (59.0–73.0)66.0 (58.0–73.0)0.872
Sex 0.464
Male60 (55.6)31 (63.3)
Female48 (44.4)18 (36.7)
History of malignancy22 (20.4)8 (16.3)0.705
History of smoking45 (41.7)24 (49.0)0.495
Chest CT findings
Size, mm30.5 (22.0–40.5)26.0 (19.0–43.0)0.374
Upper lobe61 (56.5)23 (46.9)0.348
Type 0.660
Solid74 (68.5)36 (73.5)
Sub-solid34 (31.5)13 (26.5)
Emphysema with nodules17 (15.7)10 (20.4)0.624
Spiculation63 (58.3)29 (59.2)1.000
Bronchus sign37 (34.3)11 (22.4)0.193
Shape 0.352
Round/Oval20 (18.5)13 (26.5)
Complex88 (81.5)36 (73.5)
Satellite nodules34 (31.5)13 (26.5)0.660
Radial EBUS findings
Echogenicity 0.401
Homogeneous59 (54.6)31 (63.3)
Heterogeneous49 (45.4)18 (36.7)
Attenuation43 (39.8)16 (32.7)0.496
Margin 0.191
Regular12 (11.1)10 (20.4)
Irregular96 (88.9)39 (79.6)
Shape 0.643
Round/Oval47 (43.5)24 (49.0)
Complex61 (56.5)25 (51.0)
Dots or linear arcs43 (39.8)17 (34.7)0.664
Vessels and bronchi 0.914
Patent20 (18.5)8 (16.3)
Not patent88 (81.5)41 (83.7)
Data are presented as number (%), median (interquartile range). Abbreviations: CT = computed tomography; Radial EBUS = radial probe endobronchial ultrasound.
Table 3. Baseline characteristics of the patients in the training set by malignancy status.
Table 3. Baseline characteristics of the patients in the training set by malignancy status.
Benign (n = 46)Malignant (n = 62)p Value
Clinical factors
Age, y65.0 (56.0–71.0)67.5 (59.0–73.0)0.469
Sex 0.446
Male28 (60.9)32 (51.6)
Female18 (39.1)30 (48.4)
History of malignancy8 (17.4)14 (22.6)0.674
History of smoking19 (41.3)26 (41.9)1.000
Chest CT findings
Size, mm30.0 (22.0–42.0)30.5 (22.0–40.0)0.918
Upper lobe20 (43.5)41 (66.1)0.031
Type 0.037
Solid37 (80.4)37 (59.7)
Sub-solid9 (19.6)25 (40.3)
Emphysema with nodules4 (8.7)13 (21.0)0.143
Spiculation16 (34.8)47 (75.8)<0.001
Bronchus sign7 (15.2)30 (48.4)0.001
Shape 1.000
Round/Oval9 (19.6)11 (17.7)
Complex37 (80.4)51 (82.3)
Satellite nodules28 (60.9)6 (9.7)<0.001
Radial EBUS findings
Echogenicity <0.001
Homogeneous35 (76.1)24 (38.7)
Heterogeneous11 (23.9)38 (61.3)
Attenuation14 (30.4)29 (46.8)0.129
Margin 0.139
Regular8 (17.4)4 (6.5)
Irregular38 (82.6)58 (93.5)
Shape 0.167
Round/Oval16 (34.8)31 (50.0)
Complex30 (65.2)31 (50.0)
Dots or linear arcs6 (13.0)37 (59.7)<0.001
Vessels and bronchi <0.001
Patent16 (34.8)4 (6.5)
Not patent30 (65.2)58 (93.5)
Data are presented as number (%), median (interquartile range). Abbreviations: CT = computed tomography; Radial EBUS = radial probe endobronchial ultrasound.
Table 4. Univariable and multivariable logistic regression analyses of the training set.
Table 4. Univariable and multivariable logistic regression analyses of the training set.
Univariable AnalysisMultivariable Analysis
OR (95% CI)p ValueOR (95% CI)p Value
Clinical factors
Age, y1.01 (0.98–1.04)0.601
Sex (Male)0.69 (0.32–1.49)0.339
History of malignancy1.39 (0.53–3.64)0.509
History of smoking, Ever vs. never1.03 (0.47–2.23)0.948
Chest CT
Size, mm1.00 (0.97–1.03)0.853
Upper lobe2.54 (1.16–5.57)0.0207.81 (1.71–35.75)0.008
Type (Solid)2.78 (1.14–6.75)0.024
Emphysema with nodules2.79 (0.84–9.19)0.093
Spiculation5.87 (2.54–13.61)<0.0015.65 (1.21–26.47)0.028
Bronchus sign5.22 (2.03–13.46)<0.001
Shape (Complex)1.13 (0.42–3.00)0.810
Satellite nodules0.07 (0.02–0.19)<0.0010.01 (<0.01–0.09)<0.001
Radial EBUS
Echogenicity (Heterogeneous) 5.04 (2.16–11.77)<0.0015.65 (1.11–28.89)0.037
Attenuation 2.01 (0.90–4.48)0.0884.91 (0.88–27.43)0.070
Margin (Irregular)3.05 (0.86–10.85)0.085
Shape (Complex)0.53 (0.24–1.17)0.117
Dots or Linear arcs9.87 (3.64–26.74)<0.0018.00 (1.27–50.53)0.027
Vessels and bronchi (Not patent)7.73 (2.37–25.19)<0.00110.62 (1.65–68.29)0.013
Abbreviations: CT = computed tomography; CI = confidence interval; OR = odds ratio; Radial EBUS = radial probe endobronchial ultrasound.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zo, S.; Woo, S.-y.; Kim, S.; Lee, J.E.; Jeong, B.-H.; Um, S.-W.; Kim, H.; Kwon, O.J.; Lee, H.Y.; Lee, K. Predicting the Risk of Malignancy of Lung Nodules Diagnosed as Indeterminate on Radial Endobronchial Ultrasound-Guided Biopsy. J. Clin. Med. 2020, 9, 3652. https://doi.org/10.3390/jcm9113652

AMA Style

Zo S, Woo S-y, Kim S, Lee JE, Jeong B-H, Um S-W, Kim H, Kwon OJ, Lee HY, Lee K. Predicting the Risk of Malignancy of Lung Nodules Diagnosed as Indeterminate on Radial Endobronchial Ultrasound-Guided Biopsy. Journal of Clinical Medicine. 2020; 9(11):3652. https://doi.org/10.3390/jcm9113652

Chicago/Turabian Style

Zo, Sungmin, Sook-young Woo, Seonwoo Kim, Jung Eun Lee, Byeong-Ho Jeong, Sang-Won Um, Hojoong Kim, O Jung Kwon, Ho Yun Lee, and Kyungjong Lee. 2020. "Predicting the Risk of Malignancy of Lung Nodules Diagnosed as Indeterminate on Radial Endobronchial Ultrasound-Guided Biopsy" Journal of Clinical Medicine 9, no. 11: 3652. https://doi.org/10.3390/jcm9113652

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop