Next Article in Journal
Quantifying Privacy Risks for Continuous Trait Data
Next Article in Special Issue
Lenke Classification Report Generation Method for Scoliosis Based on Spatial and Context Dual Attention
Previous Article in Journal
Dynamic Measurement of Patellofemoral Compression Forces: A Novel Method for Patient-Specific Patella Resurfacing in Total Knee Replacement
Previous Article in Special Issue
Minimum Sample Size Estimate for Classifying Invasive Lung Adenocarcinoma
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Radiomics Approach Based on Follow-Up CT for Pathological Subtypes Classification of Pulmonary Ground Glass Nodules

School of Electrical and Information Engineering, Tianjin University, Tianjin 300192, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2022, 12(20), 10587; https://doi.org/10.3390/app122010587
Submission received: 5 September 2022 / Revised: 16 October 2022 / Accepted: 17 October 2022 / Published: 20 October 2022
(This article belongs to the Special Issue Advanced Medical Imaging Technologies and Applications)

Abstract

:
Preoperative, non-invasive, and accurate identification of the pathological subtypes of pulmonary ground glass nodules (GGNs) play an important role in the precise selection of clinical surgical operations and individualized treatment plans. Efforts have been made for the classification of pathological subtypes of GGNs, but most existing methods focus on benign or malignant diagnosis of GGNs by means of a one-time computed tomography image (CTI), which fails to capture the nodule development based on follow-up CTI. In this paper, a novel method for subtype classification based on follow-up CTIs is presented as a viable option to the existing one-time CTI-based approach. A total of 383 follow-up CTIs with GGNs from 146 patients was collected and retrospectively labeled via posterior surgical pathology. Feature extraction is performed individually to the follow-up CTIs. The extracted feature differences were represented as a vector, which was then used to construct a set of vectors for all the patients. Finally, a subspace K-nearest neighbor classifier was built to predict the pathological subtypes of GGNs. Experimental validation confirmed the efficacy of the new method over the existing method. Results showed that the accuracy of the new method could reach 72.5%, while the existing methods had an upper bound of 67.5% accuracy. Subsequent three-category comparison experiments were also performed to demonstrate that the new method could increase the accuracy up to 21.33% compared to the existing methods that use one-time CTI.

1. Introduction

Lung cancer frequently manifests in the form of a malignant tumor with very high morbidity and mortality worldwide [1]. In 2015, the World Health Organization integrated multidisciplinary research on lung adenocarcinoma, classifying it into four subtypes based on its different pathologies: atypical adenomatous hyperplasia (AAH), adenocarcinoma in situ (AIS), minimally invasive adenocarcinoma (MIA), and invasive adenocarcinoma (IA).
With advancements in imaging technology, and the widespread application of computed tomography image (CTI) for lung cancer scan, the detection rate of early-stage lung adenocarcinoma, manifested as ground glass nodules (GGNs), has increased significantly. GGNs are closely related to lung cancer, especially lung adenocarcinoma [2]. During the pathological progress of lung adenocarcinoma from pre-invasive to invasive lesions, GGNs can be observed in the CTI, but lack specificity [3]. The growth of GGN follows a regular pattern, from benign lesions (e.g., AAH) to malignant lesions (e.g., IA) [4]. Most GGN lesions are benign, but about 30% are malignant including AIS, MIA, and IA [5]. However, GGN is likely to be related to other lung diseases such as viral pneumonia [6], the coronavirus disease 2019 (COVID-19) [7], etc., where COVID-19 has become a global pandemic. To date, how to distinguish their differences remains a key issue.
In the past, traditional computer-aided diagnosis methods utilize various feature extraction protocols to quantify the appearance of nodules on diagnostic CTIs, and machine learning algorithms such as fuzzy clustering [8], threshold segmentation [9], support vector machines [10], etc., have been employed to classify GGNs. Although these works have achieved impressive performance, extracting appropriate nodule features is very time-consuming, unapparent, and unclear. In recent decades, three classes of remarkable progresses on GGN have been made as follows.
(1) Rapid development in digital imaging and artificial intelligence technologies has led to the field of radiomics, a new technique first proposed by Lambin et al. in 2012 for the noninvasive diagnosis of tumors [11]. Radiomics is recognized as an effective quantitative tool for characterizing the phenotypes of lung lesion [12]. It has achieved remarkable results in oncology assessments and diagnosis as well as in post-treatment prognosis [13]. In early pulmonary nodules diagnosis, for example, studies have demonstrated that radiomics performs well when classifying benign or malignant pulmonary nodules, histopathologic lung cancer phenotypes, and invasiveness in lung adenocarcinoma lesions based on quantitative CTIs [14,15].
(2) Deep learning (DL) methods have been demonstrated to greatly reduce the difficulty of feature extraction in CTIs [16]. Unlike the radiomics model, the DL-based model can extract deep imaging features by using an end-to-end deep convolutional neural network [17]. Wang et al. [18] showed that DL combined with the radiomics features could conveniently and automatically obtain the best performance in predicting the invasiveness of lung adenocarcinoma manifesting as GGNs. Moreover, a cascade architecture with both segmentation and classification networks was built. It could perform better and was more stable than the multi-task learning model appearing as GGNs. Ni et al. [19] proposed an automatic GGN invasiveness classification algorithm for the adenocarcinoma. Experiments showed that the algorithm outperformed the traditional machine learning method.
(3) AI techniques have attracted significant attention in the fight against COVID-19. One crucial application to use CTIs is to segment the COVID-19 infections, which can aid doctors in the treatment. A novel evolvable adversarial framework [20] has been developed for COVID-19 infection segmentation that incorporated the gradient penalty into the network, penalizing the discriminator’s gradient norm input. Experiments verified that the proposed model achieved superior effectiveness and stability for COVID-19 infection segmentation. Additionally, a weakly supervised method [21] was proposed for the segmentation of COVID-19 infections in CT slices with scribble supervision. The whole framework was constructed with a mean teacher framework and optimized by a weighted combination of the supervised and unsupervised losses. In the same direction, some other AI methods have been presented for the diagnosis and analysis of COVID-19 [22], and so on.
Although efforts and progress have been made, existing methods are very limited due to the following two issues:
(1) One-time CTI. The existing studies create their diagnosis models or classifiers based on the set of one-time CTIs, while medical professionals compare the change in GGNs in follow-up CTIs by reviewing and comparing visual characteristics rather than performing a quantitative evaluation. Thus, follow-up CTIs at regular intervals are necessary to identify and track the lesion change.
(2) Poor interpretability. As a data driven algorithm, the development of a DL-based model usually needs a large training dataset with thousands of CTIs. However, the diagnosis and therapy results for these models often have poor interpretability and do not respond to the morphological characteristics in CTIs. In the case of a small scale CTI set, their results may be unreliable. Since these characteristics are often atypical, it makes the differential diagnosis of pathological subtypes based on GGNs even more difficult.
In this paper, we propose a follow-up feature difference-based classification method (FFDC) to improve the accuracy of preoperative diagnosis, and overcome the limitation of the existing one-time feature-based (OFDC) method.

2. Materials and Methods

2.1. Sample Acquisition and Labeling

To build a classifier for the pathological subtypes of GGNs, a set of follow-up CTIs with GGNs must be collected.
The CTIs used in this study were retrospectively collected from the department of pulmonary tumor surgery, Tianjin Medical University General Hospital, corresponding to 146 patients with early lung adenocarcinoma from January 2020 to June 2021. All GGNs were retrospectively labeled by their surgical pathology. Figure 1 shows the four pathological subtypes of GGNs. All patients had one-time follow-up CTIs at least in which these lesions manifested as GGNs. These GGNs were pathologically analyzed after surgical resection. Hence, their pathological subtypes were confirmed by histopathology analysis. In this paper, the confirmed subtypes were used to label the GGNs for subsequent classification when constructing a classifier. The study was conducted in accordance with the Declaration of Helsinki, and all experiments were approved by the ethics committee of General Hospital of Tianjin Medical University (IRB2020-YX-145-01). The requirement to obtain informed consent from the participants was waived by the ethics committee. Table 1 shows the number subtypes of 146 patients, their number of follow-ups along these subtypes, and the GGNs subtypes in CTIs, respectively.
In this paper, we implemented the segmentation and feature extraction of GGNs using 3D Slicer [23]. 3D Slicer is a free and open-source multi-platform software package that is widely used for medical, biomedical, and related imaging research.
Each GGN corresponded to a group of CTIs with different sizes and shapes, but we fixed the CTI with the largest area for sequential classification purposes. According to the pathological and the CT detection reports, each patient’s GGN location and subtype can be found and labeled. The segmentation and labeling steps of GGN are as follows:
(1)
Import a set of CTIs for each patient into 3D Slicer and locate the GGNs.
(2)
Select CTIs that contain GGNs and then find the CTI with the largest area among these selected CTIs.
(3)
Segment the GGN with the largest area and save it as sequential classification.
(4)
Label the GGNs subtype with pathology reports.
According to 3D Slicer, 1041 features can be extracted from each GGN from the 146 patients’ 386 follow-up CTIs. Algorithmically, let Date (k, i) be the ith follow-up date of kth patient, Δtk,i be the time interval from ith to (i + 1) paired follow-up dates, fk (i, j) be the jth extracted feature from GGN in the ith follow-up CTI, and Tk is the total number of follow-up times of k-th patient, k = 1, 2, …, 146, i = 1, 2, …, 383, j = 1, 2, …, 1041.
Consequently, their feature differences along the paired follow-ups is computed as
Δ f k ( i , j ) = ( f 2 ( i , j ) f 1 ( i , j ) ) / Δ t i j ,   k = 1 , 2 , , 146 ;   i = 1 , 2 , , T k ; j = 1 , 2 , , 1041
where the denominator of Δtij aims to normalize the feature change in two different follow-up time intervals. Hence, the GGN feature changes of different patients at different dates are comparable.
Let SFFDC be the set of all feature-difference samples from Equation (1) in FFDC, and SOFDC be the set of samples in OFDC in which the Tkth time CTI for each patient is used to capture the latest features of GGN. Thus, SFFDC = {Δfk (i, j)}, SOFDC = {fk (Tk, j)}
Figure 2 shows the feature extraction process of our proposed method, where these figures in the third row show CTI samples, and these figures in the fourth row refer to the correspondingly segmented GGNs, respectively.

2.2. Radiomics Feature Extraction

The built-in package Pyradiomics in 3D Slicer can extract the main features of GGNs [24]. Through an analysis of the contour, direction, and gray value of GGNs, we can not only obtain the existing morphological characteristics, but also quantify the sufficient radiomics characteristics [25].
These quantitative features from radiomics are then computed on the original CTI and the six transformation images that follow: square, log, square root, exponential, logarithm, and wavelet. The set of initial features consists of 95 original features, 86 square features, 430 log features, 86 square root features, 172 wavelet features, 86 logarithm features, and 86 exponential features. The original features include nine shape features, 18 histogram features, and 68 texture features. These texture features are further divided into four categories: gray level run length matrix (GLRLM), gray level difference matrix (GLDM), gray level co-occurrence matrix (GLCM), and gray level size zone matrix (GLSZM), with their numbers being 16, 14, 22, and 16, respectively. In addition to the features extracted on the original CTI, we could identify the histogram features and texture features in the derived images.
Figure 3 shows the type and number of 1041 extracted features of GGN for the CTI of each patient.
The pair of CTIs from two-time adjacent flow-up records was used for feature extraction in FFDC from the first to the final follow-ups before the patient was operated, since each patient had two-time follow-up CTIs at least. On the other hand, a patient can have multiple GGNs, and thereby the radiomics feature difference between two-time follow-up CTIs of each GGN is regarded as a sample in FFDC. In contrast, only the most recent CTIs before surgery were used in OFDC. These CTIs had a follow-up period of more than three years compared to the most recent preoperative CTI, which were also referenced as samples and empirically compared for diagnosis in OFDC. In all, 383 samples in FFDC were obtained while 146 samples in OFDC were used.

2.3. Feature Selection and Data Augmentation

When all samples are used for the pathological classification of GGNs, two problems remain, as follows:
(1)
The number of samples is much less than that of the features, and some features are unnecessary.
(2)
The sample distribution is imbalanced; Table 1 shows that the number of samples in the majority class is 96, but there are only eight in the minority class.
To overcome these problems, feature selection and sample augmentation are implemented to SFFDC and SOFDC in advance. Feature selection removes irrelevant and redundant features [26]. To identify the key features and reduce feature dimensionality, we applied the analysis of variance (ANOVA) method [27]. ANOVA is a single variable analysis method to test whether the effect of any independent feature is obvious for which we computed the three sums of squares in S, SST, SSW, and SSB [28]. According to the four pathological subtypes of GGN and all samples, S consists of four groups of {xij} in which each contains ni samples, i = 1, 2, 3, 4; j = 1, …, ni.
As a result, SST is computed by
S S T = i = 1 4 j = 1 n i ( x i j X ¯ )
where X ¯ is the mean of all samples in S. SSB is computed as
S S B = i = 1 4 n i ( X ¯ i X ¯ )
Finally, SSW is calculated as
S S W = S S T S S B
To calculate the effect of each feature in S, SSB is divided by its freedom degree of 3 to obtain an estimate of MSB. SSW is divided by its freedom degree of 233 to obtain an estimate of MSW. Finally, a statistical value of F-ratio is computed as
F = M S B / M S W
We consulted the priori table of critical F values to obtain a significant p value. In this paper, we took a threshold of 0.05. If p > 0.05, the relative feature is rejected; if not, it is accepted for classification. In the following, the feature selection process is implemented in the IBM SPSS Statistics software. The feature number in S based on FFDC and OFDC was reduced to 142 dimensions and 680 dimensions, respectively.
To overcome the problem of the imbalanced sample distribution in S, the synthetic minority oversampling technique (SMOTE) [29,30] is used to increase the balance radio between cases in four classes in S. SMOTE randomly creates synthetic samples by adding a weighted difference between the jth sample and its k nearest neighbors. This enables oversampling of minority samples. These newly synthesized samples will enhance the generality of the classifiers, thereby avoiding overfitting to a certain extent [31]. Before data augmentation, all samples in the set on FFDC and the set on OFDC must be normalized according to the following form:
F s t a = ( F μ F ) / σ F
where Fsta is the standardized feature; μF is the mean value of the feature; and σF is the standard deviation of the feature.
According to Table 1, SMOTE is configured with five nearest neighbors for oversampling to generate synthetic samples in SFFDC and SOFDC. The SMOTE steps are as follows:
(1)
For each sample a in the minority class, five nearest neighbors are found.
(2)
For each randomly selected nearest neighbor b, a new sample c is constructed with the original sample a according to the following equation:
c = a + r a n d ( 0 , 1 ) a b
(1)
The new sample set is thus obtained by the original and generated samples.

2.4. Performance Assessment

After implementing SMOTE, the number of samples in SFFDC was extended from 237 to 413, and from 186 to 370 in SOFDC, as shown in Table 2. The extended sample set is uniformly denoted as SS. In this study, we chose macro average arithmetic (MavA), macro average geometric (MavG), and mean F-measure (MFM) as the criteria to evaluate the classification performance [32]. These criteria have been widely used in multi-class imbalance datasets [33,34,35]. The confusion matrix for binary classification problems is shown in Table 3.
The confusion matrix represents the results of correctly and incorrectly categorized samples. Here, the positive rate responds to the minority class and the negative to the majority class. In the binary scenario, several common assessment metrics can be derived from the confusion matrix, as shown in Table 4.
The MavA comprehensively considers the classification results, and each class is assigned the same weight. It calculates the accuracy of each class independently, and then computes their mean to obtain the assessment result. Therefore, the MavA is considered the arithmetic mean of the individual accuracy of each class. MavG is defined as the geometric average of the accuracy for each class. MavA and MavG are formulated as
MAvA = ( i = 1 4 TPR i ) / 4
MAvG = ( i = 1 4 TPR i ) 1 / 4
where TPRi represents the accuracy rate for the class i, i = 1, 2, 3, and 4.
F-measure assigns the same importance degree to recall and precision. It is shown as follows:
F - measure = 2 × recall × precision / ( recall + precision )
The F-measure for two-class classification assessment can be extended to deal with multi-class assessment problems. In this paper, MFM was employed to evaluate the four-category task, defined as follows:
MFM = ( i = 1 4 F - measure i ) / 4
where i is the index of the class.
Alternatively, we computed the area under the receiver operating characteristic (ROC) curve, which is also denoted by AUC. In order to extend ROC curve to multi-class classification, the output is binarized. The ROC curve can be drawn by calculating metrics for each label in a one-vs.-all manner and by finding their unweighted mean (macro-averaging). Figure 4 shows the schematic diagram of the FFDC method.

3. Results and Discussion

3.1. Classification Comparison

Contrast experiments were performed for the classification of four pathological subtypes of GGNs using FFDC and OFDC. To avoid large fluctuations in classification accuracy and to ensure that the training process can learn sufficient features, we retained ten cases of four subtypes in the dataset as the test set, and the rest were used to train and develop the classification model after implementing SMOTE. The sample distribution in SS is shown in Table 2.
We input samples in SS into the subspace KNN classifier for pathological subtypes classification, k = 1, 2, …, 20. KNN begins with k nearest labeled neighbors of each sample to determine the label of any unknown sample. In general, with reference to the integer value of k, the prediction output of classifier is determined on the basis of the majority vote cast by the neighbor class [36]. Namely, if any sample XC is assigned to class C1, it must be the maximum probability of XC belonging to class C1, expressed as
K N N ( X C ) = max P ( C 1 , X C ) .
where P(C1, XC) denotes the probability of XC in class C1. In this paper, the ensemble method was set as the subspace to improve the classification accuracy of each independent classifier. KNN was applied to the pathological subtype classification as the learner. A total of three hyperparameters were included in the training process (i.e., the number of nearest labeled neighbors k, the number of learners, and the subspace dimension). By combining grid search and cross validation, we avoid the situation where the selection of the model and parameter depends greatly on the partition method of the dataset. The selection interval of the nearest labeled neighbors k and the number of learner parameters was 1–10 and 1–100, respectively. The number of predictors to sample for each random subspace learner was specified as a positive integer in the interval 1, … p, where p is the number of predictor variables. For FFDC and OFDC, p is 142 and 680, respectively, corresponding to the maximum feature dimension after feature selection. The five-fold cross validation was applied in the training process. The datasets were divided into five equal parts, using four folds as the training sets and the remaining for validation. The optimal combination of parameter values was selected by grid search with the aid of the five-fold cross validation.
The confusion matrix results and the ROC curve for classification Are shown in Figure 5. Based on the confusion matrix, we calculated the corresponding evaluation indices. The experiments based on FFDC were: MavA was 72.5%, MavG was 72%, MFM was 0.75, and AUC value was 0.83. However, the comparative experiments based on OFDC were as follows: MavA was 67.5%, MavG was 66.2%, MFM was 0.68, and AUC value was 0.78. These quantitative evaluation metrics showed the same conclusion that the FFDC method yielded higher classification performance than the OFDC method in classifying four pathological subtypes of GGNs. This outcome proves that the FFDC method was effective.
Additionally, we found that the classification performance of both methods for MIA was slightly poor. According to the analysis, MIA is the transitional period of pathological changes between pre-invasive and IA. At this stage, most of the cancer cells grow in a wall-attached manner, and the maximum diameter of the infiltration area is less than 0.5 cm. When the infiltration area invades the blood vessels, lymphatic vessels, or adjacent to the pleura, or when the tumor shedding cells spread to the adjacent alveolar cavity or small airway, the tumor enters the invasive stage. Therefore, there is a possibility of overlap between MIA and the two other pathologies, pre-invasive lesions, and IA pathology. As such, the classification performance of MIA was slightly worse than that of other pathological subtypes.
To further test the effectiveness of FFDC, we considered another clinically important three-category classification subtask in distinguishing the IA, MIA, and pre-invasive lesions. This subtask is urgently needed in clinical practice. The lesions corresponding to pre-invasive often require conservative treatment, emphasizing long-term follow-up, while MIA and IA require elective or immediate surgical treatment due to their poorer prognosis when compared to pre-invasive lesions. The experimental steps are the same as the above classification of four pathological subtypes; the results are shown in Figure 6.
We also compared our experiments with other OFDC methods. The results are listed in Table 5. Compared with the previous literature in which a classifier is trained with one-time CTI to determine invasiveness, the FFDC method is seen as more effective. The FFDC classification accuracy was about 15.9% higher than that in [37], 21.33% than that in [21], 15.1% than that in [38], and 10% than that of the OFDC method trained with a traditional classifier. In addition, we found that the FFDC method seldom made misclassifications in discriminating between pre-invasive lesions and MIA in the three-category subtype classification. Only 1/10 MIA was misclassified as pre-invasive lesions, and no pre-invasive lesions were misclassified as MIA. It was shown that FFDC can learn the implicit relationship between the three categories. However, due to the overlap between MIA and two other pathologies, FFDC would misclassify MIA as IA or pre-invasive lesions.

3.2. Different Subtypes Development Based on the Follow-Up Radiomics Features

To further explore the development of different four subtypes of GGNs, we illustrate the statistics of the two-time follow-up features, which were selected from the first three ones with the lowest p value, as shown in Table 6. After the analysis of variance, multiple comparisons were used to determine whether there were significant differences between the follow-up features of each pathological sample.
The variation in the first three features in four pathological stages can be explained as follows:
(1)
‘wavelet-L_glcm_MaximumProbability’ reflects the probability of the highest frequency of adjacent gray pairs in ROI. The smaller the probability, the more complex the texture pattern. The texture complexity of GGNs manifested as IA and benign became uncomplicated over time, and benign changed faster than IA. In contrast, the texture complexity of GGNs gradually increased in MIA and AIS stage.
(2)
‘log-sigma-5-0-mm-3D_glszm_GrayLevelVariance’ reflects the discreteness of each pixel gray, relative to the average gray. The greater the value, the greater the image contrast. Among the four pathological results, only the contrast of GGNs in the MIA stage was gradually increased, and IA changed the fastest in other gradually decreasing stages.
(3)
‘exponential_glszm_SmallAreaLowGrayLevelEmphasis’ measures the distribution of low gray values in small regions of ROI. The larger the value, the more emphasis is placed on the range of low gray values in small regions. In addition to the gradual increase in benign eigenvalues, the values of the other three pathological stages gradually decreased, and the IA stage changed the slowest.
Therefore, we conclude that FFDC has higher accuracy and value for the classification of pathological subtypes of GGNs than OFDC.

4. Conclusions

This paper presents a new method called FFDC for the classification of four pathological subtypes of GGNs. The radiomics tool was used to extract sufficient and quantitative characteristics. The feature difference of two-time follow-up CTIs was used to find the development of GGNs in different pathological subtypes. The classification results demonstrated the following conclusions.
(1) Feature differences between two-time follow-up CTIs are very helpful for building a more effective classifier after the features of GGN are sufficiently extracted. Based on this, FFDC can achieve a better classification performance than the existing OFDC methods.
(2) Classification of all four pathological subtypes can be effectively realized, while most existing research is focused on the limited three-category radiomics classification.
(3) Four pathological subtypes had significant differences along the three extracted texture characteristics, which proves that the development rate of GGNs can reflect the corresponding pathological stages to a certain extent.
Although FFDC showed clear advantages over the existing OFDC methods, there were still limitations as follows.
(1) GGNs were manually segmented and labeled by posterior pathological analysis reports, but the current focus is machine automatic segmentation and labeling to avoid the error of manual segmentation. Moreover, in clinical applications, when the lesion segmentation is performed by human beings, it has been criticized as time-consuming and generally introducing bias.
(2) Radiomics features were extracted based on the two-dimensional CTI, and the three-dimensional information of the entire GGN lesion must be lost. Generally, the diagnosis model based on three-dimensional GGN segmentation and feature extraction is expected to provide more accurate and stable classifications for lung diseases.
(3) The used machine learning methods such as data argument, subspace classification may fail to give an overall comparison with the current DL algorithm due to the lack of sufficient samples.
How to overcome these problems are our future concerns. For example, the automatic segmentation of GGN lesions is not the research content in this paper, but it will be the focus of our future work.

Author Contributions

Conceptualization, C.M. and S.Y.; Methodology, C.M. and S.Y.; Software, C.M.; Validation, C.M. and C.S.; Writing—original draft preparation, C.M. and S.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China under Grant No. 61573251, 61973232.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the ethics committee of General Hospital of Tianjin Medical University (IRB2020-YX-145-01, 31 December 2020).

Informed Consent Statement

Patient consent was waived due to the secondary use of medical record specimens by the ethics committee of General Hospital of Tianjin Medical University.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy.

Acknowledgments

We would like to acknowledge Chen J. and Zhang H.B. from the Department of Pulmonary Tumor Surgery, Tianjin Medical University General Hospital, for their guidance and corrections on nodule segmentation.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Siegel, R.L.; Miller, K.D.; Jemal, A. Cancer Statistics, 2016. CAA Cancer J. Clin. 2016, 66, 7–30. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Kodama, K.; Higashiyama, M.; Yokouchi, H.; Takami, K.; Kuriyama, K.; Kusunoki, Y.; Nakayama, T.; Imamura, F. Natural history of pure ground-glass opacity after long-term follow-up of more than 2 years. Ann. Thorac. Surg. 2002, 73, 386–392. [Google Scholar] [CrossRef]
  3. MacMahon, H.; Naidich, D.P.; Goo, J.M.; Lee, K.S.; Leung, A.N.C.; Mayo, J.R.; Mehta, A.C.; Ohno, Y.; Powell, C.A.; Prokop, M.; et al. Guidelines for management of incidental Pulmonary Nodules Detected on CT Images: From the Fleischner society. Radiology 2017, 284, 228–243. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Chen, C.-H.; Chang, C.-K.; Tu, C.-Y.; Liao, W.-C.; Wu, B.-R.; Chou, K.-T.; Chiou, Y.-R.; Yang, S.-N.; Zhang, G.; Huang, T.-C. Radiomic features analysis in computed tomography images of lung nodule classification. PLoS ONE 2018, 13, e0192002. [Google Scholar] [CrossRef] [Green Version]
  5. Lee, H.J.; Goo, J.M.; Lee, C.H.; Park, C.M.; Kim, K.G.; Park, E.-A. Predictive CT findings of malignancy in ground-glass nodules on thin-section chest CT: The effects on radiologist performance. Eur. Radiol. 2009, 19, 552–560. [Google Scholar] [CrossRef]
  6. Qing, C.W.; Shou, Z.R.; Peter, D.; Zhang, S.; Zeng, H.; Bray, F.; Jemal, A.; Yu, X.Q.; He, J. Cancer statistics in China, 2015. CA Cancer J. Clin. 2016, 66, 115–132. [Google Scholar]
  7. Travis, W.D.; Brambilla, E.; Burke, A.P.; Marx, A.; Nicholson, A.G. Introduction to the 2015 World Health Organization Classification of Tumors of the Lung, Pleura, Thymus, and Heart. Thorac. Oncol. 2015, 10, 1240–1242. [Google Scholar] [CrossRef] [Green Version]
  8. Wang, Y.Q.; Yue, S.H. Ground Glass Nodule Segmentation Based on Regional Adaptive MRF Model. In Proceedings of the 39th Chinese Control Conference, Xi’an, China, 27–29 July 2020. [Google Scholar]
  9. Dong, T.; Wei, L.; Ye, X.; Chen, Y.; Hou, X.; Nie, S. Segmentation of ground glass pulmonary nodules using full convolution residual network based on atrous spatial pyramid pooling structure and attention mechanism. J. Biomed. Eng. 2022, 39, 441–451. [Google Scholar]
  10. Statnikov, A.; Wang, L.; Aliferis, C.F. A comprehensive comparison of random forests and support vector machines for microarray-based cancer classification. BMC Bioinform. 2008, 9, 319. [Google Scholar] [CrossRef] [Green Version]
  11. Lambin, P.; Rios-Velazquez, E.; Leijenaar, R.; Carvalho, S.; van Stiphout, R.G.P.M.; Granton, P.; Zegers, C.M.L.; Gillies, R.; Boellard, R.; Dekker, A.; et al. Radiomics: Extracting more information from medical images using ad-vanced feature analysis. Eur. J. Cancer 2012, 48, 441–446. [Google Scholar] [CrossRef] [Green Version]
  12. Schabath, M.; Balagurunathan, Y.; Dmitry, G.; Lawrence, H.; Samuel, H.; Stringfield, O.; Li, Q.; Liu, Y.; Gillies, R. Radiomics of lung cancer. J. Thorac. Oncol. 2016, 11, S5–S6. [Google Scholar] [CrossRef] [Green Version]
  13. Liu, Z.; Wang, S.; Dong, D.; Wei, J.; Fang, C.; Zhou, X.; Sun, K.; Li, L.; Li, B.; Wang, M.; et al. The application of radiomics in precision diagnosis and treatment of oncology: Opportunities and challenges. Theranostics 2021, 9, 1303–1322. [Google Scholar] [CrossRef]
  14. Thawani, R.; McLane, M.; Beig, N.; Ghose, S.; Prasanna, P.; Velcheti, V.; Madabhushi, A. Radiomics and radiogenomics in lung cancer: A review for the clinician. Lung Cancer 2018, 155, 34–41. [Google Scholar] [CrossRef] [PubMed]
  15. Fornacon-Wood, I.; Faivre-Finn, C.; O’Connor, J.P.; Price, G. Radiomics as a personalized medicine tool in lung cancer: Separating the hope from the hype. Lung Cancer 2020, 146, 197–208. [Google Scholar] [CrossRef] [PubMed]
  16. Hu, X.F.; Gong, J.; Zhou, W. Computer-aided diagnosis of ground glass pulmonary nodule by fusing deep learning and radiomics features. Phys. Med. Biol. 2021, 66, 065015. [Google Scholar] [CrossRef] [PubMed]
  17. Shen, D.; Wu, G.; Suk, H.I. Deep learning in medical image analysis. Annu. Rev. Biomed. Eng. 2017, 19, 221–248. [Google Scholar] [CrossRef] [Green Version]
  18. Wang, X.; Li, Q.C.; Cai, J.L. Predicting the invasiveness of lung adenocarcinomas appearing as ground-glass nodule on CT scan using multi-task learning and deep radiomics. Transl. Lung Cancer Res. 2020, 9, 1397–1405. [Google Scholar] [CrossRef] [PubMed]
  19. Ni, Y.; Yang, Y.; Zheng, D.; Xie, Z.; Huang, H.; Wang, W. The invasiveness classification of ground-glass nodules using 3D attention network and HRCT. J. Digit. Imaging 2020, 33, 1144–1154. [Google Scholar] [CrossRef]
  20. Chen, C.; Zhou, K.; Wang, H.; Lu, Y.; Wang, Z.; Xiao, R.; Lu, T. TMSF-Net: Multi-series fusion network with treeconnect for colorectal tumor segmentation. Comput. Methods Programs Biomed. 2022, 215, 106613. [Google Scholar] [CrossRef] [PubMed]
  21. Wang, D.; Zhang, T.; Li, M.; Bueno, R.; Jayender, J. 3D deep learning based classification of pulmonary ground glass opacity nodules with automatic segmentation. Comput. Med. Imaging Graph. 2021, 88, 101814. [Google Scholar] [CrossRef]
  22. Liu, X.; Yuan, Q.; Gao, Y.; He, K.; Wang, S.; Tang, X.; Tang, J.; Shen, D. Weakly Supervised Segmentation of COVID-19 Infection with Scribble Annotation on CT Images. Pattern Recognit. 2022, 122, 108341. [Google Scholar] [CrossRef] [PubMed]
  23. Cheng, G.Z.; Estepar, R.S.J.; Folch, E.; Onieva, J.; Gangadharan, S.; Majid, A. Three-dimensional printing and 3D slicer powerful tools in understanding and treating structural lung disease. Chest 2016, 149, 1136–1142. [Google Scholar] [CrossRef]
  24. van Griethuysen, J.J.M.; Fedorov, A.; Parmar, C.; Hosny, A.; Aucoin, N.; Narayan, V.; Beets-Tan, R.G.H.; Fillion-Robin, J.-C.; Pieper, S.; Aerts, H.J.W.L. Computational Radiomics System to Decode the Radiographic Phenotype. Cancer Res. 2017, 77, 104–107. [Google Scholar] [CrossRef] [Green Version]
  25. Hu, X.; Ye, W.; Li, Z.; Chen, C.; Cheng, S.; Lv, X.; Weng, W.; Li, J.; Weng, Q.; Pang, P.; et al. Non-invasive evaluation for benign and malignant subcentimeter pulmonary ground-glass nodules (≤1 cm) based on CT texture analysis. Br. J. Radiol. 2020, 93, 20190762. [Google Scholar] [CrossRef]
  26. Cao, P.; Liu, X.; Yang, J.; Zhao, D.; Li, W.; Huang, M.; Zaiane, O. A multi-kernel based framework for heterogeneous feature selection and over-sampling for computer-aided detection of pulmonary nodules. Pattern Recognit. 2017, 64, 327–346. [Google Scholar] [CrossRef] [Green Version]
  27. Tan, M.; Ma, W.; Sun, Y.; Gao, P.; Huang, X.; Lu, J.; Chen, W.; Wu, Y.; Jin, L.; Tang, L.; et al. Prediction of the Growth Rate of Early-Stage Lung Adenocarcinoma by Radiomics. Front. Oncol. 2021, 11, 1141. [Google Scholar] [CrossRef]
  28. Monica, L.; Gaddis, P.D. Statistical Methodology: IV. Analysis of Variance, Analysis of Covariance, and Multivariate Analysis of Variance. Acad. Emerg. Med. 1998, 5, 258–265. [Google Scholar]
  29. Abu Bakar, Z.; Ispawi, D.I.; Ibrahim, N.F.; Tahir, N.M. Classification of Parkinson’s disease based on Multilayer Perceptrons (MLPs) Neural Network and ANOVA as a feature extraction. In Proceedings of the 2012 IEEE 8th International Colloquium on Signal Processing and Its Applications, Malacca, Malaysia, 23–25 March 2012. [Google Scholar]
  30. Gong, J.; Liu, J.-Y.; Hao, W.; Nie, S.-D.; Wang, S.; Peng, W. Computer-aided diagnosis of ground-glass opacity pulmonary nodules using radiomic features analysis. Phys. Med. Biol. 2019, 64, 135015. [Google Scholar] [CrossRef]
  31. Huang, H.-Y.; Lin, Y.-J.; Chen, Y.-S.; Lu, H.-Y. Imbalances data classification using random subspace method and SMOTE. In Proceedings of the 13th International Symposium on Advanced Intelligence Systems, Kobe, Japan, 20–24 November 2012. [Google Scholar]
  32. Sánchez-Crisostomo, J.P.; Alejo, R.; López-González, E.; Valdovinos, R.M.; Pacheco-Sánchez, J.H. Empirical analysis of assessments metrics for multi-class imbalance learning on the back-propagation contest. In Advances in Swarm Intelligence; Springer: Cham, Switzerland, 2014. [Google Scholar]
  33. García, S.; Zhang, Z.-L.; Altalhi, A.; Alshomrani, S.; Herrera, F. Dynamic ensemble selection for multi-class imbalanced datasets. Inf. Sci. 2018, 445, 22–37. [Google Scholar] [CrossRef]
  34. Zhang, Z.-L.; Luo, X.-G.; González, S.; García, S.; Herrera, F. DRCW-ASEG: One-versus-One distance-based relative competence weighting with adaptive synthetic example generation for multi-class imbalanced datasets. Neurocomputing 2018, 285, 176–187. [Google Scholar] [CrossRef]
  35. Pavan, M.R.; Jayagopal, P. A preprocessing method combined with an ensemble framework for the multiclass imbalanced data classification. Int. J. Comput. Appl. 2019, 64, 1–8. [Google Scholar]
  36. Swarna, K.; Vinayagam, A.; Ananth, M.B.J.; Kumar, P.V.; Veerasamy, V.; Radhakrishnan, P. A KNN based random subspace ensemble classifier for detection and discrimination of high impedance fault in PV integrated power network. Measurement 2022, 187, 110333. [Google Scholar] [CrossRef]
  37. Zhao, W.; Yang, J.; Sun, Y.; Li, C.; Wu, W.; Jin, L.; Yang, Z.; Ni, B.; Gao, P.; Wang, P.; et al. 3D deep learning from CT scans predicts tumor invasiveness of subcentimeter pulmonary adenocarcinomas. Cancer Res. 2018, 78, 6881–6889. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Yu, Y.; Wang, N.; Huang, N.; Liu, X.; Zheng, Y.; Fu, Y.; Li, X.; Wu, H.; Xu, J.; Cheng, J. Determining the invasiveness of ground-glass nodules using a 3D multi-task network. Eur. Radiol. 2021, 31, 7162–7171. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Examples of the four pathological subtypes of GGNs. (a) Benign; (b) AIS; (c) MIA; (d) IA.
Figure 1. Examples of the four pathological subtypes of GGNs. (a) Benign; (b) AIS; (c) MIA; (d) IA.
Applsci 12 10587 g001
Figure 2. Feature extraction of the follow-up CTIs.
Figure 2. Feature extraction of the follow-up CTIs.
Applsci 12 10587 g002
Figure 3. Type and number of extracted radiomics features.
Figure 3. Type and number of extracted radiomics features.
Applsci 12 10587 g003
Figure 4. Schematic diagram of the GGN subtype classification based on FFDC.
Figure 4. Schematic diagram of the GGN subtype classification based on FFDC.
Applsci 12 10587 g004
Figure 5. The confusion matrix and ROC curve for the classification of the four pathological subtypes. (a,c) FFDC; (b,d) OFDC.
Figure 5. The confusion matrix and ROC curve for the classification of the four pathological subtypes. (a,c) FFDC; (b,d) OFDC.
Applsci 12 10587 g005
Figure 6. Experiments of the GGN subtype three-category classification with FFDC. (a) Confusion matrix; (b) ROC curve.
Figure 6. Experiments of the GGN subtype three-category classification with FFDC. (a) Confusion matrix; (b) ROC curve.
Applsci 12 10587 g006
Table 1. The GGNs subtypes of 146 patients.
Table 1. The GGNs subtypes of 146 patients.
Pathological SubtypesNumber of PatientsNumber of Follow-Ups
MalignantIA96249
MIA2150
AIS837
BenignAAH2147
Table 2. The data distribution of augmentation anterior posterior.
Table 2. The data distribution of augmentation anterior posterior.
ExperimentsIAMIAAISBenign
FFDCBefore augmentationTraining set143191916
Test set10101010
After augmentationTraining set143959580
Test set10101010
OFDCBefore augmentationTraining set100141418
Test set10101010
After augmentationTraining set100707090
Test set10101010
Table 3. Confusion matrix for the binary classification problems.
Table 3. Confusion matrix for the binary classification problems.
Confusion MatrixPredicted Class
PositiveNegative
True classPositiveTrue positive (TP)False negative (FN)
NegativeFalse positive (FP)True negative (TN)
Table 4. Typical assessment metrics.
Table 4. Typical assessment metrics.
MetricsEquation
True positive rate (TPR) or recall TPR = TP / ( TP + FN )
True negative rate (TNR) TNR = TN / ( FP + FN )
False positive rate (FPR) FPR = FP / ( FP + TN )
False negative rate (FNR) FNR = FN / ( TP + FN )
precision precision = TP / ( TP + FP )
Table 5. Comparison of studies using different methods to determine the invasiveness.
Table 5. Comparison of studies using different methods to determine the invasiveness.
YearNumber of ClassesMethodDiagnostic Performance
Pre-InvasiveMIAIAAccuracyAUC
2018 [37]205316130OFDC + DenseSharp64.1%
2021 [21]225335180OFDC + joint deep learning model58.67%0.81
2021 [38]302349258OFDC + 3D multi-task deep learning network64.9%0.82
2022 [ours]5224110OFDC + traditional classifier70%0.89
5529153FFDC + traditional classifier80%0.88
Table 6. The first three follow-up features with the lowest p value.
Table 6. The first three follow-up features with the lowest p value.
FeaturesPathologyp Value
IAMIAAISBenign
wavelet-L_glcm_MaximumProbability4.15 × 10−5−1.23 × 10−4−5.32 × 10−62.38 × 10−40.00003
log-sigma-5-0-mm-3D_glszm_GrayLevelVariance−8.84 × 10−33.95 × 10−2−1.55 × 10−3−5.06 × 10−30.00008
exponential_glszm_SmallAreaLowGrayLevelEmphasis−6.26 × 10−5−2.03 × 10−4−1.09 × 10−43.21 × 10−40.00010
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ma, C.; Yue, S.; Sun, C. A Radiomics Approach Based on Follow-Up CT for Pathological Subtypes Classification of Pulmonary Ground Glass Nodules. Appl. Sci. 2022, 12, 10587. https://doi.org/10.3390/app122010587

AMA Style

Ma C, Yue S, Sun C. A Radiomics Approach Based on Follow-Up CT for Pathological Subtypes Classification of Pulmonary Ground Glass Nodules. Applied Sciences. 2022; 12(20):10587. https://doi.org/10.3390/app122010587

Chicago/Turabian Style

Ma, Chenchen, Shihong Yue, and Chang Sun. 2022. "A Radiomics Approach Based on Follow-Up CT for Pathological Subtypes Classification of Pulmonary Ground Glass Nodules" Applied Sciences 12, no. 20: 10587. https://doi.org/10.3390/app122010587

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop