Next Article in Journal
The Association between Ankle–Brachial Index/Pulse Wave Velocity and Cerebral Large and Small Vessel Diseases in Stroke Patients
Next Article in Special Issue
Intraoperative MRI Assessment of the Tissue Damage during Laser Ablation of Hypothalamic Hamartoma
Previous Article in Journal
Is There Still a Role for Two-Phase Contrast-Enhanced CT and Virtual Monoenergetic Images in the Era of Photon-Counting Detector CT?
Previous Article in Special Issue
NAMSTCD: A Novel Augmented Model for Spinal Cord Segmentation and Tumor Classification Using Deep Nets
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

ETISTP: An Enhanced Model for Brain Tumor Identification and Survival Time Prediction

1
Department of Computer Science, City University of Science and Information Technology, Peshawar 25000, Pakistan
2
Faculty of Informatics, Kaunas University of Technology, 51368 Kaunas, Lithuania
3
Department of Applied Informatics, Vytautas Magnus University, 44404 Kaunas, Lithuania
4
Faculty of Applied Mathematics, Silesian University of Technology, 44-100 Gliwice, Poland
5
Department of Computer & Software Technology, University of Swat, Swat 19200, Pakistan
*
Authors to whom correspondence should be addressed.
Diagnostics 2023, 13(8), 1456; https://doi.org/10.3390/diagnostics13081456
Submission received: 14 March 2023 / Revised: 30 March 2023 / Accepted: 14 April 2023 / Published: 18 April 2023
(This article belongs to the Special Issue Diagnosis of Brain Tumors)

Abstract

:
Technology-assisted diagnosis is increasingly important in healthcare systems. Brain tumors are a leading cause of death worldwide, and treatment plans rely heavily on accurate survival predictions. Gliomas, a type of brain tumor, have particularly high mortality rates and can be further classified as low- or high-grade, making survival prediction challenging. Existing literature provides several survival prediction models that use different parameters, such as patient age, gross total resection status, tumor size, or tumor grade. However, accuracy is often lacking in these models. The use of tumor volume instead of size may improve the accuracy of survival prediction. In response to this need, we propose a novel model, the enhanced brain tumor identification and survival time prediction (ETISTP), which computes tumor volume, classifies it into low- or high-grade glioma, and predicts survival time with greater accuracy. The ETISTP model integrates four parameters: patient age, survival days, gross total resection (GTR) status, and tumor volume. Notably, ETISTP is the first model to employ tumor volume for prediction. Furthermore, our model minimizes the computation time by allowing for parallel execution of tumor volume computation and classification. The simulation results demonstrate that ETISTP outperforms prominent survival prediction models.

1. Introduction

Tumor refers to undesired tissues, which may result in being malign or benign. Brain tumors are a complex and heterogeneous group of diseases. There are various types of brain tumors, i.e., gliomas, meningiomas, and pituitary [1,2,3,4]. Gliomas are the most common types of brain tumors, accounting for approximately 80% of all malignant brain tumors. Gliomas rapidly spread to other tissues, they are hard to detect, and they have the highest death ratio among the aforementioned tumor types [5,6]. Gliomas are further classified into low-grade glioma (LGG) and high-grade glioma (HGG) based on their cellular and genetic characteristics. LGGs are less aggressive and have better prognoses than HGGs. Contrarily, HGG occurs in the spinal cord and brain; it exhibits a faster growth rate, which makes it highly dangerous and hard to treat. Hence, HGGs are more malignant and have a higher mortality rate.
Diagnosing and treating brain tumors are challenging tasks for healthcare systems globally, and remain dependent on a patient’s survival chances. The current standard of care for brain tumor patients includes surgery, chemotherapy, and radiotherapy. However, the effectiveness and side effects depend on several factors, such as tumor grade, size, location, patient’s age, and overall health. Brain tumors are one of the biggest contributors to deaths in human beings worldwide [7,8,9]. Once a brain tumor is diagnosed, a patient’s survival rate increases by 36% for the next five years, thereby demanding the urgent attention of the research community [10,11].
Since tumor diagnosis requires careful assessment to extend a patient’s survival chances, clinical diagnosis assisted by technology has gained immense importance in healthcare systems [12,13,14], giving rise to technology-assisted diagnoses in healthcare systems [15]. Moreover, the threat level of a tumor impacts the survival time, which depends on various parameters, such as the patient’s age, tumor type, tumor stage, etc. [16,17]. This demands the efficient classification of tumors in terms of severity level, which is referred to as the tumor grade [18].
To address this issue, the existing body of knowledge [19] provides several models. Survival prediction models have been developed to aid in the diagnosis and treatment of brain tumors. These models use different clinical parameters, such as patient age, tumor size, tumor grade, and gross total resection (GTR) status, to predict patient survival time. The authors in [20] present a novel model for brain tumor identification and patient survival prediction. Similarly, the authors of [21] predicted tumor growth using parameter population distribution (PPD). Furthermore, the authors in [22] employed multi-parametric magnetic resonance images (mpMRI) to identify tumors and analyze their progression; they are used to predict survival time based on gross total resection (GTR) and patient age. However, existing models lack the integration of the aforementioned parameters for identification, classification, and survival prediction. Moreover, these models consider two-dimensional (2D) tumor sizes, which degrade their performance. Furthermore, existing models have shown limitations in accuracy due to the complexity and heterogeneity of brain tumors.
One potential solution to improve the accuracy of survival prediction models is to integrate multiple clinical parameters, including tumor volume, into the model. Tumor volume is a critical factor in predicting brain tumor progression and patient survival, and its integration into the prediction model could improve the accuracy of survival predictions. Moreover, the parallel execution of tumor volume computation and classification could minimize the computation time, making the model more practical and efficient.
Motivated by the need for more accurate and efficient survival prediction models for brain tumors, this paper proposes a novel model, namely, enhanced brain tumor identification and survival time prediction (ETISTP), with the following contributions.
  • ETISTP enables the improved classification of gliomas with respect to different grades.
  • To the best of the authors’ knowledge, this work pioneers the use of tumor volume for survival time prediction.
  • This work integrates four different factors to enhance the accuracy of survival time prediction.
  • The proposed model reduces the computation time by enabling the parallel execution of tumor volume computation and classification.
The rest of the article is organized as follows. Section 2 critically reviews the related work on brain tumor classification and survival prediction. Section 3 details our proposed model. Section 4 evaluates the performance of the proposed method in comparison with the state-of-the-art. Finally, Section 5 includes the conclusion with future research directions.

2. Related Work

Brain tumors are one of the largest contributors to death in human beings worldwide, due to their severe adverse effects on the nervous system, which result in high death rates [17]. Magnetic resonance images (MRIs) are widely utilized in healthcare systems for tumor diagnosis [18]. However, manual diagnosis by medical practitioners utilizing these images remains challenging. As a result, researchers have proposed various models that significantly reduce human intervention in the diagnostic process and improve accuracy. This section provides a comprehensive analysis of the existing models by highlighting their advantages and disadvantages.
The authors in [12] fused computed tomography (CT) and MRIs to acquire new synthetic images with enriched information that could be exploited to enable enhanced diagnosis. Image segmentation enables enhanced identification of tumors. To this end, the authors in [23] presented a novel model based on generative adversarial net (GAN). Similarly, a convolutional neural network (CNN)-based model, proposed in [24], enables normalized segmentation that can be used to identify tumor regions. The authors in [25] reviewed supervised and unsupervised deep learning techniques for tumor identification. Tumor growth was analyzed in [22] using various machine learning algorithms that segment mpMRI images.
The process of successful identification initiates the classification of tumors into different types or grades. The authors of [26] classified brain tumors into three categories using a probabilistic neural network (PNN). This model extracts features using a gray-level co-occurrence matrix (GLCM), while segmentation is performed using the K-means algorithm. In addition, the authors of [21] used a classical mathematical parameter population distribution model to predict tumor growth by estimating an independent parameter vector of an independent growth curve. In [27], the authors integrated different classifiers, i.e., extra trees, random forest, and logistic regression, and achieved better prediction performance by utilizing the combined results obtained from the aforementioned classifiers. The authors in [7] presented an intelligent technique for classification. Another model proposed in [4] used fuzzy brain-storm optimization, which classifies brain tumors into gliomas, meningiomas, and pituitary categories. Similarly, MRIs were augmented through pair-wise GAN in [28]. Shubham et al. [2] presented an enhanced model based on CNN and support vector machine (SVM) to classify brain tumors into three categories, i.e., glioma, meningioma, and pituitary. Gliomas are categorized as low-grade glioma (LGG) and high-grade glioma (HGG).
The model proposed in [29] classifies gliomas into the aforementioned grades. Rajnikanth et al. [30] developed a computer-aided diagnosis and detection (CADD) system that uses convolutional neural network (CNN)-supported segmentation and classification to identify glioblastoma/glioma-class brain tumors in 2D MRI slices. The effectiveness of the CADD system was confirmed through an investigation using a benchmark and real clinical brain MRI slices, and the performances of well-known classifiers were compared. They found that SVM-Cubic achieved the highest accuracy (>98%). These results demonstrate that using CNN-assisted segmentation and classification can improve disease detection accuracy. Bajdie et al. [31] used the AlexNet convolutional neural network (CNN) to detect and classify brain tumors in magnetic resonance (MR) images, achieving an overall accuracy of 99.62%. Kurdi et al. [32] used the Harris Hawks optimization CNN (HHOCNN) in their study to enhance the accuracy of brain tumor recognition in MRI images. Firstly, they pre-processed the MR images and removed noisy pixels to decrease the rate of false tumor recognition. Then, they employed a candidate region method to identify the tumor region by examining the boundary regions using line segments, which helped to retain hidden edge details. After segmenting the region, various features were extracted and classified using a CNN model that computed the precise location of the tumor with fault tolerance. By using the nature-inspired Harris Hawks optimization algorithm, the researchers minimized the misclassification error rate and improved the overall tumor recognition accuracy to 98% on the Kaggle dataset.
The Cox proportional hazards (CoxPH) regression model is a popular prediction model that employs different parameters [33]. The authors of [34] presented an extended CoxPH model applied to the medical records of breast cancer patients. Similarly, the authors of [20,22] proposed prediction models, which took the age and GTR as inputs to estimate the survival time of a patient. These models categorize survival into three classes, i.e., long-survival, mid-survivors, and short-survivors. The tumor size and other clinical records are widely used for a patient’s survival prediction [35]. Additionally, the authors of [36,37] proposed models to estimate risk factors based on historical and current data. Moreover, the authors in [38] employed a deep learning method to diagnose Alzheimer’s disease. Moreover, SAVAE-COX [39], PubMed [40], and Page-Net [41] employ deep learning for survival time prediction. Similarly, a statistical model (SM) was proposed in [42], which efficiently predicts the survival time. SAVAE-COX takes into account transfer learning, which results in a C-Index of 0.71 , making it superior to PubMed, Page-Net, and SM.
From the literature review, it is apparent that various parameters are used to estimate a patient’s survival time, including age, survival days, gross total resection status, tumor size, or tumor grade. However, the existing models rely on the use of a single parameter or a combination of a few parameters. The integration of all these parameters is still lacking in the literature, which can enhance accuracy. Moreover, the consideration of the 2D tumor size for prediction also reduces the efficiency of these models. To address these issues, this study presents a novel model that is detailed in the following section.

3. The Proposed ETISTP Model

This section introduces our proposed enhanced brain tumor identification and survival time prediction (ETISTP) model. ETISTP comprises five phases: pre-processing, tumor identification, tumor volume computation, tumor grade classification, and survival time prediction, as shown in Algorithm 1. The model improves brain tumor identification and classification, and predicts the patient’s survival time in terms of days. There are several types of brain tumors, including gliomas, meningiomas, and pituitary tumors [2,3,4]. The ETISTP model focuses on gliomas, which have the highest death rate worldwide [2,6].
Algorithm 1 Pseudocode of the proposed ETISTP model.
  • Step 1. Start.
  • Step 2. Input Brats2020 datasets.
  • Step 3. Apply pre-processing.
  • Step 4. Brain tumor Identification from 3D-MRI using U-Net model, as shown in Figure 4
  • Step 5. Compute tumor volume using Equation (1).
  • Step 6. Classify the tumor grade based on HGG and LGG using 3D-CNN.
  • Step 7. Four-factor integration to calculate the hazard value by Equation (2).
  • Step 8. Using the CoxPH model to calculate the survival rate using Equation (3).
  • Step 11. End.
The first phase involves pre-processing the magnetic resonance images (MRIs) to remove noise from the input images. The pre-processed MRIs are then used as input in the second phase for tumor identification through segmentation. Upon successful tumor identification, we compute the tumor volume and perform classification in terms of low-grade glioma (LGG) and high-grade glioma (HGG). The segmented image generated by the tumor identification phase serves as input for both the tumor volume computation and tumor grade classification phases. This enables the ETISTP model to carry out tumor volume computation and classification in parallel, significantly minimizing the overall response time of our proposed model. Finally, the ETISTP model predicts the patient’s survival time in terms of days based on four different parameters, namely, tumor type, tumor volume, patient’s age, and EoGTR. Figure 1 illustrates the procedural flowchart of our proposed model.

3.1. Pre-Processing

The proposed ETISTP model begins with pre-processing of a three-dimensional (3D) source image bearing P, Q, and R dimensions, where P = {1, 2, 3, …, p}, Q = {1, 2, 3, …, q}, and R = {1, 2, 3, …, r}. Pre-processing eradicates noise from an input source image. To this end, we employ the median filter, which is one of the most efficient choices [43], as shown in Figure 2.
The ETISTP model is validated on the benchmark Brats-2020 dataset, which is publicly available on The Cancer Imaging Archive (TCIA) [10]; it comprises 3D MR images with 240 × 240 × 155 resolutions [22,44,45]. This dataset contains the MRIs of 369 patients represented in 5 different modalities, i.e., t1, t1ce, t2, t2flair, and segmented, as shown in Figure 3. The integration of data from various modalities is important for achieving higher classification accuracy [46,47]. A t1 modality refers to a 3D-weighted image with axial 2D or sagittal native images with 1–6 millimeter (mm) slice thicknesses. This modality represents the image components as black holes. Moreover, the t1ce modality is a 3D-weighted contrast-enhanced (Gadolinium) image, with an isotropic voxel size of 1 mm, showing edges of the blood vessels as white edges. Furthermore, the t2 modality is a 2D-weighted image with 2–6 mm slice thicknesses; a t2-weighted flair modality produces 2D axial, coronal, or sagittal images with 2–6 mm slice thicknesses. Finally, a binary segmented image represents the tumor as the white component. Table 1 demonstrates the demographic information of 369 patients, which is used in this work. Upon successful execution of the pre-processing phase, the ETISTP model enters the tumor identification phase, which is detailed below.

3.2. Tumor Identification

This section identifies the infected area in MRIs. Early and accurate identification is crucial for better cures, making this phase critical in the proposed ETISTP model. To achieve this, we employed image segmentation techniques to extract the tumor-infected areas from 3D MRIs. Various segmentation techniques are available in the literature [48], but we chose to use the Universal Network (U-Net) model [6] for semantic segmentation of the brain tumor. This model consists of a contracting path that captures the context and a symmetric expanding path that enables accurate localization. Figure 4 shows the architecture of the U-Net used in this work, where each gray box corresponds to a multi-channel feature map, and the number of channels is specified on top of each box. A white box represents the copied feature maps, and an arrow indicates the direction of an operation.
The proposed ETISTP model trains the U-Net model using the aforementioned modalities to enhance brain tumor identification. Figure 5 depicts the U-Net training summary for tumor identification. The U-Net model produces a segmentation map from an input RGB image (height × width × 3) or a grayscale image (height × width × 1), with each pixel containing a class label represented as an integer. Figure 6 demonstrates a sample result in this regard. After training the U-Net model, it is validated on the same dataset. Some initial numerical results of tumor identification are shown in Table 2. Upon successful identification of the tumor, the ETISTP model initiates the next phase, which is detailed in the following subsection.

3.3. Tumor Volume Computation

This section focuses on the computation of the tumor volume. To the best of our knowledge, the ETISTP model is a pioneering approach that employs the tumor volume for the classification of tumors and the prediction of survival days using 3D MR images, as illustrated in Figure 7. A segmented image received from the previous phase is taken as the input. The volume of tumor (V) is computed using Equation (1) [49], as
V = λ μ ,
where λ denotes the tumor area and μ refers to the height of the tumor in a 3D MR image, respectively. The tumor volume remains one of the inputs for survival time prediction, which is the final phase of our proposed ETISTP model.

3.4. Tumor Grade Classification

Glioma is a type of cancer that occurs in the brain and spinal cord; it originates from the gluey supportive cells. The ETISTP model classifies gliomas into LGG and HGG categories. LGGs are cancerous tumors that exhibit slow growth rates and arise from glial cells of the brain, whereas HGGs occur in the spinal cord and brain, have a fast growth rate, and are highly dangerous and difficult to treat. Classification involves grouping entities based on a set of ordered features. In this work, 3D convolutional neural networks (3D CNNs) [50,51,52] were employed to classify tumors into LGG and HGG categories. The 3D CNNs have successive convolution layers and rectified linear unit (ReLU) functions. Each layer consists of neurons that learn weights and biases from an input image and use weighted sums in the activation function. Hidden layers include conv3d, max_pooling3d, and batch_normalization, as shown in Figure 8. After training, the proposed model is tested, and initial results for the classification of tumors into HGG and LGG categories based on t1, t1ce, t2, flair, and segmented modalities are presented in Table 3.
The segmented image produced by the tumor identification phase is used as input for both the tumor volume computation and tumor grade classification phases. This allows the ETISTP model to perform both tasks simultaneously, minimizing the overall response time significantly. Upon completion of the tumor grade classification and tumor volume computation phases, the ETISTP model reaches the final phase, which is detailed below.

3.5. Survival Time Prediction

The diagnostic process involves identifying the brain tumor and its grade, which is the responsibility of the tumor identification and tumor grade classification phases of the proposed ETISTP model. However, this information alone is not sufficient to plan and enable better treatment. The survival time of a patient is crucial in this regard. Since medical practitioners cannot compute the exact survival time for a patient, the ETISTP model includes a prediction phase that estimates the number of days a patient may survive. This prediction will certainly assist medical practitioners in planning and implementing effective treatments against brain tumors.
In the literature, there are several prediction models; however, these models significantly lack accuracy. To this end, the ETISTP model integrates the patient’s age, EoGTR, tumor volume, and tumor grade. Tumor grades are indicated using binary values, i.e., zero (0) and one (1) for LGG and HGG, respectively. The ETISTP model employs the CoxPH model [34,36,53], which takes into account the tumor volume, tumor grade, age, and GTR status. This integration of different parameters helps to enhance the accuracy of survival time prediction, as will be demonstrated in Section 4.
The results of the Cox Proportional hazard (CoxPH) model provide data about the relationship between the four factors and the hazard ratio of survival time, as follows.
  • The hazard ratio (HR) is the ratio of the hazard rates of two groups, which in this case is the ratio of the hazard rate of the group with a one-unit increase in the factor to the hazard rate of the group with the reference level of the factor.
  • The coefficient (coef) of each factor is the estimated change in the log hazard ratio for a one-unit increase in the factor, holding other factors constant.
  • The exponentiated coefficient (exp (coef)) is the estimated change in the hazard ratio for a one-unit increase in the factor, holding other factors constant.
  • The standard error (se) of the coefficient is the estimated standard deviation of the coefficient.
  • The 95% confidence interval (CI) of the coefficient provides a range of values for the coefficient that is likely to contain the true value of the coefficient with a 95% probability.
  • The 95% CI of the exponentiated coefficient provides a range of values for the hazard ratio that is likely to contain the true value of the hazard ratio with a 95% probability.
  • The z-value is the coefficient divided by the standard error and indicates the significance of the coefficient.
  • The p-value is the probability of observing a z-value that is as extreme as (or more extreme than) the observed z-value under the assumption that the null hypothesis, which states that the coefficient is zero, is true.
  • The −log2(p) is the negative logarithm (base 2) of the p-value and it indicates the strength of evidence against the null hypothesis.
Table 4 includes a summary of the parameters that are used to train the CoxPH with the aforementioned four parameters.
Table 5 demonstrates the coefficient results of the patients for each factor. These results can be interpreted as follows:
  • Age: The coefficient of age is 0.04, indicating that the hazard ratio of survival time increases by 4% for a one-year increase in age, assuming that all other factors remain constant. This effect is statistically significant ( z = 5.45 , p < 0.005 ). The 95% confidence interval (CI) of the hazard ratio ranges from 1.02 to 1.05, indicating that the hazard ratio is likely to increase between 2% and 5% for a one-year increase in age.
  • GTR: The coefficient of GTR is 0.04, which means that the hazard ratio of survival time increases by 4% for GTR, holding other factors constant. However, this effect is not statistically significant ( z = 0.52 , p = 0.60 ). The 95% CI of the hazard ratio is 0.90 to 1.19, which means that the hazard ratio can decrease by 10% or increase by 19% for GTR, but the uncertainty is high.
  • Class: The coefficient of ’class’ is -0.64, which means that the hazard ratio of survival time decreases by 47% for class, holding other factors constant. This effect is marginally significant ( z = 1.75 , p = 0.08 ), indicating weak evidence against the null hypothesis. The 95% CI of the hazard ratio is 0.26 to 1.08, which means that the hazard ratio can decrease by 74% or increase by 8% for class, but the uncertainty is high.
  • Volume: The coefficient of volume is 0.00, which means that the hazard ratio of survival time does not change for volume, holding other factors constant. This effect is not statistically significant ( z = 1.73 , p = 0.08 ). The 95% CI of the hazard ratio is 1.00 to 1.00, which means that the hazard ratio is likely to remain the same for volume. However, the upper bound of the CI is 1.08, indicating that there is a small possibility that the hazard ratio can increase by up to 8% for a one-unit increase in volume, but the uncertainty is high.
In summary, the CoxPH model indicates that age is a significant predictor of survival time, with a higher age associated with an increased hazard of death. However, the effects of GTR, class, and volume are less clear and require further investigation. It is important to note that the interpretation of these results should be made in the context of the study population and the specific research question being addressed.
Finally, the concordance of our trained CoxPH model is represented in Table 6. The concordance analysis result of the CoxPH model provides an assessment of the model’s predictive accuracy. In this case, the concordance value is 0.74, indicating that the model has a moderately good ability to discriminate between subjects who experience the event of interest (death) and those who do not. A perfect concordance value is 1.0, indicating perfect prediction accuracy, while a concordance value of 0.5 indicates random prediction. The partial AIC (Akaike information criterion) value is 1999.20, which is a measure of the model’s goodness-of-fit, with lower values indicating a better fit. The log-likelihood ratio test (LRT) value is 38.17 on 4 degrees of freedom (df), which compares the fit of the full model with a reduced model that does not include any of the predictor variables. The LRT assesses whether the addition of the predictor variables significantly improves the model’s fit, with a higher value indicating a better fit. In this case, the LRT value is significant, with a −log2(p) value of 23.20, indicating that the model with the predictor variables fits significantly better than the reduced model without any predictor variables. Overall, these results suggest that the CoxPH model with the four predictor variables (age, GTR, class, and volume) has a reasonably good ability to predict the survival time and provides a better fit than a model without any predictor variables.
We keep an 80% to 20% ratio for the training and testing in this phase. The ETISTP model computes the hazard values using Equation (2) [33,34], as
h ( t ) = h o ( t ) i = 1 n e x p ( b i w i ) ,
where h represents the hazard value, h o is a baseline hazard function that reflects the underlined hazard value for a case where all of the covariates are zero, t refers to the time at which a hazard value is recorded, b represents the hazard factor, w denotes the coefficient value for the concerned hazard value, and n (ranging from 0 through 3) refers to the risk factors.
Table 7 shows hazard factor weights for the risk factor, coefficient, and Exp (coef). In this model, the tumor volume has a coefficient of 0.01, but its hazard ratio is 1.00, which suggests that a one-unit increase in tumor volume does not significantly impact the risk of the event of interest. The tumor type has a coefficient of 0.15, and its corresponding hazard ratio is 1.16, indicating that patients with a different tumor type have a 16% higher risk of the event of interest, after adjusting for other variables in the model. The patient’s age has a coefficient of 0.03, and its corresponding hazard ratio is 1.04, indicating that for every one-year increase in age, the risk of the event of interest increases by 4% while controlling for other factors. The extent of GTR has a coefficient of 0.04, and its corresponding hazard ratio is 1.04, suggesting that patients with more extensive GTR have a 4% higher risk of the event of interest than those with less extensive GTR, after adjusting for other variables in the model. Overall, these results indicate that the tumor type, patient’s age, and the extent of GTR are significant predictors of the event of interest, while the tumor volume does not appear to have a significant effect on the risk of the event in this particular model.
ETISTP keeps the target value of the survival rate within the range of 0 to 1, where 0 refers to the minimum chances of the patient’s survival and 1 denotes the maximum chances. To compute the probability of a patient’s survival time in terms of days, the ETISTP model uses Equation (3) [53], as
ln S ( t i ) = 0 t h i ( t ) d ( t ) ,
where S denotes the survival rate for a certain time t and i represent the time range, e.g., i = 1 , 2 , 3 , 4 , , n . h ( t ) is the hazard value obtained from Equation (2) and d ( t ) is a derivative for the integration in the equation.
Figure 9 shows the initial results for the survival probability of a single patient with specifications provided in Table 8.
Similarly, the initial results for multiple patients are shown in Figure 10 with respect to the parameters specified in Table 9. Moreover, Figure 11 shows the survival rate for the LGG patient, whereas Figure 12 depicts the same for the HGG patient. These plots are based on the data provided in Table 10.

4. Performance Evaluation

This section evaluates the performance of our proposed ETISTP model. For tumor identification, the ETISTP model is compared with BU-Net [6], FCN [35], BrainSeg [54], and U-Net [24]. Moreover, to evaluate the classification performance, the proposed model is compared with 3DCNN [55] using five modalities, i.e., t1, t1ce, t2, Flair, and segmented. The survival prediction efficiency is evaluated in comparison with SAVAE-COX [39], CoxPH [40], PAGE-Net [41], the statistical machine learning algorithm [42], SVM [35], and the random forest classifier [20]. The following subsection details the simulation parameters used in this work.

4.1. Simulation Setup

The simulation results were obtained using TensorFlow v1.12 with Keras in an Anaconda environment, which provides extensive built-in library support. This was utilized for the state-of-the-art segmentation and classification of MRIs, brain tumor volume computation, and prediction of patients’ survival [56].
The hardware platform includes Dell OptiPlex 9020 with an Intel ® Core i 7 TM 4770 processor, 8 gigabytes of memory, and running Microsoft © Windows 10 (Home- 20 H 2 Edition). Moreover, we used the Brats2020 dataset, which consists of MR images for 369 patients with 5 different modalities, i.e., t1, t1ce, t2, t2flair, and seg [10,22,44,45]. Each presented result is an average of over 20 replicated simulation runs, where all parameters were kept fixed, and only the input values were randomly changed.

4.2. Performance Evaluation Criteria

To evaluate the performance of the proposed ETISTP, we employed the Dice score for tumor identification [57,58]. Moreover, for the classification comparative analysis, this work used the confusion matrix for tumor classification [14,28,55]. Finally, the Concordance Index ( C i ) was utilized to evaluate the performance of our proposed model in terms of survival prediction, which is widely used for survival analyses in different models [39,40].

4.3. Results and Discussion

This section presents the simulation results with their respective discussions. Figure 3 depicts sample MRI images in five modalities from the Brats2020 dataset.

4.3.1. Tumor Identification

Tumor identification leads to effective survival prediction for a patient, which can enable healthcare centers to save the precious lives of patients. The Dice score is used to evaluate the tumor identification efficiency of the aforementioned models, which is used by state-of-the-art models for quantitative comparison. A Dice score identifies the similarity between two sets, e.g., P and Q [57], as
D i c e = 2 × | P Q | | P + Q |
where | P | and | Q | refer to the cardinalities of the sets P and Q, respectively.
We compare our ETISTP model with the identification models presented in [6,20,24,35,54]. The results depicted in Table 11 show the superior performance of ETISTP, where it achieves a considerably high Dice score in comparison with the aforementioned models.

4.3.2. Classification

The appropriate classification of brain tumors is crucial to enable effective cures and to predict a patient’s survival time. The ETISTP model classifies brain tumors in terms of LGG and HGG. To evaluate the classification performance, we employed confusion matrix, where accuracy, precision, and the F1 score, which determine the efficacy of a model. Classification accuracy is computed using Equation (5) [4], as
A c c u r a c y = S T P + S T N S T P + S F P + S T N + S F N ,
where S T P and S T N denote true positive and true negative values, respectively. Similarly, S F P refers to the false positive value, whereas S F N is a false negative value. Furthermore, precision in classification is evaluated using Equation (6) [4], as
P r e c i s i o n = S T P S T P + S F P .
Finally, the F1 score is calculated using Equation (7) [4], as
F 1 s c o r e = S T P S T P + 1 2 ( S F P + S F N ) .
The classification efficacy of ETISTP, in terms of HGG and LGG, is evaluated in comparison with state-of-the-art models proposed in [4,14,28,55]. Table 12 presents the simulation results that affirm the superiority of the proposed ETISTP model in comparison with the aforementioned models. Moreover, the training accuracy and training loss for the five different modalities, i.e., t1 through seg, are shown in Figure 13, Figure 14, Figure 15, Figure 16 and Figure 17, respectively.

4.3.3. Survival Time Prediction

This section presents simulation results obtained for the proposed ETISTP model in terms of survival time prediction, in comparison with existing models from the literature. Successful classification of brain tumors into LGG and HGG leads to the next step, i.e., survival time prediction. To this end, we use Harrell’s Concordance Index ( C i ), which is widely used for survival analysis in various models [39,40]. The C i value ranges from 0 to 1, where C i < 0.5 indicates ineffective, whereas C i ≥ 0.5 indicates effective survival prediction. C i is evaluated using Equation (8), as
C i = i , j I ( T i > T j ) I ( Y i < Y j ) S j i , j I ( T i > T j ) S j l ,
where i and j denote a pair of subjects, T i and T j refer to the survival times, and Y i and Y j are the predicted risk scores, respectively. S j { 0 , 1 } , where 0 indicates a subject as censored, where 1 shows otherwise. I ( . ) is the indicator function, which is interpreted as a fraction for subjects with correctly ordered risk scores. Here, C i remains proportional to the survival time in terms of days. To evaluate the ETISTP model for survival time prediction, we compare it with the models presented in [39,40,41,42]. The simulation results presented in Table 13 confirm our claim of enhanced performance, where the ETISTP model outperforms the aforementioned models by a considerable margin. Moreover, the survival rate is evaluated by the ETISTP model for brain tumor patients.

4.4. Computational Efficiency

This section evaluates the computational efficiency of our proposed ETISTP model in comparison with random forest (RF) [20], SVM [35], and CoxPH [34]. The execution time is taken in seconds (s) for each aforementioned model on its application to Brats2020. Since the ETISTP model enables the parallel execution of tumor volume computation and classification, it achieves the smallest execution time among the aforementioned models. To this end, Table 14 demonstrates the results that confirm our claim; the ETISTP model outperforms the rest by a significant margin.

5. Conclusions

Technology-assisted diagnosis plays a critical role in determining the efficacy of a healthcare system. Brain tumors are a major cause of death worldwide, and the survival time of patients is crucial for prioritizing treatment and improving outcomes. Gliomas are a particularly deadly type of brain tumor, and are further classified into low- and high-grade gliomas, which makes survival prediction even more challenging. The existing literature offers several survival prediction models that use different parameters, such as patient age, survival days, gross total resection status, tumor size, or tumor grade. However, a comprehensive model that integrates all of these parameters is still lacking. Moreover, these models use tumor sizes that adversely impact the accuracy of survival prediction. To this end, we propose a novel model, ETISTP, which integrates the patient’s age, survival days, gross total resection status, tumor grade, and brain tumor volume, to improve survival time prediction. The ETISTP model is a pioneering model that employs tumor volume to enhance the accuracy of survival prediction. Additionally, our model also minimizes computation time by enabling parallel execution of tumor volume computation and classification. The simulation results affirm our claim that the ETISTP model outperforms eminent survival prediction models from the literature in terms of survival time prediction. Future extensions of this work may consider the inclusion of artificial intelligence-based decision-making for treatment. Moreover, the proposed prediction model can further be validated using larger datasets. Additionally, different clinical variables, e.g., genetic information, can be investigated to further enhance the prediction process.

Author Contributions

Conceptualization: S.H. (Shah Hussain), S.H. (Shahab Haider) and S.M.; methodology: S.H. (Shah Hussain), S.H. (Shahab Haider), S.M. and R.D.; software: S.H. (Shah Hussain), S.H. (Shahab Haider) and S.M.; validation: S.H. (Shah Hussain), S.H. (Shahab Haider), S.M., R.D., R.M. and M.K.; formal analysis: S.H. (Shahab Haider), S.M., R.D. and R.M.; investigation: S.H. (Shah Hussain), S.H. (Shahab Haider), S.M., R.D. and M.K.; data curation: S.H. (Shah Hussain), S.H. (Shahab Haider) and R.D.; writing—original draft preparation: S.H. (Shah Hussain), S.H. (Shahab Haider) and S.M.; writing—review and editing, S.H. (Shahab Haider), R.D. and M.K.; supervision: S.H. (Shahab Haider) and R.D.; funding acquisition: R.D. and R.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Rajinikanth, V.; Kadry, S.; Damasevicius, R.; Sujitha, R.A.; Balaji, G.; Mohammed, M.A. Glioma/Glioblastoma Detection in Brain MRI using Pre-trained Deep-Learning Scheme. In Proceedings of the 2022 3rd International Conference on Intelligent Computing, Instrumentation and Control Technologies: Computational Intelligence for Smart Systems, ICICICT 2022, Kannur, India, 11–12 August 2022; pp. 987–990. [Google Scholar]
  2. Rao, C.S.; Karunakara, K. Efficient detection and classification of brain tumor using kernel based SVM for MRI. Multimed. Tools Appl. 2022, 81, 7393–7417. [Google Scholar] [CrossRef]
  3. Koong, K.; Preda, V.; Jian, A.; Liquet-Weiland, B.; Di Ieva, A. Application of artificial intelligence and radiomics in pituitary neuroendocrine and sellar tumors: A quantitative and qualitative synthesis. Neuroradiology 2021, 64, 1–22. [Google Scholar] [CrossRef] [PubMed]
  4. Narmatha, C.; Eljack, S.M.; Tuka, A.A.R.M.; Manimurugan, S.; Mustafa, M. A hybrid fuzzy brain-storm optimization algorithm for the classification of brain tumor MRI images. J. Ambient. Intell. Humaniz. Comput. 2020, 1–9. [Google Scholar] [CrossRef]
  5. Papic, V.; Lasica, N.; Jelaca, B.; Vuckovic, N.; Kozic, D.; Djilvesi, D.; Fimic, M.; Golubovic, J.; Pajicic, F.; Vulekovic, P. Primary intraparenchymal meningiomas: A case report and a systematic review. World Neurosurg. 2021, 153, 52–62. [Google Scholar] [CrossRef] [PubMed]
  6. Rehman, M.U.; Cho, S.; Kim, J.H.; Chong, K.T. Bu-net: Brain tumor segmentation using modified u-net architecture. Electronics 2020, 9, 2203. [Google Scholar] [CrossRef]
  7. Öksüz, C.; Urhan, O.; Güllü, M.K. Brain tumor classification using the fused features extracted from expanded tumor region. Biomed. Signal Process. Control 2022, 72, 103356. [Google Scholar] [CrossRef]
  8. Park, J.H.; de Lomana, A.L.G.; Marzese, D.M.; Juarez, T.; Feroze, A.; Hothi, P.; Cobbs, C.; Patel, A.P.; Kesari, S.; Huang, S.; et al. A systems approach to brain tumor treatment. Cancers 2021, 13, 3152. [Google Scholar] [CrossRef]
  9. Nazir, M.; Shakil, S.; Khurshid, K. Role of deep learning in brain tumor detection and classification (2015 to 2020): A review. Comput. Med. Imaging Graph. 2021, 91, 101940. [Google Scholar] [CrossRef] [PubMed]
  10. Cancer.Net Editorial Board, “Brain Tumor,” ASCO.org, Alexandria, VA, United States of America (USA). 2023. Available online: https://www.cancer.net/cancer-types/brain-tumor/statistics (accessed on 1 March 2023).
  11. Reddy, S.; Tatiparti, K.; Sau, S.; Iyer, A.K. Recent advances in nano delivery systems for blood-brain barrier (BBB) penetration and targeting of brain tumors. Drug Discov. Today 2021, 26, 1944–1952. [Google Scholar] [CrossRef]
  12. Muzammil, S.R.; Maqsood, S.; Haider, S.; Damaševičius, R. CSID: A novel multimodal image fusion algorithm for enhanced clinical diagnosis. Diagnostics 2020, 10, 904. [Google Scholar] [CrossRef]
  13. Woźniak, M.; Siłka, J.; Wieczorek, M. Deep neural network correlation learning mechanism for CT brain tumor detection. Neural Comput. Appl. 2021, 1–16. [Google Scholar] [CrossRef]
  14. Khan, M.A.; Ashraf, I.; Alhaisoni, M.; Damaševičius, R.; Scherer, R.; Rehman, A.; Bukhari, S.A.C. Multimodal brain tumor classification using deep learning and robust feature selection: A machine learning application for radiologists. Diagnostics 2020, 10, 565. [Google Scholar] [CrossRef] [PubMed]
  15. Jansson, D.; Dieriks, V.B.; Rustenhoven, J.; Smyth, L.C.; Scotter, E.; Aalderink, M.; Feng, S.; Johnson, R.; Schweder, P.; Mee, E.; et al. Cardiac glycosides target barrier inflammation of the vasculature, meninges and choroid plexus. Commun. Biol. 2021, 4, 1–17. [Google Scholar] [CrossRef]
  16. Thayumanavan, M.; Ramasamy, A. An efficient approach for brain tumor detection and segmentation in MR brain images using random forest classifier. Concurr. Eng. 2021, 29, 266–274. [Google Scholar] [CrossRef]
  17. Muhammad, K.; Khan, S.; Del Ser, J.; De Albuquerque, V.H.C. Deep learning for multigrade brain tumor classification in smart healthcare systems: A prospective survey. IEEE Trans. Neural Netw. Learn. Syst. 2020, 32, 507–522. [Google Scholar] [CrossRef] [PubMed]
  18. Chahal, P.K.; Pandey, S.; Goel, S. A survey on brain tumor detection techniques for MR images. Multimed. Tools Appl. 2020, 79, 21771–21814. [Google Scholar] [CrossRef]
  19. Tiwari, A.; Srivastava, S.; Pant, M. Brain tumor segmentation and classification from magnetic resonance images: Review of selected methods from 2014 to 2019. Pattern Recognit. Lett. 2020, 131, 244–260. [Google Scholar] [CrossRef]
  20. Amian, M.; Soltaninejad, M. Multi-resolution 3D CNN for MRI brain tumor segmentation and survival prediction. In Proceedings of the International MICCAI Brainlesion Workshop, Shenzhen, China, 17 October 2019; pp. 221–230. [Google Scholar]
  21. Benzekry, S.; Lamont, C.; Beheshti, A.; Tracz, A.; Ebos, J.M.; Hlatky, L.; Hahnfeldt, P. Classical mathematical models for description and prediction of experimental tumor growth. PLoS Comput. Biol. 2014, 10, e1003800. [Google Scholar] [CrossRef]
  22. Bakas, S.; Reyes, M.; Jakab, A.; Bauer, S.; Rempfler, M.; Crimi, A.; Shinohara, R.T.; Berger, C.; Ha, S.M.; Rozycki, M.; et al. Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment, and overall survival prediction in the BRATS challenge. arXiv 2018, arXiv:1811.02629. [Google Scholar]
  23. Jeong, J.J.; Tariq, A.; Adejumo, T.; Trivedi, H.; Gichoya, J.W.; Banerjee, I. Systematic review of generative adversarial networks (gans) for medical image classification and segmentation. J. Digit. Imaging 2022, 35, 137–152. [Google Scholar] [CrossRef]
  24. Ilhan, A.; Sekeroglu, B.; Abiyev, R. Brain tumor segmentation in MRI images using nonparametric localization and enhancement methods with U-net. Int. J. Comput. Assist. Radiol. Surg. 2022, 17, 589–600. [Google Scholar] [CrossRef] [PubMed]
  25. Saba, T. Recent advancement in cancer detection using machine learning: Systematic survey of decades, comparisons and challenges. J. Infect. Public Health 2020, 13, 1274–1289. [Google Scholar] [CrossRef] [PubMed]
  26. Lavanyadevi, R.; Machakowsalya, M.; Nivethitha, J.; Kumar, A.N. Brain tumor classification and segmentation in MRI images using PNN. In Proceedings of the 2017 IEEE International Conference on Electrical, Instrumentation and Communication Engineering (ICEICE), Karur, Tamilnadu, India, 27–28 April 2017; pp. 1–6. [Google Scholar]
  27. AlJame, M.; Ahmad, I.; Imtiaz, A.; Mohammed, A. Ensemble learning model for diagnosing COVID-19 from routine blood tests. Inform. Med. Unlocked 2020, 21, 100449. [Google Scholar] [CrossRef] [PubMed]
  28. Ge, C.; Gu, I.Y.H.; Jakola, A.S.; Yang, J. Enlarged training dataset by pairwise gans for molecular-based brain tumor classification. IEEE Access 2020, 8, 22560–22570. [Google Scholar] [CrossRef]
  29. Çinarer, G.; Emiroğlu, B.G.; Yurttakal, A.H. Prediction of glioma grades using deep learning with wavelet radiomic features. Appl. Sci. 2020, 10, 6296. [Google Scholar] [CrossRef]
  30. Rajinikanth, V.; Kadry, S.; Nam, Y. Convolutional-neural-network assisted segmentation and svm classification of brain tumor in clinical mri slices. Inf. Technol. Control 2021, 50, 342–356. [Google Scholar] [CrossRef]
  31. Badjie, B.; Deniz Ülker, E. A Deep Transfer Learning Based Architecture for Brain Tumor Classification Using MR Images. Inf. Technol. Control 2022, 51, 332–344. [Google Scholar] [CrossRef]
  32. Kurdi, S.Z.; Ali, M.H.; Jaber, M.M.; Saba, T.; Rehman, A. Brain Tumor Classification Using Meta-Heuristic Optimized Convolutional Neural Networks. J. Pers. Med. 2023, 13, 181. [Google Scholar] [CrossRef] [PubMed]
  33. Stevenson, L.W.; Zile, M.; Bennett, T.D.; Kueffer, F.J.; Jessup, M.L.; Adamson, P.; Abraham, W.T.; Manda, V.; Bourge, R.C. Chronic ambulatory intracardiac pressures and future heart failure events. Circ. Heart Fail. 2010, 3, 580–587. [Google Scholar] [CrossRef]
  34. Husain, H.; Thamrin, S.A.; Tahir, S.; Mukhlisin, A.; Apriani, M.M. The application of extended Cox proportional hazard method for estimating survival time of breast cancer. In Proceedings of the Journal of Physics: Conference Series, Makassar, Indonesia, 2–3 November 2017; Volume 979, p. 012087. [Google Scholar]
  35. Islam, M.; Wijethilake, N.; Ren, H. Glioblastoma multiforme prognosis: MRI missing modality generation, segmentation and radiogenomic survival prediction. Comput. Med. Imaging Graph. 2021, 91, 101906. [Google Scholar] [CrossRef] [PubMed]
  36. Ashraf, A.; Ali, S.; Shah, I. Online disease risk monitoring using DEWMA control chart. Expert Syst. Appl. 2021, 180, 115059. [Google Scholar] [CrossRef]
  37. Yeganeh, A.; Shadman, A.; Shongwe, S.C.; Abbasi, S.A. Employing evolutionary artificial neural network in risk-adjusted monitoring of surgical performance. Neural Comput. Appl. 2023, 1–17. [Google Scholar] [CrossRef]
  38. Nguyen, D.; Nguyen, H.; Ong, H.; Le, H.; Ha, H.; Duc, N.T.; Ngo, H.T. Ensemble learning using traditional machine learning and deep neural network for diagnosis of Alzheimer’s disease. IBRO Neurosci. Rep. 2022, 13, 255–263. [Google Scholar] [CrossRef] [PubMed]
  39. Meng, X.; Wang, X.; Zhang, X.; Zhang, C.; Zhang, Z.; Zhang, K.; Wang, S. A Novel Attention-Mechanism Based Cox Survival Model by Exploiting Pan-Cancer Empirical Genomic Information. Cells 2022, 11, 1421. [Google Scholar] [CrossRef] [PubMed]
  40. Moradmand, H.; Aghamiri, S.M.R.; Ghaderi, R.; Emami, H. The role of deep learning-based survival model in improving survival prediction of patients with glioblastoma. Cancer Med. 2021, 10, 7048–7059. [Google Scholar] [CrossRef]
  41. Hao, J.; Kosaraju, S.C.; Tsaku, N.Z.; Song, D.H.; Kang, M. PAGE-Net: Interpretable and integrative deep learning for survival analysis using histopathological images and genomic data. In Proceedings of the Pacific Symposium on Biocomputing, Kohala Coast, HI, USA, 3–7 January 2020; pp. 355–366. [Google Scholar]
  42. Senders, J.T.; Staples, P.; Mehrtash, A.; Cote, D.J.; Taphoorn, M.J.; Reardon, D.A.; Gormley, W.B.; Smith, T.R.; Broekman, M.L.; Arnaout, O. An online calculator for the prediction of survival in glioblastoma patients using classical statistics and machine learning. Neurosurgery 2020, 86, E184–E192. [Google Scholar] [CrossRef]
  43. Dong, W.; Zeng, H.; Peng, Y.; Gao, X.; Peng, A. A deep learning approach with data augmentation for median filtering forensics. Multimed. Tools Appl. 2022, 81, 11087–11105. [Google Scholar] [CrossRef]
  44. Bakas, S.; Akbari, H.; Sotiras, A.; Bilello, M.; Rozycki, M.; Kirby, J.S.; Freymann, J.B.; Farahani, K.; Davatzikos, C. Advancing the cancer genome atlas glioma MRI collections with expert segmentation labels and radiomic features. Sci. Data 2017, 4, 1–13. [Google Scholar] [CrossRef]
  45. Menze, B.; Isensee, F.; Wiest, R.; Wiestler, B.; Maier-Hein, K.; Reyes, M.; Bakas, S. Analyzing magnetic resonance imaging data from glioma patients using deep learning. Comput. Med. Imaging Graph. 2021, 88, 101828. [Google Scholar] [CrossRef]
  46. Khan, M.A.; Khan, A.; Alhaisoni, M.; Alqahtani, A.; Alsubai, S.; Alharbi, M.; Malik, N.A. Multimodal brain tumor detection and classification using deep saliency map and improved dragonfly optimization algorithm. Int. J. Imaging Syst. Technol. 2022, 33, 572–587. [Google Scholar] [CrossRef]
  47. Maqsood, S.; Damaševičius, R.; Maskeliūnas, R. Multi-Modal Brain Tumor Detection Using Deep Neural Network and Multiclass SVM. Medicina 2022, 58, 1090. [Google Scholar] [CrossRef] [PubMed]
  48. Kheradmandi, N.; Mehranfar, V. A critical review and comparative study on image segmentation-based techniques for pavement crack detection. Constr. Build. Mater. 2022, 321, 126162. [Google Scholar] [CrossRef]
  49. Dubey, R.; Hanmandlu, M.; Gupta, S.; Gupta, S. Region growing for MRI brain tumor volume analysis. Indian J. Sci. Technol. 2009, 2, 26–31. [Google Scholar] [CrossRef]
  50. Rohera, D.; Shethna, H.; Patel, K.; Thakker, U.; Tanwar, S.; Gupta, R.; Hong, W.C.; Sharma, R. A Taxonomy of Fake News Classification Techniques: Survey and Implementation Aspects. IEEE Access 2022, 10, 30367–30394. [Google Scholar] [CrossRef]
  51. Tulbure, A.A.; Tulbure, A.A.; Dulf, E.H. A review on modern defect detection models using DCNNs–Deep convolutional neural networks. J. Adv. Res. 2022, 35, 33–48. [Google Scholar] [CrossRef]
  52. Maqsood, S.; Damasevicius, R.; Shah, F.M. An efficient approach for the detection of brain tumor using fuzzy logic and U-NET CNN classification. In Proceedings of the International Conference on Computational Science and Its Applications, Cagliari, Italy, 13–16 September 2021; pp. 105–118. [Google Scholar]
  53. Fauziah, A.; Safitri, D.; Meiza, A. Survival analysis with the Cox Proportional Hazard Method to determine the factors that affect how long the Large-Scale Social Distancing (LSSD) will applied in various areas affected by the COVID-19 pandemic. In Proceedings of the Journal of Physics: Conference Series, Bandar Lampung, Indonesia, 3–4 September 2020; Volume 1751, p. 012004. [Google Scholar]
  54. Rehman, M.U.; Cho, S.; Kim, J.; Chong, K.T. BrainSeg-Net: Brain tumor MR image segmentation via enhanced encoder–decoder network. Diagnostics 2021, 11, 169. [Google Scholar] [CrossRef] [PubMed]
  55. Al-Saffar, Z.A.; Yildirim, T. A hybrid approach based on multiple eigenvalues selection (MES) for the automated grading of a brain tumor using MRI. Comput. Methods Programs Biomed. 2021, 201, 105945. [Google Scholar] [CrossRef]
  56. Jin, H.; Chollet, F.; Song, Q.; Hu, X. AutoKeras: An AutoML Library for Deep Learning. J. Mach. Learn. Res. 2023, 24, 1–6. [Google Scholar]
  57. Bilic, P.; Christ, P.; Li, H.B.; Vorontsov, E.; Ben-Cohen, A.; Kaissis, G.; Szeskin, A.; Jacobs, C.; Mamani, G.E.H.; Chartrand, G.; et al. The liver tumor segmentation benchmark (lits). Med. Image Anal. 2023, 84, 102680. [Google Scholar] [CrossRef]
  58. Chang, Y.; Zheng, Z.; Sun, Y.; Zhao, M.; Lu, Y.; Zhang, Y. Dpafnet: A residual dual-path attention-fusion convolutional neural network for multimodal brain tumor segmentation. Biomed. Signal Process. Control 2023, 79, 104037. [Google Scholar] [CrossRef]
Figure 1. Procedural flowchart of the proposed ETISTP model.
Figure 1. Procedural flowchart of the proposed ETISTP model.
Diagnostics 13 01456 g001
Figure 2. Pre-processing of the input images using a median filter.
Figure 2. Pre-processing of the input images using a median filter.
Diagnostics 13 01456 g002
Figure 3. Different modalities of the images in the Brats-2020 dataset.
Figure 3. Different modalities of the images in the Brats-2020 dataset.
Diagnostics 13 01456 g003
Figure 4. U-Net architecture for segmentation.
Figure 4. U-Net architecture for segmentation.
Diagnostics 13 01456 g004
Figure 5. U-Net model summary.
Figure 5. U-Net model summary.
Diagnostics 13 01456 g005
Figure 6. Example of the segmented tumor from the MRI.
Figure 6. Example of the segmented tumor from the MRI.
Diagnostics 13 01456 g006
Figure 7. Example of a segmented 3D image in sagittal, coronal, and axial images.
Figure 7. Example of a segmented 3D image in sagittal, coronal, and axial images.
Diagnostics 13 01456 g007
Figure 8. Classification of model parameters.
Figure 8. Classification of model parameters.
Diagnostics 13 01456 g008
Figure 9. Single patient survival rate.
Figure 9. Single patient survival rate.
Diagnostics 13 01456 g009
Figure 10. Survival rate of multiple patients.
Figure 10. Survival rate of multiple patients.
Diagnostics 13 01456 g010
Figure 11. Survival rate for the LGG patient.
Figure 11. Survival rate for the LGG patient.
Diagnostics 13 01456 g011
Figure 12. Survival rate for the HGG patient.
Figure 12. Survival rate for the HGG patient.
Diagnostics 13 01456 g012
Figure 13. T1: Model accuracy and loss for 10 epochs.
Figure 13. T1: Model accuracy and loss for 10 epochs.
Diagnostics 13 01456 g013
Figure 14. T1ce: Model accuracy and loss for 10 epochs.
Figure 14. T1ce: Model accuracy and loss for 10 epochs.
Diagnostics 13 01456 g014
Figure 15. T2: Model accuracy and loss for 10 epochs.
Figure 15. T2: Model accuracy and loss for 10 epochs.
Diagnostics 13 01456 g015
Figure 16. Flair: model accuracy and loss for 10 epochs.
Figure 16. Flair: model accuracy and loss for 10 epochs.
Diagnostics 13 01456 g016
Figure 17. Segmented: model accuracy and loss for 10 epochs.
Figure 17. Segmented: model accuracy and loss for 10 epochs.
Diagnostics 13 01456 g017
Table 1. Demographic information of the patients in Brats-2020.
Table 1. Demographic information of the patients in Brats-2020.
FactorMinimumMaximum
Age18.97586.652
Survival Days51767
GTR Status1 (N/A)3 (GTR)
Tumor Volume7.285227.126
Tumor Class76 (LGG)293 (HGG)
Table 2. Summary of the tumor identification performance.
Table 2. Summary of the tumor identification performance.
Dice CoefAccuracyPrecisionSensitivitySpecificity
0.250.960.950.900.99
Table 3. Performance of modality-wise classification.
Table 3. Performance of modality-wise classification.
ModalityAccuracyPrecisionF1 Score
T194.0093.8195.77
T1ce94.0093.8195.77
T294.3893.6295.65
Flair93.2393.8195.77
Segmented94.3893.8195.77
Average94.20%93.77%95.75%
Table 4. Summary of the parameters used for training the CoxPHFitter model.
Table 4. Summary of the parameters used for training the CoxPHFitter model.
Modellifeline.CoxPHFitter
Duration Columndays
Event Columnevent
Baseline EstimationBreslow
Number of observations228
Number of events observed228
Partial log-likelihood−994.44
Table 5. The parameter coefficient values from the CoxPH model.
Table 5. The parameter coefficient values from the CoxPH model.
FactorCoefExp
(Coef)
Se
(Coef)
Coef
Lower
95%
Coef
Upper
95%
Exp (Coef)
Lower
95%
Exp (Coef)
Upper
95%
zp−log2(p)
Age0.041.040.010.020.051.021.055.45<0.00524.26
GTR0.041.040.07−0.100.170.901.190.520.600.73
Class−0.640.530.37−1.360.080.261.08−1.750.083.63
Volume0.001.000.00−0.000.081.001.00−1.730.083.58
Table 6. Concordance results of the CoxPH model.
Table 6. Concordance results of the CoxPH model.
Concordance0.74
Partial AIC1999.20
Log-likelihood ratio test38.17 on 4 df
−log2(p) of ll-ratio test23.20
Table 7. Hazard Factor Weight.
Table 7. Hazard Factor Weight.
Risk FactorCoefficientsExp (Coef)
Tumor Volume0.011.00
Tumor Type0.151.16
Patient’s Age0.031.04
Extent of GTR0.041.04
Table 8. Single Patient input data.
Table 8. Single Patient input data.
Patient’s No.Age (Years)GTRTumor ClassVolume
10285.9421HGG58.208
Table 9. Sample input data for survival prediction.
Table 9. Sample input data for survival prediction.
Patient’s No.AgeGTRClassVolume
15063.80531095.391
05466.51032118.394
16864.37832099.624
10285.94212058.208
05052.34832121.570
15581.11232162.623
00339.06811103.496
07679.21112050.183
Table 10. Input data for LGG and HGG patients.
Table 10. Input data for LGG and HGG patients.
Patient’s No.Age (Years)GTRTumor ClassVolume
339.0681LGG103.496
15581.1123HGG162.623
Table 11. Tumor identification results with respect to the Brats2020 dataset.
Table 11. Tumor identification results with respect to the Brats2020 dataset.
S No.Author(s)Dice Score
1.Rehman et al. [54]0.790
2.Rehman et al. [6]0.837
3.Amian et al. [20]0.840
4.Ilhan et al. [24]0.880
5.Islam et al. [35]0.899
6.The proposed ETISTP model0.902
Table 12. Classification of a brain tumor with respect to LGG and HGG.
Table 12. Classification of a brain tumor with respect to LGG and HGG.
S No.Author(s)AccuracyPrecisionF1 Score
1.Chenjie et al. [28]88.22%86.76%85.18%
2.Zahraa et al. [55]91.02%87.07%88.44%
3.Attique et al. [14]92.50%88.37%89.12%
4.Narmatha et al. [4]93.85%94.77%95.42%
5.The proposed ETISTP model94.20%95.77%95.75%
Table 13. Patient’s survival prediction based on the Brats2020 dataset.
Table 13. Patient’s survival prediction based on the Brats2020 dataset.
S No.Author(s)Method(s)Concordancep-Value
1.Moradmand et al. [40]CoxPH0.580.006
2.Hao et al. [41]PAGE-Net0.640.007
3.Senders et al. [42]Statistical machine learning algorithm0.690.008
4.Meng et al. [39]SAVAE-COX0.710.009
5.The proposed ETISTP modelCoxPH using the integrated parameters0.740.050
Table 14. Computational efficiency analysis.
Table 14. Computational efficiency analysis.
S No.Model(s)Time
1.RF [20]12.348 s
2.SVM [35]8.692 s
3.CoxPH [34]7.417 s
4.The proposed ETISTP model0.005 s
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Hussain, S.; Haider, S.; Maqsood, S.; Damaševičius, R.; Maskeliūnas, R.; Khan, M. ETISTP: An Enhanced Model for Brain Tumor Identification and Survival Time Prediction. Diagnostics 2023, 13, 1456. https://doi.org/10.3390/diagnostics13081456

AMA Style

Hussain S, Haider S, Maqsood S, Damaševičius R, Maskeliūnas R, Khan M. ETISTP: An Enhanced Model for Brain Tumor Identification and Survival Time Prediction. Diagnostics. 2023; 13(8):1456. https://doi.org/10.3390/diagnostics13081456

Chicago/Turabian Style

Hussain, Shah, Shahab Haider, Sarmad Maqsood, Robertas Damaševičius, Rytis Maskeliūnas, and Muzammil Khan. 2023. "ETISTP: An Enhanced Model for Brain Tumor Identification and Survival Time Prediction" Diagnostics 13, no. 8: 1456. https://doi.org/10.3390/diagnostics13081456

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop