Next Article in Journal
Expression and Characterization of a β-Galactosidase from the Pacific Oyster, Crassostrea gigas, and Evaluation of Strategies for Testing Substrate Specificity
Next Article in Special Issue
Mitochondrial Fraction of Circulating Cell-Free DNA as an Indicator of Human Pathology
Previous Article in Journal
Serine 31 Phosphorylation-Driven Regulation of AGPase Activity: Potential Implications for Enhanced Starch Yields in Crops
Previous Article in Special Issue
Construction of a Matrix Cancer-Associated Fibroblast Signature Gene-Based Risk Prognostic Signature for Directing Immunotherapy in Patients with Breast Cancer Using Single-Cell Analysis and Machine Learning
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Artificial Intelligence and Complex Network Approaches Reveal Potential Gene Biomarkers for Hepatocellular Carcinoma

by
Antonio Lacalamita
1,2,†,
Grazia Serino
3,†,
Ester Pantaleo
1,2,
Alfonso Monaco
1,2,*,
Nicola Amoroso
2,4,
Loredana Bellantuono
2,5,
Emanuele Piccinno
3,
Viviana Scalavino
3,
Francesco Dituri
3,
Sabina Tangaro
2,6,
Roberto Bellotti
1,2,‡ and
Gianluigi Giannelli
3,‡
1
Dipartimento Interateneo di Fisica M. Merlin, Università degli Studi di Bari Aldo Moro, Via G. Amendola 173, 70125 Bari, Italy
2
Sezione di Bari, Istituto Nazionale di Fisica Nucleare (INFN), Via A. Orabona 4, 70125 Bari, Italy
3
National Institute of Gastroenterology S. De Bellis, IRCCS Research Hospital, Via Turi 27, 70013 Castellana Grotte, BA, Italy
4
Dipartimento di Farmacia-Scienze del Farmaco, Università degli Studi di Bari Aldo Moro, Via A. Orabona 4, 70125 Bari, Italy
5
Dipartimento di Biomedicina Traslazionale e Neuroscienze (DiBraiN), Università degli Studi di Bari Aldo Moro, Piazza G. Cesare 11, 70124 Bari, Italy
6
Dipartimento di Scienze del Suolo, della Pianta e degli Alimenti, Università degli Studi di Bari Aldo Moro, Via G. Amendola 165/a, 70126 Bari, Italy
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
These authors contributed equally to this work.
Int. J. Mol. Sci. 2023, 24(20), 15286; https://doi.org/10.3390/ijms242015286
Submission received: 11 September 2023 / Revised: 5 October 2023 / Accepted: 16 October 2023 / Published: 18 October 2023
(This article belongs to the Special Issue Artificial Intelligence in Biomarker Discovery 2.0)

Abstract

:
Hepatocellular carcinoma (HCC) is one of the most common cancers worldwide, and the number of cases is constantly increasing. Early and accurate HCC diagnosis is crucial to improving the effectiveness of treatment. The aim of the study is to develop a supervised learning framework based on hierarchical community detection and artificial intelligence in order to classify patients and controls using publicly available microarray data. With our methodology, we identified 20 gene communities that discriminated between healthy and cancerous samples, with an accuracy exceeding 90%. We validated the performance of these communities on an independent dataset, and with two of them, we reached an accuracy exceeding 80%. Then, we focused on two communities, selected because they were enriched with relevant biological functions, and on these we applied an explainable artificial intelligence (XAI) approach to analyze the contribution of each gene to the classification task. In conclusion, the proposed framework provides an effective methodological and quantitative tool helping to find gene communities, which may uncover pivotal mechanisms responsible for HCC and thus discover new biomarkers.

Graphical Abstract

1. Introduction

Hepatocellular carcinoma (HCC) is one of the leading causes of cancer-related deaths worldwide, and the number of cases is constantly increasing [1]. Although there have been significant improvements in diagnosis and in therapeutic interventions, HCC remains associated with poor prognosis in patients with advanced disease [2,3]. An early and accurate diagnosis is crucial to improving the therapeutic effectiveness of HCC. Serum α-fetoprotein (AFP) is currently widely used as a diagnostic and prognostic biomarker for HCC; however, when used alone, the results are unsatisfactory [4,5]. The sensitivity of AFP in detecting HCC at an early stage is limited [6,7,8]. Several studies have demonstrated poor AFP specificity in diagnosing HCC, since AFP levels increase also in other disorders or benign liver conditions [9]. The suggested guidelines for HCC surveillance reported that serum AFP could be used as a marker along with abdominal ultrasonography only in high-risk populations to detect HCC at an early stage [10,11]. The multifactorial nature of HCC [12] makes it difficult to predict the diagnosis using a single biomarker. Therefore, the combination of multiple biomarkers is key to increasing the diagnostic accuracy of HCC. Other tumor markers, such as the des-gamma-carboxyprothrombin (DCP) and the Lens culinaris agglutinin-reactive fraction of AFP (AFP-L3), have been used to increase the diagnostic accuracy of AFP [13,14]. In addition to tumor markers, biomarkers of liver inflammation (aspartate amino transferase and alanine amino transferase), fibrosis (platelet count), liver function (total bilirubin and albumin), and the hepatitis virus status are widely used in clinical practice [15,16]. However, due to the aforementioned limitations of these biomarkers for early diagnosis of HCC, there is an urgent need for the development of more sensitive diagnostic methods, the use of novel biomarkers, and the construction of prognostic models in order to increase the survival time of patients.
Microarray technology has enabled simultaneous measurement of the expression level of thousands of genes in a sample in a single experiment [17]. These gene expression profiles can be used to identify biomarkers or networks of genes that are dysregulated in cancerous versus normal samples [18]. However, microarray datasets typically have a small sample size (number of individuals or samples) but high dimensions (number of genes). If microarray data are employed to train machine learning classification algorithms to discriminate patients and controls, this imbalance typically causes overfitting issues. Designing efficient algorithms that can reduce the initial gene pool, consisting of thousands of genes, to a smaller set containing hundreds or tens of them; it is therefore critical to improve the prediction accuracy.
The aim of our study is to develop a supervised learning framework to classify HCC patients vs. controls using gene expression data from microarray samples. More specifically, we used two microarray experiments comparing tumor tissues of HCC patients with adjacent normal tissues. We constructed a complex network in which genes correspond to nodes and their connections are weighted according to the strength of their co-expression relations [19,20]. Then, we performed a feature selection step, which is essential to developing a robust classification algorithm, using artificial intelligence methods coupled with complex network algorithms. In short, we applied hierarchical community detection using the Leiden algorithm [21], a community detection method that is especially useful when a network has both positive and negative links, as in our case. We identified 46 communities of genes, which we further filtered using the Boruta feature selection method [22]. Twenty of these communities could discriminate between healthy and cancerous samples with an accuracy exceeding 90%. We validated these communities on an independent dataset; eight of them still provided satisfactory classification performances, and two of them reached an accuracy of more than 80%. Finally, we focused on two communities, selected because they were enriched with relevant biological functions, and on these we applied an explainable artificial intelligence approach [23,24] to analyze the contribution of each of their genes to the classification task.
The paper is organized as follows. In the Section 2, we present an overview of the methodology adopted and report the outcome with associated figures and tables. In the Section 3, we comment on our results and underline some limitations of our work. In the Section 4, we provide details about the input data and the normalization procedure (Section 4.1 “Data Sources”), and then we describe the methods used (subsections include Section 4.2 “Hierarchical community detection”, Section 4.3 “Feature selection”, Section 4.4 “Machine learning scheme”, Section 4.5 “XAI analysis”, and Section 4.6 “Gene Set Enrichment Analysis”).

2. Results

We downloaded gene expression data on liver tissue from 152 patients who underwent hepatic resection. The data consisted of 152 tumor samples and 91 adjacent liver tissues, as well as 14 adjacent liver tissues obtained from patients with colorectal cancer metastasis who had not received chemotherapy (see Section 4 “Material and methods” for more details).
Our computational pipeline consisted of three main steps: (i) a hierarchical community detection phase, in which we applied the Leiden algorithm to find stable gene communities within the gene co-expression network; (ii) an additional learning phase, in which we focused on each community, selected a subset of genes with the Boruta method, and fed this subset to a random forest (RF) algorithm in a 5-fold cross validation framework to obtain the classification of HCC vs. normal samples; and (iii) an explainable artificial intelligence (XAI) phase, in which we quantified the impact of each gene at the community scale on the classifier’s predictions by applying Shapley (SHAP) values. Finally, we validated the model using an independent gene expression dataset. A schematic overview of our workflow is displayed in Figure 1.
The original dataset is composed of samples belonging to three different classes: HCC, Normal and Peritumoral samples. We implemented an unsupervised analysis to see if there was a statistically significant difference between Normal and Peritumoral samples.
Firstly, we determined the optimal number of clusters using two quantities, the Within Sum of Square (WSS) and the Silhouette coefficient (SC). From Figure S1 we can see that the optimal number of clusters is 2 with both WSS (left) and SC (right) (using the elbow method and the maximum value, respectively). Once we set the number of clusters, we applied a k-means clustering algorithm with k = 2, displayed in Figure S2. In Table S1, we presented cluster cardinalities and compared original labels vs k-means labels in a contingency matrix. These results confirm that 95.24% of Normal + Peritumoral samples belong to the same cluster, therefore there is no statistically significant difference between Normal and Peritumoral samples.
From the hierarchical community detection procedure, we derived 46 stable communities. As shown in Table 1, 20 of these gene communities gave a robust prediction of the disease (accuracy exceeding 90%). Our choice of the random forest algorithm was suggested by a previous study on microarrays of cancerous tissues [25], where we found that RF was one of the best performing methods, as well as being the easiest to tune and the lightest in terms of computational burden. Table 1 also reports area under the curve (AUC), F1 Score, and Log Loss. In Figure 2 we display the boxplot of the accuracy values of the 20 top communities. The distributions were computed through a 5-fold cross validation procedure repeated 100 times. In the Supplementary Materials, we list the complete set of genes in each of these communities.
In order to validate our results, we tested the performance of the 20 identified communities on an independent dataset. We report our results in Table 2, showing that eight of these communities still had satisfactory accuracy values, especially for an independent test; in particular, Comm_29 and Comm_32 reached an accuracy, AUC, and F1 Score of more than 80%.
After close biological inspection of the set of 20 communities, we identified two communities, namely, Comm_29 and Comm_41, which were particularly interesting as they were enriched with relevant biological functions. It is worth noting that the first of these two communities (Comm_29) is the second best performing on the test set (as already mentioned),while Comm_41 was one of the top performing communities on the test set (with 74.5% accuracy).

2.1. XAI Analysis

We conducted a study of explainability by applying the Shapley (SHAP) algorithm [22,23] on a subset of the 20 communities, namely, Comm_29 and Comm_41, because they were enriched with relevant biological functions. In Figure 3, we display the resulting SHAP plots, which show the direction of the relationship between the expression of individual genes and the classification outcome. Each row corresponds to a gene within the considered community and includes a distribution of points, each representing a prediction on a subject. The horizontal axis reports the SHAP-values, quantifying the impact of features, i.e., gene expression values, on the different predictions provided by the machine learning classifier. Positive SHAP-values are indicative of the contribution of the specific gene expression value to a positive diagnosis (HCC), while negative SHAP-values are indicative of a contribution to a negative diagnosis (no HCC). In each row, instances with higher and lower values of the gene expression feature are shown in red and blue, respectively. This reveals that a higher expression of gene TBXA2R, for example, is associated with HCC samples, while a lower expression is associated with healthy samples.

2.2. Pathways Analysis

Functional enrichment analysis with GSEA [26] of genes in Comm_29 and Comm_41 revealed that they are involved in hallmarks of the matrisome and immune microenvironment, which are two important features of the HCC pathogenesis (FDR < 0.05; Tables S2 and S3 in the Supplementary Materials).

3. Discussion

HCC management is seriously challenged by the lack of biomarkers that could enable a reliable diagnosis and prognosis of HCC [27]. The use of serum enzymes, such as AFP, DCP, and AFP-L3, has been demonstrated to be more effective than other methods in monitoring tumor progression [28]. However, the use of serum enzymes lacks the sensitivity and specificity required for a reliable diagnosis and prognosis of HCC.
Recent advances in multi-omics technologies in HCC studies have led to the discovery of new candidate biomarkers for diagnosis and prognosis [29]. Technologies such as microarrays or next-generation sequencing can provide useful tools with which to identify new genes or mechanisms aiding to making an early discrimination of a pathological state. In this paper, using microarray gene expression data from GEO, we developed a supervised learning framework in order to classify HCC patients and controls.
More specifically, we analyzed microarray gene expression data of HCC tumor and adjacent liver tissues from the dataset GSE20295. Through a hierarchical community detection phase based on the Leiden algorithm, we found 46 stable communities. With a machine learning procedure combining RF, Boruta, and 5-fold cross-validation, among these 46 communities, we were able to identify 20 gene communities that could discriminate between healthy and HCC patients, with a mean accuracy exceeding 90%, as shown in Figure 2.
We validated our findings on an independent liver microarray dataset, GSE54236, and confirmed that two communities, namely, Comm_29 and Comm_32 (see Supplementary Materials), could distinguish between healthy subjects and HCC patients with an accuracy of more than 80%.
Functional enrichment analysis of genes revealed that two communities, namely, Comm_29 and Comm_41, are involved in two main hallmarks of HCC, i.e., the matrisome and the immune microenvironment, respectively. The matrisome includes extracellular matrix (ECM) molecules (collagens, glycoproteins, and proteoglycans) and ECM-associated members (ECM regulators, ECM-affiliated proteins, and secreted factors) [30]. Matrisome remodeling is one of the main features of liver fibrosis and occurs in carcinogenesis during cell proliferation, migration, or invasion [31]. Several studies have reported that the tumor microenvironment (TME) plays a critical role in HCC onset, progression, and outcome [32,33,34].
The results obtained in our study can help identify potential new markers for the diagnosis of HCC. However, our study has several limitations. The sample size of the experimental data we used is relatively small, so other studies are necessary in order to validate and improve the identification of genes in a larger multicenter prospective cohort of patients and controls. Furthermore, we are aware that machine learning algorithms are less effective when the training datasets contain a small number of observations. An improvement to our work would be the application of the same models to a larger training set. Moreover, the results of our study were obtained from tissue samples, which is still an invasive procedure. Further research is needed in order to determine whether the identified genes can be detected in blood so as to promote a non-invasive diagnosis and prognosis.
In conclusion, in our study, we identified two sets of genes expressed in liver samples that can distinguish HCC patients from healthy subjects with high accuracy. The robustness of our results, which were obtained from a cross-validation procedure and validated on an independent dataset, suggests they may have a potential clinical significance as a means of identifying biomarkers and new therapeutic targets.

4. Materials and Methods

4.1. Data Sources

Two microarray datasets, GSE102079 and GSE54236, were downloaded from the GEO database (http://www.ncbi.nlm.nih.gov/geo/; accessed on 9 January 2023).
Dataset GSE102079 contains gene expression data of the liver tissue of 152 patients who underwent hepatic resection from the GPL570 Affymetrix Human Genome U133 Plus 2.0 Array. Specifically, this set contains 152 tumor and 91 adjacent liver tissues from HCC patients and 14 adjacent liver tissues obtained from patients with metastasis of colorectal cancer who had not received chemotherapy.
Dataset GSE54236 contains gene expression data of 156 samples of 78 HCC tumor tissues and 78 adjacent non-tumor tissues from the GPL6480 Agilent-014850 Whole Human Genome Microarray. This dataset was used for independent testing.
Raw data were normalized using robust multiarray analysis (RMA) [35]; this method implements a background correction of the original data; then, a log2 transformation and finally a quantile normalization.
For our analysis, we used the R framework version 4.2.2 [36] with packages oligo version 1.62.2 [37] to read CEL files; affy version 1.76.0 [38] to perform RMA; factoextra version 1.0.7 [39] to evaluate silhouette; amap version 0.8-19 [40] to perform K-means clustering; Boruta version 8.0.0 [22]; random forest version 4.7-1.1 [41]; treeshap version 0.1.1 [42]; and igraph version 1.4.1 [43]. For the Leiden algorithm, we used igraph function cluster_leiden with parameters resolution_parameter = 1, objective_function = “modularity”, n_iterations = 200, and beta = 0.05; and for evaluating the mutual information, we used function compare with method = “nmi”.

4.2. Hierarchical Community Detection

We implemented a hierarchical community detection workflow based on iterative applications of the Leiden algorithm [21] to find groups (or communities) of genes with highly-correlated gene expression profiles. The Leiden algorithm identifies an optimal partition of the network, which maximizes positive-weight connections within communities and negative-weight connections across communities, starting from a random configuration consisting of an arbitrary number of communities to which nodes are arbitrarily assigned. Due to the inherent randomness of the Leiden community detection algorithm, it is necessary to check that the partition it provides is stable compared with the initial conditions. The method we employed to quantify the stability of the community detection outcome is discussed below. Communities of the optimal partition were independently used to implement machine learning algorithms for the classification of HCC vs. healthy samples.
Because discovering meaningful biological knowledge from communities with more than 100 genes is challenging [44,45], we iteratively applied the Leiden algorithm on the whole co-expression network until we obtained communities with less than 100 genes. We also ignored communities with less than 4 elements. Specifically, the communities found in the first step were considered to be second-level co-expression subnetworks, to which the Leiden algorithm was independently applied; this hierarchical process was iterated at the next levels for each community in a given partition until the size of its further subdivisions became smaller than 100.
The Leiden algorithm, when applied iteratively, converges on a partition in which all subsets of the obtained communities are locally optimally assigned. At each step of the hierarchical community detection process, the most stable partition was found by tuning two internal parameters of the Leiden algorithm, namely, the resolution γ and the level of randomness β , while keeping the other parameters fixed to their default values. For each configuration ( γ , β ) of the considered internal parameters, the stability of the community detection outcome was evaluated by performing L = 100 runs of the Leiden algorithm, each corresponding to a different seed of the pseudorandom number generator and to a different initial arbitrary assignment of nodes to groups. For the j-th run ( j = 1 , , L ) , the algorithm returned a partition p j , and the most recurring (majority) partition over all L runs was determined via majority voting. This partition was considered acceptable provided that it was simultaneously, stable, nontrivial, and not fragmented. Below we describe each of these conditions in detail.
The stability criterion was based on the similarity between partitions { p j } j = 1 , , L obtained in the L runs and corresponding to the different random initial conditions. Specifically, this similarity was evaluated through the average normalized mutual information:
N M I = 2 L ( L 1 ) a = 1 L 1 b = a + 1 L N M I ( p a , p b ) ,
where N M I ( p a , p b ) is the normalized mutual information between a given pair ( p a , p b ) of partitions, and L ( L 1 ) / 2 is the number of distinct pairs. The majority partition was considered stable only if N M I   0.80 , a condition related to the general uniformity of the partitions returned by the different runs.
Moreover, the most recurring partition returned by the Leiden algorithm must be nontrivial, i.e., not consist of a single community, coinciding with the whole network or subnetwork on which the Leiden algorithm was applied.
Finally, to avoid excessive fragmentation, the most recurrent partition over L runs must not include communities whose number of nodes is less than 5% of the whole network cardinality.
In cases where multiple configurations ( γ , β ) of the internal parameters of the Leiden algorithm provided a majority partition that satisfied the aforementioned requirements, the one with the highest N M I was chosen and identified as the outcome of the hierarchical community detection at the considered level.

4.3. Feature Selection

Following the gene community detection procedure explained in the previous section, as the number of input features (genes) still exceeded the number of samples, we filtered the genes in each community further using a wrapper method known as Boruta [22]. This method aims to eliminate noise and redundant data by selecting only those features that enhance the performance of the learning model.
Boruta, a robust and efficient supervised feature selection algorithm, is based on the random forest method. It leverages the principles of random forest (RF) (see the following section), where random perturbations in the system and the randomization of the training samples mitigate the negative effects caused by the random fluctuations and correlations inherent to the learning model. Essentially, Boruta improves independent classification and regression trees (CART) by generating surrogate features, referred to as shadow features, through shuffling of the original feature values. It then compares the importance of these shadow features with that of the original features within the model. In simple terms, Boruta employs these shadow attributes as reference values to quantify the importance of an attribute.
We applied the Boruta algorithm to each community selected by the gene community procedure. To avoid data leakage, we used 40% of the dataset for feature selection and the remaining 60% for classification.

4.4. Machine Learning Scheme

Gene community detection and feature selection allowed us to achieve a significant reduction in the number of features. The remaining genes were used as input to the random forest (RF) algorithm. We developed an RF model for each community.
RF [46] is a highly popular machine learning algorithm because its parameters are easy to tune, particularly the two main parameters: (i) the number of trees, denoted as M; and (ii) the number of randomly selected features at each split, denoted as s. The RF structure consists of an ensemble of CART classification trees, which are grown using a bootstrap procedure. The randomization process during training makes RF robust to overfitting and generates trees that exhibit low mutual correlation. In this study, we implemented a standard configuration with M = 300 trees and s = |S|, where S represents the set input features and |.| represents the cardinality.
To enhance the robustness of our approach, we applied a 5-fold cross-validation scheme that we repeated 100 times. We carried out this procedure on the subjects.

4.5. XAI Analysis

Explainable artificial intelligence (XAI) procedures aim at improving machine learning transparency and interpretability, especially when applied to real-world scenarios [47,48,49,50,51,52]. As opposed to traditional approaches that focus on informativeness, quantified by performance metrics and uncertainties [53,54,55], a XAI framework attempts to combine informativeness with generalization, namely, the reliability of predictions on previously unseen data and transparency, aimed at making model decisions as easy to understand as possible [56,57].
In this study, we used a SHAP local explanation algorithm to determine the importance of features for the classification of HCC vs. normal samples. This algorithm is a local, model-agnostic post hoc explainer, based on the Shapley values concept borrowed from cooperative game theory [23,24]. For each sample, the SHAP algorithm learns local interpretable linear models and quantifies the contribution of each feature to the prediction given by the model for that sample. The computation of a SHAP value for a given feature is based on the difference between the model prediction when that feature is considered or not considered, averaging over all possible subsets of features. The model is thus retrained on all the possible feature subsets F of the complete feature set S  ( F S ) . Calling f x ( F ) the model prediction for instance x when the subset F does not include the j-th feature, and f x ( F j ) the prediction when the j-th feature is added, the difference f x ( F j ) f x ( F ) quantifies the marginal contribution of the j-th feature. The SHAP value of the j-th feature for the instance x is then evaluated as
S H A P j ( x ) = F S { j } | F | ! ( | S | | F | 1 ) ! | S | ! [ f x ( F j ) f x ( F ) ] ,
with | F | ! is the number of permutations of features in the subset F; ( | S | | F | 1 ) ! is the number of permutations of features in the subset S ( F { j } ) ; and | S | ! is the total number of feature permutations [23].

4.6. Gene Set Enrichment Analysis

Gene set enrichment analysis (GESA) was performed with GSEA software version MSigDB 2023.1 [26] using the hallmark gene sets of the Molecular Signature Database gene set, canonical pathways, and gene ontology. An FDR value threshold of 0.05 was used to select significant hallmarks.

Supplementary Materials

The supporting information can be downloaded at https://www.mdpi.com/article/10.3390/ijms242015286/s1.

Author Contributions

Conceptualization, A.M., E.P. (Ester Pantaleo), G.S. and L.B.; methodology, A.L., A.M., E.P. (Ester Pantaleo), G.S. and L.B.; software, A.L.; validation, A.L., A.M., E.P. (Ester Pantaleo), G.S. and L.B.; formal analysis, A.L., A.M., E.P. (Ester Pantaleo), G.S., L.B., E.P. (Emanuele Piccinno), V.S. and F.D.; data curation, A.L. and G.S.; writing—original draft preparation, A.L., A.M., E.P. (Ester Pantaleo)., G.S. and L.B.; writing—review and editing, A.L., A.M., E.P. (Ester Pantaleo), G.S., L.B., N.A., F.D., E.P. (Emanuele Piccinno), V.S., S.T., G.G. and R.B.; visualization, A.L., A.M., E.P. (Ester Pantaleo), G.S. and L.B.; supervision, G.G. and R.B.; funding acquisition, G.S., G.G., N.A., L.B., S.T. and R.B. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by a grant from the Italian Ministry of Health (Ricerca Corrente 2023). NA, LB, ST, and RB have obtained funding for this work under the National Recovery and Resilience Plan (NRRP), Mission 4 Component 2 Investment 1.4-Call for tender no. 3138 of 16 December 2021 of the Italian Ministry of University and Research funded by the European Union–NextGenerationEU (award number/project code: CN00000013), and Concession Decree No. 1031 of 17 February 2022 adopted by the Italian Ministry of University and Research (CUP: D93C22000430001), Project title: “National Centre for HPC, Big Data and Quantum Computing”.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors thank Mary V.C. Pragnell, B.A. for language revision of the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Forner, A.; Reig, M.; Bruix, J. Hepatocellular carcinoma. Lancet 2018, 391, 1301–1314. [Google Scholar] [CrossRef] [PubMed]
  2. Llovet, J.M.; Bruix, J. Systematic review of randomized trials for unresectable hepatocellular carcinoma: Chemoembolization improves survival. Hepatology 2003, 3, 429–442. [Google Scholar] [CrossRef]
  3. Trevisani, F.; Cantarini, M.C.; Wands, J.R.; Bernardi, M. Recent advances in the natural history of hepatocellular carcinoma. Carcinogenesis 2008, 29, 1299–1305. [Google Scholar] [CrossRef]
  4. Galle, P.R.; Foerster, F.; Kudo, M.; Chan, S.L.; Llovet, J.M.; Qin, S.; Schelman, W.R.; Chintharlapalli, S.; Abada, P.B.; Sherman, M.; et al. Biology and significance of alpha-fetoprotein in hepatocellular carcinoma. Liver Int. 2019, 39, 2214–2229. [Google Scholar] [CrossRef] [PubMed]
  5. Giannini, E.G.; Marenco, S.; Borgonovo, G.; Savarino, V.; Farinati, F.; Del Poggio, P.; Rapaccini, G.L.; Di Nolfo, M.A.; Benvegnù, L.; Zoli, M.; et al. Alpha-fetoprotein has no prognostic role in small hepatocellular carcinoma identified during surveillance in compensated cirrhosis. Hepatology 2012, 56, 1371–1379. [Google Scholar] [CrossRef] [PubMed]
  6. Heimbach, J.K.; Kulik, L.M.; Finn, R.S.; Sirlin, C.B.; Abecassis, M.M.; Roberts, L.R.; Zhu, A.X.; Murad, M.H.; Marrero, J.A. AASLD guidelines for the treatment of hepatocellular carcinoma. Hepatology 2018, 67, 358–380. [Google Scholar] [CrossRef] [PubMed]
  7. Hu, X.; Chen, R.; Wei, Q.; Xu, X. The Landscape of alpha fetoprotein in hepatocellular carcinoma: Where are we? Int. J. Biol. Sci. 2020, 18, 536–551. [Google Scholar] [CrossRef]
  8. Trevisani, F.; D’Intino, P.E.; Morselli-Labate, A.M.; Mazzella, G.; Accogli, E.; Caraceni, P.; Domenicali, M.; De Notariis, S.; Roda, E.; Bernardi, M. Serum alpha-fetoprotein for diagnosis of hepatocellular carcinoma in patients with chronic liver disease: Influence of HBsAg and anti-HCV status. J. Hepatol. 2001, 34, 570–575. [Google Scholar] [CrossRef]
  9. Frenette, C.T.; Isaacson, A.J.; Bargellini, I.; Saab, S.; Singal, A.G. A Practical Guideline for Hepatocellular Carcinoma Screening in Patients at Risk. Mayo Clin. Proc. Innov. Qual. Outcomes 2019, 3, 302–310. [Google Scholar] [CrossRef]
  10. Bruix, J.; Sherman, M. Management of hepatocellular carcinoma: An update. Hepatology 2011, 53, 1020–1022. [Google Scholar] [CrossRef]
  11. European Association for the Study of the Liver. EASL-EORTC clinical practice guidelines: Management of hepatocellular carcinoma. J. Hepatol. 2012, 56, 908–943. [Google Scholar] [CrossRef] [PubMed]
  12. Sanyal, A.J.; Yoon, S.K.; Lencioni, R. The etiology of hepatocellular carcinoma and consequences for treatment. Oncologist 2010, 15, 14–22. [Google Scholar] [CrossRef] [PubMed]
  13. Liebman, H.A.; Furie, B.C.; Tong, M.J.; Blanchard, R.A.; Lo, K.-J.; Lee, S.-D.; Coleman, M.S.; Furie, B. Des-gamma-carboxy (abnormal) prothrombin as a serum marker of primary hepatocellular carcinoma. N. Engl. J. Med. 1984, 310, 1427–1431. [Google Scholar] [CrossRef] [PubMed]
  14. Sato, Y.; Nakata, K.; Kato, Y.; Shima, M.; Ishii, N.; Koji, T.; Taketa, K.; Endo, Y.; Nagataki, S. Early recognition of hepatocellular carcinoma based on altered profiles of alpha-fetoprotein. N. Engl. J. Med. 1993, 383, 1802–1806. [Google Scholar] [CrossRef] [PubMed]
  15. Singal, A.; Volk, M.L.; Waljee, A.; Salgia, R.; Higgins, P.; Rogers, M.A.M.; Marrero, J.A. Meta-analysis: Surveillance with ultrasound for early-stage hepatocellular carcinoma in patients with cirrhosis. Aliment. Pharmacol. Ther. 2009, 30, 37–47. [Google Scholar] [CrossRef] [PubMed]
  16. Lok, A.S.; Sterling, R.K.; Everhart, J.E.; Wright, E.C.; Hoefs, J.C.; Di Bisceglie, A.M.; Morgan, T.R.; Kim, H.; Lee, W.M.; Bonkovsky, H.L.; et al. Des-gamma-carboxy prothrombin and alpha-fetoprotein as biomarkers for the early detection of hepatocellular carcinoma. Gastroenterology 2010, 138, 493–502. [Google Scholar] [CrossRef] [PubMed]
  17. Brown, P.O.; Botstein, D. Exploring the new world of the genome with DNA microarrays. Nat. Genet. 1999, 21, 33–37. [Google Scholar] [CrossRef] [PubMed]
  18. Zhang, L.; Fan, S.; Vera, J.; Lai, X. A network medicine approach for identifying diagnostic and prognostic biomarkers and exploring drug repurposing in human cancer. Comput. Struct. Biotechnol. J. 2022, 21, 34–45. [Google Scholar] [CrossRef]
  19. Stuart, J.M.; Segal, E.; Koller, D.; Kim, S.K. A gene-coexpression network for global discovery of conserved genetic modules. Science 2003, 302, 249–255. [Google Scholar] [CrossRef]
  20. Monaco, A.; Pantaleo, E.; Amoroso, N.; Bellantuono, L.; Lombardi, A.; Tateo, A.; Tangaro, S.; Bellotti, R. Identifying potential gene biomarkers for parkinson’s disease through an information entropy based approach. Phys. Biol. 2020, 18, 016003. [Google Scholar] [CrossRef]
  21. Traag, V.A.; Waltman, L.; van Eck, N.J. From Louvain to Leiden: Guaranteeing well-connected communities. Sci. Rep. 2019, 9, 5233. [Google Scholar] [CrossRef] [PubMed]
  22. Kursa, M.B.; Rudnicki, W.R. Feature selection with the Boruta package. J. Stat. Softw. 2010, 36, 1–13. [Google Scholar] [CrossRef]
  23. Lundberg, S.; Lee, S. A unified approach to interpreting model predictions. In Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA, 4–9 December 2017; pp. 44768–44777. [Google Scholar]
  24. Lundberg, S.M.; Erion, G.; Chen, H.; DeGrave, A.; Prutkin, J.M.; Nair, B.; Katz, R.; Himmelfarb, J.; Bansal, N.; Lee, S.-I. From local explanations to global understanding with explainable AI for trees. Nat. Mach. Intell. 2020, 2, 56–67. [Google Scholar] [CrossRef] [PubMed]
  25. Lacalamita, A.; Piccinno, E.; Scalavino, V.; Bellotti, R.; Giannelli, G.; Serino, G. A Gene-Based Machine Learning Classifier Associated to the Colorectal Adenoma—Carcinoma Sequence. Biomedicines 2021, 9, 1937. [Google Scholar] [CrossRef] [PubMed]
  26. Subramanian, A.; Tamayo, P.; Mootha, V.K.; Mukherjee, S.; Ebert, B.L.; Gillette, M.A.; Paulovich, A.; Pomeroy, S.L.; Golub, T.R.; Lander, E.S.; et al. Gene set enrichment analysis: A knowledge-based approach for interpreting genome-wide expression profiles. Proc. Natl. Acad. Sci. USA 2005, 102, 15545–15550. [Google Scholar] [CrossRef] [PubMed]
  27. Tsuchiya, N.; Sawada, Y.; Endo, I.; Saito, K.; Uemura, Y.; Nakatsura, T. Biomarkers for the early diagnosis of hepatocellular carcinoma. World J. Gastroenterol. 2015, 21, 10573–10583. [Google Scholar] [CrossRef] [PubMed]
  28. Zhou, L.; Liu, J.; Luo, F. Serum tumor markers for detection of hepatocellular carcinoma. World J. Gastroenterol. 2006, 12, 1175–1181. [Google Scholar] [CrossRef] [PubMed]
  29. Woo, H.G.; Kim, Y.J. Multiplatform genomic roadmap of hepatocellular carcinoma: A matter of molecular heterogeneity. Hepatology 2018, 68, 2029–2032. [Google Scholar] [CrossRef] [PubMed]
  30. Shao, X.; Taha, I.N.; Clauser, K.R.; Gao, Y.T.; Naba, A. MatrisomeDB: The ECM-protein knowledge database. Nucleic Acids Res. 2020, 48, D1136–D1144. [Google Scholar] [CrossRef]
  31. Socovich, A.M.; Naba, A. The cancer matrisome: From comprehensive characterization to biomarker discovery. Semin. Cell Dev. Biol. 2019, 89, 157–166. [Google Scholar] [CrossRef]
  32. Xingxing, G.; Hechen, H.; Yubo, W.; Caixu, P.; Shengyong, X.; Lin, Z.; Shusen, Z. Tumor Immune Microenvironment Characterization in Hepatocellular Carcinoma Identifies Four Prognostic and Immuno therapeutically Relevant Subclasses. Front. Oncol. 2021, 10, 610513. [Google Scholar] [CrossRef]
  33. Hou, J.; Zhang, H.; Sun, B.; Karin, M. The immunobiology of hepatocellular carcinoma in humans and mice: Basic concepts and therapeutic implications. J. Hepatol. 2020, 72, 167–182. [Google Scholar] [CrossRef] [PubMed]
  34. Prieto, J.; Melero, I.; Sangro, B. Immunological landscape and immunotherapy of hepatocellular carcinoma. Nat. Rev. Gastroenterol. Hepatol. 2015, 12, 681–700. [Google Scholar] [CrossRef] [PubMed]
  35. Irizarry, R.A.; Hobbs, B.; Collin, F.; Beazer-Barclay, Y.D.; Antonellis, K.J.; Scherf, U.; Speed, T.P. Exploration, normalization, and summaries of high density oligonucleotide array probe level data. Biostatistics 2003, 4, 249–264. [Google Scholar] [CrossRef] [PubMed]
  36. R Core Team. R: A Language and Environment for Statistical Computing; Foundation for Statistical Computing: Vienna, Austria, 2021; Available online: https://www.R-project.org/ (accessed on 11 January 2023).
  37. Carvalho, B.S.; Irizarry, R.A. A Framework for Oligonucleotide Microarray Preprocessing. Bioinformatics 2010, 26, 2363–2367. [Google Scholar] [CrossRef] [PubMed]
  38. Gautier, L.; Cope, L.; Bolstad, B.M.; Irizarry, R.A. Affy—Analysis of Affymetrix GeneChip data at the probe level. Bioinformatics 2004, 20, 307–315. [Google Scholar] [CrossRef] [PubMed]
  39. Kassambara, A.; Mundt, F. Factoextra: Extract and Visualize the Results of Multivariate Data Analyses, R Package Version 1.0.7. 2020. Available online: https://CRAN.R-project.org/package=factoextra (accessed on 11 January 2023).
  40. Lucas, A. Amap: Another Multidimensional Analysis Package, R Package Version 0.8-19. 2022. Available online: https://CRAN.R-project.org/package=amap (accessed on 11 January 2023).
  41. Liaw, A.; Wiener, M. Classification and Regression by random Forest. R News 2002, 2, 18–22. [Google Scholar]
  42. Komisarczyk, K.; Kozminski, P.; Maksymiuk, S.; Biecek, P. treeshap: Compute SHAP Values for Your Tree-Based Models Using the ‘TreeSHAP’ Algorithm, R Package Version 0.2.5. 2002. Available online: https://CRAN.R-project.org/package=treeshap (accessed on 11 January 2023).
  43. Csardi, G.; Nepusz, T. The igraph software package for complex network research. Int. J. Complex Syst. 2006, 1695, 1–9. Available online: https://igraph.org (accessed on 23 January 2023).
  44. Sieberts, S.K.; Schadt, E.E. Moving toward a system genetics view of disease Mamm. Genome 2007, 18, 389–401. [Google Scholar]
  45. Choobdar, S.; The DREAM Module Identification Challenge Consortium; Ahsen, M.E.; Crawford, J.; Tomasoni, M.; Fang, T.; Lamparter, D.; Lin, J.; Hescott, B.; Hu, X.; et al. Assessment of network module identification across complex diseases. Nat. Methods 2019, 16, 843–852. [Google Scholar] [CrossRef]
  46. Breiman, L. Random forests. Mach. Learn. 2001, 45, 32–45. [Google Scholar] [CrossRef]
  47. Lombardi, A.; Amoroso, N.; Bellantuono, L.; Bove, S.; Comes, M.C.; Fanizzi, A.; La Forgia, D.; Lorusso, V.; Monaco, A.; Tangaro, S.; et al. Accurate Evaluation of Feature Contributions for Sentinel Lymph Node Status Classification in Breast Cancer. Appl. Sci. 2022, 12, 7227. [Google Scholar] [CrossRef]
  48. Jiménez-Luna, J.; Grisoni, F.; Schneider, G. Drug discovery with explainable artificial intelligence. Nat. Mach. Intell. 2020, 2, 573–584. [Google Scholar] [CrossRef]
  49. Bellantuono, L.; Monaco, A.; Amoroso, N.; Lacalamita, A.; Pantaleo, E.; Tangaro, S.; Bellotti, R. Worldwide impact of lifestyle predictors of dementia prevalence: An eXplainable Artificial Intelligence analysis. Front. Big Data 2022, 5, 1027783. [Google Scholar] [CrossRef] [PubMed]
  50. Miller, T. Explanation in artificial intelligence: Insights from the social sciences. Artif. Intell. 2019, 267, 1–38. [Google Scholar] [CrossRef]
  51. Bussmann, N.; Giudici, P.; Marinelli, D.; Papenbrock, J. Explainable AI in Fintech Risk Management. Front. Artif. Intell. 2020, 3, 26. [Google Scholar] [CrossRef] [PubMed]
  52. Bellantuono, L.; Palmisano, F.; Amoroso, N.; Monaco, A.; Peragine, V.; Bellotti, R. Detecting the socio-economic drivers of confidence in government with eXplainable Artificial Intelligence. Sci. Rep. 2023, 13, 839. [Google Scholar] [CrossRef] [PubMed]
  53. Schaffer, C. Selecting a classification method by cross-validation. Mach. Learn. 1993, 13, 135–143. [Google Scholar] [CrossRef]
  54. Rao, R.B.; Fung, G.; Rosales, R. On the Dangers of Cross Validation. An Experimental Evaluation. In Proceedings of the 2008 SIAM International Conference on Data Mining, Atlanta, GA, USA, 24–26 April 2008; Society for Industrial and Applied Mathematics: Philadelphia, PA, USA, 2008; pp. 588–596. [Google Scholar]
  55. Musil, F.; Willatt, M.J.; Langovoy, M.A.; Ceriotti, M. Fast and Accurate Uncertainty Estimation in Chemical Machine Learning. J. Chem. Theory Comput. 2019, 15, 906–915. [Google Scholar] [CrossRef]
  56. Flach, P. Performance Evaluation in Machine Learning: The Good, the Bad, the Ugly, and the Way Forward. Proc. AAAI Conf. Artif. Intell. 2019, 33, 9808–9814. [Google Scholar] [CrossRef]
  57. Vollmer, S.; A Mateen, B.; Bohner, G.; Király, F.J.; Ghani, R.; Jonsson, P.; Cumbers, S.; Jonas, A.; McAllister, K.S.L.; Myles, P.; et al. Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness. BMJ 2020, 368, l6927. [Google Scholar] [CrossRef]
Figure 1. Schematic representation of the workflow in our study. After detecting the communities with highly correlated gene expression profiles through a procedure based on the Leiden algorithm, we estimated the most informative genes with the Boruta algorithm and used them to feed a random forest model inside a 5-fold cross-validation scheme.
Figure 1. Schematic representation of the workflow in our study. After detecting the communities with highly correlated gene expression profiles through a procedure based on the Leiden algorithm, we estimated the most informative genes with the Boruta algorithm and used them to feed a random forest model inside a 5-fold cross-validation scheme.
Ijms 24 15286 g001
Figure 2. Boxplot of the accuracy values of the 20 best communities averaged over 100 5-fold cross-validation rounds.
Figure 2. Boxplot of the accuracy values of the 20 best communities averaged over 100 5-fold cross-validation rounds.
Ijms 24 15286 g002
Figure 3. SHAP values of the 20 most important features in the classification of healthy vs. HCC samples for communities Comm_29 (panel (a)) and Comm_41 (panel (b)). Each point in the same row corresponds to a different patient.
Figure 3. SHAP values of the 20 most important features in the classification of healthy vs. HCC samples for communities Comm_29 (panel (a)) and Comm_41 (panel (b)). Each point in the same row corresponds to a different patient.
Ijms 24 15286 g003
Table 1. Number of genes, accuracy, AUC, F1 Score, and Log Loss of the classifiers obtained using the 46 stable communities. Results for each classifier were obtained after 100 5-fold cross-validation rounds.
Table 1. Number of genes, accuracy, AUC, F1 Score, and Log Loss of the classifiers obtained using the 46 stable communities. Results for each classifier were obtained after 100 5-fold cross-validation rounds.
CommunityCardinalityAccuracy (%)AUC (%)F1 Score (%)Log Loss
Comm_1359.61 ± 3.0657.64 ± 3.1548.61 ± 4.125.64 ± 2.31
Comm_21687.28 ± 1.2981.47 ± 2.1077.77 ± 2.70−4.11 ± 1.26
Comm_32177.89 ± 2.0578.55 ± 2.0174.16 ± 2.54−2.67 ± 1.58
Comm_4773.28 ± 2.4592.37 ± 1.4191.32 ± 1.62−6.31 ± 0.56
Comm_52487.28 ± 1.5785.22 ± 1.8582.46 ± 2.20−1.34 ± 1.06
Comm_62083.37 ± 1.8293.58 ± 1.3892.66 ± 1.65−5.76 ± 0.95
Comm_71586.66 ± 2.0393.59 ± 1.1892.63 ± 1.37−5.58 ± 0.72
Comm_83393.22 ± 1.3092.79 ± 1.2991.63 ± 1.46−5.16 ± 0.52
Comm_92170.59 ± 2.0690.79 ± 1.3389.41 ± 1.62−5.94 ± 0.80
Comm_102383.06 ± 1.9282.66 ± 1.8779.35 ± 2.32−3.14 ± 1.14
Comm_112080.13 ± 1.9688.85 ± 1.9887.01 ± 2.42−5.50 ± 1.13
Comm_124993.23 ± 1.1986.64 ± 1.2984.20 ± 1.55−2.67 ± 1.13
Comm_132385.69 ± 1.7170.49 ± 2.2663.97 ± 2.93−0.18 ± 1.63
Comm_143494.17 ± 1.3087.12 ± 1.5084.80 ± 1.80−3.53 ± 1.06
Comm_152794.13 ± 1.0787.33 ± 1.6484.86 ± 1.88−0.24 ± 1.07
Comm_163493.32 ± 1.1191.42 ± 0.4689.69 ± 0.54−2.55 ± 0.41
Comm_173091.74 ± 1.2595.54 ± 0.8194.29 ± 0.97−2.87 ± 0.74
Comm_181883.88 ± 1.7584.81 ± 1.2881.97 ± 1.50−0.29 ± 1.10
Comm_193289.92 ± 1.7988.47 ± 0.8986.29 ± 1.04−1.96 ± 0.74
Comm_20872.39 ± 2.1891.96 ± 0.6390.53 ± 0.78−4.14 ± 0.59
Comm_213187.91 ± 1.3995.44 ± 0.8894.64 ± 1.08−5.07 ± 0.78
Comm_224487.29 ± 1.5795.78 ± 0.5994.57 ± 0.64−3.03 ± 0.28
Comm_234091.47 ± 0.4576.07 ± 2.1470.90 ± 2.83−2.47 ± 2.14
Comm_242995.19 ± 0.8393.12 ± 1.1291.41 ± 1.28−1.41 ± 0.89
Comm_252485.07 ± 1.1994.36 ± 0.6792.89 ± 0.75−2.25 ± 0.50
Comm_263688.72 ± 0.8895.18 ± 0.8794.31 ± 1.02−4.90 ± 0.56
Comm_274492.34 ± 0.6696.01 ± 0.9495.34 ± 1.09−5.40 ± 0.64
Comm_284095.64 ± 0.8974.93 ± 1.6969.67 ± 2.17−1.18 ± 1.21
Comm_295195.44 ± 0.5292.00 ± 1.2190.38 ± 1.34−2.84 ± 0.47
Comm_303792.69 ± 1.0980.38 ± 1.6376.84 ± 1.901.57 ± 1.08
Comm_313193.99 ± 0.6378.55 ± 1.5174.33 ± 1.88−1.26 ± 1.10
Comm_324195.37 ± 0.8282.98 ± 2.2179.80 ± 2.66−1.06 ± 1.34
Comm_334196.23 ± 0.8789.45 ± 0.9187.49 ± 1.11−2.81 ± 0.89
Comm_342376.56 ± 1.6172.10 ± 2.6266.68 ± 3.312.02 ± 1.87
Comm_353292.06 ± 1.0592.62 ± 1.0891.23 ± 1.30−3.79 ± 0.85
Comm_362680.70 ± 1.5897.79 ± 0.4097.22 ± 0.56−5.04 ± 0.51
Comm_373379.78 ± 1.4792.30 ± 1.4191.02 ± 1.65−4.86 ± 0.90
Comm_38483.65 ± 2.0589.74 ± 1.0187.91 ± 1.20−3.71 ± 0.65
Comm_393689.79 ± 0.9680.23 ± 1.5476.51 ± 1.83−0.46 ± 1.24
Comm_403092.84 ± 1.0776.38 ± 1.6671.53 ± 2.03−1.43 ± 1.36
Comm_415397.71 ± 0.4867.03 ± 2.3960.24 ± 3.022.72 ± 1.86
Comm_423892.81 ± 1.2986.12 ± 1.7483.62 ± 2.15−4.55 ± 0.90
Comm_433590.27 ± 0.9581.96 ± 1.9478.44 ± 2.46−3.61 ± 1.34
Comm_442281.07 ± 1.5485.34 ± 2.2582.65 ± 2.80−4.83 ± 1.00
Comm_452077.91 ± 1.6793.23 ± 1.2991.81 ± 1.54−3.17 ± 1.07
Comm_46668.62 ± 2.3368.84 ± 2.2562.14 ± 3.061.21 ± 1.44
Table 2. Accuracy, AUC, F1 Score, and Log Loss of the 20 best classifiers tested on the independent dataset.
Table 2. Accuracy, AUC, F1 Score, and Log Loss of the 20 best classifiers tested on the independent dataset.
CommunityCardinalityAccuracy (%)AUC (%)F1 Score (%)Log Loss
Comm_83351.5551.254.8816.73
Comm_124959.0158.8037.7414.16
Comm_143461.4961.2841.5113.30
Comm_152766.4666.3357.8111.58
Comm_163470.8170.7366.1910.08
Comm_173050.9350.647.0616.95
Comm_234050.3150.000.0017.16
Comm_242950.3150.000.0017.16
Comm_274463.9863.8251.6712.44
Comm_284068.9468.7857.6310.73
Comm_295181.3781.3881.716.44
Comm_303750.9350.622.4716.95
Comm_313171.4371.5375.279.87
Comm_324182.6182.6282.726.01
Comm_334170.8170.6762.4010.08
Comm_353274.5374.6377.848.80
Comm_403071.4371.4572.299.87
Comm_415374.5374.6578.538.80
Comm_423851.5551.267.1416.73
Comm_433550.3150.000.0017.16
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Lacalamita, A.; Serino, G.; Pantaleo, E.; Monaco, A.; Amoroso, N.; Bellantuono, L.; Piccinno, E.; Scalavino, V.; Dituri, F.; Tangaro, S.; et al. Artificial Intelligence and Complex Network Approaches Reveal Potential Gene Biomarkers for Hepatocellular Carcinoma. Int. J. Mol. Sci. 2023, 24, 15286. https://doi.org/10.3390/ijms242015286

AMA Style

Lacalamita A, Serino G, Pantaleo E, Monaco A, Amoroso N, Bellantuono L, Piccinno E, Scalavino V, Dituri F, Tangaro S, et al. Artificial Intelligence and Complex Network Approaches Reveal Potential Gene Biomarkers for Hepatocellular Carcinoma. International Journal of Molecular Sciences. 2023; 24(20):15286. https://doi.org/10.3390/ijms242015286

Chicago/Turabian Style

Lacalamita, Antonio, Grazia Serino, Ester Pantaleo, Alfonso Monaco, Nicola Amoroso, Loredana Bellantuono, Emanuele Piccinno, Viviana Scalavino, Francesco Dituri, Sabina Tangaro, and et al. 2023. "Artificial Intelligence and Complex Network Approaches Reveal Potential Gene Biomarkers for Hepatocellular Carcinoma" International Journal of Molecular Sciences 24, no. 20: 15286. https://doi.org/10.3390/ijms242015286

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop