Next Article in Journal
Structural Evaluation and Conformational Dynamics of ZNF141T474I Mutation Provoking Postaxial Polydactyly Type A
Next Article in Special Issue
Understanding the Role of Connectivity Dynamics of Resting-State Functional MRI in the Diagnosis of Autism Spectrum Disorder: A Comprehensive Study
Previous Article in Journal
Bio-Activated PEEK: Promising Platforms for Improving Osteogenesis through Modulating Macrophage Polarization
Previous Article in Special Issue
Automated Lung-Related Pneumonia and COVID-19 Detection Based on Novel Feature Extraction Framework and Vision Transformer Approaches Using Chest X-ray Images
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

Artificial Intelligence for Detecting and Quantifying Fatty Liver in Ultrasound Images: A Systematic Review

by
Fahad Muflih Alshagathrh
and
Mowafa Said Househ
*
Division of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Qatar Foundation, Education City, Doha P.O. Box 34110, Qatar
*
Author to whom correspondence should be addressed.
Bioengineering 2022, 9(12), 748; https://doi.org/10.3390/bioengineering9120748
Submission received: 23 September 2022 / Revised: 20 October 2022 / Accepted: 30 October 2022 / Published: 1 December 2022
(This article belongs to the Special Issue Machine Learning for Biomedical Applications)

Abstract

:
Background: Non-alcoholic Fatty Liver Disease (NAFLD) is growing more prevalent worldwide. Although non-invasive diagnostic approaches such as conventional ultrasonography and clinical scoring systems have been proposed as alternatives to liver biopsy, their efficacy has been called into doubt. Artificial Intelligence (AI) is now combined with traditional diagnostic processes to improve the performance of non-invasive approaches. Objective: This study explores how well various AI methods function and perform on ultrasound (US) images to diagnose and quantify non-alcoholic fatty liver disease. Methodology: A systematic review was conducted to achieve this objective. Five science bibliographic databases were searched, including PubMed, Association for Computing Machinery ACM Digital Library, Institute of Electrical and Electronics Engineers IEEE Xplore, Scopus, and Google Scholar. Only peer-reviewed English articles, conferences, theses, and book chapters were included. Data from studies were synthesized using narrative methodologies per Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria. Results: Forty-nine studies were included in the systematic review. According to the qualitative analysis, AI significantly enhanced the diagnosis of NAFLD, Non-Alcoholic Steatohepatitis (NASH), and liver fibrosis. In addition, modalities, image acquisition, feature extraction and selection, data management, and classifiers were assessed and compared in terms of performance measures (i.e., accuracy, sensitivity, and specificity). Conclusion: AI-supported systems show potential performance increases in detecting and quantifying steatosis, NASH, and liver fibrosis in NAFLD patients. Before real-world implementation, prospective studies with direct comparisons of AI-assisted modalities and conventional techniques are necessary.

Graphical Abstract

1. Introduction

1.1. Background

Non-alcoholic Fatty Liver Disease (NAFLD) is a group of disorders caused by a build-up of fat in the liver. The disease is most common in overweight or obese people [1]. One of the most common chronic liver disease in the world is NAFLD, affecting between 25% and 30% of the adult population [1,2]. High liver fat levels are linked to a higher risk of significant health issues such as diabetes, high blood pressure, cirrhosis, renal disease, and heart disease [3]. However, if diagnosed and treated early enough, NAFLD can be prevented from worsening, and the amount of fat in the liver can be reduced. Unfortunately, advanced liver disease and mortality due to NAFLD/NASH are expected to rise in Saudi Arabia (Figure 1), necessitating a strategy to slow the growth of the NAFLD population and minimize the liver disease burden [4]. The primary line of treatment for NAFLD and NASH is lifestyle changes, including eating habits and physical activity. A well-established therapy for NAFLD and NASH is weight loss, which has an unmistakable dose–response correlation between definite nutriments and fatty liver disease [5].
The progression of NAFLD involves four stages. Steatosis (simple fatty liver) is a harmless build-up of fat in the liver cells. A more severe form of NAFLD called NASH occurs when the liver becomes inflamed. A patient is diagnosed with fibrosis when persistent inflammation creates scar tissue around the liver and adjacent blood vessels, but the liver can still function normally. Cirrhosis, the most severe stage, develops after years of inflammation and causes the liver to shrink, scar, and lump; this damage is irreversible and can lead to liver failure (Figure 2). Typically, doctors divide the severity of a patient’s disease into four groups, normal, mild, intermediate, or severe, based on histological characteristics [6].
In most cases, abdominal ultrasonography is used to diagnose NAFLD [7]. Ultrasonography is a low-cost, safe, quick, and uncomplicated procedure in most healthcare settings [8]. To determine the severity of liver disease, non-invasive testing or liver biopsies are used. Hepatic steatosis, inflammation, and fibrosis are all assessed with a liver biopsy. However, a liver biopsy is an intrusive procedure that may result in a hemoperitoneum or hemothorax. Liver biopsy is also ineffective as a follow-up technique for liver disease due to its invasive nature [9]. Alternative NAFLD diagnostic approaches, such as clinical/laboratory scores, have been developed, although their efficacy has been questioned. The accuracy of magnetic resonance imaging proton density fat fraction (MRI-PDFF) is higher, but the cost and availability are limiting [10]. Compared to results in late-stage NAFLD, transient elastography and several biomarkers demonstrate better performance in the initial stages. Various diagnosis approaches are being combined with artificial intelligence (AI) to increase diagnostic performance [11].
AI is an area of computer science that tries to replicate humans’ learning and problem-solving abilities [12]. Expert systems made up of clearly stated rule-based algorithms [13] and machine learning (ML), where patterns are learned from data rather than human-designed rules [14], are the two primary forms of AI [15]. The three types of ML are unsupervised, supervised, and reinforcement. Unsupervised learning (e.g., k-means, clustering, and Gaussian mixtures) is used to find clusters based on shared characteristics. To teach mapping relationships between input-output (anticipated outcome) pairings, supervised learning (e.g., support vector machines (SVM), decision trees, and artificial neural networks (ANN)) are typically utilized. ANN are a computer analysis tool inspired by the neuroanatomy of the human brain. ANN have three layers: input, hidden, and output. The training phase allows neurons to optimize outcomes by weighting the incoming data. A convolutional neural network (CNN) is an image-based ML technology inspired by the human brain’s visual cortex. Convolutional, nonlinear, and pooling layers make up CNNs. A deep neural network (DNN) is made up of numerous filters that are applied to automatically find relevant aspects in the input data. Learning how to act in order to maximize a numerical reward signal is known as reinforcement learning. The learner must try each action to determine which produces the greatest reward. In the most fascinating and difficult situations, choices can influence not only the immediate reward but also the subsequent circumstance [16].
Numerous research has demonstrated the viability of combining AI with medical technologies to enhance outcomes, lower margins of error, and increase the standard of care. M.B. Jamshidi et al. found, for instance, in their review that various AI techniques can forecast the spread of COVID-19 [17]. In a distinct review, M.B. Jamshidi et al. also demonstrated how mobile applications are quickly becoming tools that provide a variety of services in the field of medical sciences, particularly in the COVID-19 era, and can effectively aid medical systems [18]. In fact, a substantial role for AI in battling COVID-19 [19] and creating vaccines in a short amount of time [20] has been demonstrated. Additionally, V. Srivastava et al.’s study improved the categorization accuracy for dermatoscopic images using AI approaches, increasing it to 96%. [21]. Another example was the work of D. Pal et al., where they showed that Attention UW-Net is the best for automatically segmenting and annotating organ x-rays due to its uniformity in prediction accuracy of segmentation masks [22]. Diverse types of AI have been used to address multiple liver problems using different interventions. Many studies on diagnosing, detecting, quantifying, and managing liver disorders such as fibrosis, focal lesions, carcinoma, NAFLD, and chronic illness have used AI to improve diverse diagnosis methodologies. For example, Piscaglia et al. employed ANN to predict the presence or absence of fibrosis in liver samples [23]. In addition, S-h Z et al. employed MRI scans and a ML technique to distinguish between malignant and benign liver cancers [24]. However, more studies are using AI to diagnose and determine the stage of NAFLD. For example, Vanderbeck et al. employed an SVM machine learning model to categorize digital normal and NAFLD biopsy images [25]. In addition, Naganawa et al. used a logistic regression (LR) machine learning model on non-contrast-enhanced computed tomography to predict stages of fatty liver disease [26].
Using ultrasonography with AI to detect and quantify NAFLD is a promising approach that has recently attracted researchers’ attention. In a review published in 2021, the domains of liver disease in which AI can be used are briefly discussed [27]. In addition, the use of ML for measuring liver fibrosis, forecasting hepatic decompensation, screening potential liver transplant recipients, and predicting post-transplant survival and complications was reported in a recent systematic review of AI in hepatology [28,29,30]. A comprehensive study also highlights basic technical knowledge about AI, such as traditional ML and deep learning (DL) algorithms, particularly CNNs, and their clinical applications in the medical imaging of liver diseases, such as detecting and evaluating focal liver lesions, facilitating treatment, and predicting liver treatment response [11,31]. Another recent systematic review detailed the use of AI in imaging modalities, digital pathology, and electronic health records to diagnose and stage NAFLD [32]. Furthermore, the performance of AI-assisted systems for the detection of NAFLD, NASH, and liver fibrosis is examined in a recent meta-analysis [33].

1.2. Research Problem and Aim

To the researchers’ best knowledge, no studies rigorously analyzed AI models for diagnosing and quantifying NAFLD using ultrasound (US) images or compared models regarding measures. Therefore, this systematic review is the first work of its kind in the literature. Many knowledge gaps have been identified and explored throughout this article. This study aims to examine all prior studies to determine the best accuracy, sensitivity, and specificity for diagnosing and quantifying NAFLD using ML, DL, or a combination of both.

2. Methods

2.1. Overview

A preliminary search and idea validation were conducted using the search terms “Artificial Intelligence” and “Ultrasound” and “Fatty liver” in PubMed and Google Scholar. When performing this step, systematic reviews and meta-analyses were found. These sources contained relevant papers to read to gain a deeper understanding of the topic and identify gaps to articulate the research question better. Because the previous reviews had different outcomes and populations, a systematic review of AI-powered ultrasonography were conducted to detect and quantify NAFLD. Figure 3 summarizes the method and tackles the research purpose.

2.2. Protocol and Registration

The protocol was designed by the author and reviewed and approved by the corresponding author. The protocol is registered at PROSPERO.

2.3. Search Sources

The bibliographic databases used in this study were PubMed, ACM Digital Library, IEEE Xplore, Scopus, and Google Scholar. The first one hundred Google Scholar results were sorted by relevancy to the search topic, returning many publications. The initial search was broad, based on terms in all fields across all databases. Because the number of keywords allowed in IEEE Xplore and Google Scholar was limited, shorter search strings were used compared to the other databases. Backward and forward reference list checking turned up a multitude of related studies in a variety of databases.

2.4. Search Terms

The search terms used in this review were related to the population (e.g., “fatty liver”, “hepatic steatosis”, “non-alcoholic fatty liver”, “metabolic associated fatty liver disease”, etc.), first intervention group (e.g., “Artificial Intelligent *”, “machine learning,” “deep learning”, “convolutional neural network *”, “artificial neural network *”, etc.), second intervention group (e.g., “ultrasound”, “ultrasonogr *”, “sonography”, etc.), and outcome (e.g., “detect *”, “quantif *”, “diagnos *”, etc.). Even though the comparator is usually essential for explaining the mode of comparison, no terminology related to it was included because a comparison based on comparators is outside the scope of this study. All comparators in the included studies were grouped into a single category termed “Control.”

2.5. Study Eligibility Criteria

All studies reported patients with hepatic steatosis, including NAFLD, NASH, acute fatty liver of pregnancy (AFLP), and other disease phases. Eligible interventions were those that fell under the umbrella of AI and were related to computer vision (CV), which was used to assess medical images. The type of medical image discussed in this review was a US, also known as sonography or ultrasonography. Interventions that identified and diagnosed fatty liver disease and its stages were considered eligible outcomes. Outcome accuracy, sensitivity, and specificity were used to assess performance. This review used no limitations such as age, gender, race, or publication date. Table 1 defines the inclusion and exclusion criteria.

2.6. Study Selection

Using PRISMA, studies were selected based on three processes: deleting duplicates, screening and assessing titles and abstracts of recovered research and index terms, and reading the contexts of the studies selected during the previous processes. The research selection was aided by a web-based systematic review tool known as Rayyan, speeding up the screening step [34]. Finally, the primary author completed all the processes and conducted data cross-checking among the studies’ extracted data to correct any probable errors.

2.7. Data Extraction and Synthesis

The primary author designed a data extraction form to collect specific data and parameters from the included studies. The form was a result of revising the parameters gathered in similar reviews and adding extra parameters needed to accomplish this review’s aim. The final extraction form was reviewed and approved by the corresponding author. Furthermore, data regarding the study (e.g., first author, year of publication, country of publication, publication type, etc.), population (e.g., age, gender, health status, sample size, etc.), interventions (e.g., imaging modalities, image types, image quality, AI branch, AI methods, validation methods, etc.), datasets (e.g., public/private, training data, testing data, augmented or not, etc.), and performance measures (e.g., accuracy, sensitivity, specificity, and Area Under the Curve) were collected by the author manually. In addition, as previously mentioned, manual data cross-checking among the studies’ extracted data was conducted by the author to correct any probable errors.

2.8. Risk of Bias in Individual Studies

Using the modified Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) was considered to evaluate the risk of bias in the studies, but all studies were included because of the limited number of studies available. A literature map was created to help review the literature for gaps and points of impact. According to Figure 4, the selected studies are mostly correlated since there are very few studies not in the citation loop. This result encourages including all the studies even though their quality is questionable.

2.9. Data Checking Task

Data was validated through the cross-verification of more than two sources. Using triangulation, the consistency of findings was evaluated, increasing the chance of controlling any threats to result validity [35]. Collected parameters of included studies were cross-checked in front of the same parameter in different studies. A form that was designed by the author was used to record any discrepancy that was found. The next step was to revisit each paper and correctly extract the parameters that showed discrepancies according to the form.

3. Results

3.1. Search Results

Figure 5 depicts the search process and results. A total of 609 articles were found during a literature search. After eliminating 93 duplicates, 516 titles and abstracts were reviewed and 461 articles were rejected for the following reasons: irrelevant research (n = 398), incorrect intervention (n = 42), incorrect population (n = 16), and incorrect publication type (n = 5). Following that, 55 full-text articles were reviewed, with 23 being removed for the following reasons: incorrect research design (n = 1), incorrect population (n = 4), incorrect intervention (n = 13), irrelevant studies (n = 2), and articles written in languages other than English (n = 2). Finally, after completing the forward and backward review process, the total number of studies considered was forty-nine.

3.2. Description of the Included Studies

Results of the performance measures and assessments of each included study are summarized in Table 5. This table contains basic information about the whole study, including the study number in the reference, the type of categorization, the number of images, and the classifier. The AUC, sensitivity, accuracy, and specificity are then added. Each study’s findings are also summarized.

3.3. Study Characteristics

The highest percentage of studies were journal articles (n = 34, ≈69%), while most of the rest of the studies were conference proceedings (n = 14, ≈28.5%). However, one study was a dissertation. As shown in Table 2, studies were published between 1996 and 2021—however, there was a marked increase in published studies, especially DL studies, starting in 2014. When dividing the studies by year of publication, 22.4% were published in 2021, 8.16% in 2020, 10.2% in 2019, and approximately 24.5% between 2015 and 2018. More than a third of the studies were about DL (n = 17, 35%), and the rest discussed ML (n = 32, 56%). Finally, while India, the USA, China, and Portugal published the most significant number of studies, the USA, Taiwan, and Romania published the largest number of DL studies.

3.4. Definition of Result Themes

3.4.1. Evaluation of Modalities

The included studies used different modalities, probe frequencies, and settings. Table 3 shows the modalities and frequency ranges used in all the studies.

3.4.2. Evaluation of Image Pre-Processing

Image pre-processing enhances an image’s quality by cleaning and organizing it for better feature extraction suitable for ML models. Usually, three steps are taken to prepare an image for further operations. First, images are resized. Second, images are de-noised by removing and smoothing noises. For example, speckle noise is removed using filters such as the Gaussian blur. Third, images are segmented by separating the background from the foreground. Many methods were used to process the US images in the included studies. The processing methods used include cropping [37,42,45,50,51,53,55,56,59,62,69,77,80,84], resizing [37,50,59,60,61,77,84], rotating [60,61,81], edge detection using “Active Snake Contour” [80] or “α-scale space derivative quadrature filters” [62], image squaring process [51], and contrast limited adaptive histogram equalization [36,37,51,54,81].
The included studies also used different methods to deal with the size of the images. Usually, a Region of Interest (ROI) resides around the center line and under an image’s near, focal, or far zones. It can be rectangular [48,74,75] or circular [59,81]. Typically, ROIs are chosen manually by an expert or automatically using methods like a self-organizing map [53]. In this research, some studies used the complete image as the ROI with a size of 434 × 636 pixels [60,61,63,64], 800 × 600 pixels [71], 960 × 720 pixels [51], or 1024 × 1024 pixels [39]. Other studies selected larger ROIs with 500 × 500 pixels [36,37,53]. Some studies selected medium-sized ROIs of 360 × 360 pixels [77], 334 × 334 pixels [62], 224 × 224 pixels [50], 128 × 128 pixels [38,40,41,42], or 100 × 100 pixels [79]. Finally, some studies selected small ROIs such as 23 × 23 pixels [78], 30 × 30 pixels [65,66], 32 × 32 pixels [47,48,49,52], 50 × 50 pixels [58,72], 64 × 64 pixels [55,56,57], or 75 × 75 pixels [84].

3.4.3. Evaluation of Features

Features such as maximum probability [38,52,53,59,63,78,80], uniformity [38,52,53,59,60,63,70,80], entropy [37,38,49,52,59,63,66,70,71,73,74,76,80,82], contrast [38,49,52,59,63,65,66,70,71,73,74,76,78,80], run-length uniformity [38,52,70,80], attenuation [43,73,74,75,79], grey-level metrics [49,71,73,74,80,82], inverse difference [38,49,52,59,63,70,80], anisotropy, and pair correlation function [54] are examples of features that are repeated in studies of higher accuracy.
There are many methods used to extract features from US images. Among the extraction methods frequently used in studies with higher performance are the grey-level co-occurrence matrix method [38,52,54,58,63,71,76,79,80,83], grey-level difference statistics [48,49,66], grey-level run-length matrix [38,48,49,58], spatial grey-level dependence [47,48,49,53,65,66], wavelet packet transform [55,56,57], and first-order statistics [52,58,79].
Using only pertinent data and eliminating data noise, feature selection is a technique for lowering the variability of inputs put into a model. Choosing suitable characteristics for the AI model is based on the type of problem to be solved. Some feature selection methods often used in high-performance studies are locality-sensitive discriminant analysis [36,37], student’s t-test [41,53], Fisher’s discrimination ratio with Pearson’s correlation coefficient [65,66], sequential forward floating selection [79], marginal Fisher analysis with Wilcoxon signed-rank test [39], and Welch’s test [54].

3.4.4. Cross-Validation and Data Splitting

Even though not all studies provided information about the methods used to manage data, most studies used cross-validation. Twelve studies implemented 10-fold cross-validation on the testing and training datasets [36,38,39,42,43,52,58,60,62,67,68,70], four studies used five-fold cross-validation [59,63,66,69], one study used four-fold cross-validation [77], two studies used three-fold cross-validation [41,54], one study used two-fold cross-validation [40], and one study used one-fold cross-validation [74]. In addition, four studies mentioned that a leave-one-out cross-validation (LOOCV) method was used [55,56,57,79].
Not all the included studies reported the rate of data splitting used for training and testing. Often, the percentage of data allocated for validation was also unclear. Table 4 shows approximate data splitting calculations. For most studies, the number of samples used for validation was assumed to be null since no numbers were explicitly declared for validation.

3.4.5. Evaluation of Classification Models

An algorithm that performs classification is known as a classifier. The features of images that need to be classified significantly impact classifier performance. Numerous empirical studies have been conducted to compare classifier performance and identify the elements of images that affect classifier performance.
Thirty-two included studies used ML models, and seventeen studies used DL models. In the ML studies, seven studies had their best performance using a SVM [52,55,56,57,58,60,67], four studies used a probabilistic neural network [37,39,54,76], and three studies used k-nearest neighbor [KNN] [48,49,82]. In addition, four studies used the Sugeno method [36], neural network method [47], or other fuzzy logic methods [74,78], and two studies used random forest [67,75]. Two studies used ensembled models. One study used three different classifiers: SVM, multi-layered perceptron neural net, and extreme gradient boost [70]. The other study used two classifiers: LR and SVM [68]. The rest of the studies used the following models to classify the images: binary logistic regression [BLR][71], adaptive boosting [67], Bayes [79], decision tree [41], single-layer perceptron network [73], regression tree model [43], single-layer feed-forward neural network [38], ANN [80], Levenberg–Marquardt back propagation neural network [40], and z-score [66].
DL studies used many models to classify US images. Seven studies used CNNs with variations in architecture (e.g., layers, branches, number of batches, pooling, convolution, etc.) [42,44,46,61,72,77,83]. The number of layers used ranged between three, as in [46], and twenty-two, as in [79]. In all seven studies, SoftMax was used for classification. In one study, Fourier CNNs with six layers were used as a classification model [64]. Two studies used Inception-v3 as a classification model [51,84], and two studies used VGG-16 to classify US images [50,69]. Five studies used a residual neural network (ResNet) with the following version variations: Inception-ResNet-v2 [63], multi-scale two-dimensional mid-fusion ResNet [62], ResNet-18 [45,51], and ResNet-50 v2 [81]. Finally, in one study, a SVM was used to classify images after a CNN was used to extract features [59].

3.4.6. Explanation of the Performance Measure

Every machine learning problem may be divided into two categories: regression and classification [13]. For regression models, for example, measures such as Mean Absolute Error, Mean Squared Error, Root Mean Squared Error, and R2 are used to evaluate the performance. Classification models are also evaluated using measures such as Accuracy, Precision, Recall, F1-score, and AU-ROC. It is worth noting that the Metrics are distinct from the loss functions used to train a machine learning model, and they are typically distinguishable in the model’s parameters [85].
We will include the three key performance indicators reported in the majority of the included studies in this review: sensitivity, specificity, and accuracy. A few studies also reported F1-score and AUC; however, due to the scarcity of studies utilizing these measures, they will not be included in the review. The classification accuracy of a collection of measures is defined as how near they are to their actual value. Accuracy is calculated by dividing the number of correct predictions by the total number of predictions and multiplying the result by 100. A diagnostic test’s classification sensitivity measures how well it can identify true positives. Sensitivity is also known as Recall, Hit-Rate, and True Positive Rate. It may be computed by dividing the number of true positives by the total number of positives in the ground truth. Specificity, also known as Selectivity or True Negative Rate, assesses how successfully a test can identify true negatives. [86].
Table 5. Results of included studies.
Table 5. Results of included studies.
Ref. No.Patients CategoriesTotal no. of Images AI ClassifierAUCSensitivityAccuracySpecificityMain Findings
[36]1- normal
2- abnormal
100Fuzzy Sugeno (FS)Unknown100%100%100%An automated diagnosis based on RT and DCT coefficients was used to classify a normal liver and a liver affected by fatty liver disease (FLD). Using only two features, the FS classifier presented the highest accuracy, sensitivity, and specificity, at 100%. Moreover, using just two elements, FLDI discriminated between normal and FLD.
[51]1- Normal
2- Mild
3- Moderate
4- Severe
3200Inception v3Unknown99.78%99.91%100%The final neural network, SteatosisNet, used clipped L-K sections (using transfer learning and a second neural network) to categorize the severity of FLD. The experimental findings show that the suggested model may predict FLD effectively, comparable to the usual conclusions noted by medical professionals.
[69]1- Normal
2- mild
3- moderate
4- severe
820VGG-16for B Modes Images:
Mild = 0.71
Moderate = 0.75
Severe = 0.88

for Entropy Images:
Mild = 0.68
Moderate = 0.85
Severe = 0.90
for B Modes Images:
Mild = 73.18%
Moderate = 63.25%
Severe = 85.23%

for Entropy Images:
Mild = 64.10%
Moderate = 70%
Severe = 78.82%
for B Modes Images:
Mild = 70%
Moderate = 80%
Severe = 97%

for Entropy Images:
Mild = 68%
Moderate = 80%
Severe = 83%
for B Modes Images:
Mild = 60%
Moderate = 74.82%
Severe = 84.12%

for Entropy Images:
Mild = 70.16%
Moderate = 86.54%
Severe = 93.30%
When identifying mild and severe hepatic steatosis, there was no discernible difference between the VGG-16 model and entropy imaging. However, when it came to detecting moderate hepatic steatosis, ultrasonic entropy imaging performed better than the VGG-16 model. Interestingly, a physics-based analysis technique was as effective as DL and performed better at spotting mild to severe hepatic steatosis.
[44]1- Fatty liver
2- Not Fatty liver
905CNN unknown0.88692.30%95.30%Diagnosing NAFLD by US was compared to radiologists’ performance. Cloud AutoML Vision Beta allowed the creation of custom models trained on uploaded images using a CNN pre-trained through transfer learning. The model accurately detected NAFLD on US.
[47]1- normal
2- fatty
3- cirrhotic
150Fuzzy neural network unknownunknownNormal = 80%
Fatty = 88%
Cirrhosis = 80%

Total = 82,67%
unknownThrough this work, proximity-based methods for building fuzzy neural classifiers in greater detail can be assessed, and more effective strategies for generating soft decisions can be learned.
[75]1- Normal
2- Mild
3- Moderate
4- Severe
120Random forestUnknownUnknown90.84%UnknownWithout using any features, RF had superior or comparable accuracy to SVM when classifying the severity of steatosis. In addition, human intra-observer and inter-observer agreement rates were outperformed by RF-based steatosis rating and SVM classification.
[37]1- normal
2- FLD
3- cirrhosis
150 probabilistic neural network0.9896%97.33%100%This work proposed a unique method for automatically distinguishing between a normal, FLD, and cirrhotic liver using US images. The technique combines CT, entropy features, and LSDA feature reduction. The suggested approach achieved high performance using a PNN classifier.
[45]1- healthy
2- mild
3- moderate
4- severe
UnknownResNet-18mild = 0.85,
moderate = 0.90,
severe = 0.93,
UnknownUnknownUnknownThe DL algorithm offers a trustworthy quantitative steatosis assessment across views and scanners in two multi-scanner cohorts. High diagnostic performance was achieved, matching or exceeding that of FibroScan.
[59]1- normal
2- fatty
550support vector machine0.977100%96.30%88.20%This study used a steatosis level assessment utilizing B-mode US images via a CNN-based method. The method was effective and did not rely on an operator. Additionally, it performed better than both HI- and GLCM-based classifications.
[76]1- normal
2- fatty
100Probabilistic Neural Network UnknownUnknownNormal = 85%
Fatty = 87.25%
UnknownTo automatically classify and recognize fatty and normal liver, five joint statistical feature parameters [mean, variance, contrast, ASM, and entropy] retrieved from three approaches [grey histogram statistic, GLDS, and GLCM] achieved good results when utilized as the input of a PNN.
[77] S0: H-MRS index < 3.12%,
S1: H-MRS index > 3.12% and < 8.77%
S2: H-MRS index > 8.77% and < 13.69%
S3: H-MRS index > 13.69%
31,702CNNUnknownUnknown90%UnknownA high number of US images were used to train 5-layer CNNs. Results showed a good correlation with state-of-the-art magnetic resonance spectroscopy measurements.
[60]1- Susceptible to FL [Steatosis > 5%]
2- normal people [<5%]
550support vector machine0.999997.20%98.64%100%This method displayed and contrasted the outcomes of various DL algorithms based on how well they performed. The findings of this study demonstrated that the suggested pre-trained CNN could categorize US images of the liver as normal or fatty with excellent accuracy.
[78]1- normal
2- diseased
UnknownFuzzy ClassifierUnknownUnknown100%UnknownThis study identified how to automatically classify and recognize focal and diffuse liver diseases [including fatty and normal liver]. Advanced image processing methods such as MLPND and MI were used. Five features [contrast, cluster prominence, auto-correlation, cluster shade, and ASM] retrieved by the Haralick approaches achieved excellent results when utilized as the input of a fuzzy classifier.
[61]1- Does not have steatosis
2- has steatosis
550CNNUnknownUnknown87.49%UnknownUsing an 18-layer CNN with four convolutional layers resulted in an accuracy of 87.49%. Better image processing and dataset splitting techniques must be used for better results.
[73]1- normal
2- fatty
3- cirrhotic
120Single-Layer Perceptron NetworkUnknownFor Cirrhotic: 91.7%
For Fatty: 96.7%
Unknown88.30%Some features [mean grey level, first percentile, grey level co-occurrence matrix, contrast, entropy, correlation, ASM, attenuation and backscattering parameters, and scatterer separation distance] retrieved from GLCM approaches achieved good results for classifying fatty and cirrhotic liver when utilized as an input of a single-layer perceptron network with a functional link.
[41]1- normal
2- fatty liver
100Decision Tree0.93388.9%93.3%100%This study had excellent performance results for classifying normal and fatty liver using three highly discriminatory noteworthy features [texture homogeneity, texture run percentage, and short-run emphasis] to train and build two supervised-learning-based classifiers [decision tree].
[79]1- healthy
2- steatotic
75BayesUnknownnormal = 95.83%
steatosis = 85.71%
93.54%UnknownThis study’s key finding was that the AR coefficients obtained from a multi-scale Haar wavelet decomposition were relevant for classifying hepatic steatosis using US images.
The results of global and local assessments of liver tissue defined by the Bayes factor can give doctors valuable information about the classification’s confidence and the classification itself.
[42]1- normal
2- abnormal
CNN1100%100%100%To reduce dimensionality and DL network speed without raising computational expenses, the system in this study used the inception model. First, the background of the original liver images was removed from the optimized images by stripping the border. When removing 15% of the background, the findings showed remarkable accuracy.
[84]1- normal patient
2- fatty liver patient
629Inception-v30.9389.90%93.23%96.60%This study used the Inception-v3 to detect steatosis and classify normal and fatty liver images, yielding an excellent test performance.
[48]1- normal
2- fatty
3- cirrhosis
4- hepatoma
unknownK-nearest neighbourUnknownUnknown80%UnknownUsing GLDS, RUNL, SGLDM, and FDTA algorithms, this study used a method created for computer-assisted liver tissue characterization. It was anticipated that it would be challenging to distinguish cirrhosis, fatty, and diffused diseases from normal, but the preliminary outcomes seemed incredibly good.
[53]1- normal
2- fatty
100Self Organising MapUnknownUnknownUnknownUnknownThis study found representative feature vectors using a one-dimensional self-organizing map [SOM]. The most distinctive components were “maximum probability” and “uniformity.” The plots for normal and fatty liver superimposed images indicate distinct groups with little to no overlap.
[72]1- normal
2- mild
3- moderate
4- severe
852CNN0.958Unknown95.45%UnknownIn the NAFLD diagnosis stages, envelope signal and grayscale values were essential components of this study. However CNN showed the highest sensitivity and specificity when determining the severity of NAFLD. In addition, the deep-learning index had the best diagnostic performance in differentiating between mild and severe NAFLD (AUC = 0.958).
[55]1- normal
2- fatty
3- heterogeneous
88SVMUnknownHeterogeneous= 100%
Fatty= 93.3%
Normal= 86.4%
91%UnknownIn this study, a suggested algorithm distinguished between normal, fatty, and heterogeneous liver images. Two steps make up the proposed algorithm’s operation. Without the aid of a medical specialist, the first stage automatically chooses a few ROIs from a liver US image. Then, the wavelet packet transform [WPT] was applied to chosen ROIs as a multi-scale texture analyser to extract some statistical features. A hierarchical binary classification method with an SVM classifier was used in the second stage.
[49]1- fatty
2- cirrhosis
3- normal
90K-Nearest NeighbourUnknownUnknown82.2%UnknownThe FDTA and the SGLDM were the texture analysis methods employed in this study. On three sets of liver US images—fatty, cirrhotic, and normal—algorithms were used. A 32 × 32 pixel ROI was used to extract textural features. A kNN classifier was used to categorize the results. Together, the FDTA and SGLDM provided an accuracy of 82.2%.
[74]1- normal
2- fatty
3- cirrhotic
140Fuzzy logicunknowncirrhosis = 94%
Fatty = 96%
Unknown92%In this study, features such as the mean grey level, 10th percentile, contrast, ASM, entropy, correlation, attenuation, and speckle separation, produced good results when used as the input of fuzzy logic to build an automated categorization of cirrhosis, fatty, and normal liver.
The findings of this research demonstrated the potential benefit of taking fuzzy reasoning into account during the “quantitative tissue characterization” of diffused liver diseases.
[80]1- Normal liver
2- abnormal liver [cirrhosis, fatty liver, hepatomegaly]
60 ANN Unknown95%95%UnknownIn this study, the feature set employed, training samples chosen, and the classifier’s ability to learn from the training examples all impacted how accurate the ANN classifier was. A comparison strategy indicated that the GLRLM and the mixed-feature set demonstrated high accuracy during both training and testing.
[62]1- normal
2- diseased
550multi-scale two-dimensional mid-fusion residual neural network Unknownabnormal: 95.37%
normal: 82.40%
91.31%abnormal: 92.42%
normal: 88.99%
The study proposed a multi-scale two-dimensional mid-fusion residual neural network for improving NAFLD classification from US data and a GAN-based network for image synthesis to enlarge the training dataset (instead of using patch images). The study showed that fusing B-mode US features, local phase features, and radial symmetry features at a mid-stage outperform early and late fusion, which indicates a strong correlation among unique features obtained after convolution operation.
[50]1- normal
2- abnormal
157VGG160.9695%90.60%85%The study suggested DL, transfer learning, and fine-tuning as methods for identifying fatty liver in US pictures with comparable performance to other similar studies.
[56]1- Normal
2- Fatty
3- Heterogeneous
88ν-linear support vectorUnknownFatty = 93.3%
Normal = 97.4%
Heterogeneous = 94.7%
95.40%UnknownThe diagnosis of FLD and heterogeneous liver utilizing textural analysis of liver US images is a unique method presented in this research. First, a WPT was used to examine the ROI, and from each of the WPT sub-images, several statistical features were collected (median, standard deviation, and interquartile range). The classification was then performed using a “v-linear support vector” classifier. The suggested approach provided an overall accuracy of approximately 95%, demonstrating the system’s effectiveness.
[81]1- Normal
2- Mild
3- Moderate
4- Severe
21,855ResNet-50 v2Normal =0985
Mild = 0.974
Moderate = 0.971
Severe = 0.981
0.8380.8410.948In this study, ResNet-50 v2 was trained and evaluated on many images and, as a result, performed relatively well compared to invasive diagnostic techniques for fatty liver.
[54]1- normal
2- fatty
340probabilistic neural networkUnknown100%99%97%This study revealed that it is possible to differentiate between normal and fatty liver images using the anisotropy feature supplied to PNN.
[82]1- normal
2- steatosis
3- hepatitis
4- cirrhosis
Unknownk-nearest neighbour UnknownUnknownnormal = 86%
steatosis = 90%
hepatitis = 85%
cirrhosis = 50%
UnknownIn this study, to automatically classify and recognize diffused liver diseases, three features (for steatosis: mean grey value, and for cirrhosis: mean grey value, texture energy, entropy) were retrieved from the GLCM approach. The approach achieved satisfactory results (except for cirrhosis) when utilized as a kNN input.
[57]1- normal
2- fatty
3- heterogeneous
88support vector machineUnknown98.84%98.86%UnknownIn this work, feature fusion techniques were used to create a computer-aided diagnostic system for the hierarchical classification of normal, fatty, and heterogeneous liver US images. The prominent features of the parallel- and serial-fused feature spaces were chosen after features were extracted (energy, energy deviation, median, standard deviation, and interquartile range). Using the LOOCV technique and the SVM classifier, serial and parallel feature fusion modes, achieved maximum classification accuracies of 100% and 98.86%, respectively.
[71]1- healthy
2- diseased
16,551A Binary Logistic Regression (BLR)0.98695.45%95.74%96.00%According to the findings, US images are more dependable than CT imaging for detecting hepatic steatosis. In addition, when ten features from a co-occurrence matrix were loaded into a BLR, it performed pretty well at differentiating between healthy and diseased fatty liver.
[68]1- normal
2- fatty
3- cancerous
114logistic regression + support vector machineNormal = 0.959
fatty = 0.956
cancer = 0.985
Unknown87.50%UnknownThe goal of this study was to examine the performance of a hybrid classifier (SVM and LR) in the diagnosis of liver steatosis utilizing a variety of US image features that were retrieved, including mean, SD, arithmetic mean, geometric mean, and skew.
[63]1- malignant fatty livers
2- benign fatty livers
550Inception-ResNet-v2 0.992Unknown98.50%92%The study results showed that the Inception-ResNet-v2 architecture-based model is more helpful in classifying medical images. In addition, the study showed that it performs better than classical methods regarding accuracy and AUC.
[38]1- normal
2- abnormal
63single layer feed forward neural network [SLFFNN]0.9797.59%96.75%unknownThis study built an extreme learning machine (ELM) on a single-layer feed-forward neural network. Only hidden-to-output weights were taught, and input-to-hidden layer weights were created randomly to reduce computing costs. As a result, the results were more accurate with fewer features.
[58]1- Normal
2-Steatotic
177Support Vector Machine0.88Unknown79.77%UnknownThe results of this study indicated that the SVM was the most applicable for the discrimination of pathologic tissues in clinical practice, having better performance than the kNN and ANN.
[65]1- Fatty liver
2- Normal liver
30Fisher’s linear discriminative analysisUnknown100%92%UnknownThis paper suggested a quantitative metric for the characterisation of the liver based on texture analysis. This process was motivated by the visual criteria used by radiologists.
[67]1- fibrosis
2- activity
3- steatosis
144adaptive boosting,
random forest,
support vector machine
adaptive boosting = 085
random forest = 085
support vector machine = 0.85
adaptive boosting = 87.5%
random forest = 87,5%
support vector machine = 93.8%
adaptive boosting = 85%
random forest = 85%
support vector machine = 85%
adaptive boosting = 76.9%
random forest = 76.9%
support vector machine = 69.2%
In this study, three different image types were utilized to extract features, and the analysis and classification results were satisfactory.
[66]1- Fatty liver
2- Normal liver
180Z-scoreUnknown100%95%90%In this study, the best textural characteristics for classifying livers were found. A novel classification approach employing information fusion was suggested. It consisted of a linear combination of features weighted according to how well they could separate classes.
[43]1- Normal
2- Mild
3- Moderate
4- Severe
unknownregression tree model0.9387.50%90%92.86%This study suggested that an existing learning-based model may perform well by combining US and shear wave features (shear wave attenuation, shear wave absorption, elasticity, dispersion slope, and echo attenuation). Furthermore, it supports that the target tissue may be identified and distinguished from other targets in the high-dimensional space established by the suggested ultrasonic parameter set.
[39]1- Normal
2- Fatty
100probabilistic neural network0.967496%98%100%GIST descriptors were used in this study to extract features. A marginal fisher analysis (MFA) data reduction method reduced many elements to the top seventeen. The Wilcoxon signed-rank test was used to create effective and reliable classifiers to rank a set of characteristics. Using eighteen features, the proposed approach identified all normal classes as normal (specificity was 100%). To train the classifiers, 10-fold stratified cross-validation was employed. The PNN classifier produced results with the highest classification accuracy of 98%, sensitivity of 96%, specificity, and PPV of 100%.
[40]1- normal
2-abnormal [fatty liver, hepatomegaly, cirrhosis]
62Levenberg–Marquardt back propagation neural networkUnknown0.98080.97580.9722The proposed system was successfully able to detect and classify the FLD.
[46]1- S0 (none),
2- S1 (mild),
3- S2 (moderate),
4- S3 (severed)
300Deep Convolutional Neural NetworkUnknownUnknown87.50%UnknownThe outcomes demonstrate the power of deep convolutional neural networks (DCNN) and the higher information richness of RF data over B-mode for NAFLD staging.
[52]1- Normal
2- Mild
3- Moderate
4- Severe
53support vector machineUnknownUnknown85.4%UnknownIn this study, classifying normal, mild, moderate, and severe liver images was objectified using medical domain knowledge to diagnose the severity of fatty liver images. Findings demonstrated that the classification accuracy for a given feature category, such as run-length matrix (RLM), may be improved by appending feature sets.
[83]1- normal liver
2- low-grade fatty liver
3- moderate grade fatty liver
4- severe fatty liver
500convolution neural networkUnknown83%90%95%The study covered the impact of network width on a model. The study found that correctly expanding the network model’s width increased the model’s accuracy. “Skip connection” expedites network convergence while preserving the image’s original features.
[70]1- normal
2- positive
744Support Vector Machine + Multi-Layered Perceptron Neural Net + Extreme Gradient BoostTraining set = 0.978
Testing set = 0.951
Validation set = 0.937
UnknownUnknownUnknownIn this study, twenty-eight features were retrieved from US images using Mazda software after wavelet transforms were applied to process images. Features were used to distinguish between a healthy liver and NAFLD in paediatric individuals using an ML-based predictive analytic model [ensemble model]. The model did well in classification.
[64]1- Fatty
2- Normal
550Fourier Convolutional Neural NetworksUnknownUnknown84.40%UnknownThis study suggested that to increase the classification speed of medical images, Fourier layers are more feasible.

4. Discussion

Even though the first empirical research on this review topic was published in 1996, it must be acknowledged that few in-depth studies on this topic have had conclusive findings. For instance, Figure 6 shows the differentiation of the studies based on three factors. Regarding AI methods, some studies used ML, while others used DL. Regarding outputs, some studies detected disease while others quantified it. This quantification focused on fatty liver disease or incorporated morbidity stages. If the protocol of this review defined studies that used DL to quantify fatty liver disease and its later morbidity phases, the number of studies would be relatively small.
Figure 7 depicts the process steps followed in all the studies. Most studies used the same method to design prediction models using US images of the liver. The process consisted of collecting images, processing images to extract features, processing features in the classifier, and making a prediction. However, other studies used varied approaches, potentially resulting in disparities in performance.
A turning point in the computerized automated detection of fatty liver disease was reached when Michal Byra conducted a study in 2018 [59]. In Byra’s work, hepatic feature extraction was done using Inception-ResNet-v2 architecture. On US scans obtained from fifty-five patients, quantitative validation was conducted (38 fatty livers, 17 healthy livers). An SVM classifier was used to classify the retrieved features, and the reported mean accuracy was 96.3 percent. Since 2018, most studies have used Byra’s work as a benchmark against which to compare their findings. Five studies reviewed in this work used Byra’s dataset [60,61,62,63,64]. Furthermore, it is crucial to emphasize the significance of two recent studies conducted in Taiwan, where a considerable number of images from various imaging modalities were used in each study [45,81].
The studies included in this review show that combining AI with US image analysis can reduce human-related mistakes and enhance overall performance. The studies also demonstrate the capacity of AI-integrated approaches to detect early-stage steatosis. The studies shows impressive AI-assisted US performance with great sensitivity, specificity, Positive Predictive Value (PPV), Negative Predictive Value (NPV), and accuracy.
Although most studies collected liver US images using Philips, Siemens, or GE modalities, it does not appear that the type of modality is related to the performance of the classification model. The modality settings and the frequency of the probe used in each study may also be observed similarly. Although some studies contend that utilizing a high frequency, such as 40 MHz, will result in greater classification performance (accuracy of 95%) [43], a comparative study using a low frequency, 5 MHz, scored the same performance [56]. It is worth mentioning that most studies used a frequency probe of 3.5 MHz.
Even though studies in this review processed images and chose ROIs in numerous ways, most of the studies unequivocally agreed on the importance of conducting these two processes. Regarding image pre-processing and ROI selection, no discernible patterns can be reported. Studies consistently standardized image size, removed irrelevant details, attempted to choose ROIs near images’ central lines, and avoided anomalies such as vessels and bile stores. Two studies successfully selected ROIs automatically. Ribeiro et al. based their approach on the decomposition of liver parenchyma US images in two fields—the speckled image holding textural information and the de-speckled image comprised of liver intensity and anatomical data [79]. Owjimehr et al.’s ROI selection process included three steps. First, images were divided into blocks and overlapped repeatedly. Second, sections of a specific size were chosen from the middle of each block. Finally, a linear support vector classifier was used to select the best ROIs from all those formed [55].
Most studies that used supervised ML reported selecting features for classification. While it is well known that the number of elements positively effects accuracy, feature types seem to have the most impact on accuracy. For example, a study that used 325 features to detect whether a liver was normal or steatotic scored an overall accuracy of 79.77% [51]. In comparison, another study that used only five features for the same purpose scored 100% accuracy [36]. The same can be seen with 636 features used and 85.4% accuracy in [69] and five features used and 87.5% accuracy in [44]. Likewise, one study selected 156 features and scored 85% accuracy [47], while another used only nine features and achieved 90.84% accuracy [75].
Regarding data splitting, different studies used different methodologies. However, using 80 to 90% of the data as a training dataset and 10% to 20% as a testing dataset were the most common splitting percentages. Furthermore, many studies used the 10-fold cross-validation method to validate data.
Studies have proved the efficiency of using DL classifiers to classify images, and medical images are no exception. DL algorithms use data to learn high-level features. This is a distinguishing feature of DL and a significant advancement over classical ML. As a result, DL minimizes the need to create a new feature extractor for each challenge. However, when it comes to US images for NAFLD, studies show that a neural network AI outperforms a non-neural network AI. More research and quantitative analyses are needed to accurately identify a superior algorithm among the ones described in this review.
Finally, the included studies reported many challenges and opportunities for improvement. The following is a list of the most important obstacles to overcome in future research:
  • to overcome problems that currently exist in some classifiers, such as speckle noise, semantic gap, computational time, dimensionality reduction, and accuracy of images retrieved from a large dataset;
  • to examine the effect of every parameter to improve the performance of the model;
  • to use a more extensive dataset acquired by different operators from different patients;
  • to consider a multipolar hospital;
  • to consider more diseases stages;
  • to use more advanced techniques to improve images before analysis;
  • to automate all steps as much as possible;
  • to examine more sophisticated features; and
  • to implement classification models in the hardware and transfer the technology to a clinical setting.

4.1. Clinical Implications

Although the studies did not elaborate on the clinical implications of suggested solutions and models, several studies attempted to discover the most appropriate models for healthcare settings, even if it meant sacrificing the quality of results. For example, one study attempted to reduce computation time and enhance speed by employing Fourier layers to standardize the modern technology in clinical settings [64]. Furthermore, the results in [58] suggested that SVM was best suited for differentiating diseased tissue in clinical practice, outperforming KNN and ANN.
Despite the above, several studies suggested that having a reliable technology that can be adapted to healthcare settings has clinical implications. The clinical implications were stated as secondary results, a conclusion, or recommended future works. The clinical implications are as follows:
  • US powered by AI can be used to integrate an index in place of the H-MRS index of the biopsy method, which is invasive, expensive, scarcely available, and unsettling for patients [36,44,77]. US powered by AI also lessens the workload and the need for biopsy since it is considered a preliminary test for selecting patients eligible for biopsy [39,81].
  • In the future, DL might be used to quantify NAFLD with the combined use of pathologic and laboratory tests [72].
  • Non-invasive techniques with excellent accuracy would be superior evaluation tools to biopsy [45,55].
  • Using AI on a 2D US liver scan will decrease subjectivity in diagnosing and increase reliability [37,45,57,72].
  • Given the rising incidence of NAFLD and the potential for permanent hepatic damage, early recognition of NAFLD and cirrhosis is essential for doctors to be able to advise on appropriate therapies to stop the onset of HCC and its associated consequences [37,44].
  • The accuracy of NAFLD detection with ultrasonography can be enhanced with the development of computer-aided diagnostic technology, especially for those less trained or operating in distant locations [50,51].
  • Various image processing techniques will improve image quality, enhancing clinical interpretations and grading performance [41,53,68,69,78].
  • Some methods provide a fully automated solution that will assist in determining the advantages of telehealth [40,56].
  • Future US devices will include functionalities for tissue analysis that are easier to implement in hardware [73].
Potential readers of this work might include healthcare practitioners and computer scientists to promote awareness of the importance of collaboration between the two fields. Healthcare professionals, for example, can supply the necessary dataset for fatty liver to computer scientists, who can then run additional tests and act on clinical validation and feedback.

4.2. Strengths

To the best of the researchers’ knowledge, this is the first review to investigate all AI strategies used to automate NAFLD detection and quantification. The search was sensitive and accurate since the most prominent health and information technology databases were searched using a well-developed search query and backward and forward reference list checking. Because this research does not focus on individual AI branches or stages, it may be considered comprehensive. As a result, the study presents a comprehensive view of AI’s function in monitoring fatty liver using US images. On the one hand, the review may be deemed high-quality since well-recommended criteria were followed during the creating, implementing, and reporting processes. On the other hand, it is possible to expand on this work.

4.3. Limitations

Despite data cross-checking between studies being used to fill any gaps in the gathered data, it could be a limitation that only one person carried out the review was. Another drawback is that the search conducted for this study only covered English studies. As a result, studies written in other languages were omitted. Finally, the analysis presented in this research is qualitative. Therefore, it would be preferable to contribute additional value to the topic by conducting a metadata analysis on some of the included papers.

5. Conclusions and Future Work

Over time, efforts to detect and classify fatty liver disease and its accompanying clinical stages more accurately than humans have increased. Most of the effort has been devoted to extracting features from processed images and employing these features to complete the task. Using ANNs, whether for extracting features or classifying, represents a significant step in the right direction.
For potential future work, more effort needs to be placed into creating models that tackle challenges and performing randomized clinical trials on more significant numbers of patients. The findings will help in the future development of explainable AI. Furthermore, more efforts must be devoted to processing images and extracting features to determine the most accurate stages of the images, taking into account the structural differences between the images. In addition, comparing computational complexity/power and classification accuracy should be considered a strategy for comparing DL methods with ML methods. This will lead to a more advantageous selection to detect and quantify NAFLD using US images.
As AI has received a lot of attention regarding its utilization in the healthcare sector, this study emphasizes the application of AI in fatty liver diagnosis and future problems. Our findings pave the way for computer scientists to focus on the use of AI in the diagnosis of fatty liver, particularly in the early stages of the illness, which is difficult to identify, especially for junior non-expert doctors. As a result, AI applications are critical in this domain to overcome challenges and avoid human mistake.

Author Contributions

Conceptualization, F.M.A.; methodology, F.M.A.; validation, F.M.A. and M.S.H.; formal analysis, F.M.A.; investigation, F.M.A.; resources, M.S.H.; data curation, F.M.A.; writing—original draft preparation, F.M.A.; writing—review and editing, F.M.A. and M.S.H.; visualization, F.M.A.; supervision, M.S.H.; project administration, F.M.A. and M.S.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Younossi, Z.; Tacke, F.; Arrese, M.; Sharma, B.C.; Mostafa, I.; Bugianesi, E.; Wong, V.W.-S.; Yilmaz, Y.; George, J.; Fan, J.; et al. Global Perspectives on Nonalcoholic Fatty Liver Disease and Nonalcoholic Steatohepatitis. Hepatology 2019, 69, 2672–2682. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Li, J.; Zou, B.; Yeo, Y.H.; Feng, Y.; Xie, X.; Lee, D.H.; Fujii, H.; Wu, Y.; Kam, L.Y.; Ji, F.; et al. Prevalence, incidence, and outcome of non-alcoholic fatty liver disease in Asia, 1999–2019: A systematic review and meta-analysis. Lancet Gastroenterol. Hepatol. 2019, 4, 389–398. [Google Scholar] [CrossRef] [PubMed]
  3. Mantovani, A.; Scorletti, E.; Mosca, A.; Alisi, A.; Byrne, C.D.; Targher, G. Complications, morbidity and mortality of nonalcoholic fatty liver disease. Metabolism 2020, 111, 154170. [Google Scholar] [CrossRef] [PubMed]
  4. Alswat, K.; Aljumah, A.A.; Sanai, F.M.; Abaalkhail, F.; Alghamdi, M.; Al Hamoudi, W.K.; Al Khathlan, A.; Al Quraishi, H.; Al Rifai, A.; Al Zaabi, M.; et al. Nonalcoholic fatty liver disease burden–Saudi Arabia and United Arab Emirates, 2017–2030. Saudi J. Gastroenterol. Off. J. Saudi Gastroenterol. Assoc. 2018, 24, 211. [Google Scholar]
  5. Romero-Gómez, M.; Zelber-Sagi, S.; Trenell, M. Treatment of NAFLD with diet, physical activity and exercise. J. Hepatol. 2017, 67, 829–846. [Google Scholar] [CrossRef] [Green Version]
  6. Altamirano, J.; Miquel, R.; Katoonizadeh, A.; Gonzalez-Abraldes, J.; Duarte-Rojo, A.; Louvet, A.; Augustin, S.; Mookerjee, R.; Michelena, J.; Smyrk, T.C.; et al. A Histologic Scoring System for Prognosis of Patients with Alcoholic Hepatitis. Gastroenterology 2014, 146, 1231–1239.e6. [Google Scholar] [CrossRef]
  7. Wong, V.W.; Chan, W.K.; Chitturi, S.; Chawla, Y.; Dan, Y.Y.; Duseja, A.; Fan, J.; Goh, K.-L.; Hamaguchi, M.; Hashimoto, E.; et al. Asia–Pacific Working Party on Non-alcoholic Fatty Liver Disease guidelines 2017—Part 1: Definition, risk factors and assessment. J. Gastroenterol. Hepatol. 2018, 33, 70–85. [Google Scholar] [CrossRef] [Green Version]
  8. Phisalprapa, P.; Supakankunti, S.; Charatcharoenwitthaya, P.; Apisarnthanarak, P.; Charoensak, A.; Washirasaksiri, C.; Srivanichakorn, W.; Srivanichakorn, W. Cost-effectiveness analysis of ultrasonography screening for nonalcoholic fatty liver disease in metabolic syndrome patients. Medicine 2017, 96, e6585. [Google Scholar] [CrossRef]
  9. Piccinino, F.; Sagnelli, E.; Pasquale, G.; Giusti, G.; Battocchia, A.; Bernardi, M.; Bertolazzi, R.; Bianchi, F.; Brunelli, E.; Budillon, G.; et al. Complications following percutaneous liver biopsy: A multicentre retrospective study on 68 276 biopsies. J. Hepatol. 1986, 2, 165–173. [Google Scholar] [CrossRef]
  10. Middleton, M.S.; Van Natta, M.L.; Heba, E.R.; Alazraki, A.; Trout, A.T.; Masand, P.; Brunt, E.M.; Kleiner, D.E.; Doo, E.; Tonascia, J.; et al. Diagnostic accuracy of magnetic resonance imaging hepatic proton density fat fraction in pediatric nonalcoholic fatty liver disease. Hepatology 2018, 67, 858–872. [Google Scholar] [CrossRef] [Green Version]
  11. Zhou, L.-Q.; Wang, J.-Y.; Yu, S.-Y.; Wu, G.-G.; Wei, Q.; Deng, Y.-B.; Wu, X.-L.; Cui, X.-W.; Dietrich, C.F. Artificial intelligence in medical imaging of the liver. World J. Gastroenterol. 2019, 25, 672–682. [Google Scholar] [CrossRef] [PubMed]
  12. Colom, R.; Karama, S.; Jung, R.E.; Haier, R.J. Human intelligence and brain networks. Dialog. Clin. Neurosci. 2010, 12, 489–501. [Google Scholar] [CrossRef] [PubMed]
  13. Ben-Israel, I. Towards Regulation of AI Systems: Global Perspectives on the Development of a Legal Framework on Artificial Intelligence [AI] Systems Based on the Council of Europe’s Standards on Human Rights, Democracy and the Rule of Law; Council of Europe: London, UK, 2020. [Google Scholar]
  14. Masuzaki, R.; Kanda, T.; Sasaki, R.; Matsumoto, N.; Nirei, K.; Ogawa, M.; Moriyama, M. Application of artificial intelligence in hepatology: Minireview. Artif. Intell. Gastroenterol. 2020, 1, 5–11. [Google Scholar] [CrossRef]
  15. LeCun, Y.; Bengio, Y.; Hinton, G. Deep learning. Nature 2015, 521, 436–444. [Google Scholar] [CrossRef] [PubMed]
  16. Sutton, R.S.; Barto, A.G. Reinforcement Learning: An Introduction, 2nd ed.; The MIT Press: Cambridge, MA, USA, 2017. [Google Scholar]
  17. Jamshidi, M.B.; Roshani, S.; Talla, J.; Lalbakhsh, A.; Peroutka, Z.; Roshani, S.; Parandin, F.; Malek, Z.; Daneshfar, F.; Niazkar, H.R.; et al. A Review of the Potential of Artificial Intelligence Approaches to Forecasting COVID-19 Spreading. AI 2022, 3, 493–511. [Google Scholar] [CrossRef]
  18. Jamshidi, M.B.; Heydari, M.; Talla, J.; Peroutka, Z.; Ahmadi, M.; Mehraeen, E.; Abdollahi, H.; Karimi, A. A comprehensive review of radiology smartphone applications. In Artificial Intelligence Strategies for Analyzing COVID-19 Pneumonia Lung Imaging; IOP Publishing Ltd.: Bristol, UK, 2022; Volume 1, p. 4. [Google Scholar]
  19. Alzubaidi, M.; Zubaydi, H.D.; Bin-Salem, A.A.; Abd-Alrazaq, A.A.; Ahmed, A.; Househ, M. Role of deep learning in early detection of COVID-19: Scoping review. Comput. Methods Programs Biomed. Updat. 2021, 1, 100025. [Google Scholar] [CrossRef] [PubMed]
  20. Biswas, M.R.; Alzubaidi, M.S.; Shah, U.; Abd-Alrazaq, A.A.; Shah, Z. A scoping review to find out worldwide COVID-19 vaccine hesitancy and its underlying determinants. Vaccines 2021, 9, 1243. [Google Scholar] [CrossRef] [PubMed]
  21. Srivastava, V.; Kumar, D.; Roy, S. A median based quadrilateral local quantized ternary pattern technique for the classification of dermatoscopic images of skin cancer. Comput. Electr. Eng. 2022, 102, 108259. [Google Scholar] [CrossRef]
  22. Pal, D.; Reddy, P.B.; Roy, S. Attention UW-Net: A fully connected model for automatic segmentation and annotation of chest X-ray. Comput. Biol. Med. 2022, 150, 106083. [Google Scholar] [CrossRef]
  23. Piscaglia, F.; Cucchetti, A.; Benlloch, S.; Vivarelli, M.; Berenguer, J.; Bolondi, L.; Pinna, A.D.; Berenguer, M. Prediction of significant fibrosis in hepatitis C virus infected liver transplant recipients by artificial neural network analysis of clinical factors. Eur. J. Gastroenterol. Hepatol. 2006, 18, 1255–1261. [Google Scholar] [CrossRef]
  24. Zhen, S.H.; Cheng, M.; Tao, Y.B.; Wang, Y.F.; Juengpanich, S.; Jiang, Z.Y.; Jiang, Y.K.; Yan, Y.Y.; Lu, W.; Lue, J.M.; et al. Deep learning for accurate diagnosis of liver tumor based on magnetic resonance imaging and clinical data. Front. Oncol. 2020, 10, 680. [Google Scholar] [CrossRef] [PubMed]
  25. Vanderbeck, S.; Bockhorst, J.; Komorowski, R.; Kleiner, D.E.; Gawrieh, S. Automatic classification of white regions in liver biopsies by supervised machine learning. Hum. Pathol. 2013, 45, 785–792. [Google Scholar] [CrossRef] [PubMed]
  26. Naganawa, S.; Enooku, K.; Tateishi, R.; Akai, H.; Yasaka, K.; Shibahara, J.; Ushiku, T.; Abe, O.; Ohtomo, K.; Kiryu, S. Imaging prediction of nonalcoholic steatohepatitis using computed tomography texture analysis. Eur. Radiol. 2018, 28, 3050–3058. [Google Scholar] [CrossRef]
  27. Lee, H.W.; Sung, J.J.Y.; Ahn, S.H. Artificial intelligence in liver disease. J. Gastroenterol. Hepatol. 2021, 36, 539–542. [Google Scholar] [CrossRef] [PubMed]
  28. Le Berre, C.; Sandborn, W.J.; Aridhi, S.; Devignes, M.D.; Fournier, L.; Smail-Tabbone, M.; Danese, S.; Peyrin-Biroulet, L. Application of artificial intelligence to gastroenterology and hepatology. Gastroenterology 2020, 158, 76–94. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Spann, A.; Yasodhara, A.; Kang, J.; Watt, K.; Wang, B.; Goldenberg, A.; Bhat, M. Applying machine learning in liver disease and transplantation: A comprehensive review. Hepatology 2020, 71, 1093–1105. [Google Scholar] [CrossRef] [PubMed]
  30. Wong, G.L.; Yuen, P.; Ma, A.J.; Chan, A.W.; Leung, H.H.; Wong, V.W. Artificial intelligence in prediction of non-alcoholic fatty liver disease and fibrosis. J. Gastroenterol. Hepatol. 2021, 36, 543–550. [Google Scholar] [CrossRef]
  31. Lupsor-Platon, M.; Serban, T.; Silion, A.; Tirpe, G.; Tirpe, A.; Florea, M. Performance of Ultrasound Techniques and the Potential of Artificial Intelligence in the Evaluation of Hepatocellular Carcinoma and Non-Alcoholic Fatty Liver Disease. Cancers 2021, 13, 790. [Google Scholar] [CrossRef]
  32. Popa, S.L.; Ismaiel, A.; Cristina, P.; Cristina, M.; Chiarioni, G.; David, L.; Dumitrascu, D.L. Nonalcoholic fatty liver disease: Implementing complete automated diagnosis and staging. A systematic review. Diagnostics 2021, 11, 1078. [Google Scholar] [CrossRef]
  33. Decharatanachart, P.; Chaiteerakij, R.; Tiyarattanachai, T.; Treeprasertsuk, S. Application of artificial intelligence in chronic liver diseases: A systematic review and meta-analysis. BMC Gastroenterol. 2021, 21, 10. [Google Scholar] [CrossRef]
  34. Ouzzani, M.; Hammady, H.; Fedorowicz, Z.; Elmagarmid, A. Rayyan—A web and mobile app for systematic reviews. Syst. Rev. 2016, 5, 210. [Google Scholar] [CrossRef] [PubMed]
  35. Flick, U. The SAGE Handbook of Qualitative Data Collection; Sage: Thousand Oaks, CA, USA, 2018. [Google Scholar] [CrossRef]
  36. Acharya, U.R.; Fujita, H.; Sudarshan, V.K.; Mookiah, M.R.; Koh, J.E.; Tan, J.H.; Hagiwara, Y.; Chua, C.K.; Junnarkar, S.P.; Vijayananthan, A.; et al. An integrated index for identification of fatty liver disease using radon transform and discrete cosine transform features in ultrasound images. Inf. Fusion 2016, 31, 43–53. [Google Scholar] [CrossRef]
  37. Acharya, U.R.; Raghavendra, U.; Fujita, H.; Hagiwara, Y.; Koh, J.E.; Hong, T.J.; Sudarshan, V.K.; Vijayananthan, A.; Yeong, C.H.; Gudigar, A.; et al. Automated characterization of fatty liver disease and cirrhosis using curvelet transform and entropy features extracted from ultrasound images. Comput. Biol. Med. 2016, 79, 250–258. [Google Scholar] [CrossRef] [PubMed]
  38. Kuppili, V.; Biswas, M.; Sreekumar, A.; Suri, H.S.; Saba, L.; Edla, D.R.; Marinhoe, R.T.; Sanches, J.; Suri, J.S. Extreme Learning Machine Framework for Risk Stratification of Fatty Liver Disease Using Ultrasound Tissue Characterization. J. Med. Syst. 2017, 41, 152. [Google Scholar] [CrossRef] [PubMed]
  39. Acharya, U.R.; Fujita, H.; Bhat, S.; Raghavendra, U.; Gudigar, A.; Molinari, F.; Vijayananthan, A.; Ng, K.H. Decision support system for fatty liver disease using GIST descriptors extracted from ultrasound images. Inf. Fusion 2016, 29, 32–39. [Google Scholar] [CrossRef]
  40. Saba, L.; Dey, N.; Ashour, A.; Samanta, S.; Nath, S.S.; Chakraborty, S.; Sanches, J.; Kumar, D.; Marinho, R.; Suri, J.S. Automated stratification of liver disease in ultrasound: An online accurate feature classification paradigm. Comput. Methods Programs Biomed. 2016, 130, 118–134. [Google Scholar] [CrossRef]
  41. Acharya, U.R.; Sree, S.V.; Ribeiro, R.; Krishnamurthi, G.; Marinho, R.; Sanches, J.; Suri, J.S. Data mining framework for fatty liver disease classification in ultrasound: A hybrid feature extraction paradigm. Med. Phys. 2012, 39, 4255–4264. [Google Scholar] [CrossRef] [Green Version]
  42. Biswas, M.; Kuppili, V.; Edla, D.R.; Suri, H.S.; Saba, L.; Marinhoe, R.T.; Sanches, J.; Suri, J.S. Symtosis: A liver ultrasound tissue characterization and risk stratification in optimized deep learning paradigm. Comput. Methods Programs Biomed. 2018, 155, 165–177. [Google Scholar] [CrossRef]
  43. Shi, X.; Ye, W.; Liu, F.; Zhang, R.; Hou, Q.; Shi, C.; Yu, j.; Shi, Y. Ultrasonic liver steatosis quantification by a learning-based acoustic model from a novel shear wave sequence. BioMed. Eng. OnLine 2019, 18, 121. [Google Scholar] [CrossRef] [Green Version]
  44. Gummadi, S.; Nirmal, P.; Naringrekar, H.; Needleman, L.; Lyshchik, A.; O’Kane, P.; Civan, J.; Eisenbrey, J.R. Automated Machine Learning in the Sonographic Diagnosis of Non-alcoholic Fatty Liver Disease. Adv. Ultrasound Diagn. Ther. 2020, 4, 176. [Google Scholar] [CrossRef]
  45. Li, B.; Tai, D.-I.; Yan, K.; Chen, Y.-C.; Chen, C.-J.; Huang, S.-F.; Hsu, T.-H.; Yu, W.-T.; Xiao, J.; Le, L.; et al. Accurate and generalizable quantitative scoring of liver steatosis from ultrasound images via scalable deep learning. World J. Gastroenterol. 2022, 28, 2494–2508. [Google Scholar] [CrossRef]
  46. Sanabria, S.J.; Dahl, J.; Pirmoazen, A.; Kamaya, A.; ElKaffas, A. Learning steatosis staging with two-dimensional Convolutional Neural Networks: Comparison of accuracy of clinical B-mode with a co-registered spectrogram representation of RF Data. In Proceedings of the 2020 IEEE International Ultrasonics Symposium (IUS), Las Vegas, NV, USA, 7–11 September 2020; pp. 1–4. [Google Scholar] [CrossRef]
  47. Pavlopoulos, S.; Kyriacou, E.; Koutsouris, D.; Blekas, K.; Stafylopatis, A.; Zoumpoulis, P. Fuzzy neural network-based texture analysis of ultrasonic images. IEEE Comput. Graph. Appl. 2000, 19, 39–47. [Google Scholar] [CrossRef]
  48. Kyriacou, E.; Pavlopoulos, S.; Koutsouris, D.; Zoumpoulis, P.; Theotokas, I. Computer assisted characterization of liver tissue using image texture analysis techniques on B-scan images. In Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Socie-ty. ‘Magnificent Milestones and Emerging Opportunities in Medical Engineering’ [Cat. No. 97CH36136], Chicago, IL, USA, 30 October–2 September 1997; pp. 806–809. [Google Scholar]
  49. Kyriacou, E.; Pavlopoulos, S.; Konnis, G.; Koutsouris, D.; Zoumpoulis, P.; Theotokas, L. Computer assisted characterization of diffused liver disease using image texture analysis techniques on B-scan images. In Proceedings of the 1997 IEEE Nuclear Science Symposium Conference Record, Albuquerque, NM, USA, 9–15 November 1997. [Google Scholar] [CrossRef]
  50. Reddy, D.S.; Bharath, R.; Rajalakshmi, P. A Novel Computer-Aided Diagnosis Framework Using Deep Learning for Classification of Fatty Liver Disease in Ultrasound Imaging. In Proceedings of the 2018 IEEE 20th International Conference on e-Health Networking, Applications and Services (Healthcom), Ostrava, Czech Republic, 17–20 September 2018; pp. 1–5. [Google Scholar] [CrossRef]
  51. Rhyou, S.-Y.; Yoo, J.-C. Cascaded Deep Learning Neural Network for Automated Liver Steatosis Diagnosis Using Ultrasound Images. Sensors 2021, 21, 5304. [Google Scholar] [CrossRef]
  52. Subramanya, M.B.; Kumar, V.; Mukherjee, S.; Saini, M. A CAD system for B-mode fatty liver ultrasound images using texture features. J. Med. Eng. Technol. 2014, 39, 123–130. [Google Scholar] [CrossRef]
  53. Mukherjee, S.; Chakravorty, A.; Ghosh, K.; Roy, M.; Adhikari, A.; Mazumdar, S. Corroborating the Subjective Classification of Ultrasound Images of Normal and Fatty Human Livers by the Radiologist through Texture Analysis and SOM. In Proceedings of the 15th International Conference on Advanced Computing and Communications (ADCOM 2007), Guwahati, India, 18–21 December 2007; pp. 197–202. [Google Scholar] [CrossRef]
  54. Neogi, N.; Adhikari, A.; Roy, M. Use of a novel set of features based on texture anisotropy for identification of liver steatosis from ultrasound images: A simple method. Multimedia Tools Appl. 2018, 78, 11105–11127. [Google Scholar] [CrossRef]
  55. Owjimehr, M.; Danyali, H.; Helfroush, M.S. An improved method for liver diseases detection by ultrasound image analysis. J. Med. Signals Sens. 2015, 5, 21–29. [Google Scholar] [CrossRef] [PubMed]
  56. Minhas, F.u.A.A.; Sabih, D.; Hussain, M. Automated Classification of Liver Disorders using Ultrasound Images. J. Med. Syst. 2011, 36, 3163–3172. [Google Scholar] [CrossRef] [PubMed]
  57. Alivar, A.; Danyali, H.; Helfroush, M.S. Hierarchical classification of normal, fatty and heterogeneous liver diseases from ultrasound images using serial and parallel feature fusion. Biocybern. Biomed. Eng. 2016, 36, 697–707. [Google Scholar] [CrossRef]
  58. Andrade, A.; Silva, J.S.; Santos, J.; Belo-Soares, P. Classifier Approaches for Liver Steatosis using Ultrasound Images. Procedia Technol. 2012, 5, 763–770. [Google Scholar] [CrossRef] [Green Version]
  59. Byra, M.; Styczynski, G.; Szmigielski, C.; Kalinowski, P.; Michałowski, Ł.; Paluszkiewicz, R.; Ziarkiewicz-Wróblewska, B.; Zieniewicz, K.; Sobieraj, P.; Nowicki, A. Transfer learning with deep convolutional neural network for liver steatosis assessment in ultrasound images. Int. J. Comput. Assist. Radiol. Surg. 2018, 13, 1895–1903. [Google Scholar] [CrossRef] [Green Version]
  60. Zamanian, H.; Mostaar, A.; Azadeh, P.; Ahmadi, M. Implementation of Combinational Deep Learning Algorithm for Non-alcoholic Fatty Liver Classification in Ultrasound Images. J. Biomed. Phys. Eng. 2021, 11, 73–84. [Google Scholar] [CrossRef] [PubMed]
  61. Simion, G.; Caleanu, C.; Barbu, P.A. Ultrasound liver steatosis diagnosis using deep convolutional neural networks. In Proceedings of the 2021 IEEE 27th International Symposium for Design and Technology in Electronic Packaging [SIITME], Timisoara, Romania, 27–30 October 2021; pp. 326–329. [Google Scholar]
  62. Che, H. Improved Nonalcoholic Fatty Liver Disease Diagnosis from Ultrasound Data Based on Deep Learning. Master’s Thesis, Rutgers, The State University of New Jersey, New Brunswick, NJ, USA, 2021. [Google Scholar]
  63. Mohammad, U.F.; Almekkawy, M. Automated Detection of Liver Steatosis in Ultrasound Images Using Convolutional Neural Networks. In Proceedings of the 2021 IEEE International Ultrasonics Symposium (IUS), Xi’an, China, 11–16 September 2021; pp. 1–4. [Google Scholar] [CrossRef]
  64. Mohammad, U.F.; Almekkawy, M. A Substitution of Convolutional Layers by FFT Layers—A Low Computational Cost Version. In Proceedings of the 2021 IEEE International Ultrasonics Symposium (IUS), Xi’an, China, 11–16 September 2021; pp. 1–3. [Google Scholar] [CrossRef]
  65. Singh, M.; Singh, S.; Gupta, S. A New Quantitative Metric for Liver Classification from Ultrasound Images. Int. J. Comput. Electr. Eng. 2012, 4, 605–607. [Google Scholar] [CrossRef] [Green Version]
  66. Singh, M.; Singh, S.; Gupta, S. An information fusion based method for liver classification using texture analysis of ultrasound images. Inf. Fusion 2014, 19, 91–96. [Google Scholar] [CrossRef]
  67. Li, W.; Huang, Y.; Zhuang, B.-W.; Liu, G.-J.; Hu, H.-T.; Li, X.; Liang, J.-Y.; Wang, Z.; Huang, X.-W.; Zhang, C.-Q.; et al. Multiparametric ultrasomics of significant liver fibrosis: A machine learning-based analysis. Eur. Radiol. 2018, 29, 1496–1506. [Google Scholar] [CrossRef]
  68. Chen, C.-I.; Chen, T.-B.; Lu, N.-H.; Du, W.-C.; Liang, C.-Y.; Liu, K.-I.; Hsu, S.-Y.; Lin, L.W.; Huang, Y.-H. Classification for liver ultrasound tomography by posterior attenuation correction with a phantom study. Proc. Inst. Mech. Eng. Part H J. Eng. Med. 2019, 233, 1100–1112. [Google Scholar] [CrossRef]
  69. Chen, J.-R.; Chao, Y.-P.; Tsai, Y.-W.; Chan, H.-J.; Wan, Y.-L.; Tai, D.-I.; Tsui, P.-H. Clinical Value of Information Entropy Compared with Deep Learning for Ultrasound Grading of Hepatic Steatosis. Entropy 2020, 22, 1006. [Google Scholar] [CrossRef]
  70. Das, A.; Connell, M.; Khetarpal, S. Digital image analysis of ultrasound images using machine learning to diagnose pediatric nonalcoholic fatty liver disease. Clin. Imaging 2021, 77, 62–68. [Google Scholar] [CrossRef]
  71. Rivas, E.C.; Moreno, F.; Benitez, A.; Morocho, V.; Vanegas, P.; Medina, R. Hepatic Steatosis detection using the co-occurrence matrix in tomography and ultrasound images. In Proceedings of the 20th Symposium on Signal Processing, Images and Computer Vision (STSIVA), Bogota, Colombia, 2–4 September 2015; pp. 1–7. [Google Scholar] [CrossRef] [Green Version]
  72. Cao, W.; An, X.; Cong, L.; Lyu, C.; Zhou, Q.; Guo, R. Application of Deep Learning in Quantitative Analysis of 2-Dimensional Ultrasound Imaging of Nonalcoholic Fatty Liver Disease. J. Ultrasound Med. 2019, 39, 51–59. [Google Scholar] [CrossRef]
  73. Kadah, Y.M.; Farag, A.A.; Zurada, J.M.; Badawi, A.M.; Youssef, A.M. Classification algorithms for quantitative tissue characterization of diffuse liver disease from ultrasound images. IEEE Trans. Med. Imaging 1996, 15, 466–478. [Google Scholar] [CrossRef]
  74. Badawi, A.M.; Derbala, A.S.; Youssef, A.-B.M. Fuzzy logic algorithm for quantitative tissue characterization of diffuse liver diseases from ultrasound images. Int. J. Med. Inform. 1999, 55, 135–147. [Google Scholar] [CrossRef]
  75. Mihailescu, D.M. Computer aided diagnosis method for steatosis rating in ultrasound images using random forests. Med. Ultrason. 2013, 15, 184–190. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  76. Huang, Y.; Han, X.; Tian, X.; Zhao, Z.; Zhao, J.; Hao, D. Texture analysis of ultrasonic liver images based on spatial domain methods. In Proceedings of the 2010 3rd International Congress on Image and Signal Processing, Yantai, China, 16–18 October 2010; Volume 2, pp. 562–565. [Google Scholar] [CrossRef]
  77. Colantonio, S.; Salvati, A.; Caudai, C.; Bonino, F.; De Rosa, L.; Pascali, M.A.; Germanese, D.; Brunetto, M.R.; Faita, F. A Deep Learning Approach for Hepatic Steatosis Estimation from Ultrasound Imaging. In Proceedings of the International Conference on Computational Collective Intelligence, Kallithea, Rhodes, Greece, 29 September–1 October 2021; Springer: Cham, Switzerland; pp. 703–714. [Google Scholar] [CrossRef]
  78. Suganya, R.; Kirubakaran, R.; Rajaram, S. Classification and Retrieval of Focal and Diffuse Liver from Ultrasound Images Using Machine Learning Techniques. In Proceedings of the First International Symposium on Signal Processing and Intelligent Recognition Systems (SIRS-2014), Trivandrum, India, 13–15 March 2014; Volume 264, pp. 253–261. [Google Scholar] [CrossRef]
  79. Ribeiro, R.; Marinho, R.; Sanches, J. Global and local detection of liver steatosis from ultrasound. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, USA, 28 August–1 September 2012; pp. 6547–6550. [Google Scholar]
  80. Kalyan, K.; Jakhia, B.; Lele, R.D.; Joshi, M.; Chowdhary, A. Artificial Neural Network Application in the Diagnosis of Disease Conditions with Liver Ultrasound Images. Adv. Bioinform. 2014, 2014, 708279. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  81. Chou, T.-H.; Yeh, H.-J.; Chang, C.-C.; Tang, J.-H.; Kao, W.-Y.; Su, I.-C.; Li, C.-H.; Chang, W.-H.; Huang, C.-K.; Sufriyana, H.; et al. Deep learning for abdominal ultrasound: A computer-aided diagnostic system for the severity of fatty liver. J. Chin. Med. Assoc. 2021, 84, 842–850. [Google Scholar] [CrossRef]
  82. Mitrea, D.; Nedevschi, S.; Cenan, C.; Platon, M.L. Exploring texture-based parameters for noninvasive detection of diffuse liver diseases and liver cancer from ultrasound images. In Proceedings of the 8th WSEAS International Conference on Mathematical Methods and Computational Techniques in Electrical Engineering, Bucharest, Romania, 16–18 October 2006. [Google Scholar]
  83. Zhang, L.; Zhu, H.; Yang, T. Deep Neural Networks for fatty liver ultrasound images classification. In Proceedings of the 2019 Chinese Control and Decision Conference (CCDC), Nanchang, China, 3–5 June 2019; pp. 4641–4646. [Google Scholar] [CrossRef]
  84. Constantinescu, E.C.; Udriștoiu, A.-L.; Udriștoiu, C.; Iacob, A.V.; Gruionu, L.G.; Gruionu, G.; Săndulescu, L.; Săftoiu, A. Transfer learning with pre-trained deep convolutional neural networks for the automatic assessment of liver steatosis in ultrasound images. Med. Ultrason. 2020, 23, 135–139. [Google Scholar] [CrossRef]
  85. Anderson, D.R.; Sweeney, D.J.; Williams, T.A.; Camm, J.D.; Cochran, J.J. Statistics for Business & Economics; Cengage Learning: Belmont, CA, USA, 2016. [Google Scholar]
  86. Sokolova, M.; Lapalme, G. A systematic analysis of performance measures for classification tasks. Inf. Process. Manag. 2009, 45, 427–437. [Google Scholar] [CrossRef]
Figure 1. Distribution of NAFLD population by fibrosis stage—2017 and 2030, adapted from [4].
Figure 1. Distribution of NAFLD population by fibrosis stage—2017 and 2030, adapted from [4].
Bioengineering 09 00748 g001
Figure 2. Example of NAFLD progression model [liver fibrosis can be divided into four stages (F1–4) as follows: F0—no fibrosis; F1—portal fibrosis without septa; F2—portal fibrosis and few septa; F3—numerous septa without cirrhosis; F4—cirrhosis, adapted from [4].
Figure 2. Example of NAFLD progression model [liver fibrosis can be divided into four stages (F1–4) as follows: F0—no fibrosis; F1—portal fibrosis without septa; F2—portal fibrosis and few septa; F3—numerous septa without cirrhosis; F4—cirrhosis, adapted from [4].
Bioengineering 09 00748 g002
Figure 3. Method Summary.
Figure 3. Method Summary.
Bioengineering 09 00748 g003
Figure 4. Selected studies’ relevance and recommended papers.
Figure 4. Selected studies’ relevance and recommended papers.
Bioengineering 09 00748 g004
Figure 5. PRISMA diagram for study selection.
Figure 5. PRISMA diagram for study selection.
Bioengineering 09 00748 g005
Figure 6. Separation of studies based on three factors.
Figure 6. Separation of studies based on three factors.
Bioengineering 09 00748 g006
Figure 7. Methodology used to design models.
Figure 7. Methodology used to design models.
Bioengineering 09 00748 g007
Table 1. Inclusion and Exclusion Criteria.
Table 1. Inclusion and Exclusion Criteria.
ParametersInclusion CriteriaExclusion Criteria
PopulationPatients with Hepatic Steatosis (NAFLD) and developed stages.- Alcoholic fatty liver disease (AFLD) includes simple AFLD and alcoholic steatohepatitis (ASH).
- Patients suffering from liver illnesses other than steatosis (e.g.,: tumors).
InterventionAI that used ultrasound images to detect and quantify hepatic steatosis.Non-AI-based technologies and AI technologies used other types of imaging (MRI, X-ray, etc.)
ComparatorN/AN/A
OutcomeDetection and quantification of hepatic steatosis.Any other outcome that is not mentioned in the inclusion criteria
Performance measuresThe metrics to be measured are accuracy, sensitivity (recall), specificity, or AUC.Any other measures that are not mentioned in the inclusion criteria
Study TypePeer-reviewed articles, theses, dissertations, and reports.Reviews, conference abstracts, and proposals.
Study DesignEmpirical studies.Any other study design that is not mentioned in the inclusion criteria
Study languageEnglishStudies written in any language other than English.
Study time frameNo limitationNo limitation
Age, Gender, EthnicityNo limitationNo limitation
Table 2. Number of studies sorted by AI type.
Table 2. Number of studies sorted by AI type.
CountryTotal Number of StudiesStudies with Deep Learning Classifying ApproachStudies with Machine Learning Classifying ApproachPublication Period *
India8 (≈16%)172007 → 2019
USA7 (≈16%)521996 → 2021
China5 (≈10%)232010 → 2020
Portugal5 (≈10%)142012 ← 2018
Romania4 (≈8%)222006 → 2021
Taiwan4 (≈8%)312019 → 2021
Greece3 (≈6%)031997 ← 2000
Iran3 (≈6%)032015 ← 2021
Malaysia3 (≈6%)032016
Italy2 (≈4%)112016–2021
Egypt1 (≈2%)011999
Korea1 (≈2%)102021
Pakistan1 (≈2%)012012
Poland1 (≈2%)102018
Venezuela1 (≈2%)012015
Total4917 (≈35%)32 (≈56%)1996 → 2021
*: The arrow indicates an increase or a decrease in studies over time.
Table 3. Modalities and frequencies used.
Table 3. Modalities and frequencies used.
Modality Manufacturer Modalities ModelAverage Frequencies in MHzStudies Reference Number
PhilipsCX 503.5[36,37,38,39,40]
CX c503[41,42]
EPIQ40[43]
EPIQ 7G3[44,45,46]
HD15-[45]
IU22-[44,45]
SiemensACUSON 128XP/103.5[47,48,49]
ACUSON S1000-[50]
ACUSON S2000-[45]
ACUSON sequoia 5124.5[51]
ACUSON X300-[52]
Sonoline Versa Plus3.5[53,54]
ToshibaSSA-700A-[45]
SSA 5505[55,56,57]
Xario-[45]
TUS-A300-[45]
GELogic E94[44,45,58]
Vivid E92.5[59,60,61,62,63,64]
Voluson 730 Pro3.5[65,66]
Logic S8-[45]
CanonAplio 5003.5[44,67]
i800-[44]
HitachiAvius-[45]
Preirus-[45]
CIRS040GSE-[68]
BurlingtonTerason 30003.5[69]
SonositeM-Turbo3[70]
ESAOTEMyLab 50-[71]
MindrayResona 75[72]
KRETZ SA 32004[73,74]
UnknownUnknown-[75,76,77,78,79,80,81,82,83]
Table 4. Data splitting rates.
Table 4. Data splitting rates.
InAI learning TypeRef. No.
≈50%, 50%, 0%machine learning[43,48,78]
≈56%, 44%, 0%Machine learning[82]
≈60%, 20%, 20%Machine learning[45]
≈60%, 40%, 0%Deep learning[77]
≈60%, 40%, 0%machine learning[81]
≈70%, 30%, 0%Deep learning[71]
≈70%, 30%, 0%machine learning[44,51]
≈75%, 25%, 0%Deep learning[72]
≈78%, 28%, 0%Deep learning[69]
≈79%, 21%, 0%Deep learning[70]
≈80%, 10%, 10%machine learning[84]
≈80%, 20%, 0%Deep learning[60,62]
≈80%, 20%, 0%machine learning[59,63]
≈80%, 9%, 11%Deep learning[61]
≈84%, 16%, 0%Deep learning[64]
≈88%, 12%, 0%Deep learning[83]
≈92%, 18%, 0%Deep learning[54]
≈94%, 6%, 0%Deep learning[46]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Alshagathrh, F.M.; Househ, M.S. Artificial Intelligence for Detecting and Quantifying Fatty Liver in Ultrasound Images: A Systematic Review. Bioengineering 2022, 9, 748. https://doi.org/10.3390/bioengineering9120748

AMA Style

Alshagathrh FM, Househ MS. Artificial Intelligence for Detecting and Quantifying Fatty Liver in Ultrasound Images: A Systematic Review. Bioengineering. 2022; 9(12):748. https://doi.org/10.3390/bioengineering9120748

Chicago/Turabian Style

Alshagathrh, Fahad Muflih, and Mowafa Said Househ. 2022. "Artificial Intelligence for Detecting and Quantifying Fatty Liver in Ultrasound Images: A Systematic Review" Bioengineering 9, no. 12: 748. https://doi.org/10.3390/bioengineering9120748

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop