Next Article in Journal
Study of Angiogenic, Pro-Apoptotic, and Pro-Inflammatory Factors in Congenital and Acquired Cholesteatomas
Previous Article in Journal
Pain in High-Dose-Rate Brachytherapy for Cervical Cancer: A Retrospective Cohort Study
Previous Article in Special Issue
Contrast-Induced Acute Kidney Injury and Endothelial Dysfunction: The Role of Vascular and Biochemical Parameters
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
JPM
Volume 13
Issue 8
10.3390/jpm13081188
jpm-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluation of Plasma miR-17-5p, miR-24-3p and miRNA-223-3p Profile of Hepatitis C Virus-Infected Patients after Treatment with Direct-Acting Antivirals

by
Zehra Öksüz
1,*,
Laura Gragnani
2,3,
Serena Lorini
2,
Gülhan Örekici Temel
4,
Mehmet Sami Serin
1 and
Anna Linda Zignego
2,*
1
Department of Pharmaceutical Microbiology, Faculty of Pharmacy, Mersin University, 33160 Mersin, Turkey
2
MASVE Interdepartmental Hepatology Center, Department of Experimental and Clinical Medicine, University of Florence, Center for Research and Innovation CRIA-MASVE, AOU Careggi, 50134 Firenze, Italy
3
Department of Translational Research & New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy
4
Department of Biostatistics, Faculty of Medicine, Mersin University, 33343 Mersin, Turkey
*
Authors to whom correspondence should be addressed.
J. Pers. Med. 2023, 13(8), 1188; https://doi.org/10.3390/jpm13081188
Submission received: 29 June 2023 / Revised: 21 July 2023 / Accepted: 24 July 2023 / Published: 26 July 2023
(This article belongs to the Special Issue New Biomarkers for Diagnosis and Therapy in Civilization Diseases)
Browse Figures
Versions Notes

Abstract

:
The expression of miR-223-3p, miR-17-5p, and miR-24-3p was evaluated in hepatitis C virus (HCV) patient serum samples, collected before DAA treatment and after a sustained virological response (SVR). Fifty HCV patients were stratified based on their liver damage stages into three different subgroups (21 with chronic hepatitis—CH, 15 with cirrhosis, and 14 with hepatocellular carcinoma—HCC). Considering the entire HCV population, the miRNA expression levels were significantly downregulated after the SVR compared to pre-treatment ones (p < 0.05). Stratifying the patients based on liver damage, the post-SVR values of the three miRNAs were significantly downregulated compared to the pre-treatment levels for both cirrhosis and HCC patients. No significant differences emerged from the analysis of the CH group. To our knowledge, this is the first study to detail the behavior of miR-223-3p, miR-17-5p, and miR-24-3p levels in patients with HCV-related CH, cirrhosis, and HCC after DAA therapy. Our findings show that HCV-infected patients have different miRNA profiles before and after treatment with DAAs, strongly suggesting that miRNAs may be involved in the pathogenesis of HCV-related damage. In this respect, the correlation observed among the three studied miRNAs could imply that they share common pathways by which they contribute the progression of HCV-induced chronic liver damage.

1. Introduction

The hepatitis C virus (HCV) is a major cause of serious liver disease, by which approximately 71 million people worldwide are affected [1]. In the long-term clinical history of chronic hepatitis C (CHC) infection, liver injury can range from minimal necroinflammatory changes to serious liver complications such as fibrosis, cirrhosis, and hepatocellular carcinoma (HCC) [2]. HCC is the sixth most commonly diagnosed cancer and the fourth leading cause of cancer mortality in the world [3]. In the past, the standard treatment for HCV infection was pegylated interferon (Peg-IFN)/ribavirin (RBV) until, in 2014, direct-acting antiviral (DAA) agents became available. DAA therapies, whose primary targets are non-structural proteins (HCV NS3/4A, NS5A, and NS5B), inhibit critical steps in the HCV replication cycle. The first direct-acting antiviral protease inhibitors, boceprevir and telaprevir, were approved by the United States Food and Drug Administration (FDA) in 2013. Since then, many highly effective and well-tolerated DAA regimens have been developed, which consist of various combinations of simeprevir, daclatasvir, sofosbuvir, ledipasvir/sofosbuvir, ombitasvir/paritaprevir/ritonavir plus dasabuvir, sofosbuvir/velpatasvir, elbasvir/grazoprevir, sofosbuvir/velpatasvir/voxilaprevir, and glecaprevir/pibrentasvir [4]. DAA therapy has revolutionized hepatitis C treatment by increasing sustained viral response rates (SVR) by over 90–100% [5,6]. These treatments have very low toxicity and can be administrated for short periods (two or three months); they are usually pan-genomic drugs and, because of their excellent tolerance compared to IFN therapy, assure a high level of compliance [7].
In HCV infection, host factors, as well as viral factors, play a role in the induction and maintenance of inflammation, liver fibrosis, and/or tissue regeneration. Treatment should both ensure virus clearance and improve host-related factors [8]. However, the regulation of inflammatory and fibrosis biomarkers associated with HCV eradication after DAA treatment is still unclear, and also the clinical effects of treatment with these antivirals are not yet fully known. The emergence of conflicting data in the literature regarding the increased risk of HCC in patients following treatment with DAA agents has led to controversy [9,10,11]. In the literature, some researchers have found unexpected recurrent HCC following DAA therapy [9], while other researchers have shown no significant risk [11]. This issue has led to increased clinical interest, resulting in different studies and metanalyses that have demonstrated a decrease in the HCC onset rate in HCV patients treated with DAA [12,13].
Recent studies have shown that host-related molecular factors can play an important role in determining the course of HCV infection [14]. Together with genetic predisposition, epigenetic regulators such as microRNA (miRNA) expression can make an extremely important contribution to the physiological processes as well as to the pathogenesis of several diseases. microRNAs are a class of endogenous 19–25-nucleotide long non-coding RNA molecules regulating a wide variety of genes by blocking the translation of complementary mRNAs [15]. Therefore, microRNAs have been associated with many events in a wide range of biological pathways, such as cellular development, differentiation, proliferation, metabolism, immunity, and death [16,17]. As with other viruses, HCV interacts with cellular miRNAs that can help in the replicative process. In fact, it is known that in different stages of the life cycle of HCV, some microRNAs, such as miR-122, can increase the virus replication rate and contribute to the spread of the infection in the hepatocytes [16,18]. On this basis, miR-122 has been identified as an essential host factor for new viral particle production and for the efficient replication of HCV [19], providing one of the first pieces of evidence that a host miRNA can contribute to an infectious process in humans [20].
miRNA expression is often modulated by up- or downregulation in HCV infection and its complications, such as fibrosis, cirrhosis, and HCC [21]. It has been shown that circulating miRNAs are candidate non-invasive biomarkers for the diagnosis of liver fibrosis, cirrhosis, and HCC [22,23]. In this context, the analysis of circulating miRNA expression, which can serves as biomarkers in HCV-related complications, may be important to support the long-term monitoring and clinical management of patients.
In the current study, the expression profiles of miR-17-5p, miR-24-3p, and miR-223-3p from the serum of 50 HCV patients (21 chronic hepatitis (CH), 15 cirrhosis, and 14 hepatocellular carcinoma (HCC)) were evaluated both pre- (baseline) and post-treatment with DAAs. This study aimed to analyze the levels of these three circulating miRNAs in patients with CH, cirrhosis, and HCC treated with DAAs and to show their modulation after treatment.

2. Materials and Methods

2.1. Study Population

The blood samples of 50 HCV patients, 21 with CH, 15 with cirrhosis, and 14 with HCC, obtained both before and after treatment with DAAs, were retrospectively included in this study. The serum of these patients was collected before treatment (baseline) and 6 months after the end of treatment with DAAs. The clinical follow-up of the patients was performed at the Interdepartmental Hepatology Center MaSVE (Systemic Manifestations of Hepatitis Viruses), Department of Experimental and Clinical Medicine, University of Florence. In this study, elevated liver enzymes (ALT, alanine aminotransferase; AST, aspartate aminotransferase) and the presence of HCV-RNA in serum were considered as inclusion criteria; co-infection with other viruses (such as hepatitis B virus (HBV), human immunodeficiency virus (HIV)) and the presence of other liver diseases and various comorbidities (e.g., rheumatoid arthritis, systemic lupus erythematosus, and myotonic dystrophy type 1) were exclusion criteria. The HCV RNA titer and genotype were determined as routine tests.
Liver disease was evaluated by non-invasive methods including liver elastography using FibroScan (Echos-ens, Paris, France), imaging, clinical presentation, and laboratory data; the METAVIR score system was used to assess the severity of liver disease.
The clinical and demographic data obtained from the routine examinations of the patients and the used DAAs are summarized in Table 1. The whole study was conducted according to the Declaration of Helsinki and approved by the Ethical Committee (BIO.16.014).

2.2. RNA Isolation and Reverse Transcription

According to the manufacturer’s protocol, RNA isolation from plasma samples was performed using the miRNeasy Serum/Plasma Advanced Isolation Kit (Qiagen, Hilden, Germany). RNA was stored at −20 °C until reverse transcription. Isolated RNA (160 nanograms for each sample) was reverse-transcribed using the M-MVL reverse transcriptase (Promega, Milan, Italy) kit. Reverse transcription was carried out using a Rotor-Gene Q Real-Time PCR System (Qiagen, Hilden, Germany) for 10 min at 25 °C, 50 min at 37 °C, and 15 min at 70 °C conditions.

2.3. Quantitative Real-Time PCR (RT-qPCR)

qPCR reaction was carried out in a Rotor-Gene Q Real-Time PCR System (Qiagen, Hilden, Germany) using the GoTaq® Probe qPCR Master Mix (Promega, Italy) and specific TaqMan MicroRNA Assays (Applied Biosystems, Foster City, CA, USA), according to the manufacturer’s instructions. Relative expression levels of the different miRNAs were evaluated using RNU48 small-nucleolar RNA as a housekeeping RNA. Reactions were run as duplicates for each sample.

2.4. Statistical Analysis

Through RT-PCR, we analyzed the expression levels of miR-223-3p, miR-17-5p, and miR-24-3p. RNU48 was used as an endogenous control. Threshold cycle (Ct) data from the RT-PCR quantification cycle were analyzed via relative quantification by the 2-ΔΔCT method [24]. As descriptive statistics, numbers and percentages were given for categorical variables. The mean standard deviation values were given for the continuous variables. A paired-sample t-test was preferred for continuous variables and the McNemar test was preferred for categorical variables, to control for differences between pre- and post-treatment measurements in each group. The correlation coefficient was used to test the relationships between miRNA measurements, and a scatter diagram was preferred to present the visual relationships between the variables. A graph of fold changes was plotted to represent the variation between miRNAs pre-treatment versus post-treatment. p < 0.05 was considered statistically significant.

3. Results

3.1. Patient Characteristics

The patient population included 50 HCV patients (mean age, 67.46 ± 11.75), and 19/50 (38%) were females. Of these patients, 21 had CH (mean age, 65.90 ± 11.61), 15 had cirrhosis (mean age 66.67 ± 12.50), and 14 had HCC (mean age 70.64 ± 11.33). The most common HCV genotype was 1b (56%). Patients included in the study underwent anti-HCV IFN-free treatment with DAAs according to their genotypes (Table 1). In addition, 17 (34%) patients were treatment-naïve, whereas seven (14%) had been previously treated with Peg-IFN + RBV and 10 (20%) with Peg-IFN + RBV +/− BOC or +/− TEL. The pre-DAA treatment regimens of 16 patients (32%) were unknown. The pre- and post-treatment ALT, AST, and HCV RNA levels of the 50 HCV patients, and the different subgroups (CH, cirrhosis, and HCC), were compared and, as expected due to the different stages of liver damage, the variation was statistically significant (p < 0.05) (Table 1). A sustained virological response (SVR), defined as the absence of HCV RNA in the serum 12 weeks after the end of treatment, was observed in all patients after antiviral treatment with DAAs.

3.2. Analysis of miRNA Expression

In this study, the expression levels of pre-treatment miR-223-3p, miR-17-5p, and miR-24-3p were compared with post-treatment levels in both the total population of 50 HCV patients and in the different patient subgroups (CH, cirrhosis, HCC). In the 50 HCV patients, the expression levels of miR-17-5p, miR-223-3p, and miR-24-3p were significantly lower post-treatment compared to pre-treatment (p < 0.05). (Figure 1). Considering the different groups, in the CH patients (n = 21), the decrease in the expression of these three miRNAs post-treatment did not reach a significant difference (p > 0.05) (Figure 2). By contrast, in the cirrhosis patient group (n = 15), the expression levels of miR-17-5p, miR-24-3p, and miR-223-3p were significantly higher pre-treatment compared to post-treatment (p < 0.05) (Figure 3). In the HCC patient group (n = 14), miR-24-3p and miR-223-3p were significantly downregulated post-treatment compared to pre-treatment; concerning miR-17-5p expression, the level decreased without reaching statistical significance, (p > 0.05) (Figure 4). The expression levels and p values of the studied miRNAs are shown in Figure 1, Figure 2, Figure 3 and Figure 4 together with the fold change analysis obtained by considering the pre-treatment value as a calibrator.

3.3. Pre- and Post-Treatment miRNA Expression Correlation

The correlation of miR-17-5p, miR-24-3p, and miR-223-3p expression pre- and post-treatment was examined in the total group of 50 HCV patients. A strong linear correlation was found between the value of pre-treatment miR-24-3p and both pre-treatment miR-223-3p (p< 0.001) and pre-treatment miR-17-5p (p < 0.001). In addition, a high level of linear correlation was found between the values of post-treatment miR-24-3p and post-treatment miR-223-3p (p < 0.001). A strong linear correlation was found between the values of post-treatment miR-223-3p and post-treatment miR-17-5p (p = 0.001). Similarly, a strong linear correlation was found between the pre-treatment miR-17-5p and the pre-treatment miR-223-3p values (p< 0.001). However, a moderate linear relationship was detected between pre-treatment miR-24-3p and post-treatment miR-17-5p (p = 0.001), post-treatment miR-24-3p and post-treatment miR-17-5p (p = 0.002), pre-treatment miR-223-3p and post-treatment miR-17-5p (p = 0.003), and pre-treatment miR-24-3p and post-treatment miR-17-5p (p < 0.001). Pre- and post-treatment and miRNA expression correlation comparisons are shown in Table 2 and Figure 5.

4. Discussion

The risk of developing liver-related complications in HCV-infected patients who achieve an SVR after treatment with DAAs is controversial [25]. Therefore, patients with HCV, particularly those with advanced liver damage, should still be monitored for signs of liver disease progression, even if they achieve an SVR after DAA therapy [26]. Recently, it has been shown that miRNAs may play a role in the regeneration or progression of liver damage in patients with chronic HCV infection [27,28]. In this study, we investigated the expression of miR-17-5p, miR-24-3p, and miR-223-3p in the sera of HCV-infected patients after treatment with DAAs to determine the effect of DAA treatment and viral eradication on host factors reputed to play an important role in the pathogenesis of liver damage. To perform this analysis, circulating levels of plasma miR-17-5p, miR-24-3p, and miR-223-3p were measured in matched samples of CH, cirrhosis, and HCC patients pre- (baseline) and post-antiviral therapy (6 months after treatment). Our findings showed that the expression of the miRNAs included in the study was downregulated after DAA treatment in the total population of HCV patients, with different patterns of expression in different HCV-related conditions: CH, cirrhosis, and HCC.
In fact, the miR-17-5p expression level was found to be significantly downregulated in the post-treatment period compared to pre-treatment with DAAs in the cirrhosis group, but not in the HCC one. miR-17-5p, a member of the miR-17-92 polycistron family, is overexpressed in many cancers, including HCC [22,29,30]. A study revealed that miR-17-5p has an important role in the carcinogenesis and development of HCC by significantly activating the p38 mitogen-activated protein kinase (MAPK) pathway and increasing the phosphorylation of heat shock protein 27 (HSP27) [31]. Chen et al. reported that miR-17-5p was upregulated in patients with HCC and may be a prognostic biomarker for HCC [32]. In a study by Yu et al., they showed that the serum miR-17-5p levels of patients with cirrhosis were significantly higher than those of healthy controls, and that the inhibition of this miRNA led to the suppression of hepatic stellate cell proliferation induced by transforming growth factor-β1 (TGF-β1) [33]. In addition, in a previous study that we performed, in which we detected miRNAs with significant expression at all stages of the disease, from CHC to cirrhosis and HCC, miR-17-5p levels were upregulated in both HCV-related cirrhosis and HCV-related HCC patients compared to healthy controls [22]. In a recent study that we conducted in the Turkish population, we examined the serum levels of this miRNA in CH patients who achieved an SVR after treatment with ombitasvir/paritaprevir/ritonavir + dasabuvir ± ribavirin [34]. Serum miR-17-5p levels were found to be significantly downregulated post-treatment compared to pre-treatment, thus supporting the present study conducted in the Italian population.
In recent studies, the role of miR-24-3p, which showed differences in expression in the initiation, progression, and metastasis of various cancer types [35], was confirmed also in HCC [36,37]. Zeng et al. [36] showed that the upregulation of miR-24-3p was inversely correlated with that of CASC2 and that it reversed growth inhibition in HCC cells. Dong et al. [37] reported that miR-24-3p played an important role in the initiation and progression of HCC by targeting metallothionein 1M. In a previous study by our group, the expression of this miRNA was shown to be upregulated in HCV-associated HCC patients compared to a healthy control group, in accordance with the literature [22]. In addition, in the study that we conducted in the Turkish population, it was found that the expression of miR-24-3p decreased in HCV patients who achieved an SVR after treatment with ombitasvir/paritaprevir/ritonavir + dasabuvir ± ribavirin [34]. Consistent with our previous results, in the present study performed in the Italian population, miR-24-3p expression was significantly downregulated after treatment with DAAs in the total population of HCV patients, as well as in the cirrhosis and HCC subgroups. After DAA treatment, the decreased expression levels of miR-17-5p and miR-24-3p (miRNAs upregulated in advanced stages of hepatitis C) in patients with cirrhosis and HCC suggest that treatment with new-generation DAAs positively affects the immunopathogenesis of these conditions. By contrast, Hyrina et al. [38] reported that miR-24 and miR-223 levels were significantly increased in patients who obtained an SVR with IFN-based antiviral treatment (Peg-IFN-α and RBV ± boceprevir (BOC) or telaprevir (TPV)), strongly suggesting the opposite effect of the pro-inflammatory IFN cytokine, possibly in combination with various factors, such as the genetic background and the different severity stages of liver disease.
Another miRNA emerging from the HCV-related HCC literature is miR-223-3p. miR-223-3p, targeting the pyrin alanine-containing NOD-like receptor family 3 (NLRP3) in HCC cells, has been shown to play an important role in this tumor’s biology, and it may be useful to ascertain the prognosis of the liver damage related to HCV infection [39]. Shaker et al. [40] showed that miR-223 was upregulated in advanced fibrosis (≥F3) compared to HCV-related early stages of fibrosis in Egyptian patients. Moreover, another study reported that this miRNA was upregulated in HCV-related HCC patients compared to healthy controls [41]. In contrast, our study group [22] and several others [42,43] previously reported that miR-223-3p is downregulated in HCC and may be a potential biomarker for the diagnosis of this type of cancer. On the other hand, a recent study highlighted that the expression of circulating miRNA-223 showed no significant difference between HCV, HCV-related cirrhosis, and HCC [44]. Our data showed that miR-223-3p expression, similarly to miR-24-3p, was significantly downregulated after treatment with DAAs in patients affected by cirrhosis and in subjects with HCC, but not in patients with CH. Interestingly, in our previous study performed in a Turkish population of HCV patients, it was shown that the expression of this miRNA in HCV patients who achieved an SVR after treatment with ombitasvir/paritaprevir/ritonavir + dasabuvir ± ribavirin was decreased, even if the difference did not reach statistical significance [32]. This may be due to the difference in the number of patients included in the study, to the geographical origin of the populations that we analyzed (Turkish and Italian), to the HCV genotypes affecting the patients included in the study, and to the different methods used to process the ex vivo samples and for the miRNA extraction, detection, and normalization.
Another striking result regarding the miRNAs included in the study was the high level of correlation observed in the plasma levels of circulating miR-17-5p, miR-24-3p, and miR-223-3p pre-treatment with DAAs. This suggests that there may be a close link between these miRNAs, which may result from common pathways or target genes, or that they contribute to shared mechanisms.

5. Conclusions

To our knowledge, this is the first study detailing the potential diagnostic value of miR-17-5p, miR-24-3p, and miR-223-3p in patients with chronic HCV-related liver diseases (CH, cirrhosis, and HCC) after DAA therapy. In conclusion, our findings show that HCV-infected patients have different microRNA profiles before and after treatment with DAAs and that the differences in their deregulation seem to be associated with particular steps in the progression of liver damage. In particular, this study suggests that miR-17-5p and miR-24-3p play an important role in the pathogenesis of HCV-related CH, cirrhosis, and HCC and may be potential therapeutic targets. In other words, this study provides preliminary data to elucidate the pathogenetic pathways underlying the progression of HCV-related liver damage, suggesting the importance of further studies clarifying, at the molecular level, the roles and mechanisms of these miRNAs in HCV infection. This will be made possible by analyzing larger populations of patients and taking into account the different grades of progression (both hepatic and extrahepatic) of the HCV chronic infection.

Author Contributions

Conceptualization, Z.Ö. and L.G.; methodology, Z.Ö., S.L. and L.G.; investigation, A.L.Z. and M.S.S.; data curation, L.G., S.L. and G.Ö.T.; writing—original draft preparation, Z.Ö., L.G. and S.L.; writing—review and editing, Z.Ö., L.G., S.L., A.L.Z., M.S.S. and G.Ö.T.; supervision, Z.Ö., A.L.Z. and M.S.S.; project administration, Z.Ö. and A.L.Z.; funding acquisition, Z.Ö. and A.L.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by the Federation of European Microbiological Societies (FEMS) under grant FEMS-Go-2018-205 and by the Ricerca Finalizzata 2016 under RF-2016-02364053 (PI Prof. A.L. Zignego).

Institutional Review Board Statement

The present study was performed in accordance with the Declaration of Helsinki and was approved by the Ethics Committee of Area Vasta Centro (approval number: BIO.16.014).

Informed Consent Statement

All patients have given informed consent for their blood to be used for research purposes.

Data Availability Statement

Data can be requested from the corresponding author.

Conflicts of Interest

The authors declare that they have no conflict of interest.

References

  1. European Association for the Study of the Liver. EASL recommendations on treatment of hepatitis C: Final update of the series. J. Hepatol. 2020, 73, 1170–1218. [Google Scholar] [CrossRef] [PubMed]
  2. Morgan, R.; Baack, B.; Smith, B.D.; Yartel, A.; Pitasi, M.; Falck-Ytter, Y. Eradication of hepatitis C virus infection and the development of hepatocellular carcinoma: A meta-analysis of observational studies. Ann. Intern. Med. 2013, 158, 329–337. [Google Scholar] [CrossRef] [Green Version]
  3. Global Burden of Disease Cancer Collaboration; Fitzmaurice, C.; Allen, C.; Barber, R.M.; Barregard, L.; Bhutta, Z.A.; Brenner, H.; Dicker, D.J.; Chimed-Orchir, O.; Dandona, R.; et al. Global, regional, and national cancer incidence, mortality, years of life lost, years lived with disability, and disability-adjusted life-years for 32 cancer groups, 1990 to 2015: A systematic analysis for the global burden of disease study. JAMA Oncol. 2017, 3, 5245–5248. [Google Scholar]
  4. Garrison, K.L.; German, P.; Mogalian, E.; Mathias, A. The Drug-Drug Interaction Potential of Antiviral Agents for the Treatment of Chronic Hepatitis C Infection. Drug Metab. Dispos. 2017, 46, 1212–1225. [Google Scholar] [CrossRef]
  5. Spengler, U. Direct antiviral agents (DAAs)—A new age in the treatment of hepatitis C virus infection. Pharmacol. Ther. 2018, 183, 118–126. [Google Scholar] [CrossRef]
  6. Asselah, T.; Marcellin, P. New direct-acting antivirals’ combination for the treatment of chronic hepatitis C. Liver Int. 2011, 31, 68–77. [Google Scholar] [CrossRef] [PubMed]
  7. Liang, T.J.; Ghany, M.G. Current and future therapies for hepatitis C virus infection. N. Engl. J. Med. 2013, 368, 1907–1917. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Saraiva, G.N.; Fonseca do Rosário, N.; Medeiros, T.; Côrrea Leite, P.E.; de Souza Lacerda, G.; Guaraná de Andrade, T.; de Azeredo, E.L.; Ancuta, P.; Almeida, J.R.; Xavier, A.R.; et al. Restoring Inflammatory Mediator Balance after Sofosbuvir-Induced Viral Clearance in Patients with Chronic Hepatitis C. Mediat. Inflamm. 2018, 27, 8578051. [Google Scholar] [CrossRef] [Green Version]
  9. Waziry, R.; Hajarizadeh, B.; Grebely, J.; Amin, J.; Law, M.; Danta, M.; George, J.; Dore, G.J. Hepatocellular carcinoma risk following direct-acting antiviral HCV therapy: A systematic review, meta-analyses, and meta-regression. J. Hepatol. 2017, 6, 1204–1212. [Google Scholar] [CrossRef]
  10. Sangiovanni, A.; Alimenti, E.; Gattai, R.; Filomia, R.; Parente, E.; Valenti, L.; Marzi, L.; Pellegatta, G.; Borgia, G.; Gambato, M.; et al. Undefined/non-malignant hepatic nodules are associated with early occurrence of HCC in DAA-treated patients with HCV-related cirrhosis. J. Hepatol. 2020, 3, 593–602. [Google Scholar] [CrossRef]
  11. Ioannou, G.N.; Green, P.K.; Berry, K. HCV eradication induced by direct-acting antiviral agents reduces the risk of hepatocellular carcinoma. J. Hepatol. 2017, 68, 25–32. [Google Scholar] [CrossRef]
  12. Celsa, C.; Stornello, C.; Giuffrida, P.; Giacchetto, C.M.; Grova, M.; Rancatore, G.; Pitrone, C.; Di Marco, V.; Cammà, C.; Cabibbo, G. Direct-acting antiviral agents and risk of Hepatocellular carcinoma: Critical appraisal of the evidence. Ann. Hepatol. 2022, 27, 100568. [Google Scholar] [CrossRef] [PubMed]
  13. Rutledge, S.M.; Zheng, H.; Li, D.K.; Chung, R.T. No evidence for higher rates of hepatocellular carcinoma after direct-acting antiviral treatment: A meta-analysis. Hepatoma Res. 2019, 5, 31. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. De Re, V.; De Zorzi, M.; Caggiari, L.; Lauletta, G.; Tornesello, M.L.; Fognani, E.; Miorin, M.; Racanelli, V.; Quartuccio, L.; Gragnani, L.; et al. HCV-related liver and lymphoproliferative diseases: Association with polymorphisms of IL28B and TLR2. Oncotarget 2016, 25, 37487–37497. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Zamore, P.D.; Haley, B. Ribo-gnome: The big world of small RNAs. Science 2005, 309, 1519–1524. [Google Scholar] [CrossRef] [Green Version]
  16. Krützfeldt, J.; Poy, M.N.; Stoffel, M. Strategies to determine the biological function of microRNAs. Nat. Genet. 2006, 10, 14–19. [Google Scholar]
  17. Nilsen, T.W. Mechanisms of microRNA-mediated gene regulation in animal cells. TRENDS Genet. 2007, 5, 243–249. [Google Scholar] [CrossRef]
  18. Girard, M.; Jacquemin, E.; Munnich, A.; Lyonnet, S.; Henrion-Caude, A. miR-122, a paradigm for the role of microRNAs in the liver. J. Hepatol. 2008, 4, 648–656. [Google Scholar] [CrossRef] [Green Version]
  19. Kunden, R.D.; Khan, J.Q.; Ghezelbash, S.; Wilson, J.A. The Role of the Liver-Specific microRNA, miRNA-122 in the HCV Replication Cycle. Int. J. Mol. Sci. 2020, 16, 5677. [Google Scholar] [CrossRef]
  20. Conrad, K.D.; Niepmann, M. The role of microRNAs in hepatitis C virus RNA replication. Arch. Virol. 2014, 5, 849–862. [Google Scholar]
  21. Wong, C.M.; Wong, C.C.; Lee, J.M.; Fan, D.N.; Au, S.L.; Ng, I.O. Sequential alterations of microRNA expression in hepatocellular carcinoma development and venous metastasis. Hepatology 2012, 5, 1453–1461. [Google Scholar] [CrossRef]
  22. Oksuz, Z.; Serin, M.S.; Kaplan, E.; Dogen, A.; Tezcan, S.; Aslan, G.; Emekdas, G.; Sezgin, O.; Altintas, E.; Tiftik, E.N. Serum microRNAs; miR-30c-5p, miR-223-3p, miR-302c-3p and miR-17-5p could be used as novel non-invasive biomarkers for HCV-positive cirrhosis and hepatocellular carcinoma. Mol. Biol. Rep. 2015, 3, 713–720. [Google Scholar] [CrossRef]
  23. Jin, Y.; Wong, Y.S.; Goh, B.K.P.; Chan, C.Y.; Cheow, P.C.; Chow, P.K.H.; Lim, T.K.H.; Goh, G.B.B.; Krishnamoorthy, T.L.; Kumar, R.; et al. Circulating microRNAs as Potential Diagnostic and Prognostic Biomarkers in Hepatocellular Carcinoma. Sci. Rep. 2019, 1, 10464. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Schmittgen, T.D.; Livak, K.J. Analyzing real-time PCR data by the comparative C(T) method. Nat. Protoc. 2008, 6, 1101. [Google Scholar] [CrossRef]
  25. Roche, B.; Coilly, A.; Duclos-Vallee, J.C.; Samuel, D. The impact of treatment of hepatitis C with DAAs on the occurrence of HCC. Liver Int. 2018, 38, 139–145. [Google Scholar] [CrossRef] [Green Version]
  26. Montaldo, C.; Terri, M.; Riccioni, V.; Battistelli, C.; Bordoni, V.; D’Offizi, G.; Prado, M.G.; Trionfetti, F.; Vescovo, T.; Tartaglia, E.; et al. Fibrogenic signals persist in DAA-treated HCV patients after sustained virological response. J. Hepatol. 2021, 75, 1301–1311. [Google Scholar] [CrossRef]
  27. Pascut, D.; Cavalletto, L.; Pratama, M.Y.; Bresolin, S.; Trentin, L.; Basso, G.; Bedogni, G.; Tiribelli, C.; Chemello, L. Serum miRNA Are Promising Biomarkers for the Detection of Early Hepatocellular Carcinoma after Treatment with Direct-Acting Antivirals. Cancers 2019, 11, 1773. [Google Scholar] [CrossRef] [Green Version]
  28. El-Ahwany, E.; Nagy, F.; Zoheiry, M.; Shemis, M.; Nosseir, M.; Taleb, H.A.; El Ghannam, M.; Atta, R.; Zada, S. Circulating miRNAs as Predictor Markers for Activation of Hepatic Stellate Cells and Progression of HCV-Induced Liver Fibrosis. Electron. Physician 2016, 1, 1804–1810. [Google Scholar] [CrossRef] [Green Version]
  29. Tsujiura, M.; Ichikawa, D.; Komatsu, S.; Shiozaki, A.; Takeshita, H.; Kosuga, T.; Konishi, H.; Morimura, R.; Deguchi, K.; Fujiwara, H.; et al. Circulating microRNAs in plasma of patients with gastric cancers. Br. J. Cancer. 2010, 102, 1174–1179. [Google Scholar] [CrossRef] [Green Version]
  30. Ebi, H.; Sato, T.; Sugito, N.; Hosono, Y.; Yatabe, Y.; Matsuyama, Y.; Yamaguchi, T.; Osada, H.; Suzuki, M.; Takahashi, T. Counterbalance between RB inactivation and miR-17-92 overexpression in reactive oxygen species and DNA damage induction in lung cancers. Oncogene 2009, 28, 3371–3379. [Google Scholar] [CrossRef] [Green Version]
  31. Yang, F.; Yin, Y.; Wang, F.; Wang, Y.; Zhang, L.; Tang, Y.; Sun, S. miR-17-5p promotes migration of human hepatocellular carcinoma cells through the p38 mitogen-activated protein kinase-heat shock protein 27 pathway. Hepatology 2010, 51, 1614–1623. [Google Scholar] [CrossRef] [PubMed]
  32. Chen, L.; Jiang, M.; Yuan, W.; Tang, H. miR-17-5p as a novel prognostic marker for hepatocellular carcinoma. J. Investig. Surg. 2012, 25, 156–161. [Google Scholar] [CrossRef] [PubMed]
  33. Yu, F.; Guo, Y.; Chen, B.; Dong, P.; Zheng, J. MicroRNA-17-5p activates hepatic stellate cells through targeting of Smad7. Lab Investig. 2015, 95, 781–789. [Google Scholar] [CrossRef] [Green Version]
  34. Öksüz, Z.; Üçbilek, E.; Serin, M.S.; Yaraş, S.; Temel, G.Ö.; Sezgin, O. hsa-miR-17-5p: A Possible Predictor of Ombitasvir/Paritaprevir/Ritonavir + Dasabuvir ± Ribavirin Therapy Efficacy in Hepatitis C Infection. Curr. Microbiol. 2022, 79, 186. [Google Scholar] [CrossRef] [PubMed]
  35. Romano, G.; Veneziano, D.; Acunzo, M.; Croce, C.M. Small non-coding RNA and cancer. Carcinogenesis 2017, 38, 485–491. [Google Scholar] [CrossRef] [Green Version]
  36. Zeng, F.; Le, Y.G.; Fan, L.J.; Xin, L. LncRNA CASC2 inhibited the viability and induced the apoptosis of hepatocellular carcinoma cells through regulating miR-24-3p. J. Cell Biochem. 2018, 119, 6391–6397. [Google Scholar] [CrossRef]
  37. Dong, X.; Ding, W.; Ye, J.; Yan, D.; Xue, F.; Xu, L.; Yin, J.; Guo, W. MiR-24-3p enhances cell growth in hepatocellular carcinoma by targeting metallothionein 1M. Cell Biochem. Funct. 2016, 7, 491–496. [Google Scholar] [CrossRef]
  38. Hyrina, A.; Olmstead, A.D.; Steven, P.; Krajden, M.; Tam, E.; Jean, F. Treatment-Induced Viral Cure of Hepatitis C Virus-Infected Patients Involves a Dynamic Interplay among three Important Molecular Players in Lipid Homeostasis: Circulating microRNA (miR)-24, miR-223, and Proprotein Convertase Subtilisin/Kexin Type 9. EBioMedicine 2017, 23, 68–78. [Google Scholar] [CrossRef] [Green Version]
  39. Wan, L.; Yuan, X.; Liu, M.; Xue, B. miRNA-223-3p regulates NLRP3 to promote apoptosis and inhibit proliferation of hep3B cells. Exp. Ther. Med. 2018, 3, 2429–2435. [Google Scholar] [CrossRef] [Green Version]
  40. Shaker, O.G.; Senousy, M.A. Serum microRNAs as predictors for liver fibrosis staging in hepatitis C virus-associated chronic liver disease patients. J. Viral Hepat. 2017, 24, 636–644. [Google Scholar] [CrossRef]
  41. Qi, P.; Cheng, S.Q.; Wang, H.; Li, N.; Chen, Y.F.; Gao, C.F. Serum MicroRNAs as Biomarkers for Hepatocellular Carcinoma in Chinese Patients with Chronic Hepatitis B Virus Infection. PLoS ONE 2011, 6, e28486. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Bhattacharya, S.; Steele, R.; Shrivastava, S.; Chakraborty, S.; Bisceglie, A.M.D.; Ray, R.B. Serum miR-30e and miR-223 as Novel Noninvasive Biomarkers for Hepatocellular Carcinoma. Am. J. Pathol. 2016, 2, 242–247. [Google Scholar] [CrossRef] [PubMed]
  43. Serti, E.; Park, H.; Keane, M.; O’Keefe, A.C.; Rivera, E.; Liang, T.J.; Ghany, M.; Rehermann, B. Rapid decrease in hepatitis C viremia by direct acting antivirals improves the natural killer cell response to IFN alpha. Gut 2017, 4, 724–735. [Google Scholar] [CrossRef] [PubMed]
  44. Nasser, M.Z.; Zayed, N.A.; Mohamed, A.M.; Attia, D.; Esmat, G.; Khairy, A. Circulating microRNAs (miR-21, miR-223, miR-885-5p) along the clinical spectrum of HCV-related chronic liver disease in Egyptian patients. Arab. J. Gastroenterol. 2019, 20, 198–204. [Google Scholar] [CrossRef]
Jpm 13 01188 g001 550
Figure 1. miRNA expression levels and relative fold changes in the total population of 50 HCV patients. In the first row, histograms show the miRNAs levels in the total population of HCV patients pre- and post-treatment. The miRNA levels were calculated in terms of relative expression using RNU48 as a housekeeping gene. In the second row, the fold changes are shown for each miRNA, comparing pre- and post-treatment values. Considering the pre-treatment value as a calibrator, after the therapy, the expression levels of miR-17-5p, miR-24-3p, and miR-223-3p were downregulated 2.08-fold, 2.94-fold, and 3.38-fold, respectively. (Pre-tre: pre-treatment, Post-tre: post-treatment, 2^ΔCt: 2 elevated at delta Ct).
Figure 1. miRNA expression levels and relative fold changes in the total population of 50 HCV patients. In the first row, histograms show the miRNAs levels in the total population of HCV patients pre- and post-treatment. The miRNA levels were calculated in terms of relative expression using RNU48 as a housekeeping gene. In the second row, the fold changes are shown for each miRNA, comparing pre- and post-treatment values. Considering the pre-treatment value as a calibrator, after the therapy, the expression levels of miR-17-5p, miR-24-3p, and miR-223-3p were downregulated 2.08-fold, 2.94-fold, and 3.38-fold, respectively. (Pre-tre: pre-treatment, Post-tre: post-treatment, 2^ΔCt: 2 elevated at delta Ct).
Jpm 13 01188 g001
Jpm 13 01188 g002 550
Figure 2. miRNA expression levels and relative fold changes in the group of patients with HCV-related chronic hepatitis. In the first row, histograms show the miRNA levels in the chronic hepatitis (CH) group (21 patients) pre- and post-treatment. The miRNA levels were calculated in terms of relative expression using RNU48 as a housekeeping gene. In the second row, the fold changes are shown for each miRNA, comparing pre- and post-treatment values. Considering the pre-treatment value as a calibrator, after the therapy, the expression levels of miR-17-5p, miR-24-3p, and miR-223-3p were downregulated 0.72-fold, 1.43-fold, and 0.80-fold, respectively. (Pre-tre: pre-treatment, Post-tre: post-treatment, 2^ΔCt: 2 elevated at delta Ct).
Figure 2. miRNA expression levels and relative fold changes in the group of patients with HCV-related chronic hepatitis. In the first row, histograms show the miRNA levels in the chronic hepatitis (CH) group (21 patients) pre- and post-treatment. The miRNA levels were calculated in terms of relative expression using RNU48 as a housekeeping gene. In the second row, the fold changes are shown for each miRNA, comparing pre- and post-treatment values. Considering the pre-treatment value as a calibrator, after the therapy, the expression levels of miR-17-5p, miR-24-3p, and miR-223-3p were downregulated 0.72-fold, 1.43-fold, and 0.80-fold, respectively. (Pre-tre: pre-treatment, Post-tre: post-treatment, 2^ΔCt: 2 elevated at delta Ct).
Jpm 13 01188 g002
Jpm 13 01188 g003 550
Figure 3. miRNA expression levels and relative fold changes in the group of patients with HCV-related cirrhosis. In the first row, histograms show the miRNA levels in the cirrhosis group (15 patients) pre- and post-treatment. The miRNA levels were calculated in terms of relative expression using RNU48 as a housekeeping gene. In the second row, the fold changes are shown for each miRNA, comparing pre- and post-treatment values. Considering the pre-treatment value as a calibrator, after the therapy, the expression levels of miR-17-5p, miR-24-3p, and miR-223-3p were downregulated 6.27-fold, 6.45-fold, and 9.84-fold, respectively. (Pre-tre: pre-treatment, Post-tre: post-treatment, 2^ΔCt: 2 elevated at delta Ct).
Figure 3. miRNA expression levels and relative fold changes in the group of patients with HCV-related cirrhosis. In the first row, histograms show the miRNA levels in the cirrhosis group (15 patients) pre- and post-treatment. The miRNA levels were calculated in terms of relative expression using RNU48 as a housekeeping gene. In the second row, the fold changes are shown for each miRNA, comparing pre- and post-treatment values. Considering the pre-treatment value as a calibrator, after the therapy, the expression levels of miR-17-5p, miR-24-3p, and miR-223-3p were downregulated 6.27-fold, 6.45-fold, and 9.84-fold, respectively. (Pre-tre: pre-treatment, Post-tre: post-treatment, 2^ΔCt: 2 elevated at delta Ct).
Jpm 13 01188 g003
Jpm 13 01188 g004 550
Figure 4. miRNA expression levels and relative fold changes in the group of patients with HCV–hepatocellular carcinoma. In the first row, histograms show the miRNA levels in the hepatocellular carcinoma (HCC) group (14 patients) pre- and post-treatment. The miRNA levels were calculated in terms of relative expression using RNU48 as a housekeeping gene. In the second row, the fold changes are shown for each miRNA, comparing pre- and post-treatment values. Considering the pre-treatment value as a calibrator, after the therapy, the expression levels of miR-17-5p, miR-24-3p, and miR-223-3p were downregulated 3.05-fold, 8.33-fold, and 9.51-fold, respectively. (Pre-tre: pre-treatment, Post-tre: post-treatment, 2^ΔCt: 2 elevated at delta Ct).
Figure 4. miRNA expression levels and relative fold changes in the group of patients with HCV–hepatocellular carcinoma. In the first row, histograms show the miRNA levels in the hepatocellular carcinoma (HCC) group (14 patients) pre- and post-treatment. The miRNA levels were calculated in terms of relative expression using RNU48 as a housekeeping gene. In the second row, the fold changes are shown for each miRNA, comparing pre- and post-treatment values. Considering the pre-treatment value as a calibrator, after the therapy, the expression levels of miR-17-5p, miR-24-3p, and miR-223-3p were downregulated 3.05-fold, 8.33-fold, and 9.51-fold, respectively. (Pre-tre: pre-treatment, Post-tre: post-treatment, 2^ΔCt: 2 elevated at delta Ct).
Jpm 13 01188 g004
Jpm 13 01188 g005 550
Figure 5. Pre- and post-treatment miRNA scatter diagrams. Symmetrical view of miR-17-5p, miR-24-3p and miR-223-3p expression diagram pre and post-treatment in a total of 50 HCV patient groups.
Figure 5. Pre- and post-treatment miRNA scatter diagrams. Symmetrical view of miR-17-5p, miR-24-3p and miR-223-3p expression diagram pre and post-treatment in a total of 50 HCV patient groups.
Jpm 13 01188 g005
Table
Table 1. Demographic and clinical information of patients.
Table 1. Demographic and clinical information of patients.
Total HCV Population
(n = 50)		CH Patients
(n = 21)		Cirrhotic Patients
(n = 15)		HCC Patients
(n = 14)		p
Age (mean ± SD)67.46 ± 11.7565.90 ± 11.6166 ± 12.6170.64 ± 10.91
Gender
Male31 (62)6 (28)6 (40)7 (50)
Female19 (38)15 (72)9 (60)7 (50)
Genotype, n (%)
1a–1b5 (10)–28 (56)3 (14)–7 (33)1 (6)–9 (60)1 (7)–12 (85)
2–2a/2c9 (18)–4 (8)7 (33)–3 (14)2 (13)–1 (6)-
3a–3c3 (6)–1 (2)1 (4)–01 (6)–1 (6)1 (7)–0
DAA treatment (%)
Harvoni19 (38)7 (33)5 (33)7 (50)
SOF + RBV15 (30)10 (47)4 (26)1 (7)
SOF + RBV + DAC7 (14)-4 (26)3 (21)
DAS + OMB + ABT 4504 (8)-2 (13)2 (14)
Maviret4 (8)4 (19)--
Zepatier1 (2)--1 (7)
ALT (IU/L)
Pre-treatment90.78 ± 72.7095.32 ± 89.6775.67 ± 45.1997.57 ± 68.84<0.001 *
0.002 **
0.001 ***
0.003 ****
Post-treatment25.93 ± 9.8822.60 ± 7.1824.25 ± 6.6431.86 ± 12.87
AST (IU/L)
Pre-treatment88.47 ± 63.0692.47 ± 84.4181.92 ± 36.9888.64 ± 48.71<0.001 *
0.001 **
<0.001 ***
<0.001 ****
Post-treatment25.04 ± 10.9722.68 ± 9.8727.33 ± 11.7826.29 ± 11.84
HCV RNA (IU/mL)
Pre-treatment3,054,496.80 ± 4,604,619.5233,428,032.75 ±
6,306,331.477		1,865,182.82 ±
1,847,452.949		3,455,335.00 ±
3,070,385.284		<0.001 *
0.003 **
0 < 0.001 ***
0.001 ****
Post-treatment0000
CH: chronic hepatitis C, HCC: hepatocellular carcinoma, ALT: alanine aminotransferase, AST: aspartate aminotransferase, DAS: dasabuvir, omb: ombitasvir, rbv: ribavirin, sof: sofosbuvir, dac: daclatasvir. Statistical significance is shown as * p < 0.05, pre- and post-treatment comparison in the total HCV population; ** p < 0.05, pre- and post-treatment comparison in CH patients; *** p < 0.05, pre- and post-treatment comparison in cirrhotic patients; **** p < 0.05, pre- and post-treatment comparison in HCC patients.
Table
Table 2. Comparison of pre- and post-DAA treatment miRNA expression correlations.
Table 2. Comparison of pre- and post-DAA treatment miRNA expression correlations.
miRNApPre-miR-24-3pPost-miR-24-3pPre-miR-223-3pPost-miR-223-3pPre-miR-17-5pPost-miR-17-5p
Pre-miR-24-3pr1.0000.2950.7800.3850.7940.517
p.0.037 *<0.001 *0.006 *<0.001 *<0.001 *
Post-miR-24-3pr 1.0000.1830.7410.2120.427
p .0.204<0.001 *0.1390.002 *
Pre-miR-223-3pr 1.0000.2720.8590.412
p .0.056<0.001 *0.003 *
Post-miR-223-3pr 1.0000.2270.460
p .0.1130.001 *
Pre-miR-17-5pr 1.0000.473
p .0.001 *
Post-miR-17-5pr 1.000
p .
Statistical significance is shown as * p < 0.05, r: Pearson correlation value.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Öksüz, Z.; Gragnani, L.; Lorini, S.; Temel, G.Ö.; Serin, M.S.; Zignego, A.L. Evaluation of Plasma miR-17-5p, miR-24-3p and miRNA-223-3p Profile of Hepatitis C Virus-Infected Patients after Treatment with Direct-Acting Antivirals. J. Pers. Med. 2023, 13, 1188. https://doi.org/10.3390/jpm13081188

AMA Style

Öksüz Z, Gragnani L, Lorini S, Temel GÖ, Serin MS, Zignego AL. Evaluation of Plasma miR-17-5p, miR-24-3p and miRNA-223-3p Profile of Hepatitis C Virus-Infected Patients after Treatment with Direct-Acting Antivirals. Journal of Personalized Medicine. 2023; 13(8):1188. https://doi.org/10.3390/jpm13081188

Chicago/Turabian Style

Öksüz, Zehra, Laura Gragnani, Serena Lorini, Gülhan Örekici Temel, Mehmet Sami Serin, and Anna Linda Zignego. 2023. "Evaluation of Plasma miR-17-5p, miR-24-3p and miRNA-223-3p Profile of Hepatitis C Virus-Infected Patients after Treatment with Direct-Acting Antivirals" Journal of Personalized Medicine 13, no. 8: 1188. https://doi.org/10.3390/jpm13081188

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop