Next Article in Journal
Exploring the Therapeutic Potential of Cannabinoid Receptor Antagonists in Inflammation, Diabetes Mellitus, and Obesity
Previous Article in Journal
Septic Tibial Nonunions on Proximal and Distal Metaphysis—A Systematic Narrative Review
Previous Article in Special Issue
Pathogenesis and Current Treatment Strategies of Hepatocellular Carcinoma
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Biomedicines
Volume 11
Issue 6
10.3390/biomedicines11061666
biomedicines-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Simultaneous Inhibition of Mcl-1 and Bcl-2 Induces Synergistic Cell Death in Hepatocellular Carcinoma

by
Marlen Michalski
†,
Magdalena Bauer
†,
Franziska Walz
,
Deniz Tümen
,
Philipp Heumann
,
Petra Stöckert
,
Manuela Gunckel
,
Claudia Kunst
,
Arne Kandulski
,
Stephan Schmid
,
Martina Müller
and
Karsten Gülow
*
Department of Internal Medicine I, Gastroenterology, Hepatology, Endocrinology, Rheumatology, and Infectious Diseases, University Hospital Regensburg Franz-Josef-Strauß-Allee 11, 93053 Regensburg, Germany
*
Author to whom correspondence should be addressed.
†
These authors contributed equally to this work.
Biomedicines 2023, 11(6), 1666; https://doi.org/10.3390/biomedicines11061666
Submission received: 6 May 2023 / Revised: 1 June 2023 / Accepted: 7 June 2023 / Published: 8 June 2023
(This article belongs to the Special Issue Pathogenesis and Counteracting Strategies of Hepatocellular Carcinoma, Cholangiocarcinoma and Urothelial Carcinoma)
Browse Figures
Versions Notes

Abstract

:
Despite the recent approval of new therapies, the prognosis for patients with hepatocellular carcinoma (HCC) remains poor. There is a clinical need for new highly effective therapeutic options. Here, we present a combined application of BH3-mimetics as a potential new treatment option for HCC. BH3-mimetics inhibit anti-apoptotic proteins of the BCL-2 family and, thus, trigger the intrinsic apoptosis pathway. Anti-apoptotic BCL-2 proteins such as Bcl-2 and Mcl-1 are frequently overexpressed in HCC. Therefore, we analyzed the efficacy of the two BH3-mimetics ABT-199 (Bcl-2 inhibitor) and MIK665 (Mcl-1 inhibitor) in HCC cell lines with differential expression levels of endogenous Bcl-2 and Mcl-1. While administration of one BH3-mimetic alone did not substantially trigger cell death, the combination of two inhibitors enhanced induction of the intrinsic apoptosis pathway. Both drugs acted synergistically, highlighting the effectivity of this specific BH3-mimetic combination, particularly in HCC cell lines. These results indicate the potential of combining inhibitors of the BCL-2 family as new therapeutic options in HCC.

1. Introduction

One of the hallmarks of cancer pathophysiology is resistance toward apoptosis [1]. Expressions of anti-apoptotic and pro-apoptotic BCL-2 family members, which control the intrinsic apoptosis pathway, are often altered in cancer. This correlates with resistance to therapy. The BCL-2 family consists of three groups of structurally related proteins: anti-apoptotic Bcl-2-like proteins (Bcl-2, Bcl-XL, Bcl-W, Mcl-1, A1/BFL-1 and Bcl-B), pro-apoptotic Bax/Bak proteins with multiple BH-domains (Bax, Bak and Bok), and pro-apoptotic BH3-only proteins (Bim, Puma, Bid, NOXA, Bid, Bmf, Bik, and HRK).
Upon initiation of intrinsic apoptosis, BH3-only proteins are upregulated. They inhibit anti-apoptotic BCL-2 family members such as Bcl-2 and Mcl-1, activating Bax and Bak. Activation of Bax and Bak results in mitochondrial outer membrane permeabilization (MOMP). MOMP promotes the release of cytochrome c from mitochondria [2,3]. Cytochrome c stimulates the oligomerization of APAF-1, which recruits pro-caspase-9 to form the apoptosome, enabling auto-cleavage and activation of caspase-9. Activated caspase-9 cleaves the effector caspases-3 and -7. These effector caspases cause irreversible induction of apoptosis [2]. Due to their important function in the BCL-2-regulated apoptosis pathway, BH3-only proteins are crucial for determining whether the fate of the cell shifts toward survival or death [4]. Therefore, many anticancer drugs aim to induce cell death in tumor cells via indirect activation of BH3-only proteins by modulation of p53 or glucocorticoid receptor pathways [5,6]. However, in tumor tissue, proteins within these upstream signaling cascades are often mutated, deleted, or their expression is epigenetically suppressed during tumor development [7]. These cellular adaptations often result in resistance to chemotherapeutics. To bypass resistance, a new class of therapeutics, called BH3-mimetics, has been developed [3,8]. BH3-mimetics imitate the effect of BH3-only proteins. They inhibit anti-apoptotic BCL-2 proteins and therefore induce apoptosis.
The first clinically approved BH3-mimetic is the selective Bcl-2 inhibitor ABT-199/venetoclax [9]. It was approved by the Food and Drug Administration (FDA, USA) and the European Medicines Agency (EMA) in 2016 for the treatment of chronic lymphocytic leukemia (CLL) [10,11]. Resistance or reduced response to ABT-199 has been reported to be associated with the overexpression of anti-apoptotic molecules such as Bcl-XL and/or Mcl-1 [12]. Other resistant tumors rely on increased expression of multiple anti-apoptotic BCL-2-molecules for survival, and therefore do not respond to monotherapy with ABT-199 in the first place [13]. ABT-199 has been combined with various drugs to improve efficacy and overcome resistance toward cell death. It is already approved in combination with obinutuzumab or rituximab in CLL and azacitidine, decitabine, or cytarabine in acute myeloid leukemia (AML) [14]. Several recent clinical trials and in vivo studies use ABT-199 in combination with other pharmaceuticals in different tumor entities [3,15], including solid tumors such as breast and pancreatic cancer, as well as hematopoietic neoplasia [16,17].
MIK665/S64315 is a BH3-mimetic specifically inhibiting Mcl-1. It has achieved considerable effects in mouse models of solid and hematologic cancer entities, while sparing healthy tissue [18]. In addition, Mcl-1 inhibitors are currently being investigated in clinical trials for various hematologic malignancies [15]. As Mcl-1 plays a major role in resistance to ABT-199 and other chemotherapeutics, combining ABT-199 and MIK665 is a promising approach to improve therapeutic efficacy [12,19].
Hepatocellular carcinoma (HCC) is the most frequent liver tumor entity and the third-leading cause of cancer-related death worldwide [20]. Barcelona Clinic Liver Cancer (BCLC) publishes treatment algorithms depending on the tumor stage. In 2022, the updated BCLC algorithm redefined the intermediate-stage HCC (BCLC-B) and the treatment sequence for systemic treatment has been addressed in detail [21]. Systemic treatment is recommended for patients with compensated liver function and HCC in the intermediate stage (BCLC-B) that cannot be treated locally, and those in advanced stage with multifocal disease or distant metastasis (BCLC-C). Combination therapies with immunotherapeutic agents are effective and superior to tyrosine kinase inhibitors, such as sorafenib or lenvatinib [22]. The combination of atezolizumab (neutralizing humanized monoclonal anti-PD-L1 antibody) and bevacizumab (neutralizing humanized monoclonal anti-VEGF antibody) was approved by the FDA and EMA in 2020 and is now an established first-line treatment option. Very recently, data from the HIMALAYA-trial (NCT03298451) led to the approval of the combination of tremelimumab (neutralizing humanized monoclonal anti-CTLA-4 antibody) and durvalumab (neutralizing humanized monoclonal anti-PD-L1 antibody). Other combination therapies, such as ipilimumab (anti-CTLA antibody) plus nivolumab (anti-PD-L1 antibody), are still under investigation in current recruiting phase III clinical studies (NCT04039607 (CheckMate-9DW)). Patients with contraindications for immunotherapy should be treated with tyrosine kinase inhibitors lenvatinib or sorafenib.
After progression under first-line treatment, the tyrosine kinase inhibitors regorafenib (for patients who initially responded to sorafenib) and cabozantinib are possible treatment options in the second-line setting. For patients with high expression of alpha-feto-protein (AFP > 400 ng/mL), ramucirumab (neutralizing humanized anti-VEGFR2 antibody) is recommended [22,23,24,25,26,27]. Reliable, current data and clinical evidence for an optimal treatment sequence after progression under immunotherapy are rare. HCC remains a highly therapy-resistant tumor entity and, therefore, challenging to treat [24].
Thus, it is important to identify new therapeutic targets for HCC. In addition, markers to predict sensitivity and resistance to certain treatments are highly important. In HCC, the expression of pro- and anti-apoptotic BCL-2 molecules is often altered. In particular, Mcl-1 is overexpressed and functions as a crucial survival factor in HCC [28,29,30,31,32]. There are other anti-apoptotic BCL-2 family members overexpressed in tumors. Consistent with these findings, inhibition of Bcl-2 increased the chemosensitivity of HCC cell lines [33,34]. Using the BH3-mimetic ABT-737, which inhibits Bcl-2, Bcl-XL and Bcl-W, induced apoptosis in HCC when Mcl-1 expression was simultaneously inhibited, e.g., by sorafenib [35]. In addition, treatment with the Bcl-XL inhibitor A-1331852 restores sensitivity to HepG2 cells resistant to regorafenib [36]. ABT-737 and the pan-Bcl-2 inhibitor obatoclax reduce cell migration and adhesion in HCC [37]. These studies demonstrate that BH3-mimetics have a high potential in treating HCC. However, the efficacy of BH3-mimetics specifically for Mcl-1 in combination with other BCL-2 inhibitors has not been addressed in HCC.
This study analyzed the therapeutic potential of the Mcl-1 inhibitor MIK665 and the Bcl-2 inhibitor ABT-199 in different HCC cell lines. Both drugs were tested either alone or in combination.

2. Materials and Methods

2.1. Chemicals

ABT-199, MIK665, carbonyl cyanide-p-trifluoromethoxyphenylhydrazone (FCCP), and zVAD were obtained from Selleck Chemicals GmbH, Planegg, Germany. Tetramethylrhodamine ethyl ester (TMRE) was obtained from Invitrogen, Waltham, MA, USA. Cells were treated with ABT-199, MIK665, or both in the given concentrations. Co-treatment with zVAD (35 µM) was performed 20 min prior to treatment with ABT-199 and MIK665. Cells were incubated for the indicated time.

2.2. Cells

Hep3B cells were cultured in MEM, Huh7 cells in DMEM (high glucose) and HepG2 cells in RPMI-1640 medium. All media were supplemented with 10% FCS. Hep3B (Hep3B 2.1-7 [ATCC HB-8064]) and HepG2 (HepG2 [ATCC HB-8065]) were obtained from American Type Culture Collection (ATCC, Manassas, VA, USA) and Huh7 (CLS 300156) from Cell Lines Service (CLS, Eppelheim, Germany).

2.3. Cell Death Assays

Cell death was assessed 24 h and 48 h after administering specific treatments consisting of ABT-199, MIK665, or both. Cells were harvested and stained with Annexin V-FITC and DAPI (Becton Dickinson (BD) Biosciences, Heidelberg, Germany) and were analyzed using flow cytometry (LSRFortessaTM Cell Analyzer, BD Biosciences, Heidelberg, Germany). To compare results between experiments, a normalized value (specific death [%]) was calculated as follows [38,39,40]:
s p e c i f i c   c e l l   d e a t h % = ( e x p e r i m e n t a l   c e l l   d e a t h % − s p o n t a n e o u s   b a c k g r o u n d   c e l l   d e a t h % ) ( 100 − s p o n t a n e o u s   b a c k g r o u n d   c e l l   d e a t h % ) × 100 .

2.4. Luciferase Activity Assays

Caspase activity was determined using Caspase-Glo assay systems (Promega, Madison, WI, USA). Luminescent signals were detected using a TriStar2 LB 942 Multimode Reader (Berthold Technologies, Bad Wildbad, Germany). Specific increase in caspase activity was calculated using the following formula [41]:
s p e c i f i c   i n c r e a s e   i n   a c t i v i t y   % = L I t r e a t e d − L I c o n t r o l L I c o n t r o l × 100
LI = luminous intensity.

2.5. Immunofluorescence

Cells were fixed in 4% paraformaldehyde (Alfa Aesar Chemicals, Haverhill, MA, USA) and permeabilized in 0.1% Triton X-100 (Sigma-Aldrich, St. Louis, MI, USA). Antibodies against cytochrome c (ab110325, Abcam, Cambridge, UK) were diluted 1:500, antibodies against TOMM20 (42406, Cell Signaling Technology, Danvers, MA, USA) were diluted 1:100. Secondary antibodies against rabbit IgG (A-11008, Invitrogen, Waltham, MA, USA) and mouse IgG (A-11005, Invitrogen, Waltham, MA, USA) were diluted 1:1000. Specific staining was analyzed using fluorescence microscopy (Keyence BZ-X810, Keyence, Osaka, Japan). The contrast and brightness of the single stainings were adjusted in the individual fluorescence images to optimize the detection of a possible cytochrome c release.

2.6. Western Blot

Western blot analysis was performed as described previously [42]. Antibodies against full-length and cleaved caspase-9 (PA5-17913, Invitrogen, Waltham, Massachusetts, USA), full-length and cleaved caspase-3 (9662, Cell Signaling Technology, Danvers, MA, USA), full-length and cleaved PARP (9542, Cell Signaling Technology, Danvers, MA, USA), Mcl-1 (4572, Cell Signaling Technology, Danvers, MA, USA), Bcl-2 (ab182858, Abcam, Cambridge, UK), Bcl-XL (2762S, Cell Signaling Technology, Danvers, MA, USA), p53 (sc-126, Santa Cruz Biotechnology, Dallas, Texas, USA ) and NOXA (ab13654, Abcam, Cambridge, UK) were diluted 1:1000. Secondary antibodies against rabbit IgG (A0545, Sigma-Aldrich, St. Louis, MI, USA) were diluted 1:10,000 and secondary antibodies against mouse IgG (A9044, Sigma Aldrich, St. Louis, MI, USA) were diluted 1:10,000.

2.7. Graphics and Calculations

All graphs and statistical analyses were created with GraphPad Prism 8 Software (Graphpad Software, Inc., San Diego, CA, USA). Significances were determined using unpaired t-tests. The Combination Index was calculated with the CompuSyn software (http://www.combosyn.com/ (accessed on 26 May 2023)) Version 1 [43,44]. Schematics were created with BioRender (https://biorender.com/ (accessed on 26 May 2023)).

3. Results

3.1. HCC Cell Lines Display Different Expression Levels of Bcl-2 and Mcl-1

In tumor cells, Bcl-2 and Mcl-1 are often overexpressed. This leads to increased resistance toward apoptosis and to dependence on these survival factors [45]. Inhibition of anti-apoptotic BCL-2 molecules by BH3-mimetics, such as ABT-199/venetoclax and MIK665/S64315, can therefore lead to induction of apoptosis. To investigate whether the HCC cell lines Hep3B, HepG2, and Huh7 represent a model system to analyze the potential of ABT-199 and MIK665 for HCC treatment, we examined the protein expression of Bcl-2 and Mcl-1 in these cell lines. To include the role of p53, which is an important upstream regulator of BH3-only proteins, we ensured the differential p53 status for the cell lines being used (p53 is deleted in Hep3B, wild-type p53 is expressed in HepG2, and mutant p53 is present in Huh7) (Figure 1A).
HepG2 showed the highest protein expression of Bcl-2 (Figure 1B,F) while Hep3B revealed the highest expression of Mcl-1 (Figure 1C,G). Huh7 displayed low levels of both proteins (Figure 1B,C,F,G). Since other BCL-2 family members may also have an impact on BH3-mimetics-mediated induction of cell death, we examined the expression of Bcl-XL (Figure 1D,H) and NOXA (Figure 1E,I). It is known that a high Bcl-XL expression can compensate for the inhibition of Bcl-2 [32,46], while NOXA is known to enhance the degradation of Mcl-1 and thus may enhance effects induced by Mcl-1 inhibitors [47]. HepG2 showed the highest expression of Bcl-XL, whereas Hep3B and Huh7 displayed a moderate Bcl-XL expression. In Hep3B cells, we could not detect NOXA expression. HepG2 and Huh7 showed moderate NOXA expression (Figure 1D,E,H,F).

3.2. Combination of BH3-Mimetics Induces Release of Cytochrome c into the Cytosol

BH3-mimetics inhibit anti-apoptotic members of the BCL-2 family, resulting in the release of cytochrome c from mitochondria into the cytosol, which is the initial step of the intrinsic apoptosis pathway. However, the anti-apoptotic BCL-2 proteins can substitute for each other [48]. To evaluate whether a single or combined treatment with ABT-199 and MIK665 can initiate intrinsic apoptosis in HCC, we examined the induction of MOMP and cytochrome c release upon treatment with ABT-199 and MIK665 in Hep3B cells. MOMP was determined using flow cytometry with TMRE staining. TMRE is a cell-permeable, cationic dye that accumulates in the mitochondrial matrix of active mitochondria with intact mitochondrial membrane potential. Induction of MOMP results in reduced membrane potential, and, therefore, reduced TMRE staining. The mitochondrial uncoupler carbonyl cyanide-p-trifluoromethoxyphenylhydrazone (FCCP) was used as a positive control for membrane depolarization (Supplementary Figure S1A). Application of 5 µM ABT-199 did not cause depolarization of the mitochondria. After application of 6 µM MIK665, some cells showed a modest loss of membrane potential. Similar results were seen for a combination of 1 µM ABT-199 and 6 µM MIK665. The combination of 5 µM ABT-199 and 1 µM MIK665 resulted in a clear induction of MOMP (Supplementary Figure S1B–E). Cytochrome c release was analyzed using immunofluorescence. Translocase of outer mitochondrial membrane 20 (TOMM20) was used as a marker for mitochondria. FCCP was applied as a positive control for the induction of cytochrome c release (Figure 2A–D, Supplementary Figure S2A,B). Application of a single BH3-mimetic induced only moderate or no cytochrome c release. Consistent with the data on the induction of MOMP (Supplementary Figure S1), only the highest dose (6 µM) of MIK665 showed a moderate release of cytochrome c in Hep3B cells (Figure 2I, Supplementary Figure S2G). Lower concentrations of MIK665 or single treatment with ABT-199 did not result in cytochrome c release (Figure 2E,F,H, Supplementary Figure S2C,D,F). Thereafter, we tested whether simultaneous inhibition of Bcl-2 and Mcl-1 by ABT-199 and MIK665 can induce cytochrome c release. The combination of 5 µM ABT-199 and 1 µM MIK665, as well as the combination of 6 µM MIK665 and 1 µM ABT-199, led to the release of cytochrome c after 4 h of treatment (Figure 2G,J, Supplementary Figure S2E,H). This confirms the results obtained from measuring the mitochondrial membrane potential (Supplementary Figure S1). Thus, the combined inhibition of two members of the BCL-2 family in HCC cells cannot be compensated by cellular resistance mechanisms.

3.3. Combination Treatment of ABT-199 and MIK665 Induces a Caspase Cascade

Release of cytochrome c leads to activation of initiator caspase-9. As expected, we demonstrated that one individual inhibitor could not induce cleavage of caspase-9 in the HCC cell lines HepG2 and Huh7 (Figure 3B,C). Only in Hep3B cells, a moderate cleavage upon treatment with 1 µM MIK665 and 6 µM MIK665 was observed (Figure 3A). In contrast, the combined administration of 5 µM ABT-199 and 1 µM MIK665 resulted in caspase-9 cleavage after 4 h in all cell lines (Figure 3A–C). In addition to caspase cleavage, the combination treatment resulted in increased caspase-9 activity in the HCC cell lines after 4 h (Figure 3D,E). Thus, caspase-9 activity was markedly enhanced after combination treatment. Levels of caspase-9 activity remained constant for up to 6 h of treatment (Supplementary Figure S3A–F). Caspase-9 is activated in all cell lines irrespective of their p53 status or NOXA expression. The p53 status and NOXA expression therefore do not seem to markedly influence response to ABT-199 and MIK665 (Figure 1A,E,I).
Active caspase-9 activates the effector caspase-3 by proteolytic cleavage. As assumed, treatment with ABT-199 and MIK665 alone resulted in a rather low induction of cleavage and activity of caspase-3 (Figure 4A–E). Of note, the combination of ABT-199 and MIK665 led to increased caspase-3 cleavage in all cell lines (Figure 4A–E). After 24 h of treatment, caspase-3 activity was still enhanced in samples treated with the combination of the inhibitors compared to single drug-treated cells (Supplementary Figure S4A–F).
To further investigate the potential involvement of the extrinsic apoptosis pathway upon inhibition of Bcl-2 and Mcl-1, we analyzed the activity of caspase-8. No relevant involvement of caspase-8, and thus no extrinsic apoptosis, was detected upon treatment with the BH3-mimetics (Supplementary Figure S5A–F). ABT-199 and MIK665 induce the intrinsic apoptosis pathway. Activation of effector caspase-3 leads to the cleavage of so-called death substrates, such as poly(ADP-ribose)polymerase-1 (PARP) [49]. After combined treatment with both inhibitors, PARP cleavage was observed in all cell lines examined. Single-drug treatment only resulted in discreet PARP cleavage in MIK665-treated Hep3B cells (Figure 4F–H). Taken together, our experiments show an induction of the intrinsic apoptosis pathway in HCC cell lines after combination treatment with ABT-199 and MIK665. The combined inhibition of two anti-apoptotic BCL-2 family members, namely Bcl-2 and Mcl-1, was demonstrated to effectively induce the caspase cascade.

3.4. The Combination of ABT-199 and MIK665 Effectively Induces Cell Death in HCC Cell Lines

Since the combination treatment of ABT-199 and MIK665 induces the caspase cascade, it can be assumed that this combination can successfully induce apoptosis in HCC cells. Therefore, we evaluated the impact of combination treatment on specific cell death using flow cytometry. Cells were treated with a constant concentration of ABT-199 (5 µM) and varying MIK665 concentrations, or vice versa, with 6 µM MIK665 and varying concentrations of ABT-199. As shown in our previous results, single treatment with ABT-199 and MIK665 induced low cell death rates. The combination of both drugs resulted in significantly increased cell death in a dose-dependent manner (Figure 5A–F, Supplementary Figures S6A–E, S7A–F and S8A–E, Supplementary Table S1). Hence, cell death induction could be increased up to fivefold by combination treatment compared to a single treatment. The extent of cell death induction was dependent on the cell line. Strongest effects were measured in HepG2. Notably, a concentration of 5 µM ABT-199 and only low nanomolar concentrations of MIK665 were sufficient to induce high cell death rates in HepG2 cells (Figure 5C,D). Huh7 cells, on the other hand, displayed the lowest effects after treatment (Figure 5E,F). Induction of cell death does not correlate with the expression of other BCL-2 family members, such as Bcl-XL and NOXA. High Bcl-XL expression in HepG2 cells could not block apoptosis, and the expression of NOXA seen in HepG2 and Huh7 cells did not result in enhancement of cell death induction by MIK665 and ABT-199 (Figure 1D,E,H,I). In addition, we examined whether cell death induced by the combination of ABT-199 and MIK665 could be blocked by the pan-caspase inhibitor zVAD. Co-treatment with ABT-199/MIK665 combinations and zVAD reduced cell death induction after 24 h in all analyzed HCC cell lines compared to treatment without zVAD (Supplementary Figure S9A–F). Our data suggest that the combination of ABT-199 and MIK665 effectively induces caspase-dependent intrinsic apoptosis in HCC cells.

3.5. ABT-199 and MIK665 Act Synergistically in HCC Cell Lines

Due to the impressive effect of the combination of BH3-mimetics, we further investigated whether both drugs work in an additive or synergistic manner. Therefore, we determined the half-maximum inhibitory concentration (IC50) for ABT-199 and MIK665 alone and in combination for each HCC cell line after 24 h and 48 h of treatment. The IC50 of the combination treatments was assessed using a constant concentration of 5 µM ABT-199 and increasing concentrations of MIK665, or vice versa, with 6 µM MIK665 and increasing concentrations of ABT-199. The IC50 of both ABT-199 and MIK665 alone was comparatively high (18.2 µM–23.6 µM after 24 h treatment and 10.1 µM–21.6 µM after 48 h, Figure 6A–F, Supplementary Figures S10A,B, S11A,B and S12A,B). At a constant ABT-199 concentration of 5 µM, the IC50 of MIK665 decreased to 0.03 µM–17.4 µM after 24 h and to 0.01 µM–15.5 µM after 48 h of treatment.
At a constant concentration of 6 µM MIK665, the IC50 of ABT-199 decreased to 1.8–6.6 µM after 24 h and to 0.6–8.1 µM after 48 h of treatment. Using the CompuSyn software, we calculated the Combination Index (CI) according to Chou et al. [44]. This dimensionless value describes the synergistic (CI < 1), additive (CI = 1), or antagonistic (CI > 1) effect of a combination of substances versus either substance alone. Our analyses demonstrate synergistic effects of ABT-199 and MIK665 combinations in all analyzed cell lines (Figure 6G,H, Supplementary Figures S10C,D, S11C,D and S12C,D). A CI < 0.3 (dotted line) demonstrates strong synergism of the combination of MIK665 and ABT-199 in Hep3B and HepG2 at the indicated concentrations after 24 h and 48 h of treatment. A CI < 1 (solid line) demonstrates synergism of the combination of MIK665 and ABT-199 in all analyzed cell lines after 24 h and 48 h. It can be concluded that inhibition of both Bcl-2 and Mcl-1 is necessary to induce apoptosis in HCC cells efficiently. Only combined blockage of these two proteins effectively induces cytochrome c release, induction of the caspase cascade, and, finally, apoptosis.

4. Discussion

Although the major risk factors for HCC pathogenesis are well known, the incidence and mortality rates of HCC remain high, with the incidence steadily rising [26,44,45]. In North America and Europe, more than 60% of HCC are first diagnosed in intermediate (BCLC-B) or advanced stages (BCLC-C and -D) [50]. Despite recent developments leading to new treatment options, the prognosis for advanced-staged HCC is still poor [21,51]. The combination of atezolizumab and bevacizumab as first-line therapy for HCC improved median overall survival (OS) (to 19.2 months) and progression-free survival (6.8 months, compared to 4.3 months with sorafenib) for HCC patients [23,52]. Recently, the immune checkpoint inhibitors tremelimumab (anti-CTLA-4) and durvalumab (anti-PD-L1) were approved as another first-line combination regimen by the FDA and EMA. This regimen improved median OS compared to sorafenib, as shown in the HIMALAYA trial. Median OS was 16.4 months with the combination, compared to 13.8 months with sorafenib. In the LEAP-002 study (NCT03713593), the combination of lenvatinib with pembrolizumab showed promising anti-tumor activity with a median OS of 21.2 months. However, it failed to be superior to lenvatinib (median OS: 19.0 months) [53]. Despite this progress, existing therapies still have low overall response rates, and most patients have progress of the disease. Thus, new treatment options after the failure of existing therapies are urgently needed [54].
BH3-mimetics are promising therapeutic options for systemic anti-tumor treatment [15,30]. Several Mcl-1 inhibitors are currently being investigated in clinical trials for various hematological malignancies. For example, MIK665 is under investigation for the treatment of relapsed and/or refractory patients with lymphoma or multiple myeloma (NCT02992483 clinical study phase I) [55]. Another clinical trial analyzes the potential of MIK665 in patients with acute myeloid leukemia or myelodysplastic syndrome (NCT04629443 clinical study phase I/II) [56]. AMG176, another Mcl-1 inhibitor, is being tested in participants with relapsed or refractory multiple myeloma, and in patients with relapsed or refractory acute myeloid leukemia (NCT02675452 clinical study phase I) [57]. The Mcl-1 inhibitor PRT1419 is being investigated for the treatment of patients with relapsed and/or refractory hematologic malignancies (NCT04543305, clinical phase I) [58].
The BH3-mimetic ABT-199/venetoclax is already approved and in clinical use in the therapy of AML [10]. Initial studies with ABT-199 in CLL showed promising results. A phase I trial (NCT01328626) in patients with relapsed or refractory CLL reported overall response rates of 79% and complete response rates of 20%. Further studies led to the approval of ABT-199 for CLL treatment in 2016 [10,11,59]. ABT-199-based therapy has been reported to be tolerated much better and to be more effective than conventional chemo-immunotherapy in patients with CLL or AML, thus providing patients with a higher quality of life [60]. Resistance to therapy is still a major issue.
One mechanism of resistance to Bcl-2 inhibition is the upregulation of Mcl-1 [29,48]. An ongoing clinical trial currently evaluates the therapeutic effects of the combination of ABT-199 and MIK665 (NCT03672695) in AML [61]. The same combination also showed promising results in T cell lymphoblastic leukemia cells [62]. Most solid tumors, including HCC, depend on the expression of more than one BCL-2 molecule, supporting the idea to combine different BH3-mimetics [63]. Solid tumors have been shown to respond to ABT-199/MIK665 combinations [30]. For example, Mukherjee et al. showed that the combination of ABT-199 and MIK665 led to reduced cell viability and an increased PARP cleavage in different melanoma cell lines. ABT-199/MIK665 treatment was also effective in a corresponding mouse model, leading to tumor volume reduction with minimal toxicity. Seiller et al. showed efficacy of the same combination in multiple myeloma [43,64]. Various malignancies, including HCC, express Mcl-1 at a significantly higher level compared to healthy cells [65]. Mcl-1 gene amplifications are often found in human cancer. Mcl-1 appears to be a key factor for the resistance to conventional cancer therapies in some cancer types [66]. Targeting Mcl-1 simultaneously with Bcl-2 restores sensitivity toward ABT-199 in AML cells [67]. Therefore, we hypothesize that a combination of the selective Mcl-1 inhibitor MIK665 with ABT-199 could also be very effective in HCC.
Here, we present a possible new treatment option for HCC. Our data provide evidence that simultaneously targeting Bcl-2 and Mcl-1 with BH3-mimetics is successful across different HCC cell lines, irrespective of the p53 status (HepG2: wtp53, Hep3B: deleted p53 and Huh7: mutated p53) and Bcl-XL and NOXA expression. This was characterized by the release of cytochrome c, cleavage and activation of initiator caspase-9 and executioner caspase-3, and the cleavage of the apoptosis marker PARP. Both inhibitors act synergistically, and thus offer the possibility of bypassing existing protective mechanisms of the tumor. The inhibitors show little effect individually, but the combination effectively induces apoptosis in HCC cells. This indicates that cellular survival co-depends on Bcl-2 and Mcl-1. Cells that respond to simultaneous inhibition of multiple BCL-2 molecules do not necessarily overexpress all of these proteins [15,68]. Therefore, we cannot directly conclude the treatment response from the expression pattern of BCL-2 molecules in our cells. However, Hep3B and HepG2 cells, which demonstrated the highest rates of increase in caspase activity and cell death, had high amounts of at least one of Bcl-2 or Mcl-1 compared to the other cell lines. In contrast, Huh7 cells expressed low amounts of both proteins. Therefore, Huh7 cells are likely less dependent on these survival pathways, which may explain why these cells were less sensitive to the treatment used than the other HCC cell lines. Nevertheless, all cell lines showed synergistic effects upon drug combination, indicating co-dependencies of the cell lines on Bcl-2 and Mcl-1. This is in agreement with synergistic effects also demonstrated in different melanoma cell lines when ABT-199 and MIK665 were combined [43].
HCC cells overexpress anti-apoptotic proteins such as Bcl-2, or Mcl-1 in a heterogeneous manner [69]. Therefore, expression profiling of these resistance factors in HCC patients can help to develop new treatment options. Selecting patients with specific expression patterns or testing responsiveness before treatment using BH3 profiling could significantly increase treatment success [70]. Furthermore, BH3-mimetics might be used to enhance the efficacy of transarterial chemoembolization (TACE) in the treatment of intermediate-stage HCC. The combination with this local treatment could potentially reduce the inhibitor concentration needed.
BH3-mimetics bypass mutations in upstream signaling pathways. Both ABT-199 and MIK665 induce apoptosis in cells without an intact p53 tumor-suppressor pathway [18,71]. This is in line with our results showing that the application works in Hep3B cells, which do not express p53, as well as in HepG2, which express a wild type of p53 (Figure 1A). Using a combination of ABT-199 and MIK665 could therefore be a viable approach for HCC patients displaying a p53 mutation. Mutations of p53 occur in 25–30% of patients with HCC, and lead to shorter median OS and relapse-free survival times compared to patients with wild-type p53 [72,73]. The use of BH3-mimetics bypasses p53 mutations to successfully induce apoptosis.
In summary, our data indicate that the combination of two different BH3-mimetics induces apoptosis synergistically in HCC cell lines. This opens up new strategies for systemic treatment of HCC. Resistance can potentially be circumvented, and the dose of drugs can be reduced by combining them. This also reduces the risk of serious side effects. Therefore, the combination of BH3-mimetics presented here may represent an important step towards the future development and evaluation of a new treatment option in HCC.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/biomedicines11061666/s1, Supplementary Figure S1. Combination of ABT-199 and MIK665 leads to decreased mitochondrial membrane potential in Hep3B. Figure S2: Combination of ABT-199 and MIK665 results in increased cytochrome c release in Hep3B cells. Supplementary Figure S3: Caspase-9 activity is elevated up to 6 h after treatment with an ABT-199 and MIK665 combination. Supplementary Figure S4: Caspase-3/7 activity remains significantly enhanced after 24 h of treatment with a BH3-mimetics combination. Supplementary Figure S5: Caspase 8 (extrinsic apoptosis signaling pathway) is not or only to a very low extent induced by application of BH3-mimetics. Supplementary Figure S6: The combination of ABT-199 and MIK 665 increases cell death in Hep3B after 24 h treatment. Supplementary Figure S7: The combination of ABT-199 and MIK665 increases cell death rates in HepG2 after 24 h. Supplementary Figure S8: The combination of ABT-199 and MIK665 increases cell death in Huh7 after 24 h treatment. Supplementary Table S1: Summary of flow cytometry analysis shown in Figures S6–8. Supplementary Figure S9: The pan-caspase inhibitor zVAD inhibits cell death induction by ABT-199/MIK665. Supplementary Figure S10: Combination of BH3-mimetics leads to induction of synergistic cell death in Hep3B. Supplementary Figure S11: Combination of BH3-mimetics leads to induction of synergistic cell death in HepG2. Supplementary Figure S12: Combination of BH3-mimetics leads to induction of synergistic cell death in Huh7. Supplementary Methods - Determination of mitochondrial membrane potential.

Author Contributions

K.G. and M.B. initiated the project; M.M. (Marlen Michalski), K.G. and M.B. were responsible for experimental design; M.M. (Marlen Michalski), M.B. and F.W. performed the majority of the experiments; M.G. performed the immunofluorescence analysis; M.M. (Marlen Michalski) drafted the manuscript; M.B. prepared Figures; M.M. (Marlen Michalski), M.B., F.W., P.H., P.S., A.K., M.M. (Martina Müller) and K.G. wrote the manuscript. D.T., P.H., P.S. and C.K. have proofread the manuscript. D.T., C.K., S.S., A.K., M.M. (Martina Müller) and K.G. edited the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Wilhelm-Sander-Stiftung (2022.096.1).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

We thank Elisabeth Aschenbrenner for technical support, and the Wilhelm Sander Stiftung (2022.096.1) for financial support.

Conflicts of Interest

A.K. (scientific presentations and scientific advisory activities): Roche Pharma AG, Eisai GmbH, Abbvie Germany AG, Janssen-Cilag GmbH, MSD Sharp & Dohme GmbH, Boston Scientific Corp., Fujifilm Germany, Micro-Tech Germany. K.G. and D.T. receive financial support from the Wilhelm Sander Stiftung (2022.096.1). All other authors declare no conflict of interest.

References

  1. Hanahan, D. Hallmarks of Cancer: New Dimensions. Cancer Discov. 2022, 12, 31–46. [Google Scholar] [CrossRef] [PubMed]
  2. Galluzzi, L.; Vitale, I.; Aaronson, S.A.; Abrams, J.M.; Adam, D.; Agostinis, P.; Alnemri, E.S.; Altucci, L.; Amelio, I.; Andrews, D.W.; et al. Molecular mechanisms of cell death: Recommendations of the Nomenclature Committee on Cell Death 2018. Cell Death Differ. 2018, 25, 486–541. [Google Scholar] [CrossRef] [PubMed]
  3. Townsend, P.A.; Kozhevnikova, M.V.; Cexus, O.N.F.; Zamyatnin, A.A.; Soond, S.M. BH3-mimetics: Recent developments in cancer therapy. J. Exp. Clin. Cancer Res. 2021, 40, 355. [Google Scholar] [CrossRef] [PubMed]
  4. Happo, L.; Strasser, A.; Cory, S. BH3-only proteins in apoptosis at a glance. J. Cell Sci. 2012, 125, 1081–1087. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Müller, M.; Wilder, S.; Bannasch, D.; Israeli, D.; Lehlbach, K.; Li-Weber, M.; Friedman, S.L.; Galle, P.R.; Stremmel, W.; Oren, M.; et al. p53 activates the CD95 (APO-1/Fas) gene in response to DNA damage by anticancer drugs. J. Exp. Med. 1998, 188, 2033–2045. [Google Scholar] [CrossRef] [Green Version]
  6. Villunger, A.; Michalak, E.M.; Coultas, L.; Müllauer, F.; Böck, G.; Ausserlechner, M.J.; Adams, J.M.; Strasser, A. p53- and drug-induced apoptotic responses mediated by BH3-only proteins puma and noxa. Science 2003, 302, 1036–1038. [Google Scholar] [CrossRef] [Green Version]
  7. Pflaum, J.; Schlosser, S.; Müller, M. p53 Family and Cellular Stress Responses in Cancer. Front. Oncol. 2014, 4, 285. [Google Scholar] [CrossRef] [Green Version]
  8. Merino, D.; Kelly, G.L.; Lessene, G.; Wei, A.H.; Roberts, A.W.; Strasser, A. BH3-Mimetic Drugs: Blazing the Trail for New Cancer Medicines. Cancer Cell 2018, 34, 879–891. [Google Scholar] [CrossRef] [Green Version]
  9. Souers, A.J.; Leverson, J.D.; Boghaert, E.R.; Ackler, S.L.; Catron, N.D.; Chen, J.; Dayton, B.D.; Ding, H.; Enschede, S.H.; Fairbrother, W.J.; et al. ABT-199, a potent and selective BCL-2 inhibitor, achieves antitumor activity while sparing platelets. Nat. Med. 2013, 19, 202–208. [Google Scholar] [CrossRef]
  10. Deeks, E.D. Venetoclax: First Global Approval. Drugs 2016, 76, 979–987. [Google Scholar] [CrossRef]
  11. Hafezi, S.; Rahmani, M. Targeting BCL-2 in Cancer: Advances, Challenges, and Perspectives. Cancers 2021, 13, 1292. [Google Scholar] [CrossRef] [PubMed]
  12. Tahir, S.K.; Smith, M.L.; Hessler, P.; Rapp, L.R.; Idler, K.B.; Park, C.H.; Leverson, J.D.; Lam, L.T. Potential mechanisms of resistance to venetoclax and strategies to circumvent it. BMC Cancer 2017, 17, 399. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Soderquist, R.S.; Crawford, L.; Liu, E.; Lu, M.; Agarwal, A.; Anderson, G.R.; Lin, K.H.; Winter, P.S.; Cakir, M.; Wood, K.C. Systematic mapping of BCL-2 gene dependencies in cancer reveals molecular determinants of BH3 mimetic sensitivity. Nat. Commun. 2018, 9, 3513. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. FDA Medication Guide Venclexta. Available online: https://www.accessdata.fda.gov/drugsatfda_docs/label/2021/208573s026lbl.pdf#page=54 (accessed on 25 August 2022).
  15. Diepstraten, S.T.; Anderson, M.A.; Czabotar, P.E.; Lessene, G.; Strasser, A.; Kelly, G.L. The manipulation of apoptosis for cancer therapy using BH3-mimetic drugs. Nat. Rev. Cancer 2022, 22, 45–64. [Google Scholar] [CrossRef] [PubMed]
  16. Vaillant, F.; Merino, D.; Lee, L.; Breslin, K.; Pal, B.; Ritchie, M.E.; Smyth, G.K.; Christie, M.; Phillipson, L.J.; Burns, C.J.; et al. Targeting BCL-2 with the BH3 mimetic ABT-199 in estrogen receptor-positive breast cancer. Cancer Cell 2013, 24, 120–129. [Google Scholar] [CrossRef] [Green Version]
  17. Zhou, Y.; Liu, H.; Xue, R.; Tang, W.; Zhang, S. BH3 Mimetic ABT-199 Enhances the Sensitivity of Gemcitabine in Pancreatic Cancer in vitro and in vivo. Dig. Dis. Sci. 2018, 63, 3367–3375. [Google Scholar] [CrossRef]
  18. Kotschy, A.; Szlavik, Z.; Murray, J.; Davidson, J.; Maragno, A.L.; Le Toumelin-Braizat, G.; Chanrion, M.; Kelly, G.L.; Gong, J.-N.; Moujalled, D.M.; et al. The MCL1 inhibitor S63845 is tolerable and effective in diverse cancer models. Nature 2016, 538, 477–482. [Google Scholar] [CrossRef]
  19. Michels, J.; Obrist, F.; Vitale, I.; Lissa, D.; Garcia, P.; Behnam-Motlagh, P.; Kohno, K.; Wu, G.S.; Brenner, C.; Castedo, M.; et al. MCL-1 dependency of cisplatin-resistant cancer cells. Biochem. Pharmacol. 2014, 92, 55–61. [Google Scholar] [CrossRef]
  20. Sung, H.; Ferlay, J.; Siegel, R.L.; Laversanne, M.; Soerjomataram, I.; Jemal, A.; Bray, F. Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA Cancer J. Clin. 2021, 71, 209–249. [Google Scholar] [CrossRef]
  21. Reig, M.; Forner, A.; Rimola, J.; Ferrer-Fàbrega, J.; Burrel, M.; Garcia-Criado, Á.; Kelley, R.K.; Galle, P.R.; Mazzaferro, V.; Salem, R.; et al. BCLC strategy for prognosis prediction and treatment recommendation: The 2022 update. J. Hepatol. 2022, 76, 681–693. [Google Scholar] [CrossRef]
  22. Abou-Alfa, G.K.; Lau, G.; Kudo, M.; Chan, S.L.; Kelley, R.K.; Furuse, J.; Sukeepaisarnjaroen, W.; Kang, Y.-K.; van Dao, T.; de Toni, E.N.; et al. Tremelimumab plus Durvalumab in Unresectable Hepatocellular Carcinoma. NEJM Evid. 2022, 1, EVIDoa2100070. [Google Scholar] [CrossRef]
  23. Cheng, A.-L.; Qin, S.; Ikeda, M.; Galle, P.R.; Ducreux, M.; Kim, T.-Y.; Lim, H.Y.; Kudo, M.; Breder, V.; Merle, P.; et al. Updated efficacy and safety data from IMbrave150: Atezolizumab plus bevacizumab vs. sorafenib for unresectable hepatocellular carcinoma. J. Hepatol. 2022, 76, 862–873. [Google Scholar] [CrossRef] [PubMed]
  24. Bruix, J.; Chan, S.L.; Galle, P.R.; Rimassa, L.; Sangro, B. Systemic treatment of hepatocellular carcinoma: An EASL position paper. J. Hepatol. 2021, 75, 960–974. [Google Scholar] [CrossRef]
  25. Vogel, A.; Cervantes, A.; Chau, I.; Daniele, B.; Llovet, J.M.; Meyer, T.; Nault, J.-C.; Neumann, U.; Ricke, J.; Sangro, B.; et al. Hepatocellular carcinoma: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann. Oncol. 2018, 29, iv238–iv255. [Google Scholar] [CrossRef] [PubMed]
  26. Galle, P.R.; Forner, A.; Llovet, J.M.; Mazzaferro, V.; Piscaglia, F.; Raoul, J.-L.; Schirmacher, P.; Vilgrain, V. EASL Clinical Practice Guidelines: Management of hepatocellular carcinoma. J. Hepatol. 2018, 69, 182–236. [Google Scholar] [CrossRef] [Green Version]
  27. Tümen, D.; Heumann, P.; Gülow, K.; Demirci, C.-N.; Cosma, L.-S.; Müller, M.; Kandulski, A. Pathogenesis and Current Treatment Strategies of Hepatocellular Carcinoma. Biomedicines 2022, 10, 3202. [Google Scholar] [CrossRef]
  28. Wang, H.; Guo, M.; Wei, H.; Chen, Y. Targeting MCL-1 in cancer: Current status and perspectives. J. Hematol. Oncol. 2021, 14, 67. [Google Scholar] [CrossRef]
  29. Fleischer, B.; Schulze-Bergkamen, H.; Schuchmann, M.; Weber, A.; Biesterfeld, S.; Müller, M.; Krammer, P.H.; Galle, P.R. Mcl-1 is an anti-apoptotic factor for human hepatocellular carcinoma. Int. J. Oncol. 2006, 28, 25–32. [Google Scholar] [CrossRef] [Green Version]
  30. Kehr, S.; Vogler, M. It’s time to die: BH3 mimetics in solid tumors. Biochim. Et Biophys. Acta Mol. Cell Res. 2021, 1868, 118987. [Google Scholar] [CrossRef]
  31. Algarín, E.M.; Díaz-Tejedor, A.; Mogollón, P.; Hernández-García, S.; Corchete, L.A.; San-Segundo, L.; Martín-Sánchez, M.; González-Méndez, L.; Schoumacher, M.; Banquet, S.; et al. Preclinical evaluation of the simultaneous inhibition of MCL-1 and BCL-2 with the combination of S63845 and venetoclax in multiple myeloma. Haematologica 2020, 105, e116–e120. [Google Scholar] [CrossRef] [Green Version]
  32. Verfaillie, T.; van Vliet, A.; Garg, A.D.; Dewaele, M.; Rubio, N.; Gupta, S.; de Witte, P.; Samali, A.; Agostinis, P. Pro-apoptotic signaling induced by photo-oxidative ER stress is amplified by Noxa, not Bim. Biochem. Biophys. Res. Commun. 2013, 438, 500–506. [Google Scholar] [CrossRef] [PubMed]
  33. Kanda, T.; Yokosuka, O.; Imazeki, F.; Arai, M.; Saisho, H. Enhanced Sensitivity of Human Hepatoma Cells to 5-Fluorouracil by Small Interfering RNA Targeting Bcl-2. DNA Cell Biol. 2005, 24, 805–809. [Google Scholar] [CrossRef] [PubMed]
  34. Chen, K.-F.; Lin, J.-P.; Shiau, C.-W.; Tai, W.-T.; Liu, C.-Y.; Yu, H.-C.; Chen, P.-J.; Cheng, A.-L. Inhibition of Bcl-2 improves effect of LCL161, a SMAC mimetic, in hepatocellular carcinoma cells. Biochem. Pharmacol. 2012, 84, 268–277. [Google Scholar] [CrossRef] [PubMed]
  35. Hikita, H.; Takehara, T.; Shimizu, S.; Kodama, T.; Shigekawa, M.; Iwase, K.; Hosui, A.; Miyagi, T.; Tatsumi, T.; Ishida, H.; et al. The Bcl-xL inhibitor, ABT-737, efficiently induces apoptosis and suppresses growth of hepatoma cells in combination with sorafenib. Hepatology 2010, 52, 1310–1321. [Google Scholar] [CrossRef] [PubMed]
  36. Cucarull, B.; Tutusaus, A.; Subías, M.; Stefanovic, M.; Hernáez-Alsina, T.; Boix, L.; Reig, M.; García de Frutos, P.; Marí, M.; Colell, A.; et al. Regorafenib Alteration of the BCL-xL/MCL-1 Ratio Provides a Therapeutic Opportunity for BH3-Mimetics in Hepatocellular Carcinoma Models. Cancers 2020, 12, 332. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Vogt, F.; Lieber, J.; Dewerth, A.; Hoh, A.; Fuchs, J.; Armeanu-Ebinger, S. BH3 mimetics reduce adhesion and migration of hepatoblastoma and hepatocellular carcinoma cells. Exp. Cell Res. 2013, 319, 1443–1450. [Google Scholar] [CrossRef]
  38. Arnoult, D.; Petit, F.; Lelièvre, J.D.; Lecossier, D.; Hance, A.; Monceaux, V.; Hurtrel, B.; Ho Tsong Fang, R.; Ameisen, J.C.; Estaquier, J. Caspase-dependent and -independent T-cell death pathways in pathogenic simian immunodeficiency virus infection: Relationship to disease progression. Cell Death Differ. 2003, 10, 1240–1252. [Google Scholar] [CrossRef] [Green Version]
  39. Kennedy, R.; Celis, E. T helper lymphocytes rescue CTL from activation-induced cell death. J. Immunol. 2006, 177, 2862–2872. [Google Scholar] [CrossRef] [Green Version]
  40. Neumann, L.; Pforr, C.; Beaudouin, J.; Pappa, A.; Fricker, N.; Krammer, P.H.; Lavrik, I.N.; Eils, R. Dynamics within the CD95 death-inducing signaling complex decide life and death of cells. Mol. Syst. Biol. 2010, 6, 352. [Google Scholar] [CrossRef]
  41. Kaminski, M.; Kiessling, M.; Süss, D.; Krammer, P.H.; Gülow, K. Novel role for mitochondria: Protein kinase Ctheta-dependent oxidative signaling organelles in activation-induced T-cell death. Mol. Cell. Biol. 2007, 27, 3625–3639. [Google Scholar] [CrossRef] [Green Version]
  42. Haderer, M.; Neubert, P.; Rinner, E.; Scholtis, A.; Broncy, L.; Gschwendtner, H.; Kandulski, A.; Pavel, V.; Mehrl, A.; Brochhausen, C.; et al. Novel pathomechanism for spontaneous bacterial peritonitis: Disruption of cell junctions by cellular and bacterial proteases. Gut 2022, 71, 580–592. [Google Scholar] [CrossRef] [PubMed]
  43. Mukherjee, N.; Amato, C.M.; Skees, J.; Todd, K.J.; Lambert, K.A.; Robinson, W.A.; van Gulick, R.; Weight, R.M.; Dart, C.R.; Tobin, R.P.; et al. Simultaneously Inhibiting BCL2 and MCL1 Is a Therapeutic Option for Patients with Advanced Melanoma. Cancers 2020, 12, 2182. [Google Scholar] [CrossRef] [PubMed]
  44. Chou, T.-C. Theoretical basis, experimental design, and computerized simulation of synergism and antagonism in drug combination studies. Pharmacol. Rev. 2006, 58, 621–681. [Google Scholar] [CrossRef] [PubMed]
  45. Inoue-Yamauchi, A.; Jeng, P.S.; Kim, K.; Chen, H.-C.; Han, S.; Ganesan, Y.T.; Ishizawa, K.; Jebiwott, S.; Dong, Y.; Pietanza, M.C.; et al. Targeting the differential addiction to anti-apoptotic BCL-2 family for cancer therapy. Nat. Commun. 2017, 8, 16078. [Google Scholar] [CrossRef] [Green Version]
  46. Choudhary, G.S.; Al-Harbi, S.; Mazumder, S.; Hill, B.T.; Smith, M.R.; Bodo, J.; Hsi, E.D.; Almasan, A. MCL-1 and BCL-xL-dependent resistance to the BCL-2 inhibitor ABT-199 can be overcome by preventing PI3K/AKT/mTOR activation in lymphoid malignancies. Cell Death Dis. 2015, 6, e1593. [Google Scholar] [CrossRef] [Green Version]
  47. Chiou, J.-T.; Huang, N.-C.; Huang, C.-H.; Wang, L.-J.; Lee, Y.-C.; Shi, Y.-J.; Chang, L.-S. NOXA-mediated degradation of MCL1 and BCL2L1 causes apoptosis of daunorubicin-treated human acute myeloid leukemia cells. J. Cell. Physiol. 2021, 236, 7356–7375. [Google Scholar] [CrossRef]
  48. Bose, P.; Gandhi, V.; Konopleva, M. Pathways and mechanisms of venetoclax resistance. Leuk. Lymphoma 2017, 58, 2026–2039. [Google Scholar] [CrossRef]
  49. Fischer, U.; Jänicke, R.U.; Schulze-Osthoff, K. Many cuts to ruin: A comprehensive update of caspase substrates. Cell Death Differ. 2003, 10, 76–100. [Google Scholar] [CrossRef] [Green Version]
  50. Yang, J.D.; Hainaut, P.; Gores, G.J.; Amadou, A.; Plymoth, A.; Roberts, L.R. A global view of hepatocellular carcinoma: Trends, risk, prevention and management. Nat. Rev. Gastroenterol. Hepatol. 2019, 16, 589–604. [Google Scholar] [CrossRef]
  51. Llovet, J.M.; Montal, R.; Sia, D.; Finn, R.S. Molecular therapies and precision medicine for hepatocellular carcinoma. Nat. Rev. Clin. Oncol. 2018, 15, 599–616. [Google Scholar] [CrossRef]
  52. Finn, R.S.; Qin, S.; Ikeda, M.; Galle, P.R.; Ducreux, M.; Kim, T.-Y.; Kudo, M.; Breder, V.; Merle, P.; Kaseb, A.O.; et al. Atezolizumab plus Bevacizumab in Unresectable Hepatocellular Carcinoma. N. Engl. J. Med. 2020, 382, 1894–1905. [Google Scholar] [CrossRef] [PubMed]
  53. Finn, R.S.; Kudo, M.; Merle, P.; Meyer, T.; Qin, S.; Ikeda, M.; Xu, R.; Edeline, J.; Ryoo, B.-Y.; Ren, Z.; et al. LBA34 Primary results from the phase III LEAP-002 study: Lenvatinib plus pembrolizumab versus lenvatinib as first-line (1L) therapy for advanced hepatocellular carcinoma (aHCC). Ann. Oncol. 2022, 33, S1401. [Google Scholar] [CrossRef]
  54. Llovet, J.M.; Kelley, R.K.; Villanueva, A.; Singal, A.G.; Pikarsky, E.; Roayaie, S.; Lencioni, R.; Koike, K.; Zucman-Rossi, J.; Finn, R.S. Hepatocellular carcinoma. Nat. Rev. Dis. Prim. 2021, 7, 6. [Google Scholar] [CrossRef] [PubMed]
  55. Phase I Study of MIK665, a Mcl-1 Inhibitor, in Patients with Refractory or Relapsed Lymphoma or Multiple Myeloma—Full Text View—ClinicalTrials.gov. Available online: https://www.clinicaltrials.gov/ct2/show/NCT02992483 (accessed on 23 May 2023).
  56. Phase I Study of S64315 Administred Intravenously in Patients with Acute Myeloid Leukaemia or Myelodysplastic Syndrome—Full Text View—ClinicalTrials.gov. Available online: https://www.clinicaltrials.gov/ct2/show/NCT02979366?term=NCT02979366&draw=2&rank=1 (accessed on 23 May 2023).
  57. AMG 176 First in Human Trial in Participants with Relapsed or Refractory Multiple Myeloma and Participants with Relapsed or Refractory Acute Myeloid Leukemia—Full Text View—ClinicalTrials.gov. Available online: https://www.clinicaltrials.gov/ct2/show/NCT02675452?term=NCT02675452&draw=2&rank=1 (accessed on 23 May 2023).
  58. A Study of PRT1419 in Patients with Relapsed/Refractory Hematologic Malignancies—Full Text View—ClinicalTrials.gov. Available online: https://www.clinicaltrials.gov/ct2/show/NCT04543305?term=NCT04543305&draw=2&rank=1 (accessed on 23 May 2023).
  59. Roberts, A.W.; Davids, M.S.; Pagel, J.M.; Kahl, B.S.; Puvvada, S.D.; Gerecitano, J.F.; Kipps, T.J.; Anderson, M.A.; Brown, J.R.; Gressick, L.; et al. Targeting BCL2 with Venetoclax in Relapsed Chronic Lymphocytic Leukemia. N. Engl. J. Med. 2016, 374, 311–322. [Google Scholar] [CrossRef]
  60. Lasica, M.; Anderson, M.A. Review of Venetoclax in CLL, AML and Multiple Myeloma. J. Pers. Med. 2021, 11, 463. [Google Scholar] [CrossRef]
  61. Institut de Recherches Internationales Servier|ADIR, a Servier Group company|Servier. Phase I Dose Escalation Study of Intravenously Administered S64315 in Combination with Orally Administered Venetoclax in Patients with Acute Myeloid Leukaemia: NCT03672695, CL1-64315-002|2018-001809-88. Available online: https://ClinicalTrials.gov/show/NCT03672695 (accessed on 26 May 2023).
  62. Li, Z.; He, S.; Look, A.T. The MCL1-specific inhibitor S63845 acts synergistically with venetoclax/ABT-199 to induce apoptosis in T-cell acute lymphoblastic leukemia cells. Leukemia 2019, 33, 262–266. [Google Scholar] [CrossRef]
  63. Fairlie, W.D.; Lee, E.F. Targeting the BCL-2-regulated apoptotic pathway for the treatment of solid cancers. Biochem. Soc. Trans. 2021, 49, 2397–2410. [Google Scholar] [CrossRef]
  64. Seiller, C.; Maiga, S.; Touzeau, C.; Bellanger, C.; Kervoëlen, C.; Descamps, G.; Maillet, L.; Moreau, P.; Pellat-Deceunynck, C.; Gomez-Bougie, P.; et al. Dual targeting of BCL2 and MCL1 rescues myeloma cells resistant to BCL2 and MCL1 inhibitors associated with the formation of BAX/BAK hetero-complexes. Cell Death Dis. 2020, 11, 316. [Google Scholar] [CrossRef]
  65. Sieghart, W.; Losert, D.; Strommer, S.; Cejka, D.; Schmid, K.; Rasoul-Rockenschaub, S.; Bodingbauer, M.; Crevenna, R.; Monia, B.P.; Peck-Radosavljevic, M.; et al. Mcl-1 overexpression in hepatocellular carcinoma: A potential target for antisense therapy. J. Hepatol. 2006, 44, 151–157. [Google Scholar] [CrossRef]
  66. Akgul, C. Mcl-1 is a potential therapeutic target in multiple types of cancer. Cell. Mol. Life Sci. 2009, 66, 1326–1336. [Google Scholar] [CrossRef]
  67. Ramsey, H.E.; Fischer, M.A.; Lee, T.; Gorska, A.E.; Arrate, M.P.; Fuller, L.; Boyd, K.L.; Strickland, S.A.; Sensintaffar, J.; Hogdal, L.J.; et al. A Novel MCL1 Inhibitor Combined with Venetoclax Rescues Venetoclax-Resistant Acute Myelogenous Leukemia. Cancer Discov. 2018, 8, 1566–1581. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  68. Certo, M.; Del Gaizo Moore, V.; Nishino, M.; Wei, G.; Korsmeyer, S.; Armstrong, S.A.; Letai, A. Mitochondria primed by death signals determine cellular addiction to antiapoptotic BCL-2 family members. Cancer Cell 2006, 9, 351–365. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  69. D’Aguanno, S.; Del Bufalo, D. Inhibition of Anti-Apoptotic Bcl-2 Proteins in Preclinical and Clinical Studies: Current Overview in Cancer. Cells 2020, 9, 1287. [Google Scholar] [CrossRef] [PubMed]
  70. Touzeau, C.; Ryan, J.; Guerriero, J.; Moreau, P.; Chonghaile, T.N.; Le Gouill, S.; Richardson, P.; Anderson, K.; Amiot, M.; Letai, A. BH3 profiling identifies heterogeneous dependency on Bcl-2 family members in multiple myeloma and predicts sensitivity to BH3 mimetics. Leukemia 2016, 30, 761–764. [Google Scholar] [CrossRef]
  71. Anderson, M.A.; Deng, J.; Seymour, J.F.; Tam, C.; Kim, S.Y.; Fein, J.; Yu, L.; Brown, J.R.; Westerman, D.; Si, E.G.; et al. The BCL2 selective inhibitor venetoclax induces rapid onset apoptosis of CLL cells in patients via a TP53-independent mechanism. Blood 2016, 127, 3215–3224. [Google Scholar] [CrossRef] [Green Version]
  72. Long, J.; Wang, A.; Bai, Y.; Lin, J.; Yang, X.; Wang, D.; Yang, X.; Jiang, Y.; Zhao, H. Development and validation of a TP53-associated immune prognostic model for hepatocellular carcinoma. EBioMedicine 2019, 42, 363–374. [Google Scholar] [CrossRef] [Green Version]
  73. Zucman-Rossi, J.; Villanueva, A.; Nault, J.-C.; Llovet, J.M. Genetic Landscape and Biomarkers of Hepatocellular Carcinoma. Gastroenterology 2015, 149, 1226–1239.e4. [Google Scholar] [CrossRef] [Green Version]
Biomedicines 11 01666 g001 550
Figure 1. Determination of p53 and BCL-2 family protein expression in different HCC cell lines. (A–E) Western blot analyses of p53 and BCL-2 family members Bcl-2, Mcl-1, Bcl-XL and NOXA in Hep3B, HepG2 and Huh7. The three cell lines displayed a differential expression pattern. Shown is a representative western blot. (F–I) Densitometric analysis of western blots: Shown are the relative amounts of Bcl-2, Mcl-1, Bcl-XL and NOXA in Hep3B (red), HepG2 (blue) and Huh7 (green) normalized to β-actin (n = 3, mean ± SD).
Figure 1. Determination of p53 and BCL-2 family protein expression in different HCC cell lines. (A–E) Western blot analyses of p53 and BCL-2 family members Bcl-2, Mcl-1, Bcl-XL and NOXA in Hep3B, HepG2 and Huh7. The three cell lines displayed a differential expression pattern. Shown is a representative western blot. (F–I) Densitometric analysis of western blots: Shown are the relative amounts of Bcl-2, Mcl-1, Bcl-XL and NOXA in Hep3B (red), HepG2 (blue) and Huh7 (green) normalized to β-actin (n = 3, mean ± SD).
Biomedicines 11 01666 g001
Biomedicines 11 01666 g002 550
Figure 2. Combination of ABT-199 and MIK665 results in cytochrome c release in Hep3B cells. (A,B) Corresponding isotype controls. (C) DMSO treatment was used as vehicle control. (D) Cells were treated with 30 µM FCCP for 3 h to induce MOMP as a positive control. (E–J) Immunofluorescence of TOMM20 and cytochrome c in Hep3B cells. Cells were subjected to ABT-199 and MIK665 for 4 h at the indicated concentrations as single or combined treatment (n = 3).
Figure 2. Combination of ABT-199 and MIK665 results in cytochrome c release in Hep3B cells. (A,B) Corresponding isotype controls. (C) DMSO treatment was used as vehicle control. (D) Cells were treated with 30 µM FCCP for 3 h to induce MOMP as a positive control. (E–J) Immunofluorescence of TOMM20 and cytochrome c in Hep3B cells. Cells were subjected to ABT-199 and MIK665 for 4 h at the indicated concentrations as single or combined treatment (n = 3).
Biomedicines 11 01666 g002
Biomedicines 11 01666 g003 550
Figure 3. Combination of the BH3-mimetics ABT-199 and MIK665 results in increased cleavage and activity of caspase-9 in HCC cell lines. (A–C) Western blot analyses of (cleaved) caspase-9. Shown is a representative western blot. Cells were treated with either one BH3-mimetic or a combination of ABT-199 or MIK665 inhibitors. DMSO was used as a vehicle control. (D,E) Activity assays of caspase-9 in HCC cell lines (Hep3B (red), HepG2 (blue), and Huh7 (green)) after 4 h of treatment with either ABT-199 or MIK665 alone or in combination at the indicated concentrations (the dotted line separates the single treatment from the combination treatment with ABT-199 and MIK665). Data show a specific increase in activity compared to DMSO-treated controls (n = 3, mean ± SEM) (* p < 0.05; ** p < 0.01; *** p < 0.001 compared to treatment with one inhibitor alone).
Figure 3. Combination of the BH3-mimetics ABT-199 and MIK665 results in increased cleavage and activity of caspase-9 in HCC cell lines. (A–C) Western blot analyses of (cleaved) caspase-9. Shown is a representative western blot. Cells were treated with either one BH3-mimetic or a combination of ABT-199 or MIK665 inhibitors. DMSO was used as a vehicle control. (D,E) Activity assays of caspase-9 in HCC cell lines (Hep3B (red), HepG2 (blue), and Huh7 (green)) after 4 h of treatment with either ABT-199 or MIK665 alone or in combination at the indicated concentrations (the dotted line separates the single treatment from the combination treatment with ABT-199 and MIK665). Data show a specific increase in activity compared to DMSO-treated controls (n = 3, mean ± SEM) (* p < 0.05; ** p < 0.01; *** p < 0.001 compared to treatment with one inhibitor alone).
Biomedicines 11 01666 g003
Biomedicines 11 01666 g004 550
Figure 4. Combination of ABT-199 and MIK665 results in increased cleavage and activity of caspase-3 in HCC cell lines. (A–C) Western blot analyses of (cleaved) caspase-3. Shown is a representative western blot. Cells were treated with either one of the two BH3-mimetics ABT-199 or MIK665 alone or a combination of both inhibitors. DMSO was used as vehicle control. (D,E) Activity assays of caspase-3/7 in HCC cell lines (Hep3B (red), HepG2 (blue), and Huh7 (green)) after 4 h of treatment with either ABT-199 or MIK665 alone or in combination at the indicated concentrations (the dotted line separates the single treatment from the combination treatment with ABT-199 and MIK665). Data show a specific increase in activity compared to DMSO-treated controls (n = 3, mean ± SEM). (F–H) Western blot analyses of (cleaved) PARP. Shown is a representative western blot. Cells were incubated with ABT-199 and MIK665 at the indicated concentrations as single or combined treatment. DMSO was used as vehicle control. (* p < 0.05; ** p < 0.01; *** p < 0.001; **** p < 0.0001 compared to single drug treatment).
Figure 4. Combination of ABT-199 and MIK665 results in increased cleavage and activity of caspase-3 in HCC cell lines. (A–C) Western blot analyses of (cleaved) caspase-3. Shown is a representative western blot. Cells were treated with either one of the two BH3-mimetics ABT-199 or MIK665 alone or a combination of both inhibitors. DMSO was used as vehicle control. (D,E) Activity assays of caspase-3/7 in HCC cell lines (Hep3B (red), HepG2 (blue), and Huh7 (green)) after 4 h of treatment with either ABT-199 or MIK665 alone or in combination at the indicated concentrations (the dotted line separates the single treatment from the combination treatment with ABT-199 and MIK665). Data show a specific increase in activity compared to DMSO-treated controls (n = 3, mean ± SEM). (F–H) Western blot analyses of (cleaved) PARP. Shown is a representative western blot. Cells were incubated with ABT-199 and MIK665 at the indicated concentrations as single or combined treatment. DMSO was used as vehicle control. (* p < 0.05; ** p < 0.01; *** p < 0.001; **** p < 0.0001 compared to single drug treatment).
Biomedicines 11 01666 g004
Biomedicines 11 01666 g005 550
Figure 5. Treatment with combinations of ABT-199 and MIK665 induces cell death in Hep3B, HepG2 and Huh7. (A,C,E) Specific cell death was analyzed in HCC cells treated with a constant ABT-199 concentration (5 µM) and increasing MIK665 concentrations as indicated for up to 48 h (n = 3, mean ± SD). (B,D,F) Specific cell death was analyzed in HCC cells treated with a steady MIK665 concentration (6 µM) and increasing ABT-199 concentrations as indicated for up to 48 h (the dotted line separates the single treatment from the combination treatment with ABT-199 and MIK665) (n = 3, mean ± SD) (* p < 0.05; ** p < 0.01; *** p < 0.001; **** p < 0.0001 compared to single drug treatment).
Figure 5. Treatment with combinations of ABT-199 and MIK665 induces cell death in Hep3B, HepG2 and Huh7. (A,C,E) Specific cell death was analyzed in HCC cells treated with a constant ABT-199 concentration (5 µM) and increasing MIK665 concentrations as indicated for up to 48 h (n = 3, mean ± SD). (B,D,F) Specific cell death was analyzed in HCC cells treated with a steady MIK665 concentration (6 µM) and increasing ABT-199 concentrations as indicated for up to 48 h (the dotted line separates the single treatment from the combination treatment with ABT-199 and MIK665) (n = 3, mean ± SD) (* p < 0.05; ** p < 0.01; *** p < 0.001; **** p < 0.0001 compared to single drug treatment).
Biomedicines 11 01666 g005
Biomedicines 11 01666 g006 550
Figure 6. Combination treatment with ABT-199 and MIK665 has synergistic effects in HCC cells. (A–F) Graphs show the IC50 of monotherapy and combinations of ABT-199 and MIK665 administered to the HCC cell lines Hep3B, HepG2 and Huh7 for up to 48 h of treatment. For combination treatments, all cell lines were treated with a steady concentration of 5 µM ABT-199 or 6 µM MIK665 and increasing concentrations of the respective other BH3-mimetic (n = 3, mean ± SD). IC50 calculation was executed with GraphPad Prism 8 (* p <0.05; ** p <0.01; *** p <0.001; **** p < 0.0001 compared to single drug treatment). (G,H) Graphs show dot plots of the calculated combination indices (CI) of the interpolated IC50 of the ABT-199/MIK665 combinations at 24 h and 48 h of treatment. CI was calculated using CompuSyn (version 1) (http://www.combosyn.com/ (accessed on 26 May 2023)). CI values < 1 indicate a synergistic effect of the combination treatment. Smaller CI values indicate stronger synergism. A CI < 0.3 (dotted line) signifies strong to very strong synergism [44].
Figure 6. Combination treatment with ABT-199 and MIK665 has synergistic effects in HCC cells. (A–F) Graphs show the IC50 of monotherapy and combinations of ABT-199 and MIK665 administered to the HCC cell lines Hep3B, HepG2 and Huh7 for up to 48 h of treatment. For combination treatments, all cell lines were treated with a steady concentration of 5 µM ABT-199 or 6 µM MIK665 and increasing concentrations of the respective other BH3-mimetic (n = 3, mean ± SD). IC50 calculation was executed with GraphPad Prism 8 (* p <0.05; ** p <0.01; *** p <0.001; **** p < 0.0001 compared to single drug treatment). (G,H) Graphs show dot plots of the calculated combination indices (CI) of the interpolated IC50 of the ABT-199/MIK665 combinations at 24 h and 48 h of treatment. CI was calculated using CompuSyn (version 1) (http://www.combosyn.com/ (accessed on 26 May 2023)). CI values < 1 indicate a synergistic effect of the combination treatment. Smaller CI values indicate stronger synergism. A CI < 0.3 (dotted line) signifies strong to very strong synergism [44].
Biomedicines 11 01666 g006
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Michalski, M.; Bauer, M.; Walz, F.; Tümen, D.; Heumann, P.; Stöckert, P.; Gunckel, M.; Kunst, C.; Kandulski, A.; Schmid, S.; et al. Simultaneous Inhibition of Mcl-1 and Bcl-2 Induces Synergistic Cell Death in Hepatocellular Carcinoma. Biomedicines 2023, 11, 1666. https://doi.org/10.3390/biomedicines11061666

AMA Style

Michalski M, Bauer M, Walz F, Tümen D, Heumann P, Stöckert P, Gunckel M, Kunst C, Kandulski A, Schmid S, et al. Simultaneous Inhibition of Mcl-1 and Bcl-2 Induces Synergistic Cell Death in Hepatocellular Carcinoma. Biomedicines. 2023; 11(6):1666. https://doi.org/10.3390/biomedicines11061666

Chicago/Turabian Style

Michalski, Marlen, Magdalena Bauer, Franziska Walz, Deniz Tümen, Philipp Heumann, Petra Stöckert, Manuela Gunckel, Claudia Kunst, Arne Kandulski, Stephan Schmid, and et al. 2023. "Simultaneous Inhibition of Mcl-1 and Bcl-2 Induces Synergistic Cell Death in Hepatocellular Carcinoma" Biomedicines 11, no. 6: 1666. https://doi.org/10.3390/biomedicines11061666

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop