Next Article in Journal
Prolonged Length of Stay in the Emergency Department and Increased Risk of In-Hospital Cardiac Arrest: A nationwide Population-Based Study in South Korea, 2016–2017
Previous Article in Journal
Clinical Course and Outcomes of Severe Covid-19: A National Scale Study
Previous Article in Special Issue
Saliva Diagnosis as a Disease Predictor
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Identification of a Clinical Cutoff Value for Multiplex KRASG12/G13 Mutation Detection in Colorectal Adenocarcinoma Patients Using Digital Droplet PCR, and Comparison with Sanger Sequencing and PNA Clamping Assay

1
Department of Surgery, Chungnam National University Hospital, Daejeon 282, Korea
2
The Biobank of Chungnam National University Hospital, Daejeon 282, Korea
3
Department of Pathology, Chungnam National University School of Medicine, Daejeon 266, Korea
4
Clinical Trials Center of Chungnam National University Hospital, Daejeon 282, Korea
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
J. Clin. Med. 2020, 9(7), 2283; https://doi.org/10.3390/jcm9072283
Submission received: 27 June 2020 / Revised: 8 July 2020 / Accepted: 16 July 2020 / Published: 18 July 2020

Abstract

:
KRAS (Kirsten rat sarcoma 2 viral oncogene homolog) is a major predictive marker for anti-epidermal growth factor receptor treatment, and determination of KRAS mutational status is crucial for successful management of colorectal adenocarcinoma. More standardized and accurate methods for testing KRAS mutation, which is vital for therapeutic decision-making, are required. Digital droplet polymerase chain reaction (ddPCR) is an advanced digital PCR technology developed to provide absolute quantitation of target DNA. In this study, we validated the clinical performance of ddPCR in determination of KRAS mutational status, and compared ddPCR results with those obtained by Sanger sequencing and peptide nucleic acid-clamping. Of 81 colorectal adenocarcinoma tissue samples, three repeated sets of KRASG12/G13 mutation were measured by ddPCR, yielding high consistency (ICC = 0.956). Receiver operating characteristic (ROC) curves were constructed to determine KRASG12/G13 mutational status based on mutant allele frequency generated by ddPCR. Using the best threshold cutoff (mutant allele frequency of 7.9%), ddPCR had superior diagnostic sensitivity (100%) and specificity (100%) relative to the two other techniques. Thus, ddPCR is effective for detecting the KRASG12/G13 mutation in colorectal adenocarcinoma tissue samples. By allowing definition of the optimal cutoff, ddPCR represents a potentially useful diagnostic tool that could improve diagnostic sensitivity and specificity.

1. Introduction

Colorectal cancer (CRC) is one of the most common cancers in the United States [1]. Approximately 130,000 CRC patients are newly diagnosed each year, and nearly 30% of these patients develop distant metastasis. In 2017, a total of 50,260 CRC patients died in the United States [2,3]. Following the emergence of monoclonal antibodies against epidermal growth factor receptor (EGFR) and vascular endothelial growth factor (VEGF), cytotoxic chemotherapy plus targeted monoclonal antibody has been recommended as the standard treatment for metastatic CRC around the world [4]. Anti-EGFR monoclonal antibody is recommended for RAS–wild or left colon cancers, and VEGF antibody is recommended for RAS-mutant or right colon cancers. Accordingly, the mutational status of EGFR downstream signaling effectors, especially KRAS, must be screened to determine the ideal course of targeted therapy.
KRAS is a major predictive marker for anti-EGFR treatment, and determination of KRAS mutational status is crucial for successful management of CRC patients. Mutation of KRAS is detected in 35–45% of CRC patients, and most of these mutations affect codons 12 and 13 [5]. Multiple KRAS detection methods have been investigated, including direct sequencing, pyrosequencing, polymerase chain reaction (PCR) with peptide nucleic acid (PNA)-mediated clamping, and next-generation sequencing (NGS) [6,7,8]. To detect KRAS mutation in a more effective manner, effort has been devoted to decreasing the amount of tumor material required, and optimizing the sensitivity and specificity of testing.
Digital droplet PCR (ddPCR) is a recently developed sequencing method capable of sensitively detecting target DNA in varying backgrounds of wild-type DNA in a small amount of material [9]. By partitioning DNA into a large number of droplets, ddPCR can provide absolute quantification and detect target DNA in a much higher background of non-target (usually wild-type) DNA. Due to its technological advantages, ddPCR has been adopted for testing of KRAS mutation in patient samples [4]. However, the clinical performance of ddPCR-based KRAS mutation detection in CRC has not been carefully evaluated.
In this study, we sought to validate a ddPCR platform for detection of KRASG12/G13 mutation (KRAS codon 12 and codon 13) using CRC patient tissue samples. KRASG12/G13 mutant allele frequency (MAF) generated by ddPCR was measured repeatedly to assess the consistency of ddPCR. Receiver operating characteristic (ROC) curves were constructed based on the MAF to determine KRASG12/G13 mutational status with the optimal cutoff value. The diagnostic performance of ddPCR was compared with gold standard methods for KRASG12/G13 mutational analysis: Sanger sequencing and PNA-clamping assay (PCR with PNA-mediated clamping).

2. Materials and Methods

2.1. Sample Selection and DNA Isolation

This study was performed using 81 formalin-fixed paraffin-embedded (FFPE) surgically resected colorectal adenocarcinoma (CRAC) tissue samples collected at a single institutional center (Chungnam National University Hospital, Daejeon, South Korea) from January 2014 to December 2017. Tissue samples included primary and metastatic (liver, lung, and ovary) tissues from CRAC patients. Hematoxylin/eosin-stained slides of selected cases were pathologically reviewed by two pathologists (M-KY and GEB), and the most representative areas were selected. Twenty non-neoplastic colon FFPE tissue samples (10 samples acquired from tissues located more than 5 cm apart from the CRAC and 10 samples from surgically resected colon due to inflammation) were included for negative control. Sixteen serums from healthy persons were also included negative control.
Twenty-micron thick sections of FFPE samples were prepared and deparaffinized in xylene. DNA was isolated using the QIAamp DNA FFPE Tissue Kit and QIAamp Circulating Nucleic Acid kit (QIAGEN Korea, Seoul, South Korea). All extracted DNA was diluted to 10 ng/μL. Extracted DNAs were evaluated for KRASG12/G13 mutation using ddPCR, Sanger sequencing, and PNA-clamping PCR. All bio-specimens and data used for this study were provided by the Biobank of Chungnam National University Hospital, a member of the Korea Biobank Network. The study was approved by Chungnam National University Hospital institutional review board (IRB file no. 2018-10-012-001). The study was retrospective, and a waiver of consent was approved by the Institutional Review Board.

2.2. Droplet Digital Polymerase Chain Reaction (ddPCR)

Extracted DNA from CRAC tissue samples was tested with ddPCR (QX200; Bio-Rad, Hercules, CA, USA) using the ddPCR Bio-Rad KRASG12/G13 multiplex kit (#1863506) for screening of codons 12/13 (Figure 1A). Reaction mixtures (final volume, 20 µL) consisted of extracted DNA (1 μL), 2× SuperMix for probe (10 μL), KRAS screening probe (1 μL), and distilled water (8 μL). The mixture was loaded into a disposable droplet generator cartridge (Bio-Rad), and 70 μL droplet generation oil for primer (Bio-Rad) was loaded into each of the eight oil wells. The cartridge was then placed inside the QX200 droplet generator (Bio-Rad), which partitioned each tissue sample into ~22,000 droplets per tissue sample. When droplet generation was completed, the droplets were transferred to a 96-well PCR plate. The plate was heat-sealed with foil and placed in a conventional thermal cycler (T100, Bio-Rad) using the following reaction conditions: 95 °C for 10 min (1 cycle); 94 °C for 30 s and 55 °C for 1 min (40 cycles); 98 °C for 10 min (1 cycle); and 4 °C hold. Cycled droplets were read individually on a QX200 droplet-reader (Bio-Rad). Samples were transferred to the QX200 for fluorescence measurement of mutant probe labeled with 6-fluorescein amidite (FAM) and wild-type probe labeled with hexachlorofluorescein (HEX). DNA from SW480 cell line (KRAS G12V mutation) served as a positive control; DNA from the leukocytes of the heathy persons, HEK cell line, and distilled water were used as negative control, respectively.
The QuantaSoft software (version 1.7; Bio-Rad) classifies droplets by first determining a fluorescence threshold (Figure 1B). Some droplets were in the intermediate “rain” (gray droplets), which had fluorescence ranging between those of explicit positive and negative droplets. The dashed horizontal line in Figure 1B indicates a fluorescence value greater than the set threshold; these were considered positive [10]. After analyzing the number of positive and negative fluorescence signals in droplets, MAF was calculated as the percentage of mutant droplets relative to the total (mutant + wild-type).

2.3. Sanger Sequencing

Extracted DNA (20 ng) from CRAC tissue samples were sent for Sanger sequencing (Macrogen, Seoul, Korea).
For mutation analyses in codons 12 and 13 of the KRAS gene, primer sequences for exon 2, 5′-GTAAAACGACGGCCAGTGTGTGACATGTTCTAATATAGTCA-3′(forward) and 5′-GCGGATAA CAATTTCACACAGGGAATGGTCCTGCACCAGTAA-3′ (reverse) and for exon 3, 5′-TAATA CGACTCACTATAGGGGTGCTTAGTGGCCATTTGTC-3′ (forward) and 5′-GCTAGTTATTGC TCAGCGGTATGCATGGCATTAGCAAAG -3′ (reverse) were utilized for the PCR reaction.
PCR amplification conditions were as follows: 95 °C 5 min; 95 °C 30 s, 60 °C 30 s, 72 °C 1 min for 35 cycles; 72 °C 7 min. PCR products were purified using Millipore plate MSNU030 (Millipore SAS, Molsheim, France). The purified PCR products were then Sanger-sequenced with the BigDye terminator v3.1 sequencing kit and a 3730xl automated sequencer (Applied Biosystems, Foster City, CA). Nucleotide sequence data were analyzed with Variant reporter computer software version 1.1 (Applied Biosystems, Foster City, CA, USA).

2.4. Peptide Nucleic Acid (PNA)-Clamping Assay (PCR with PNA-Mediated Clamping)

Extracted DNA (7 μL) from CRAC tissue samples was tested by PNA-clamping assay using the PNA clamp KRAS mutation detection kit (version 4; Panagene, Daejeon, South Korea) for screening of codons 12/13/59/61/117/146. Reaction mixtures contained 7 µL DNA template, 3 μL of each PNA mix, and 10 μL of 2× premix, and amplification was performed in a CFX96 real-time PCR instrument (Bio-Rad) with the following thermal program: pre-incubation at 94 °C for 5 min, followed by 40 cycles of amplification at 94 °C for 30 s (s), 70 °C for 30 s, 63 °C for 30 s, and 72 °C for 30 s.
The efficiency of PNA-mediated PCR clamping was determined by measuring the threshold cycle (Ct) value. The Ct values for the control and mutation assays were obtained by observing the SYBR Green amplification plots. The delta Ct (ΔCt) value was calculated ([Control Ct] − [Sample Ct] = ΔCt) and the cutoff ΔCt was defined as 2 for the all mutations.

2.5. Statistical Analysis

To develop ROC curves for KRASG12/G13 detection by the ddPCR platform, cases in which mutations were detected by Sanger sequencing were considered as positive references. KRASG12/G13 mutation detection by ddPCR was performed three times (first, second, and third), and the mean MAF of KRASG12/G13 was used to develop ROC curve. Internal consistency of the scales was assessed by Cronbach’s alpha via the intraclass correlation coefficient and kappa coefficient.
Diagnostic value (sensitivity, specificity, positive predictive value, and negative predictive value) was calculated for the detection of KRASG12/G13 mutation by ddPCR, Sanger sequencing, and PNA-clamping assay. All statistical analyses were performed using SPSS version 26.0 for Windows (SPSS Inc., Chicago, IL, USA) and MedCalc version 19.2.0 for Windows (MedCalc Software Ltd., Ostend, Belgium).

3. Results

3.1. Detection of KRASG12/G13 Mutation by ddPCR, Sanger Sequencing and PNA Clamping Assay

The ddPCR platform used the QuantaSoft software to measure the numbers of positive and negative droplets in each well. A total number of generated droplets ranged from 10,461 to 30,796 per well (mean: 18,182). Samples with fewer than 10,000 generated droplets were excluded from analysis. Threshold horizontal lines were set at 9474 for channel 1 (KRASG12/G13 mutant) 3480 for channel 2 (KRASG12/G13 wild) (Figure 1B). MAF was calculated as the percentage of mutant droplets relative to all (mutant + wild-type) droplets.
Sixteen serums from healthy persons showed no KRASG12/G13 mutant droplets. Twenty non-neoplastic colon tissue samples showed 0 to 6 KRASG12/G13 mutant droplets and the MAF were 0 to 0.55% (mean: 0.06%). A total of 81 CRAC tissue samples showed KRASG12/G13 mutant droplets from 0 to 1121 droplets and the MAF were 0 to 81.17% (mean: 11.13%).
Sixteen serums from healthy persons and 20 non-neoplastic colon tissue samples were all KRASG12/G13 wild type by Sanger sequencing and PNA clamping assay. A total of 81 CRAC, 51 (63%) CRAC were KRASG12/G13 wild type and 30 (37%) CRAC were KRASG12/G13 mutant (23 cases of codon12 and 7 cases of codon 13) by Sanger sequencing. A total of 81 CRAC, 48 (59%) CRAC were KRASG12/G13 wild type and 33 (41%) CRAC were KRASG12/G13 mutant (27 cases of codon12 and 6 cases of codon 13) by PNA clamping assay.

3.2. Receiver Operating Characteristic (ROC) Curves in Determination of KRASG12/G13 Mutation by ddPCR

To determine the mutational status of KRASG12/G13 by ddPCR as “mutant” or “wild-type,” a cutoff value for MAF was required. To this end, we generated ROC curves to determine KRASG12/G13 mutational status from MAFs generated by ddPCR (Figure 2). To develop ROC curves for KRASG12/G13 detection by the ddPCR platform, cases in which mutations were detected by Sanger sequencing were considered as positive references. The negative references were used (A) non-neoplastic colon; (B) non-neoplastic colon and KRASG12/G13 wild-type CRAC by Sanger sequencing (Figure 2). The AUC (area under the curve) of the A (negative reference: non-neoplastic colon) was 0.993 and optimal cutoff was 0.12% (p < 0.001) (Figure 2A). The AUC of the B (negative reference: non-neoplastic colon and KRASG12/G13 wild CRAC by Sanger sequencing) was 0.943 and optimal cutoff was 7.9% (p < 0.001) (Figure 2B).
We assessed the diagnostic value of ddPCR KRASG12/G13 mutation using the calculated cutoffs (Table 1). Sensitivity and specificity were 100% and 30.91% with 0.12% MAF cutoff; 84.38% and 97.96% for the ddPCR 7.9% MAF cutoff. The optimal cutoff value of the MAF was determined to be 7.9%, which yielded a maximal increase in the sensitivity and specificity.

3.3. Repetitive Measurement of KRASG12/G13 Mutation by ddPCR

To assess the reproducibility of the ddPCR platform, we measured three sets of KRASG12/G13 MAFs in CRAC tissue samples using the KRASG12/G13 mutation multiplex kit. The time interval between measurements was 3 months. The means of the three MAF results were calculated. The pooled intraclass correlation (ICC) coefficient for the three sets of MAFs and the mean was 0.956 (p < 0.001), which is an excellent concordance rate.
With 7.9% MAF cutoff generated by the ROC curves was used to assign “mutant” or “wild-type” KRASG12/G13 mutation status to the CRAC tissue samples (Table 2). In all, 74 of 81 cases (91%) yielded concordant results. The remaining 7 cases (8%) yielded discrepant results (Table 2, *).
Next, we assessed the diagnostic value of repetitive measurements of ddPCR KRASG12/G13 mutation using the calculated optimal cutoffs (Table 3). Sensitivity and specificity were, respectively, 71.88% and 100% for the first measurement; 84.38% and 97.96% for the second measurement; 84.38% and 93.88% for the third measurement; and 84.38% and 97.96% for the mean.

3.4. Comparison of KRASG12/G13 Mutation Analysis by ddPCR, Sanger Sequencing, and PNA-Clamping Assay

We validated KRASG12/G13 mutation status in CRAC tissue samples by ddPCR, Sanger sequencing, and PNA-clamping assay (Table 4). Twenty-eight KRASG12/G13 mutant cases were detected by ddPCR; MAF ranged from 7.9% to 81.2% (the mean mutant MAF = 30.9%). In 53 KRASG12/G13 wild-type cases, MAF ranged from 0% to 7.53% (the mean of wild-type MAF = 0.67%).
Comparing two methods to detect KRASG12/G13 mutation, the concordant rate of the ddPCR and Sanger sequencing was 93% (75/83); the ddPCR and PNA-clamping assay was 89% (72/81); Sanger sequencing and PNA-clamping assay was 81% (66/81). Six discordant cases (T23, T29, T38, T42, T48 and T54) were identified between ddPCR and Sanger sequencing. Except 1 case (T54), Sanger sequencing detected KRASG12/G13 mutation, otherwise, ddPCR (all 3 tests were wild type) and PNA clamping assay did not detect KRASG12/G13 mutation. The MAF of discordant cases were 0.17%, 0.26%, 0.39%, 0.54%, 1.78%, and 7.9%. Nine discordant cases (T15, T47, T49-T53, T59 and T61) were identified between ddPCR and PNA clamping assay. Except 2 cases (T59, T61), PNA clamping assay detected KRASG12/G13 mutation, otherwise, ddPCR and Sanger sequencing did not detect KRASG12/G13 mutation. The MAF of discordant cases were 0.11%, 1.04%, 2.14%, 2.42%, 4%, 5.48%, 7.53%, 18.2%, and 19.36%. T52 (MAF = 2.17%, 5.62%, and 8.65%) and T53 (MAF = 3.61%, 9.11%, and 9.87%) cases showed discordant results in 3 repetitive ddPCR results.
For comparative analysis, cases in which KRASG12/G13 mutation was detected by two or more methods were defined as positive references. Twenty-eight of 81 CRAC tissue samples (35%) harbored the KRASG12/G13 mutation from the results of positive references. Fifteen of 81 cases (18.5%) yielded discrepant results (Table 4, *). ddPCR generated no discordant cases relative to the positive reference. The Sanger sequencing assay yielded discordant results in 6/15 cases and PNA-clamping assay in 9/15 cases. The concordance rate (κ value) between ddPCR and the positive reference was 1.000 (p < 0.001); the κ value was 0.842 (p < 0.001) for the Sanger sequencing; 0.764 (p < 0.001) for PNA-clamping assay. The κ value of ddPCR with the Sanger sequencing was 0.842 (p < 0.001) and 0.764 (p < 0.001) with PNA-clamping assay.
Comparison of the diagnostic performance of ddPCR, Sanger sequencing, and PNA-clamping assay for detection of KRASG12/G13 (Table 5) indicated that the sensitivity and specificity of the ddPCR test were 100% and 100%, respectively, making it superior to the other two methods (Sanger sequencing: 96.43% and 90.57% respectively; PNA-clamping assay: 92.86% and 86.79%).

4. Discussion

The ddPCR platform is an advanced digital PCR technology that has been used to detect and quantify target DNA or RNA in tissue or blood samples. ddPCR is a very sensitive method that can detect as little as 0.01% mutant DNA [4]. Because ddPCR provides an absolute number of fluorescent droplets, clinical applications of the ddPCR platform require delineation between positive (mutant) and negative (wild-type) KRASG12/G13 mutation status, which is critical for therapeutic decision-making [11,12]. Previous studies reported various cutoffs for KRASG12/G13 determined by ddPCR; Dong et al. [13] set 0.02 to 0.56% cutoffs for multiple KRASG12/G13 mutation site based on detection limit on their experiments of mixing mutant KRASG12/G13 DNA to wild-type DNA; Vanova et al. [14] determined an arbitrary 0.6% cutoff; Alcaide et al. [4] set a MAF cutoff of 1%, which was a threshold above background gray-zone noisy; and Laurent-Puig et al. [15] suggested a 1% threshold, which was a clinically relevant cutoff to discriminate a patient’s prognosis.
The sensitive PCR method has the possibility to lead to false positive (FP) results. An FFPE sample is very commonly used for clinical sequencing because it is easy to match tumor and normal tissue in the slides and it can be stored at room temperature. However, sequencing from DNA-extracted FFPE samples can yield errors due to fragmentation of genomic DNA and chemical processing damage to the samples [5]. The limit of detection (LOD) for detecting KRAS mutation was differently reported depending on the sample types; 0.05% for G12D and 0.01% for G12C using cancer cell lines with TaqMan MGB probes; 0.2% using FFPE CRAC samples with KRAS multiplex kit [13,16]. We detected no mutant droplets using serums samples and 0 to 0.55% MAF using non-neoplastic FFPE colon samples. With 0.12% cutoff closed to LOD, the diagnostic value of KRASG12/G13 detection of ddPCR yielded a high sensitivity (100%) and low specificity (30.61%). With 7.9% cutoff generated from ROC curve validated with KRASG12/G13 wild-type samples, diagnostic value of ddPCR yielded a high sensitivity (84.38%) and high specificity (97.96%). We decided that 7.9% MAF cutoff might decrease the possibility of FP results and be more appropriate for clinical application using FFPE patient samples.
Cases with wild type by ddPCR KRASG12/G13 mutation have the possibility of KRASG12/G13 mutant type. The sanger sequencing detected KRASG12/G13 mutation in cases with low MAF (0.17%~1.78%) that 7.9% MAF cutoff can be rather high and can miss mutant cases with low MAF. We set arbitrary cutoff to increase the specificity to use ddPCR as a diagnostic assay using FFPE tissue samples. Considering the biggest merit of the ddPCR is the sensitivity, we need to set appropriate MAF cut offs depending on the sample types (blood or urine) and detection probes (TaqMan probe or multiplex kit). In a previous study, CRAC patients with below 1% MAF KRAS mutation showed more therapeutic response with anti-EGFR therapy than above 1% MAF KRAS mutation [15]. Clinical significance can also be the standard to set clinical cutoff for MAF of the KRAS mutation.
ddPCR is a fluorescent probe-based PCR assay to partition sample DNA into ~20,000 droplets that fluorescence emitted from each droplet is measured to quantitate the number of target DNA molecules [17]. The number of positive droplets is very sensitive to pipette handling during droplet generation, cartridge exchange, and minor changes in fluorescence color [18]. Taylor et al. [19] reported that ddPCR produced more consistent and reproducible data than quantitative PCR when they used samples with variable contamination. To estimate the consistency of the ddPCR platform using FFPE samples, we performed repetitive measurement of KRASG12/G13. Three sets of measurements yielded seven discrepant results that 5 discordant cases raised at the first measurement and 2 cases were small-sized specimens (less than 1 cm). We guessed that an unaccustomed technique in pipette handling during droplet generation and small-sized specimens could be the reason. Low fractions of mutant DNA raised the possibility of false-positive or false-negative results. When using FFPE tissue samples, sensitivity could be limited by the amount of mutant DNA; however, in such a case, repetitive measurement could guarantee the results and increase diagnostic sensitivity. Statistically, ddPCR yielded an excellent intraclass correlation, allowing us to conclude that the ddPCR platform has the potential to be used as a sensitive and reliable method to detect KRASG12/G13 mutation.
This study has some limitations. First, when developing ROC curves to calculate ddPCR cutoffs, we defined positive references based on results from Sanger sequencing. However, the mutational status assessed by Sanger sequencing did not represent the true properties of KRASG12/G13 DNA in samples. However, the Sanger sequencing has been employed in diagnostic laboratories and is considered a gold standard for evaluating KRASG12/G13 with high specificity. In addition, PNA-clamping is also commonly used in diagnostic laboratories for evaluating KRASG12/G13 with high specificity [20]. Comparing two methods to detect KRASG12/G13 mutation, the concordant rate of the ddPCR and Sanger sequencing was 93% and the ddPCR and PNA-clamping assay was 89%. Sanger sequencing detected KRASG12/G13 mutation in cases with low MAF by ddPCR (mean MAF = 0.4%). PNA clamping assay detected KRASG12/G13 mutation in cases with MAF by ddPCR (mean MAF = 3.7%), however, showed wild type with high MAF by ddPCR (18.2% and 19.36%). The ddPCR showed more comparable results to Sanger sequencing. PNA clamping assay had the possibility of lower specificity compare to ddPCR and Sanger sequencing.
In a comparison of Sanger sequencing and PNA-clamping assay, ddPCR with applied clinical cutoff eliminated false-positive results and preserved high sensitivity (100%) and specificity (100%) relative to the Sanger sequencing and PNA-clamping assay. In comparison with NGS panel sequencing (Supplementary Table S1), ddPCR and Sanger sequencing showed higher sensitivity (96.43% and 100%, respectively) and specificity (98.11% and 92.45%, respectively). NGS panel sequencing offered multiple gene screening including KRASG12/G13 status, but showed a low sensitivity and positive predictive value. ddPCR, Sanger sequencing, and the PNA-clamping assay showed comparable results for detecting KRASG12/G13 mutation, however, the required amount of DNA (1 μL) for ddPCR is much less than for Sanger sequencing (20 ng) and PNA-clamping assay (7 μL). This technical advantage is useful detecting KRASG12/G13 mutation in small biopsied tissues or even liquid biopsy samples. Furthermore, the KRASG12/G13 multiplex kit could not discriminate the mutation codon site and did not cover the full spectrum of mutation sites in KRAS. The ddPCR platform includes two fluorescence filters and supports at least duplex reactions. The development and optimization of higher-order multiplexing techniques for ddPCR are still required.

5. Conclusions

Determining KRAS mutational status has become crucial for successfully managing CRC patients, as well as in applications of anti-EGFR therapy. Furthermore, patients with the KRASG12/G13 mutation tend to have more advanced tumors and shorter survival, implying that KRASG12/G13 could be used as a prognostic factor [21]. Thus, KRASG12/G13 is a highly informative and useful marker for the management of CRAC. By allowing the optimal cutoff value to be defined, ddPCR has potential for use as a diagnostic tool that could improve diagnostic sensitivity and specificity. Because ddPCR has high sensitivity and reproducibility, it would be suitable for daily application in laboratories seeking to detect KRASG12/G13 mutations in CRAC tissue samples.

Supplementary Materials

The following are available online at https://www.mdpi.com/2077-0383/9/7/2283/s1: Table S1: Diagnostic value of KRAG12/13 mutation detection by ddPCR, Sanger sequencing, and PNA-clamping assay, and NGS panel sequencing (IonS5, Thermo Fisher Scientific).

Author Contributions

K.H.L., Resources; T.H.L., Formal analysis; M.K.C., Formal analysis, I.S.K., Software—statistics consultation, G.E.B., Conceptualization & validation; M.-K.Y., writing—review and editing. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2017R1D1A1B04031187) and the Bio and Medical Technology Development Program of the National Research Foundation (NRF) funded by the Korean government (MSIT) (2019M3E5D1A02068558).

Conflicts of Interest

The authors declare that they have no conflict of interest.

References

  1. Siegel, R.L.; Miller, K.D.; Jemal, A. Cancer statistics, 2016. CA Cancer J. Clin. 2016, 66, 7–30. [Google Scholar] [CrossRef] [Green Version]
  2. Siegel, R.L.; Miller, K.D.; Fedewa, S.A.; Ahnen, D.J.; Meester, R.G.; Barzi, A.; Jemal, A. Colorectal cancer statistics, 2017. CA Cancer J. Clin. 2017, 67, 177–193. [Google Scholar] [CrossRef] [PubMed]
  3. Malafosse, R.; Penna, C.; Cunha, A.S.; Nordlinger, B. Surgical management of hepatic metastases from colorectal malignancies. Ann. Oncol. 2001, 12, 887–894. [Google Scholar] [CrossRef]
  4. Alcaide, M.; Cheung, M.; Bushell, K.; Arthur, S.E.; Wong, H.L.; Karasinska, J.; Renouf, D.; Schaeffer, D.F.; McNamara, S.; Tertre, M.C.D.; et al. A Novel Multiplex Droplet Digital PCR Assay to Identify and Quantify KRAS Mutations in Clinical Specimens. J. Mol. Diagn. 2019, 21, 214–227. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Feng, Q.-Y.; Wei, Y.; Chen, J.-W.; Chang, W.-J.; Ye, L.-C.; Zhu, D.-X.; Xu, J.-M. Anti-EGFR and anti-VEGF agents: Important targeted therapies of colorectal liver metastases. World J. Gastroenterol. 2014, 20, 4263–4275. [Google Scholar] [CrossRef]
  6. Matsunaga, M.; Kaneta, T.; Miwa, K.; Ichikawa, W.; Fujita, K.-I.; Nagashima, F.; Furuse, J.; Kage, M.; Akagi, Y.; Sasaki, Y. A comparison of four methods for detecting KRAS mutations in formalin-fixed specimens from metastatic colorectal cancer patients. Oncol. Lett. 2016, 12, 150–156. [Google Scholar] [CrossRef] [Green Version]
  7. Rakhit, C.; Ottolini, B.; Jones, C.; Pringle, J.; Shaw, J.; Martins, L.M. Peptide nucleic acid clamping to improve the sensitivity of Ion Torrent-based detection of an oncogenic mutation in KRAS. Matters 2017, 3, e201706000001. [Google Scholar] [CrossRef] [Green Version]
  8. Lee, H.S.; Kim, W.H.; Kwak, Y.; Koh, J.; Bae, J.M.; Kim, K.-M.; Chang, M.S.; Han, H.S.; Kim, J.M.; Kim, H.W. Molecular testing for gastrointestinal cancer. J. Pathol. Transl. Med. 2017, 51, 103–121. [Google Scholar] [CrossRef] [Green Version]
  9. Miotke, L.; Lau, B.T.; Rumma, R.T.; Ji, H.P. High sensitivity detection and quantitation of DNA copy number and single nucleotide variants with single color droplet digital PCR. Anal. Chem. 2014, 86, 2618–2624. [Google Scholar] [CrossRef] [PubMed]
  10. Jones, M.; Williams, J.; Gartner, K.; Phillips, R.; Hurst, J.; Frater, J. Low copy target detection by Droplet Digital PCR through application of a novel open access bioinformatic pipeline, ‘definetherain’. J. Virol. Methods 2014, 202, 46–53. [Google Scholar] [CrossRef] [Green Version]
  11. Trypsteen, W.; Vynck, M.; De Neve, J.; Bonczkowski, P.; Kiselinova, M.; Malatinkova, E.; Vervisch, K.; Thas, O.; Vandekerckhove, L.; De Spiegelaere, W. ddpcRquant: Threshold determination for single channel droplet digital PCR experiments. Anal. Bioanal. Chem. 2015, 407, 5827–5834. [Google Scholar] [CrossRef] [PubMed]
  12. Hughesman, C.B.; Lu, X.J.D.; Liu, K.Y.P.; Zhu, Y.; Poh, C.F.; Haynes, C. A Robust Protocol for Using Multiplexed Droplet Digital PCR to Quantify Somatic Copy Number Alterations in Clinical Tissue Specimens. PLoS ONE 2016, 11, e0161274. [Google Scholar] [CrossRef] [PubMed]
  13. Dong, L.; Wang, S.; Fu, B.; Wang, J. Evaluation of droplet digital PCR and next generation sequencing for characterizing DNA reference material for KRAS mutation detection. Sci. Rep. 2018, 8, 1–9. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Vanova, B.; Kalman, M.; Jasek, K.; Kasubova, I.; Burjanivova, T.; Farkasova, A.; Kruzliak, P.; Busselberg, D.; Plank, L.; Lasabova, Z. Droplet digital PCR revealed high concordance between primary tumors and lymph node metastases in multiplex screening of KRAS mutations in colorectal cancer. Clin. Exp. Med. 2019, 19, 219–224. [Google Scholar] [CrossRef] [PubMed]
  15. Laurent-Puig, P.; Pekin, D.; Normand, C.; Kotsopoulos, S.K.; Nizard, P.; Perez-Toralla, K.; Rowell, R.; Olson, J.; Srinivasan, P.; Le Corre, D.; et al. Clinical relevance of KRAS-mutated subclones detected with picodroplet digital PCR in advanced colorectal cancer treated with anti-EGFR therapy. Clin. Cancer Res. 2015, 21, 1087–1097. [Google Scholar] [CrossRef] [Green Version]
  16. Yang, W.; Shelton, D.N.; Berman, J.R.; Zhang, B.; Cooper, S.; Tzonev, S.; Hefner, E.; Regan, J.F. Droplet digital™ PCR: Multiplex detection of KRAS mutations in formalin-fixed, paraffin-embedded colorectal cancer samples. Biotechniques 2015, 58, 205–206. [Google Scholar] [CrossRef] [Green Version]
  17. Pinheiro, L.B.; Coleman, V.A.; Hindson, C.M.; Herrmann, J.; Hindson, B.J.; Bhat, S.; Emslie, K.R. Evaluation of a droplet digital polymerase chain reaction format for DNA copy number quantification. Anal. Chem. 2012, 84, 1003–1011. [Google Scholar] [CrossRef]
  18. Gerdes, L.; Iwobi, A.; Busch, U.; Pecoraro, S. Optimization of digital droplet polymerase chain reaction for quantification of genetically modified organisms. Biomol. Detect. Quantif. 2016, 7, 9–20. [Google Scholar] [CrossRef] [Green Version]
  19. Taylor, S.C.; Laperriere, G.; Germain, H. Droplet Digital PCR versus qPCR for gene expression analysis with low abundant targets: From variable nonsense to publication quality data. Sci. Rep. 2017, 7, 1–8. [Google Scholar] [CrossRef] [Green Version]
  20. Messa, F.; Tonissi, F.; Millo, E.; Bracco, E.; Ungari, S.; Lattanzio, L.; Merlano, M.; Damonte, G.; Lo Nigro, C. A PNA-mediated clamping PCR for routine detection of KRAS mutations in colorectal carcinoma. Int. J. Biol. Markers 2014, 29, e55–e61. [Google Scholar] [CrossRef]
  21. Dinu, D.; Dobre, M.; Panaitescu, E.; Bîrlă, R.; Iosif, C.; Hoara, P.; Caragui, A.; Boeriu, M.; Constantinoiu, S.; Ardeleanu, C. Prognostic significance of KRAS gene mutations in colorectal cancer-preliminary study. J. Med. Life 2014, 7, 581–587. [Google Scholar] [PubMed]
Figure 1. Droplet digital polymerase chain reaction (ddPCR) workflow (A) and representative results of ddPCR for detection of KRASG12/13. Channel 1: fluorescence measurement of mutant probe labeled with 6-fluorescein amidite (FAM). ((B) left) Channel 2; wild-type probe labeled with hexachlorofluorescein (HEX) ((B) right).
Figure 1. Droplet digital polymerase chain reaction (ddPCR) workflow (A) and representative results of ddPCR for detection of KRASG12/13. Channel 1: fluorescence measurement of mutant probe labeled with 6-fluorescein amidite (FAM). ((B) left) Channel 2; wild-type probe labeled with hexachlorofluorescein (HEX) ((B) right).
Jcm 09 02283 g001
Figure 2. Receiver operating characteristic (ROC) curves for ddPCR. Optimal cutoff criteria and the area under curve (AUC) results are shown. (A) ROC curves using KRAS results from KRAS mutant CRAC and non-neoplastic colon (B) ROC curves using KRAS results from KRAS mutant CRAC, KRAS wild CRAC, and non-neoplastic colon.
Figure 2. Receiver operating characteristic (ROC) curves for ddPCR. Optimal cutoff criteria and the area under curve (AUC) results are shown. (A) ROC curves using KRAS results from KRAS mutant CRAC and non-neoplastic colon (B) ROC curves using KRAS results from KRAS mutant CRAC, KRAS wild CRAC, and non-neoplastic colon.
Jcm 09 02283 g002
Table 1. Diagnostic value of KRASG12/13 mutation by ddPCR depending on mutant cutoff criteria.
Table 1. Diagnostic value of KRASG12/13 mutation by ddPCR depending on mutant cutoff criteria.
KRAS Mutant CRAC & Non-Neoplastic Colon (0.12% Cutoff)KRAS Mutant and KRAS Wild CRAC & Non-Neoplastic Colon (7.9% Cutoff)
Sensitivity100.0% (89.11–100.00)84.38% (67.21–94.72)
Specificity30.61% (18.25–45.42)97.96% (89.15–99.95)
PPV48.48% (43.87–53.13)96.43% (79.42–99.47)
NPV100.0% (100.00–100.00)90.57% (81.09–97.23)
CRAC, colorectal adenocarcinoma; PPV, positive predictive value; NPV, negative predictive value.
Table 2. Repeated KRASG12/13 mutation detection in CRAC tissue by ddPCR.
Table 2. Repeated KRASG12/13 mutation detection in CRAC tissue by ddPCR.
Sample IDFirst KRAS ddPCRSecond KRAS ddPCRThird KRAS ddPCRMean KRAS ddPCR
MAFMAFMAFMAF
T10Wild-type0Wild-type0Wild-type0Wild-type
T20Wild-type0.07Wild-type0Wild-type0.02Wild-type
T30.05Wild-type0Wild-type0Wild-type0.02Wild-type
T40.05Wild-type0Wild-type0Wild-type0.02Wild-type
T50.04Wild-type0Wild-type0.04Wild-type0.03Wild-type
T60Wild-type0Wild-type0.11Wild-type0.04Wild-type
T70.04Wild-type0.04Wild-type0.09Wild-type0.05Wild-type
T80Wild-type0.19Wild-type0Wild-type0.06Wild-type
T90.08Wild-type0.13Wild-type0Wild-type0.07Wild-type
T100Wild-type0.14Wild-type0.1Wild-type0.08Wild-type
T110.09Wild-type0.09Wild-type0.07Wild-type0.09Wild-type
T120Wild-type0.15Wild-type0.11Wild-type0.09Wild-type
T130.1Wild-type0.07Wild-type0.1Wild-type0.09Wild-type
T140Wild-type0.13Wild-type0.19Wild-type0.11Wild-type
T150Wild-type0.08Wild-type0.26Wild-type0.11Wild-type
T160.11Wild-type0.27Wild-type0Wild-type0.12Wild-type
T170Wild-type0.2Wild-type0.2Wild-type0.13Wild-type
T180.02Wild-type0.15Wild-type0.27Wild-type0.15Wild-type
T190.21Wild-type0.12Wild-type0.17Wild-type0.16Wild-type
T200Wild-type0.13Wild-type0.36Wild-type0.16Wild-type
T210.11Wild-type0.11Wild-type0.25Wild-type0.16Wild-type
T220.09Wild-type0Wild-type0.4Wild-type0.16Wild-type
T230Wild-type0.16Wild-type0.36Wild-type0.17Wild-type
T240.07Wild-type0.11Wild-type0.33Wild-type0.17Wild-type
T250Wild-type0.28Wild-type0.3Wild-type0.19Wild-type
T260Wild-type0.46Wild-type0.12Wild-type0.19Wild-type
T270.19Wild-type0.23Wild-type0.24Wild-type0.22Wild-type
T280Wild-type0.48Wild-type0.26Wild-type0.25Wild-type
T290.3Wild-type0.16Wild-type0.31Wild-type0.26Wild-type
T300.28Wild-type0.19Wild-type0.41Wild-type0.29Wild-type
T310.26Wild-type0.09Wild-type0.54Wild-type0.3Wild-type
T320.06Wild-type0.53Wild-type0.3Wild-type0.3Wild-type
T330Wild-type0.49Wild-type0.45Wild-type0.31Wild-type
T340.34Wild-type0.23Wild-type0.39Wild-type0.32Wild-type
T350.06Wild-type0.44Wild-type0.5Wild-type0.33Wild-type
T360.07Wild-type0.12Wild-type0.79Wild-type0.33Wild-type
T370.14Wild-type0.37Wild-type0.47Wild-type0.33Wild-type
T380.04Wild-type0.55Wild-type0.58Wild-type0.39Wild-type
T390Wild-type0.75Wild-type0.51Wild-type0.42Wild-type
T400.27Wild-type0.4Wild-type0.76Wild-type0.48Wild-type
T410Wild-type0.73Wild-type0.71Wild-type0.48Wild-type
T420.22Wild-type0Wild-type1.4Wild-type0.54Wild-type
T430.21Wild-type0.6Wild-type0.85Wild-type0.55Wild-type
T440.7Wild-type1.08Wild-type0.69Wild-type0.82Wild-type
T452.65Wild-type0Wild-type0Wild-type0.88Wild-type
T460.97Wild-type0.8Wild-type0.97Wild-type0.91Wild-type
T470.52Wild-type1.38Wild-type1.23Wild-type1.04Wild-type
T483.69Wild-type1Wild-type0.66Wild-type1.78Wild-type
T495.76Wild-type0.49Wild-type0.16Wild-type2.14Wild-type
T505.79Wild-type1.04Wild-type0.42Wild-type2.42Wild-type
T517.42Wild-type1.56Wild-type3.01Wild-type4Wild-type
* T522.17Wild-type5.62Wild-type8.65Mutant5.48Wild-type
* T533.61Wild-type9.11Mutant9.87Mutant7.53Wild-type
* T545.48Wild-type7.74Wild-type10.49Mutant7.9Mutant
T5513.94Mutant15.08Mutant13.29Mutant14.1Mutant
* T560.75Wild-type22.36Mutant22.88Mutant15.33Mutant
T5710.48Mutant17.56Mutant18.47Mutant15.51Mutant
* T584.71Wild-type22.75Mutant21.34Mutant16.27Mutant
T5913.39Mutant20.33Mutant20.88Mutant18.2Mutant
T6016.62Mutant18.76Mutant21.23Mutant18.87Mutant
T6116.58Mutant17.12Mutant24.37Mutant19.36Mutant
T6215.04Mutant21.44Mutant22.65Mutant19.71Mutant
T6310.82Mutant24.39Mutant28.47Mutant21.23Mutant
T649.23Mutant26.74Mutant28Mutant21.32Mutant
* T652.04Wild-type29.01Mutant38.62Mutant23.22Mutant
T6615.63Mutant27.81Mutant29.46Mutant24.3Mutant
T6727.78Mutant23.06Mutant23.44Mutant24.76Mutant
T6824.88Mutant30.54Mutant31.24Mutant28.89Mutant
T6925Mutant32.61Mutant31.67Mutant29.76Mutant
T709.47Mutant46.99Mutant50.34Mutant35.6Mutant
T7134.96Mutant34.48Mutant38.13Mutant35.85Mutant
T7220.1Mutant42.43Mutant45.5Mutant36.01Mutant
T7338.23Mutant32.7Mutant38.13Mutant36.36Mutant
T7436.08Mutant40.95Mutant43.71Mutant40.25Mutant
* T754.29Wild-type55.56Mutant60.95Mutant40.27Mutant
T7630.18Mutant50.53Mutant49.34Mutant43.35Mutant
T7741.87Mutant42.24Mutant46.7Mutant43.6Mutant
T7841.14Mutant44.78Mutant48.95Mutant44.96Mutant
T7960.77Mutant45.28Mutant49.33Mutant51.79Mutant
T8053.88Mutant60.45Mutant58.23Mutant57.52Mutant
T8183.77Mutant78.03Mutant81.71Mutant81.17Mutant
ddPCR, digital droplet PCR, * Cases yielded discrepant results regarding KRASG12/G13 mutation status. MAF, mutant allele frequency.
Table 3. Diagnostic value of repeated measurement of KRASG12/13 mutation by ddPCR.
Table 3. Diagnostic value of repeated measurement of KRASG12/13 mutation by ddPCR.
First ddPCRSecond ddPCRThird ddPCRMean ddPCR
Sensitivity71.88%84.38%84.38%84.38%
Specificity100%97.96%93.88%97.96%
PPV100%96.43%90.00%96.43%
NPV84.48%90.57%90.20%90.57%
PPV, positive predictive value; NPV, negative predictive value.
Table 4. Comparative analysis of KRASG12/13 mutation detection by ddPCR, Sanger sequencing, and peptide nucleic acid (PNA) clamping assay.
Table 4. Comparative analysis of KRASG12/13 mutation detection by ddPCR, Sanger sequencing, and peptide nucleic acid (PNA) clamping assay.
Sample IDKRAS ddPCRKRAS ddPCRKRAS SangerKRAS PNA
MAFCutoff ResultSequencingClamping Assay
T10.00Wild-typeWild-typeWild-type
T20.02Wild-typeWild-typeWild-type
T30.02Wild-typeWild-typeWild-type
T40.02Wild-typeWild-typeWild-type
T50.03Wild-typeWild-typeWild-type
T60.04Wild-typeWild-typeWild-type
T70.05Wild-typeWild-typeWild-type
T80.06Wild-typeWild-typeWild-type
T90.07Wild-typeWild-typeWild-type
T100.08Wild-typeWild-typeWild-type
T110.09Wild-typeWild-typeWild-type
T120.09Wild-typeWild-typeWild-type
T130.09Wild-typeWild-typeWild-type
T140.11Wild-typeWild-typeWild-type
* T150.11Wild-typeWild-type* Mutant
T160.12Wild-typeWild-typeWild-type
T170.13Wild-typeWild-typeWild-type
T180.15Wild-typeWild-typeWild-type
T190.16Wild-typeWild-typeWild-type
T200.16Wild-typeWild-typeWild-type
T210.16Wild-typeWild-typeWild-type
T220.16Wild-typeWild-typeWild-type
* T230.17Wild-type* MutantWild-type
T240.17Wild-typeWild-typeWild-type
T250.19Wild-typeWild-typeWild-type
T260.19Wild-typeWild-typeWild-type
T270.22Wild-typeWild-typeWild-type
T280.25Wild-typeWild-typeWild-type
* T290.26Wild-type* MutantWild-type
T300.29Wild-typeWild-typeWild-type
T310.3Wild-typeWild-typeWild-type
T320.3Wild-typeWild-typeWild-type
T330.31Wild-typeWild-typeWild-type
T340.32Wild-typeWild-typeWild-type
T350.33Wild-typeWild-typeWild-type
T360.33Wild-typeWild-typeWild-type
T370.33Wild-typeWild-typeWild-type
* T380.39Wild-type* MutantWild-type
T390.42Wild-typeWild-typeWild-type
T400.48Wild-typeWild-typeWild-type
T410.48Wild-typeWild-typeWild-type
* T420.54Wild-type* MutantWild-type
T430.55Wild-typeWild-typeWild-type
T440.82Wild-typeWild-typeWild-type
T450.88Wild-typeWild-typeWild-type
T460.91Wild-typeWild-typeWild-type
* T471.04Wild-typeWild-type* Mutant
* T481.78Wild-type* MutantWild-type
* T492.14Wild-typeWild-type* Mutant
* T502.42Wild-typeWild-type* Mutant
* T514.00Wild-typeWild-type* Mutant
* T525.48Wild-typeWild-type* Mutant
* T537.53Wild-typeWild-type* Mutant
* T547.90Mutant* Wild-typeMutant
T5514.1MutantMutantMutant
T5615.33MutantMutantMutant
T5715.51MutantMutantMutant
T5816.27MutantMutantMutant
* T5918.20MutantMutant* Wild-type
T6018.87MutantMutantMutant
* T6119.36MutantMutant* Wild-type
T6219.71MutantMutantMutant
T6321.23MutantMutantMutant
T6421.32MutantMutantMutant
T6523.22MutantMutantMutant
T6624.30MutantMutantMutant
T6724.76MutantMutantMutant
T6828.89MutantMutantMutant
T6929.76MutantMutantMutant
T7035.60MutantMutantMutant
T7135.85MutantMutantMutant
T7236.01MutantMutantMutant
T7336.36MutantMutantMutant
T7440.25MutantMutantMutant
T7540.27MutantMutantMutant
T7643.35MutantMutantMutant
T7743.60MutantMutantMutant
T7844.96MutantMutantMutant
T7951.79MutantMutantMutant
T8057.52MutantMutantMutant
T8181.17MutantMutantMutant
* Cases yielded discrepant results regarding KRASG12/G13 mutation status. MAF, mutant allele frequency.
Table 5. Diagnostic value of KRAG12/13 mutation detection by ddPCR, Sanger sequencing, and PNA-clamping assay.
Table 5. Diagnostic value of KRAG12/13 mutation detection by ddPCR, Sanger sequencing, and PNA-clamping assay.
Detection of KRAG12/13 Mutation
ddPCRSanger Sequencing PNA-Clamping Assay
Sensitivity100%96.43%92.86%
Specificity100%90.57%86.79%
PPV100%84.38%78.79%
NPV100%97.96%95.83%
PPV, positive predictive value; NPV, negative predictive value.

Share and Cite

MDPI and ACS Style

Lee, K.H.; Lee, T.H.; Choi, M.K.; Kwon, I.S.; Bae, G.E.; Yeo, M.-K. Identification of a Clinical Cutoff Value for Multiplex KRASG12/G13 Mutation Detection in Colorectal Adenocarcinoma Patients Using Digital Droplet PCR, and Comparison with Sanger Sequencing and PNA Clamping Assay. J. Clin. Med. 2020, 9, 2283. https://doi.org/10.3390/jcm9072283

AMA Style

Lee KH, Lee TH, Choi MK, Kwon IS, Bae GE, Yeo M-K. Identification of a Clinical Cutoff Value for Multiplex KRASG12/G13 Mutation Detection in Colorectal Adenocarcinoma Patients Using Digital Droplet PCR, and Comparison with Sanger Sequencing and PNA Clamping Assay. Journal of Clinical Medicine. 2020; 9(7):2283. https://doi.org/10.3390/jcm9072283

Chicago/Turabian Style

Lee, Kyung Ha, Tae Hee Lee, Min Kyung Choi, In Sun Kwon, Go Eun Bae, and Min-Kyung Yeo. 2020. "Identification of a Clinical Cutoff Value for Multiplex KRASG12/G13 Mutation Detection in Colorectal Adenocarcinoma Patients Using Digital Droplet PCR, and Comparison with Sanger Sequencing and PNA Clamping Assay" Journal of Clinical Medicine 9, no. 7: 2283. https://doi.org/10.3390/jcm9072283

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop