Next Article in Journal
Treatment Equity in the Immunotherapy Era: Options for Patients with Both Autoimmune Disease and GU Cancers
Previous Article in Journal
Impact of Radiation Quality on Microdosimetry and Chromosome Aberrations for High-Energy (>250 MeV/n) Ions
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Correlation of Repeat Measurements of 27 Candidate Protein Markers for Colorectal Cancer Screening Taken Three Years and Multiple Freeze–Thaw Cycles Apart

by
Megha Bhardwaj
1,2,*,
Petra Schrotz-King
2 and
Hermann Brenner
1,2,3
1
Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), 69120 Heidelberg, Germany
2
Division of Preventive Oncology, German Cancer Research Center (DKFZ) and National Center for Tumor Diseases (NCT), 69120 Heidelberg, Germany
3
German Cancer Consortium (DKTK), German Cancer Research Center (DKFZ), 69120 Heidelberg, Germany
*
Author to whom correspondence should be addressed.
Life 2022, 12(3), 359; https://doi.org/10.3390/life12030359
Submission received: 11 February 2022 / Revised: 24 February 2022 / Accepted: 28 February 2022 / Published: 2 March 2022
(This article belongs to the Section Proteins and Proteomics)

Abstract

:
In recent years the blood proteome has been increasingly researched for biomarkers for early detection of colorectal cancer (CRC). Blood samples from screening studies are often subject to preanalytical variability and repeated freeze–thaw cycles. We aimed to assess the correlation of repeat measurements of 27 candidate protein markers for CRC screening taken three years and multiple freeze–thaw cycles apart. The concentrations of 27 protein markers were measured in plasma samples of 39 newly detected CRC cases from a cohort of 9245 participants of screening colonoscopies. The proteins were measured using proximity extension assays (PEA) carried out on the same set of samples twice, three years apart, with an average of three freeze–thaw cycles in between the two measurements. Pearson’s product moment correlation coefficients were calculated. Correlation coefficients ranged from +0.43 to +0.97, with a median of 0.67 and an interquartile range of +0.58 to +0.84, with all p-values of correlation being <0.01 (<0.0005 for 22 proteins, <0.001 for 4 proteins). Repeat measurements of the 27 protein biomarkers for CRC screening performed three years later, and on average three freeze–thaw cycles apart, showed moderate to high levels of correlation. Apart from the effects of freeze–thaw cycles, slightly different preprocessing performed on the data may have contributed to recorded differences between measurements.

1. Introduction

In recent years the blood proteome has been increasingly researched for biomarkers for early detection of various cancers, including colorectal cancer (CRC) [1,2,3,4,5]. It is often the case in cancer screening studies for blood samples to be stored in freezers and used for multiple measurements of candidate biomarkers for early detection. If the samples are stored in bigger aliquots as a result of space constraints in large-scale screening studies, they may undergo several freeze–thaw cycles before being used for measurements of candidate biomarkers for early detection of cancer. A commonly expressed concern in this context is if, and to what extent, the measurements might suffer from freeze–thaw cycles. Although adverse effects of freeze–thaw cycles are plausible, no previous study has, to the best of our knowledge, empirically assessed their possible impact in cancer screening studies. Therefore, the objective of this study was to assess the effects of preanalytical freeze–thaw cycles on plasma proteins measured as potential biomarkers for CRC early detection among CRC cases recruited from a screening colonoscopy cohort.

2. Materials and Methods

2.1. Study Design

Blood samples were selected from participants of a screening colonoscopy collected during the BLITZ study. Details of the BLITZ study design have been reported previously [6,7,8,9,10,11]. Briefly, BLITZ is an ongoing prospective screening study of participants undergoing colonoscopies as a primary screening exam. The German screening colonoscopy program, introduced in October 2002, offers up to two screening colonoscopies at least 10 years apart to men and women aged 55 years or older [12] (starting age was lowered to 50 years for men in 2019) and includes strict measures for quality assurance. Screening colonoscopies are mostly conducted in gastroenterology practices by accredited, highly qualified and experienced endoscopists. In the BLITZ study, participants have been recruited from 20 gastroenterology practices since the end of 2005. Participants are invited to donate prediagnostic blood and stool samples and fill out self-administered questionnaires during preparatory visits at these practices typically one week before the screening colonoscopy. By the end of June 2016, out of 9425 participants in BLITZ, CRC and advanced adenoma (AA) had been detected in 64 and 633 participants, respectively. In a previous study from our group [8,9], 254 plasma samples from participants of the BLITZ study, including 41 plasma samples from participants diagnosed with CRC at the screening colonoscopy, were selected for protein measurements in the year 2015. In a later study conducted in 2018, plasma samples of partly overlapping 270 BLITZ participants, including 56 participants with CRC, were selected for another set of protein measurements [13]. Overall, there was an overlap of 39 participants with CRC and 27 protein markers included in both studies. The paired measurements in 2015 and 2018 from the same blood samples of 39 CRC patients were used for evaluating the correlation of protein measurements performed three years and three freeze–thaw cycles apart.
In addition to the paired measurements in the same plasma samples of 39 CRC cases, the same 27 protein markers were also measured in plasma samples from 181 and 102 control samples free of neoplasms from the 2015 and 2018 studies, respectively [8,9,13]. However, in contrast to paired-measurement cases, there was no overlap between the control samples included from the two studies. Therefore, correlations between repeat measurements that were several freeze–thaw cycles and several years apart could not be calculated for these controls. However, in order to evaluate the potential impact of freeze–thaw cycles and storing time of blood samples on diagnostic performance, we additionally assessed and compared, for each of the 27 protein markers, differences in the measurements performed among the 39 CRC cases and 102 controls in 2018, and differences in the measurements performed among the same 39 CRC cases and 181 controls in 2015. The STARD diagram showing selection of participants from the BLITZ study is presented in Figure 1 The BLITZ study has been approved by the ethics committees of the Medical Faculty of University of Heidelberg (S-178/2005), and of the physicians’ boards of Baden-Wuerttemberg (M118-05-f), Rhineland-Palatinate (837.047.06(5145)) and Saarland (217/13). The BLITZ study adheres to the standards set by the Declaration of Helsinki, and all study participants voluntarily provided written informed consent.

2.2. Sample Collection and Storage and Lab Assay

The blood draw was performed prior to first diagnosis at recruitment in the BLITZ study. After blood draw, Ethylenediaminetetraacetic acid (EDTA) plasma samples were transported to the laboratory while preserved in a cold transport chain, followed by centrifugation at 2000–2500× g for 10 min at 4 °C and then stored at −80 °C until picked out for the protein measurements.
Protein concentrations in plasma samples were measured utilizing the proximity extension assay (PEA) offered by Olink. Olink’s multiplex panels allow simultaneous analysis of 92 biomarkers and 4 internal controls in samples of 1 µL [14]. Briefly, the 96 pairs of oligonucleotide-labelled antibodies are allowed to pairwise bind to target proteins; when in close proximity, a PCR reporter sequence is formed as a result of DNA polymerization, which is quantified by real-time PCR. The first measurement was performed in 2015 for 92 proteins that were measured using Olink’s Proseek® Multiplex Oncology I panel [9] in plasma samples of 41 CRC cases. Subsequently, in the year 2018, 92 proteins were measured using Olink’s Proseek® Multiplex Oncology II panel in plasma samples of 56 CRC cases [13]. In total, there was an overlap of 27 proteins between the two Olink panels for the 39 CRC cases that were included in both studies. There was an average difference of three years and three freeze–thaw cycles between the two measurements. In addition to the paired measurements for the 39 CRC cases, the 27 proteins were also measured in 181 and 102 non-overlapping control samples free of neoplasms from the years 2015 and 2018, respectively. Blind laboratory analyses were performed with respect to findings at colonoscopy in the laboratory of the manufacturer of the panels. The workflow of the current study is presented in Figure 2.

2.3. Statistical Analyses

Normalization was performed in order to minimize both inter- and intra-assay variation. Nevertheless, there were minor differences in the preprocessing of the data. The x-value of the point in qPCR where the reaction curve intersects with the threshold line is called the Cq value. Normalization in the first measurement in 2015 was a two-step procedure, with the first step being to subtract the raw Cq value from the extension control in order to correct for technical variation. The second step was to further normalize the calculated dCq-value against the negative control determined in the measurement, which yielded ddCq values (hereafter referred to as Cq values) on a log2 scale [8].
However, for the second measurement, normalization was a three-step procedure to obtain an arbitrary, relative quantification unit called Normalized Protein Expression (NPX). NPX is derived from the Ct values obtained from the qPCR by first subtracting the raw Ct value of an analyte from the Ct of extension controls. The obtained dCt of an analyte is further subtracted from dCt of interplate control in order to obtain the ddCt of an analyte. In the final step, the predetermined correction factor is subtracted from the ddCt of the analyte in order to obtain the NPX of any protein. NPX is an arbitrary unit and represents the relative signal on a log2 scale; a one-unit NPX difference represents a two-fold difference in protein concentration.
For assessing concordance between the first measurements from 2015 and the second measurements from 2018 of the 27 proteins included in both measurements, the Pearson’s product-moment correlation coefficient was calculated for the 39 CRC cases with paired measurements. In addition, the means, standard deviations and standard errors for the first and second measurements of the 27 protein biomarkers were calculated.
Complementary to direct comparisons of the paired 39 CRC samples were assessed and compared for each of the 27 protein markers; differences in the measurements performed among the 39 CRC cases and 102 controls in 2018, as well as differences in the measurements performed among the same 39 CRC cases and 181 controls in 2015 were also assessed and compared. Differences between cases and controls for each of the 27 proteins were assessed for statistical significance using the Wilcoxon rank-sum test with adjustments made for multiple testing using the Benjamini–Hochberg method [15]. Furthermore, for each individual protein biomarker, a logistic regression model was used in order to construct the prediction algorithm for the presence of advanced neoplasms, while predictive performance was assessed using AUCs and their 95% confidence intervals (95% CI). Correlation across the 27 proteins of the AUCs between the 2015 and 2018 measurements was quantified by Pearson’s correlation coefficient, and the DeLong test was used to determine the statistical significance of differences between AUCs for each protein from the 2015 and 2018 measurements [16]. All statistical analyses were performed with the R statistical software language and environment (version 3.5.0, R core team) [17], and p-values < 0.05 in two-sided testing were considered to be statistically significant.

3. Results

3.1. Characteristics of the Study Population

The eligibility criteria used for selection of study participants enrolled and selected from the Begleitende Evaluierung innovativer Testverfahren zur Darmkrebs-Früherkennung (BLITZ) study are presented in Figure 1 displaying the Standards for Reporting Diagnostic Accuracy studies (STARD) diagram. The main characteristics of the study population are presented in Table 1.
The sample of 39 CRC patients for whom the same 27 proteins were measured twice (with an average difference of three freeze–thaw cycles) from the same plasma samples in 2015 and 2018 included 28 men and 11 women, with a median age of 67 years. CRC was detected at stages I–III in 36 out of 39 cases. Controls whose samples were measured in 2015 and 2018 were on average slightly younger with median ages of 62 and 65.5 years, respectively.
For all protein biomarkers the intra- and inter-coefficients of variation were <20% for all measurements. The limit of detection was set three standard deviations above the background for protein. The internal and external controls developed by Olink enable monitoring of assay performance and quality of samples, and detection control monitors the read out. Extension control facilitates normalization across samples and inter-plate control enables normalization between plates.

3.2. Correlation Analyses

The results of correlation analyses of the repeat measurements (2015 and 2018) of the 27 proteins in the same plasma samples from the 39 CRC cases are presented in Table 2 and in Figure 3 and Figure 4. With correlation coefficients ranging from +0.43 to +0.97 (median +0.67, interquartile range +0.58 to +0.84), moderate to high positive correlations were observed between the first and second measurements for all 27 proteins (p-values < 0.01 for all proteins and <0.001 for 26 out of 27 proteins). With correlation coefficients between +0.86 and +0.97, correlations were very high for these six proteins: amphiregulin (AREG), carbonic anhydrase (CAIX), carcinoembryonic antigen (CEA), Fas-associated death domain protein (FADD), interleukin-6 (IL6) and mucin-16 (MUC16). Strong correlations with correlation coefficients between +0.66 and +0.84 were still observed for the following ten proteins: hepatocyte growth factor (HGF), kallikrein 11 (hk11), midkine (MK), transforming growth factor alpha (TGFalpha), tumor necrosis factor receptor superfamily member 4 (tumor necrosis factor receptor superfamily member 4 (TNFRSF4), tumor necrosis factor ligand superfamily member 13B (TNFSF13B), TNF-related apoptosis-inducing ligand (TRAIL), vimentin (VIM), vascular endothelial growth factor A (VEGFA) and WAP four-disulfide core domain protein 2 (WFDC2).
The mean concentration Cq and NPX values of the first and second measurements, respectively, for all the proteins are also presented in Table 2. As the normalizations performed on datasets from both the measurements were slightly different, the absolute concentration values are not directly comparable. Nevertheless, the standard deviations and standard errors of both measurements were largely similar.

3.3. Analyses of Diagnostic Performance

Results of the univariate analysis comparing the expression difference of each marker in plasma samples from 39 CRC cases to 181 controls from 2015 and the same 39 CRC cases to 102 controls from the measurements in 2018 are reported in Table 3. Statistically significant expression differences between CRC cases and controls without neoplasms were found for six proteins, and persisted for five proteins after correction for multiple testing in the 2015 measurements. Two proteins, AREG and CEA, displayed areas under the ROC curves (AUCs) ≥0.7 for discrimination of CRC cases from controls. Similarly, for the measurements from 2018 that compared 39 CRC cases to 102 controls free of neoplasms, adjusted p-values ≤0.05 were observed for six protein biomarkers and AUCs ≥0.7 were observed for the same two biomarkers, AREG and CEA, in the second measurements. The AUCs for the 2015 and 2018 measurements were positively correlated, with a Pearson correlation coefficient of +0.58; for only 1 out of the 27 proteins (WFDC2), a statistically significant difference in AUC was seen between the 2015 and 2018 measurements.

4. Discussion

In order to determine the effect of freeze–thaw cycles and prolonged sample storage times on expressions of candidate plasma proteins for CRC early detection, concentrations of 27 proteins were directly compared for paired samples from proximity extension assays (PEA) measurements performed in the year 2015 and, after an additional three freeze–thaw cycles, in 2018. Paired measurements were available for 39 CRC cases detected at screening colonoscopy. Moderate to very strong correlations were seen for all 27 proteins, with correlation coefficients ranging from 0.43 to 0.97 (p < 0.001 for 26 out of 27 proteins). Furthermore, analyses of diagnostic performance based on samples from the two different measurement rounds yielded rather similar results, despite inclusion of different samples of controls.
Large-scale screening and cohort studies are an invaluable resource for evaluating novel biomarkers for cancer screening. However, they often require many years of participant recruitment and follow-up. For reasons related to efficiency and logistics, and to minimize batch effects, laboratory analyses are typically performed in single batches after completion of recruitment and/or follow-up, and the precious biospecimens collected in such studies are typically stored frozen for long times at very low temperatures in order to remain available for additional analyses of novel emerging biomarkers; or to use novel, emerging technologies upon. As a result of limited storage capacities for very small aliquots, larger blood aliquots must sometimes be used multiple times and samples consequently undergo multiple freeze–thaw cycles before analysis. The research of protein biomarkers is mired by several factors, such as the dynamic range of plasma proteins [18], inconsistencies in sample handling, preanalytical and analytical procedures [19,20], in addition to varying times required for sample fixation after sample processing [21]. Although there is consensus that storing times might be of concern for some markers [22,23] and that freeze–thaw cycles should be minimized wherever possible, there is very limited empirical evidence pertaining to the degree to which prolonged storing times and freeze–thaw cycles compromise the reliability and validity of measurements of candidate diagnostic markers; moreover, there are few estimates of their diagnostic performance.
Our study aimed to help fill in these gaps for plasma measurements of 27 candidate diagnostic proteins performed in two batches, three years apart. Overall, rather high correlations were seen between repeat measurements, despite the large differences in sample handling in terms of storage times and freeze–thaw cycles. It is worth noting in this context that even repeat measurements of the same samples without any additional storage time or freeze–thaw cycle would not be expected to yield perfect correlations; variations between the two measurements may not be fully ascribed to sample storage times and freeze–thaw cycles. Although our results are reassuring in that measurement correlations for the majority of the candidate protein markers were very high, they also illustrate that vulnerabilities to preanalytical handling may strongly vary between proteins. Therefore, neither general disregard for samples that have been stored for long time and undergone multiple freeze–thaw cycles, nor general ignorance of the relevance of preanalytical conditions, are warranted. Rather, a differentiated view regarding specific analytical conditions and their relevance for specific biomarkers is warranted. In this respect, our study aims to contribute to the very limited empirical evidence available thus far.
Our study has specific strengths and limitations. A major strength is its conduction in a true screening setting, and in the target population of CRC screening for whom potential inclusion of the candidate proteins in a blood-based screening test would be of immediate practical relevance. Many studies on the role of pre-analytics for diagnostic measurements have relied on small convenience samples. In our study, the presence of CRC and absence of colorectal neoplasms were confirmed by screening colonoscopy in all participants. The study was based on a very large cohort of screening colonoscopy participants that enabled inclusion of a reasonably sized sample of screening-detected CRC patients, despite the very low prevalence of CRC in the screening population. In addition to providing quantitative evidence for the correlation between plasma protein measurements, our study also provides empirical evidence for the potential impact of preanalytical history on estimates of diagnostic performance. However, a number of limitations also need to be addressed. Although the same proteins were measured in both rounds of measurements, they were included in different protein panels in the first and second measurements, which may have affected measurement quality. Furthermore, different types of normalization were employed in the first and second measurement rounds. Finally, direct comparisons of measurements were restricted to screened subjects in whom CRC was detected at colonoscopy, whereas no such direct comparisons were possible among control samples due to a lack of overlap among them.
Despite these limitations, our results provide valuable empirical evidence on the stability against major differences in preanalytics for a number of plasma proteins that may be relevant for a potential CRC multi-protein screening panel. In particular, very high correlations were found for several markers showing the highest diagnostic potential in this and previous analyses, such as AREG and CEA [8,9,13,24], but wide variations in correlation were seen across various proteins. Although biomarkers such as AREG and CEA are not ready for clinical use, using a combination of these potentially promising proteins with other types of genetic, epigenetic, protein or metabolomic biomarkers could contribute to the development of a powerful blood-based screening tool. Such multi-omics development may receive further momentum through the application of artificial intelligence tools [25,26]. Given that preanalytics may not often be perfect in routine screening practices, the robustness of markers against various preanalytical conditions is an additional, important criterion to be considered in biomarker research that should receive increased attention in future studies.

Author Contributions

Conceptualization, H.B. and M.B.; methodology, M.B.; software, M.B.; validation, M.B. and H.B.; formal analysis, M.B.; investigation, M.B.; resources, H.B.; data curation, M.B.; writing—original draft preparation, M.B.; writing—review and editing, M.B., P.S.-K. and H.B.; visualization, M.B. and H.B.; supervision, H.B.; project administration, M.B.; funding acquisition, H.B. All authors have read and agreed to the published version of the manuscript.

Funding

The BLITZ study was partly funded by grants from the German Research Council (DFG, Grant No. BR1704/16-1).

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and has been approved by the ethics committees of the Medical Faculty of University of Heidelberg (S-178/2005, 2005), and of the physicians’ boards of Baden-Wuerttemberg (M118-05-f, 2011), Rhineland-Palatinate (837.047.06(5145), 2017), Hesse (MC 254/2007, 2007) and Saarland (217/13, 2013).

Informed Consent Statement

Written informed consent was obtained from all study participants.

Data Availability Statement

The analyzed datasets are not publicly available.

Acknowledgments

The authors acknowledge the cooperation of the gastroenterology practices and clinics in patient recruitment and of Labor Limbach in sample collection. They also thank Katja Butterbach, Katarina Cuk, Ulrike Schlesselmann, Sabine Eichenherr and Romana Kimmel for their excellent work in laboratory preparation of the blood samples, and Isabel Lerch, Susanne Köhler, Utz Benscheid, Jason Hochhaus and Maria Kuschel for their contributions in data collection, monitoring and documentation.

Conflicts of Interest

The German Cancer Research Center has received industrial grants related to blood markers for early detection of colorectal cancer from Epigenomics, Applied Proteomics and Roche Diagnostics.

References

  1. Wulfkuhle, J.D.; Liotta, L.A.; Petricoin, E.F. Proteomic applications for the early detection of cancer. Nat. Rev. Cancer 2003, 3, 267–275. [Google Scholar] [CrossRef] [PubMed]
  2. Borrebaeck, C.A. Precision diagnostics: Moving towards protein biomarker signatures of clinical utility in cancer. Nat. Rev. Cancer 2017, 17, 199–204. [Google Scholar] [CrossRef] [PubMed]
  3. Bhardwaj, M.; Gies, A.; Werner, S.; Schrotz-King, P.; Brenner, H. Blood-Based Protein Signatures for Early Detection of Colorectal Cancer: A Systematic Review. Clin. Transl. Gastroenterol. 2017, 8, e128. [Google Scholar] [CrossRef]
  4. Bhardwaj, M.; Erben, V.; Schrotz-King, P.; Brenner, H. Cell Line Secretome and Tumor Tissue Proteome Markers for Early Detection of Colorectal Cancer: A Systematic Review. Cancers 2017, 9, 156. [Google Scholar] [CrossRef] [Green Version]
  5. Bradshaw, R.A.; Hondermarck, H.; Rodriguez, H. Cancer Proteomics and the Elusive Diagnostic Biomarkers. Proteomics 2019, 19, e1800445. [Google Scholar] [CrossRef] [PubMed]
  6. Hundt, S.; Haug, U.; Brenner, H. Comparative evaluation of immunochemical fecal occult blood tests for colorectal adenoma detection. Ann. Intern. Med. 2009, 150, 162–169. [Google Scholar] [CrossRef] [PubMed]
  7. Brenner, H.; Tao, S.; Haug, U. Low-dose aspirin use and performance of immunochemical fecal occult blood tests. JAMA 2010, 304, 2513–2520. [Google Scholar] [CrossRef] [Green Version]
  8. Chen, H.; Zucknick, M.; Werner, S.; Knebel, P.; Brenner, H. Head-to-Head Comparison and Evaluation of 92 Plasma Protein Biomarkers for Early Detection of Colorectal Cancer in a True Screening Setting. Clin. Cancer Res. 2015, 21, 3318–3326. [Google Scholar] [CrossRef] [Green Version]
  9. Chen, H.; Qian, J.; Werner, S.; Cuk, K.; Knebel, P.; Brenner, H. Development and validation of a panel of five proteins as blood biomarkers for early detection of colorectal cancer. Clin. Epidemiol. 2017, 9, 517–526. [Google Scholar] [CrossRef] [Green Version]
  10. Gies, A.; Cuk, K.; Schrotz-King, P.; Brenner, H. Direct Comparison of Diagnostic Performance of 9 Quantitative Fecal Immunochemical Tests for Colorectal Cancer Screening. Gastroenterology 2018, 154, 93–104. [Google Scholar] [CrossRef] [Green Version]
  11. Weigl, K.; Thomsen, H.; Balavarca, Y.; Hellwege, J.N.; Shrubsole, M.J.; Brenner, H. Genetic Risk Score Is Associated with Prevalence of Advanced Neoplasms in a Colorectal Cancer Screening Population. Gastroenterology 2018, 155, 88–98.e10. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Pox, C.P.; Altenhofen, L.; Brenner, H.; Theilmeier, A.; Von Stillfried, D.; Schmiegel, W. Efficacy of a nationwide screening colonoscopy program for colorectal cancer. Gastroenterology 2012, 142, 1460–1467.e2. [Google Scholar] [CrossRef] [PubMed]
  13. Bhardwaj, M.; Weigl, K.; Tikk, K.; Benner, A.; Schrotz-King, P.; Brenner, H. Multiplex screening of 275 plasma protein biomarkers to identify a signature for early detection of colorectal cancer. Mol. Oncol. 2020, 14, 8–21. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Assarsson, E.; Lundberg, M.; Holmquist, G.; Björkesten, J.; Thorsen, S.B.; Ekman, D.; Eriksson, A.; Dickens, E.R.; Ohlsson, S.; Edfeldt, G.; et al. Homogenous 96-Plex PEA Immunoassay Exhibiting High Sensitivity, Specificity, and Excellent Scalability. PLoS ONE 2014, 9, e95192. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Benjamini, Y.; Hochberg, Y. Controlling the False Discovery Rate—A Practical and Powerful Approach to Multiple Testing. J. R. Stat. Soc. Ser. B-Methodol. 1995, 57, 289–300. [Google Scholar] [CrossRef]
  16. Delong, E.R.; Delong, D.M.; Clarke-Pearson, D.L. Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach. Biometrics 1988, 44, 837–845. [Google Scholar] [CrossRef]
  17. Team, R.C. A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2016. [Google Scholar]
  18. Hortin, G.L.; Sviridov, D. The dynamic range problem in the analysis of the plasma proteome. J. Proteom. 2010, 73, 629–636. [Google Scholar] [CrossRef]
  19. Hassis, M.E.; Niles, R.K.; Braten, M.N.; Albertolle, M.E.; Witkowska, H.E.; Hubel, C.A.; Fisher, S.J.; Williams, K.E. Evaluating the effects of preanalytical variables on the stability of the human plasma proteome. Anal. Biochem. 2015, 478, 14–22. [Google Scholar] [CrossRef] [Green Version]
  20. Almazi, J.G.; Pockney, P.; Gedye, C.; Smith, N.D.; Hondermarck, H.; Verrills, N.; Dun, M.D. Cell-Free DNA Blood Collection Tubes Are Appropriate for Clinical Proteomics: A Demonstration in Colorectal Cancer. Proteom. Clin. Appl. 2018, 12, e1700121. [Google Scholar] [CrossRef] [Green Version]
  21. Henry, N.L.; Hayes, D.F. Cancer biomarkers. Mol. Oncol. 2012, 6, 140–146. [Google Scholar] [CrossRef] [Green Version]
  22. Guo, G.-H.; Dong, J.; Yuan, X.-H.; Dong, Z.-N.; Tian, Y.-P. Clinical evaluation of the levels of 12 cytokines in serum/plasma under various storage conditions using evidence biochip arrays. Mol. Med. Rep. 2013, 7, 775–780. [Google Scholar] [CrossRef] [Green Version]
  23. Lee, J.-E.; Kim, S.Y.; Shin, S.-Y. Effect of Repeated Freezing and Thawing on Biomarker Stability in Plasma and Serum Samples. Osong Public Health Res. Perspect. 2015, 6, 357–362. [Google Scholar] [CrossRef] [Green Version]
  24. Werner, S.; Krause, F.; Rolny, V.; Strobl, M.; Morgenstern, D.; Datz, C.; Chen, H.; Brenner, H. Evaluation of a 5-Marker Blood Test for Colorectal Cancer Early Detection in a Colorectal Cancer Screening Setting. Clin. Cancer Res. 2016, 22, 1725–1733. [Google Scholar] [CrossRef] [Green Version]
  25. Nicora, G.; Vitali, F.; Dagliati, A.; Geifman, N.; Bellazzi, R. Integrated Multi-Omics Analyses in Oncology: A Review of Machine Learning Methods and Tools. Front. Oncol. 2020, 10, 1030. [Google Scholar] [CrossRef]
  26. Reel, P.S.; Reel, S.; Pearson, E.; Trucco, E.; Jefferson, E. Using machine learning approaches for multi-omics data analysis: A review. Biotechnol. Adv. 2021, 49, 107739. [Google Scholar] [CrossRef]
Figure 1. STARD (Standards for Reporting Diagnostic Accuracy Studies) flow diagram of the BLITZ study. Abbreviation: CRC, colorectal cancer. * The exclusion criteria for selection of CRC cases were not applicable after this point. # Participants selected from research study [13]. § Participants selected from research studies [8,9].
Figure 1. STARD (Standards for Reporting Diagnostic Accuracy Studies) flow diagram of the BLITZ study. Abbreviation: CRC, colorectal cancer. * The exclusion criteria for selection of CRC cases were not applicable after this point. # Participants selected from research study [13]. § Participants selected from research studies [8,9].
Life 12 00359 g001
Figure 2. Study workflow. Abbreviations: AUC, area under the receiver operating curve; CRC, colorectal cancer; PEA, proximity extension assay.
Figure 2. Study workflow. Abbreviations: AUC, area under the receiver operating curve; CRC, colorectal cancer; PEA, proximity extension assay.
Life 12 00359 g002
Figure 3. Correlation plot displaying Pearson’s product–moment correlation of the 27 markers from the measurements of 2015 and 2018. Abbreviations: AREG, amphiregulin; CAIX, carbonic anhydrase IX; CEA, carcinoembryonic antigen; ERBB2, receptor tyrosine-protein kinase erbB-2; ERBB3, receptor tyrosine-protein kinase erbB-3; ERBB4, receptor tyrosine-protein kinase erbB-4; FADD, Fas-associated death domain protein; FASLG, Fas antigen ligand; FRalpha, folate receptor alpha; HGF, hepatocyte growth factor; hK11, kallikrein 11; ICOSLG, ICOS ligand; IL6, interleukin-6; LYN, tyrosine-protein kinase Lyn; MIA, melanoma-derived growth regulatory protein; MK, midkine; MUC16, mucin-16; NPX, normalized protein expression; SCF, stem cell factor; TGFalpha, transforming growth factor alpha; TNFRSF4, tumor necrosis factor receptor superfamily member 4; TNFSF13B, tumor necrosis factor ligand superfamily member 13B; TRAIL, TNF-related apoptosis-inducing ligand; VEGFA, vascular endothelial growth factor A; VEGFR2, vascular endothelial growth factor receptor 2; VIM, vimentin; WFDC2, WAP four-disulfide core domain protein 2.
Figure 3. Correlation plot displaying Pearson’s product–moment correlation of the 27 markers from the measurements of 2015 and 2018. Abbreviations: AREG, amphiregulin; CAIX, carbonic anhydrase IX; CEA, carcinoembryonic antigen; ERBB2, receptor tyrosine-protein kinase erbB-2; ERBB3, receptor tyrosine-protein kinase erbB-3; ERBB4, receptor tyrosine-protein kinase erbB-4; FADD, Fas-associated death domain protein; FASLG, Fas antigen ligand; FRalpha, folate receptor alpha; HGF, hepatocyte growth factor; hK11, kallikrein 11; ICOSLG, ICOS ligand; IL6, interleukin-6; LYN, tyrosine-protein kinase Lyn; MIA, melanoma-derived growth regulatory protein; MK, midkine; MUC16, mucin-16; NPX, normalized protein expression; SCF, stem cell factor; TGFalpha, transforming growth factor alpha; TNFRSF4, tumor necrosis factor receptor superfamily member 4; TNFSF13B, tumor necrosis factor ligand superfamily member 13B; TRAIL, TNF-related apoptosis-inducing ligand; VEGFA, vascular endothelial growth factor A; VEGFR2, vascular endothelial growth factor receptor 2; VIM, vimentin; WFDC2, WAP four-disulfide core domain protein 2.
Life 12 00359 g003
Figure 4. Distribution of Pearson’s product–moment correlation coefficients of the markers from the measurements of 2015 and 2018. Abbreviations: AREG, amphiregulin; CAIX, carbonic anhydrase IX; CEA, carcinoembryonic antigen; ERBB2, receptor tyrosine-protein kinase erbB-2; ERBB3, receptor tyrosine-protein kinase erbB-3; ERBB4, receptor tyrosine-protein kinase erbB-4; FADD, Fas-associated death domain protein; FASLG, Fas antigen ligand; FRalpha, folate receptor alpha; HGF, hepatocyte growth factor; hK11, kallikrein 11; ICOSLG, ICOS ligand; IL6, interleukin-6; LYN, tyrosine-protein kinase Lyn; MIA, melanoma-derived growth regulatory protein; MK, midkine; MUC16, mucin-16; NPX, normalized protein expression; SCF, stem cell factor; TGFalpha, transforming growth factor alpha; TNFRSF4, tumor necrosis factor receptor superfamily member 4; TNFSF13B, tumor necrosis factor ligand superfamily member 13B; TRAIL, TNF-related apoptosis-inducing ligand; VEGFA, vascular endothelial growth factor A; VEGFR2, vascular endothelial growth factor receptor 2; VIM, vimentin; WFDC2, WAP four-disulfide core domain protein 2.
Figure 4. Distribution of Pearson’s product–moment correlation coefficients of the markers from the measurements of 2015 and 2018. Abbreviations: AREG, amphiregulin; CAIX, carbonic anhydrase IX; CEA, carcinoembryonic antigen; ERBB2, receptor tyrosine-protein kinase erbB-2; ERBB3, receptor tyrosine-protein kinase erbB-3; ERBB4, receptor tyrosine-protein kinase erbB-4; FADD, Fas-associated death domain protein; FASLG, Fas antigen ligand; FRalpha, folate receptor alpha; HGF, hepatocyte growth factor; hK11, kallikrein 11; ICOSLG, ICOS ligand; IL6, interleukin-6; LYN, tyrosine-protein kinase Lyn; MIA, melanoma-derived growth regulatory protein; MK, midkine; MUC16, mucin-16; NPX, normalized protein expression; SCF, stem cell factor; TGFalpha, transforming growth factor alpha; TNFRSF4, tumor necrosis factor receptor superfamily member 4; TNFSF13B, tumor necrosis factor ligand superfamily member 13B; TRAIL, TNF-related apoptosis-inducing ligand; VEGFA, vascular endothelial growth factor A; VEGFR2, vascular endothelial growth factor receptor 2; VIM, vimentin; WFDC2, WAP four-disulfide core domain protein 2.
Life 12 00359 g004
Table 1. Main characteristics of the study population.
Table 1. Main characteristics of the study population.
CharacteristicCRC Cases with Repeat Measurements from Same Plasma Samples in 2015 and 2018Controls
Measured in 2015
Controls
Measured in 2018
N (39)%N (181)%N (102)%
Age in Years
50–5971867372121
60–69205181455049
70–84123133183130
Mean66.5-62.9-65.4-
Median67.0-62.0-65.5-
SD6.6-6.2-6.9-
Gender Distribution
Male2872103576665
Female112878433635
Stage Distribution
Stage I1333----
Stage II38----
Stage III2051----
Stage IV38----
Abbreviations: CRC, colorectal cancer; N, number; SD, standard deviation.
Table 2. Correlation coefficients, mean concentrations, standard deviations and standard errors of repeat measurements of 27 proteins from the same plasma samples of 39 CRC cases analysed in 2015 and 2018.
Table 2. Correlation coefficients, mean concentrations, standard deviations and standard errors of repeat measurements of 27 proteins from the same plasma samples of 39 CRC cases analysed in 2015 and 2018.
MarkerPearson’s Product-Moment Correlation Coefficientp-Value *Measurements from 2015Measurements from 2018
Mean
Cq
Standard DeviationStandard ErrorMean
NPX
Standard DeviationStandard Error
CEA0.97<0.00053.701.430.232.171.450.23
CAIX0.92<0.00052.871.290.213.631.100.18
FADD0.92<0.00053.951.150.182.521.060.17
IL60.92<0.00054.990.880.143.020.850.14
MUC160.88<0.00052.711.050.174.050.870.14
AREG0.87<0.00053.500.650.102.640.590.10
TGFalpha0.84<0.00054.430.830.134.340.830.13
VIM0.83<0.00055.850.810.135.880.690.11
HGF0.76<0.00058.350.500.088.510.570.09
TRAIL0.69<0.00057.900.280.047.770.350.06
WFDC20.69<0.00057.550.420.078.170.460.07
hK110.68<0.00055.720.510.086.330.500.08
TNFRSF40.68<0.00053.500.480.083.130.430.07
TNFSF13B0.67<0.00056.680.350.066.930.350.06
VEGFA0.67<0.000510.890.470.0810.040.580.09
MK0.66<0.00057.740.600.106.950.680.11
MIA0.64<0.00054.970.340.0510.210.310.05
FASLG0.59<0.00052.400.420.079.090.440.07
SCF0.59<0.00058.250.490.089.090.530.08
FRalpha0.58<0.00054.890.460.076.380.490.08
ERBB20.57<0.00058.950.440.077.890.360.06
LYN0.56<0.00052.770.740.123.550.870.14
ERBB30.51<0.0018.940.380.067.920.260.04
ERBB40.51<0.0015.830.380.065.180.330.05
FURIN0.51<0.0017.740.380.069.340.380.06
VEGFR20.50<0.0017.880.430.077.170.280.04
ICOSLG0.43<0.014.030.380.065.140.390.06
* p-value is the level of significance of the t-test from Pearson’s product–moment correlation that indicates whether variables are significantly correlated or not. Abbreviations: AREG, amphiregulin; CAIX, carbonic anhydrase IX; CEA, carcinoembryonic antigen; ERBB2, receptor tyrosine-protein kinase erbB-2; ERBB3, receptor tyrosine-protein kinase erbB-3; ERBB4, receptor tyrosine-protein kinase erbB-4; FADD, Fas-associated death domain protein; FASLG, Fas antigen ligand; FRalpha, folate receptor alpha; HGF, hepatocyte growth factor; hK11, kallikrein 11; ICOSLG, ICOS ligand; IL6, interleukin-6; LYN, tyrosine-protein kinase Lyn; MIA, melanoma-derived growth regulatory protein; MK, midkine; MUC16, mucin-16; NPX, normalized protein expression; SCF, stem cell factor; TGFalpha, transforming growth factor alpha; TNFRSF4, tumor necrosis factor receptor superfamily member 4; TNFSF13B, tumor necrosis factor ligand superfamily member 13B; TRAIL, TNF-related apoptosis-inducing ligand; VEGFA, vascular endothelial growth factor A; VEGFR2, vascular endothelial growth factor receptor 2; VIM, vimentin; WFDC2, WAP four-disulfide core domain protein 2.
Table 3. Diagnostic performance of individual markers for detecting CRC at two different time points with an average of three freeze–thaw cycles.
Table 3. Diagnostic performance of individual markers for detecting CRC at two different time points with an average of three freeze–thaw cycles.
MarkerMeasurements from 2015 (nCRC = 39, nControls = 181)Measurements from 2018 (nCRC = 39, nControls = 102)DeLong p-val for Testing Differences in AUCs
Mean CqAUC (95% CI)p-valp-valadjMean NPXAUC (95% CI)p-valp-valadj
CRCControlsCRCControls
AREG3.502.950.79 (0.71–0.86)<0.05<0.052.642.270.71 (0.61–0.80)<0.05<0.050.20
CAIX2.872.620.54 (0.44–0.64)0.460.723.633.500.51 (0.40–0.62)0.910.910.68
CEA3.702.650.75 (0.66–0.84)<0.05<0.052.171.300.70 (0.60–0.81)<0.05<0.050.52
ERBB28.958.850.57 (0.47–0.68)0.150.367.897.920.52 (0.41–0.63)0.760.850.47
ERBB38.948.910.53 (0.42–0.63)0.620.727.927.950.54 (0.43–0.65)0.490.600.87
ERBB45.835.790.53 (0.43–0.63)0.580.725.185.240.56 (0.46–0.67)0.240.430.64
FADD3.953.910.50 (0.40–0.60)0.980.982.522.190.60 (0.50–0.70)0.070.210.17
FASLG2.402.450.47 (0.38–0.57)0.600.729.099.100.51 (0.40–0.62)0.870.910.62
FRalpha4.894.950.53 (0.43–0.63)0.530.726.386.570.64 (0.53–0.75)<0.05<0.050.15
FURIN7.747.680.52 (0.42–0.62)0.660.749.349.270.54 (0.44–0.65)0.410.560.76
HGF8.358.030.65 (0.56–0.74)<0.05<0.058.518.310.60 (0.50–0.71)0.050.210.52
hK115.725.610.56 (0.46–0.67)0.210.426.336.430.59 (0.48–0.70)0.110.250.76
ICOSLG4.034.010.53 (0.43–0.63)0.550.725.145.320.65 (0.54–0.75)<0.05<0.050.12
IL64.994.630.64 (0.55–0.72)<0.05<0.053.022.870.56 (0.46–0.66)0.270.430.25
LYN2.772.960.57 (0.49–0.66)0.150.363.553.230.60 (0.50–0.70)0.070.210.70
MIA4.974.930.54 (0.45–0.63)0.430.7210.2110.260.56 (0.45–0.67)0.270.450.78
MK7.747.740.51 (0.41–0.61)0.820.886.956.800.57 (0.46–0.67)0.220.430.46
MUC162.712.380.60 (0.49–0.71)0.050.164.053.870.55 (0.45–0.66)0.320.480.55
SCF8.258.240.50 (0.40–0.61)0.980.989.099.140.55 (0.44–0.65)0.370.520.53
TGFalpha4.434.060.62 (0.53–0.72)<0.050.074.343.970.64 (0.54–0.75)<0.05<0.050.80
TNFRSF43.503.440.53 (0.43–0.62)0.590.723.133.200.57 (0.46–0.67)0.220.430.59
TNFSF13B6.686.610.55 (0.45–0.65)0.330.626.936.870.54 (0.44–0.65)0.450.570.91
TRAIL7.907.960.57 (0.47–0.67)0.180.387.777.970.67 (0.57–0.77)<0.05<0.050.17
VEGFA10.8910.690.60 (0.51–0.68)0.050.1710.049.880.59 (0.49–0.69)0.110.250.87
VEGFR27.887.810.46 (0.36–0.56)0.450.727.177.210.48 (0.37–0.59)0.720.850.80
VIM5.855.470.59 (0.50–0.68)0.070.205.885.590.59 (0.48–0.69)0.100.250.96
WFDC27.557.310.64 (0.55–0.74)<0.05<0.058.178.140.49 (0.39–0.60)0.870.910.03
Abbreviations: AREG, amphiregulin; AUC, area under the receiver operating curve; CAIX, carbonic anhydrase IX; CEA, carcinoembryonic antigen; CRC, colorectal cancer; ERBB2, receptor tyrosine-protein kinase erbB-2; ERBB3, receptor tyrosine-protein kinase erbB-3; ERBB4, receptor tyrosine-protein kinase erbB-4; FADD, Fas-associated death domain protein; FASLG, Fas antigen ligand; FRalpha, folate receptor alpha; HGF, hepatocyte growth factor; hK11, kallikrein 11; ICOSLG, ICOS ligand; IL6, interleukin 6; LYN, tyrosine-protein kinase Lyn; MIA, melanoma-derived growth regulatory protein; MK, midkine; MUC16, mucin-16; NPX, normalized protein expression; p-val, nominal p-value; p-valadj, p-value obtained after adjustment for multiple testing by Benjamini–Hochberg; SCF, stem cell factor; TGFalpha, transforming growth factor alpha; TNFRSF4, tumor necrosis factor receptor superfamily member 4; TNFSF13B, tumor necrosis factor ligand superfamily member 13B; TRAIL, TNF-related apoptosis-inducing ligand; VEGFA, vascular endothelial growth factor A; VEGFR2, vascular endothelial growth factor receptor 2; VIM, vimentin; WFDC2, WAP four-disulfide core domain protein 2; 95% CI, 95% confidence interval.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Bhardwaj, M.; Schrotz-King, P.; Brenner, H. Correlation of Repeat Measurements of 27 Candidate Protein Markers for Colorectal Cancer Screening Taken Three Years and Multiple Freeze–Thaw Cycles Apart. Life 2022, 12, 359. https://doi.org/10.3390/life12030359

AMA Style

Bhardwaj M, Schrotz-King P, Brenner H. Correlation of Repeat Measurements of 27 Candidate Protein Markers for Colorectal Cancer Screening Taken Three Years and Multiple Freeze–Thaw Cycles Apart. Life. 2022; 12(3):359. https://doi.org/10.3390/life12030359

Chicago/Turabian Style

Bhardwaj, Megha, Petra Schrotz-King, and Hermann Brenner. 2022. "Correlation of Repeat Measurements of 27 Candidate Protein Markers for Colorectal Cancer Screening Taken Three Years and Multiple Freeze–Thaw Cycles Apart" Life 12, no. 3: 359. https://doi.org/10.3390/life12030359

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop