Next Article in Journal
Assessing Putative Markers of Colorectal Cancer Stem Cells: From Colonoscopy to Gene Expression Profiling
Next Article in Special Issue
Prognostic Nutritional Index, Controlling Nutritional Status (CONUT) Score, and Inflammatory Biomarkers as Predictors of Deep Vein Thrombosis, Acute Pulmonary Embolism, and Mortality in COVID-19 Patients
Previous Article in Journal
Correction: Go et al. Diagnostic Accuracy of Biomarkers for Early-Onset Neonatal Bacterial Infections: Evaluation of Serum Procalcitonin Reference Curves. Diagnostics 2020, 10, 839
Previous Article in Special Issue
A Novel Rolling Circle Amplification-Based Detection of SARS-CoV-2 with Multi-Region Padlock Hybridization
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Performance Analysis of Self-Collected Nasal and Oral Swabs for Detection of SARS-CoV-2

1
Department of Molecular Diagnostics, Seegene Medical Foundation, Seoul 04805, Korea
2
Department of Integrative Biological Sciences & BK21 FOUR Educational Research Group for Age-Associated Disorder Control Technology, Chosun University, Gwangju 61452, Korea
3
Paul F. Glenn Center for Biology of Aging Research, Department of Genetics, Blavatnik Institute, Harvard Medical School, Boston, MA 02115, USA
4
Clinical Research Institute, Seegene Medical Foundation, Seoul 04805, Korea
5
Department of Laboratory Medicine, Seegene Medical Foundation, Seoul 04805, Korea
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Diagnostics 2022, 12(10), 2279; https://doi.org/10.3390/diagnostics12102279
Submission received: 24 August 2022 / Revised: 19 September 2022 / Accepted: 19 September 2022 / Published: 21 September 2022

Abstract

:
Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is the third highly pathogenic human coronavirus and is rapidly transmitted by infected individuals regardless of their symptoms. During the COVID-19 pandemic, owing to the dearth of skilled healthcare workers (HCWs) to collect samples for early diagnosis, self-collection emerged as a viable alternative. To evaluate the reliability of self-collection, we compared the virus detection rate using 3990 self-collected swabs and HCW-collected swabs, procured from the same individuals and collected immediately after the self-collection. The results of multiplex reverse-transcription quantitative polymerase chain reaction revealed that the viral load in the HCW-collected swabs was marginally (18.4–28.8 times) higher than that in self-collected swabs. Self-collection showed no significant difference in sensitivity and specificity from HCW-collection (κ = 0.87, McNemar’s test; p = 0.19), indicating a comparable performance. These findings suggest that self-collected swabs are acceptable substitutes for HCW-collected swabs, and that their use improved the specimen screening efficiency and reduced the risk of SARS-CoV-2 infection among HCWs during and after the COVID-19 pandemic.

1. Introduction

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is the third highly pathogenic human coronavirus to emerge in recent years [1]. This novel coronavirus was initially identified in December 2019; the World Health Organization declared the coronavirus disease 2019 (COVID-19) a global pandemic on March 11, 2020 [2]. Currently, vaccination is the most effective strategy for combating the pandemic; however, viral evolution (driven by genomic mutations) threatens the efficacy of vaccines [3]. Despite multiple vaccinations, breakthrough SARS-CoV-2 infections have become common owing to the emergence of variants, including Delta (B.1.617.2) and Omicron (B.1.1.529) [4,5]. Despite increased screening and testing, more than 551 million confirmed cases and 6.3 million deaths had been documented worldwide by July 11, 2022 [6].
SARS-CoV-2 is transmitted through both symptomatic and asymptomatic carriers [7]. Therefore, early diagnosis of positive cases significantly reduces the virus spread [8]. The virus has been detected in numerous clinical specimens, including nasopharyngeal swabs (NPS), oropharyngeal swabs (OPS), nasal swabs (NS), and oral swabs (OS); as well as in sputum, urine, stools, and blood [9,10]. Current surveillance relies on established sampling techniques, such as the collection of NPS by trained healthcare workers (HCWs) [11,12,13]. However, a shortage of HCWs has strained the NPS sampling system, especially when the incidence of infections increases rapidly [14]. The Food and Drug Administration authorized rapid antigen tests for over-the-counter usage in December 2020 [15]. However, the sensitivity of these antigen tests is much lower than that of the polymerase chain reaction (PCR) test; therefore, cases need to be validated by PCR [16]. Consequently, it is necessary to expand testing capacity, including self-collection of respiratory specimens (NS, OS, and saliva), for PCR testing [10].
HCWs collect NPS and OPS specimens by swabbing the posterior nasopharynx and oropharynx, respectively [17]. Self-collection of NS and OS specimens can be performed simply by swabbing the anterior nares and mouth [10]. Numerous investigations have evaluated the accuracy of SARS-CoV-2 test results from self-collected vs. HCW-collected specimens. Some studies reported no significant difference between the two collection methods in terms of diagnostic sensitivity (86.3–89.2%) [18,19,20]; however, a low reliability of test results from self-collected samples was reported in some other studies [21].
Because sampling by HCWs is limited by time and place [22], previous findings have suggested that the time delay between disease onset and sampling may be variable. The diagnostic performance of self-collected swabs has been evaluated using small sample sizes; however, large-scale (≥ 3000) sampling has not yet been conducted. Therefore, research on the diagnostic efficacy of self-collected swabs is crucial for the prevention of disease transmission and early diagnosis. In this study, we assessed the detection rate and viral load using large-scale sampling and evaluated the diagnostic performance of the self-collection system to highlight its potential as an alternative to collection by HCWs. The results demonstrate that self-collection could replace HCW-collection for the diagnosis of SARS-CoV-2.

2. Materials and Methods

2.1. Study Design and Inclusion and Exclusion Criteria

This study was designed as a collaboration between Ewha Womans University and Seegene Medical Foundation for the Ewha Safe Campus (ESC) project. This project was developed by the university safety campus management as a model for the SARS-CoV-2 infection. The study was approved by the Institutional Review Board of the Seegene Medical Foundation (SMF-IRB-2022-022). Informed consent from the participants was waived because the data collected for this study were anonymized. Anonymized data were obtained from the ESC project between February and April 2022. A total of 16,478 participants were enrolled in the study and divided into two groups: (i) both self-collection and HCW-collection (3990 participants), and (ii) either self-collection or HCW-collection (12,488 participants). Participants from the latter group were excluded from this study. The participants were provided visual instructions according to the self-collection manual (Korean version). Self-collection was first conducted under the supervision of HCWs, and HCW-collection was conducted immediately thereafter. Self-collection was performed by first swabbing the anterior nares and then the mouth, whereas HCW-collection was performed by swabbing the oropharynx first and then the posterior nasopharynx. Each sample was analyzed immediately after collection. The outcomes of the test using self-collected samples were compared with those of the HCW-collected samples.

2.2. Collection and Experimental Protocol

HCW-collection was used as the gold standard: combined NPS and OPS swabs were collected in ALLTM medium (SG Medical, Seoul, Republic of Korea). The NS and OS swabs were self-collected in SELTM medium (SG Medical). Based on the collection site, ALLTM and SELTM universal transport media were classified into two sets of swabs. Nucleic acids were simultaneously extracted from HCW- and self-collected specimens using the automated MagNA Pure 96 system (Roche, Inc., Basel, Switzerland), as described previously [23]. Following the Pathogen Universal 200 protocol, 200 µL of the samples was processed using magnetic beads for nucleic acid extraction. The purified nucleic acids were eluted in 100 µL of elution buffer.

2.3. Multiplex Reverse Transcription Quantitative Real-Time Polymerase Chain Reaction (mRT-qPCR) Analysis

mRT-qPCR was performed using the AllplexTM SARS-CoV-2 Assay kit (Seegene Inc., Seoul, Republic of Korea) to detect the SARS-CoV-2 genes encoding the envelope (E), RNA-dependent RNA polymerase (RdRP), spike protein (S), and nucleocapsid (N), following a recent study [24]. If more than one of the target genes (E, RdRP and S, and N) were not detected in HCW-collected samples, the result was considered negative [25]. Positive samples were categorized as weakly positive (30–40 Ct), moderately positive (20–30 Ct), or strongly positive (10–20 Ct).

2.4. Viral RNA Load Standard

The nucleic acid of the SARS-CoV-2 strain NCCP-43330 was procured as an RNA powder from the National Culture Collection for Pathogens (NCCP; Cheongju, South Korea). The viral RNA was serially diluted in Tris-EDTA buffer to 103 copies/mL for use as a quantification standard. The viral RNA load was measured in triplicates from 109 to 103 copies/mL (Supplementary Figure S1). Raw Ct values of HCW- and self-collected samples were converted to viral RNA loads based on the SARS-CoV-2 standard curve, using the following formula: Viral load = 10(Ct value − 47.01)/−3.40 for N, 10(Ct value − 47.79)/−3.39 for RdRP and S, and 10(Ct value − 46.35)/−3.45 for E.

2.5. Statistical Analysis

All statistical analyses were performed using R Studio (version 4.1.2; R_Studio Inc., Boston, MA, USA). Categorical variables (positive or negative) are reported in percentages, absolute numbers, and 95% confidence intervals (CI). We defined the detection rate as the ratio of positivity for either self- or HCW-collection among self- and HCW-collected samples with at least one positive. The performance of a diagnostic test for SARS-CoV-2 was evaluated by estimating the sensitivity and specificity for self-collected samples against HCW-collected samples using the epiR package. Using Cohen’s kappa (κ) and McNemar’s significance test from the caret package, perfect concordance (κ = 1), almost perfect agreement (κ > 0.9), or strong agreement (κ > 0.8) was determined between HCW-collected and self-collected samples [26]. The McNemar’s test was used to evaluate the reliability of paired differences (false positives and false negatives) between the two collection methods [27]. A paired t-test was used to determine the difference in Ct values between the HCW- and self-collection groups. Results were considered statistically significant at p < 0.05. Continuous variables of the mRT-PCR Ct values are represented by mean or median (interquartile range (IQR)). The scatter, histogram, and box plots were generated using the ggplot2 packages.

3. Results

3.1. Characteristics of the Study Participants

The demography and characteristics of the 3990 eligible participants are presented in Table 1. Samples from the 3990 participants were collected immediately and classified into self- or HCW-collection groups. The percentages of participants showing SARS-CoV-2-positive and -negative results in the self-collection group were 23.9% (n = 954/3990) and 76.1% (n = 3036/3990) and those in the HCW-collection group were 23.4% (n = 935/3990) and 76.6% (n = 3055/3990), respectively. The Ct values for the N, RdRP and S, and E were similar in each group.

3.2. Comparison of the Clinical Diagnosis Performance between the HCW- and Self-Collected Samples

Among the 3990 participants, 26.0% (1039/3990) tested positive for the virus in the HCW-collection group, the self-collection group, or both groups. Self-collected samples had a higher detection rate than those in HCW-collected samples (HCW-collection (90.0%; 935/1039) versus self-collection (91.8%; 954/1039), paired t-test; p < 0.001) (Table 2). The Ct values for each gene (N, RdRP and S, and E) were compared in (81.8%; 850/1039) samples from the HCW-collection and self-collection groups that were positive for the virus (Figure 1). In the concordant positive group (samples that tested positive for the virus in both the HCW- and self-collection groups), more samples in the HCW-collection group had a low Ct value than those in the self-collection group (this was true for all the tested genes): N (82.0%, 697/850; RdRP and S (79.1%, 672/850); and E (79.5%, 676/850) (Table 2 and Figure 1). Overall, the results indicate that HCW-collected samples had a lower Ct value of SARS-CoV-2 than that of the self-collected samples.
Among the samples with discordant results (18.2%; 189/1039), 104 tested positive for the virus in the self-collection group but tested negative in the HCW-collection group. Eighty-five participants tested positive for SARS-CoV-2 in the HCW-collection group but tested negative in the self-collection group (Table 2). These findings imply that the self-collection method is reasonably sensitive, detecting > 90.9% of the SARS-CoV-2 infections diagnosed after sample collection by HCWs (Table 2). Our positive rates for the self-collected samples are comparable to those reported in other studies.

3.3. Clinical Performance of the HCW- and Self-Collection Methods

Cohen’s kappa analysis was performed to analyze the correlation between the two collection methods. For all three genes in the self-collection group, 21.3% (850/3990) tested positive for SARS-CoV-2. The sensitivity and specificity for the self-collection group were 90.9% (95% CI: 88.9–92.7) and 96.6% (95% CI: 95.9–97.2), respectively. In particular, the clinical performance of self-collected samples was in strong agreement and not statistically different from that of HCW-collected samples (κ = 0.87, McNemar’s test; p = 0.19) (Table 2).

3.4. Viral Load Detected Using the HCW- and Self-Collection Methods

As shown in Figure 2, the target viral genes in 850 individuals with concordant results were analyzed following immediate collection. Positive samples in the HCW-collection group had a mean Ct value of 21.6 (range: 17.6–24.4) for N, 22.7 (range: 18.8–25.6) for RdRP and S, and 21.9 (range: 18.1–25.0) for E (Figure 2A–C). In contrast, positive samples in the self-collection group had a mean Ct value of 26.6 (range: 21.8–31.3) for N, 27.1 (range: 22.3–31.6) for RdRP and S, and 26.3 (range: 21.6–30.7) for E (Figure 2D–F). The mean difference in Ct values ranged from 4.3 to 5.0, indicating that the viral load was 18.4–28.8 times lower in self-collected samples than in HCW-collected samples (Figure S1).

3.5. Comparison of Ct Values in the HCW-Collection and Self-Collection Groups

We analyzed and compared the Ct values of self-collected and HCW-collected samples. The Ct values were as follows: strongly positive (median 17.7–18.3 for HCW-collection versus 22.5–23.6 for self-collection), moderately positive (median 22.7–23.3 for HCW-collection versus 27.9–28.2 for self-collection), and weakly positive (median 32.9–33.7 for HCW-collection versus 31.9–32.1 for self-collection) (Figure 3). Compared with self-collected samples, the HCW-collected samples had a lower Ct value for strongly and moderately positive samples. In contrast, the HCW-collected samples had a higher Ct value for weakly positive samples. All groups (strongly, moderately, and weakly positive) of Ct values differed significantly between HCW- and self-collected samples (paired t-test; p < 0.001).

4. Discussion

SARS-CoV-2 has frequently exhibited new mutations that have resulted in new variants, including Delta (B.1.617.2) and Omicron (B.1.1.529). Moreover, Omicron is evolving rapidly and its new subvariants are constantly emerging (e.g., BA.1, BA.2 and BA.5) [28]. The emergence of SARS-CoV-2 variants carrying mutations in the S gene raises concerns about the possibility of enhanced transmission during the ongoing COVID-19 pandemic [29]. As the pandemic spreads, with a rapidly increasing number of positive cases [30], the workload of HCWs becomes more physically exhausting, leading to pandemic fatigue [31]. NPS collection by HCWs is the conventional approach for SARS-CoV-2 testing [10]. However, the collection of NPS exposes frontline HCWs to the virus, whereas self-collection eliminates this risk and simultaneously processes the amount of sample collections needed, which is particularly advantageous given the current global health crisis [32].
It is crucial that samples are collected promptly so that communities can undergo testing for widespread infection without delay. Self-sampling is an excellent approach in these situations, as it allows for more samples to be collected and screened in less time. Self-collection of upper respiratory tract samples via the nasal cavity (such as NS) or oral cavity (such as saliva, OS, or mouthwash) is, therefore, being investigated as a minimally invasive technique, which poses less risk of infection to HCWs, and does not require the use of expensive personal protective equipment [10,11,33]. Thus, self-collection could be easily conducted at home or in the community in cases where close contact is required with patients having SARS-CoV-2 infection for rapid screening and detection of the virus during mass infection, thereby, eliminating close interaction of HCWs individuals with SARS-CoV-2 infection.
Some studies have reported low sensitivities of self-collected specimens (saliva or NS) from asymptomatic patients [11]. Saliva, in particular, has serious limitations in its usefulness due to its viscosity and the presence of various types of inhibitors [34]. In addition, different sampling sites can affect the early detection of SARS-CoV-2 [35,36,37]. Therefore, self-collected swabs were used in this study. This investigation was conducted according to the guidelines of the Korean Society for Laboratory Medicine guidelines and the Korea Centers for Disease Prevention and Control for the diagnosis of COVID-19 [25]. We enrolled 3990 eligible participants, who were provided with two swabbing methods (self-collection or HCW-collection). To avoid misdiagnosis, HCWs collected both NPS and OPS in the same viral transport medium. In addition, self-collected NS and OS samples were also combined in a transport medium.
The primary finding of this study was that there was a strong correlation between the performance of self- and HCW-collected swabs (κ = 0.87, McNemar’s test; p = 0.19). Moreover, the self-collection method demonstrated a sensitivity of 90.9 (88.9–92.7) and a specificity of 96.6 (95.9–97.2) (Table 2). These findings imply that self-collected swabs are as accurate as HCW-collected swabs for viral detection.
It has been suggested that SARS-CoV-2 can be detected in various specimens (such as NPS, OPS, saliva, urine, and stools) [9,10,38], and that the viral load in the upper respiratory tract is the highest during onset and in the last few days of symptoms [39]. However, it is not apparent whether samples from the upper respiratory tract have higher detection rates [40]. We found that SARS-CoV-2 detection rates were similar between self- and HCW-collected samples, although viral loads were lower in self-collected samples than in HCW-collected samples (Figure 3 and Supplementary Figure S1), as previously reported [10,41]. However, an analysis of weakly positive samples, namely, those with Ct > 30 (<105 copies/mL), revealed a decreased viral load in the HCW-collection group (Figure 3). These results indicate that the HCW-collection method detects SARS-CoV-2 at a higher viral load than the self-collection method (Figure 2), despite the effect of several variables such as the sampling worker, individual proficiency, and time interval. Nevertheless, although the self-collection method shows a low viral load and varies with the self-sampling ability, it may be advantageous for early diagnosis of COVID-19. We also emphasize that the diagnostic capabilities between HCW- and self-collected samples are statistically similar, as a criterion for an accurate diagnosis of COVID-19.
This study has three limitations. First, the participants were selected based on their ability to collect samples suitable for analysis using an endogenous internal control. This is because it is difficult to assess if an exogenous internal control is appropriate for collection. Second, other respiratory specimens that can be obtained using the self-collection method, such as saliva, were not evaluated. Third, depending on the sampling site, viral load or clinical performance can affect the interpretation of the results. Therefore, additional research is required to investigate the effectiveness of different collection methods in participants with typical COVID-19 symptoms (such as cough and fever), compare detection rates in other specimens (such as saliva), and examine the effects of endogenous internal controls. Finally, because this was a retrospective study where we focused on the detection ability of the early-stage self-collection system, no separate verification procedure was undertaken because it was difficult to follow-up on the disease progression. However, we conducted a verification process for the inconsistent samples by repeating the test, from nucleic acid extraction to the mRT-qPCR assay. Therefore, future studies are needed to perform follow-up studies and test using other platforms, including rapid antigen tests or other assay kits.

5. Conclusions

Owing to the global lifting of all COVID-19 restrictions and the emergence of highly infectious SARS-CoV-2 variants, such as Omicron, we believe that the sampling method needs to be highly reliable to manage community-based screening and necessary isolation. In our study, we validated two hypotheses: firstly, the SARS-CoV-2 viral load required for self-collection may be lower than that of HCW-collection; secondly, the sensitivities of self-collected NS and OS swabs for SARS-CoV-2 were comparable to those of HCW-collected NPS and OPS swabs, despite the viral load variation. The data presented support the notion that self-collection of swabs is an acceptable substitute for HCW-collection for mRT-qPCR analysis. In addition, self-collection reduces the exposure of HCWs to SARS-CoV-2 and can improve testing capacity during and after the COVID-19 pandemic (Figure 4).

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/diagnostics12102279/s1, Supplementary Figure S1: Ten-fold dilutions ranging from 109 to 103 copies of SARS-CoV-2 RNA were tested in triplicates using real-time RT-PCR.

Author Contributions

Conceptualization, N.S., and Y.-J.Y.; methodology, H.-J.L., M.-Y.P., and Y.-J.Y.; validation, H.-J.L., Y.-H.B., J.-E.P., and Y.-J.Y.; formal analysis, H.-J.L., Y.-H.B., and M.-J.K.; investigation, H.-J.L., J.-H.Y., Y.-H.S., and Y.-J.Y.; data curation, M.-J.K., and S.-H.L.; writing—original draft preparation, H.-J.L., and J.-E.P.; writing—review and editing, M.-Y.P., J.-H.Y., N.S., Y.-H.S., S.-H.L., J.-E.P., and Y.-J.Y.; visualization, H.-J.L., Y.-H.B., and J.-E.P.; supervision, M.-Y.P., and Y.-J.Y.; project administration, Y.-H.S., and Y.-J.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the guidelines of the Declaration of Helsinki and was approved by the Institutional Review Board of the Seegene Medical Foundation (SMF-IRB-2022-022).

Informed Consent Statement

Patient consent was waived as per Article 16 Clause 3 of the Bioethics and Safety Act. A research project may be exempted from obtaining written consent from human research participants, subject to approval from the competent IRB that has authority over the presented cases. The legal compliance of this study was reviewed and approved by the Institutional Review Board of the Seegene Medical Foundation (SMF-IRB-2022-022 approved on 8 July 2022).

Data Availability Statement

All data are available within the article.

Acknowledgments

Anonymized data were obtained from the Ewha Safe Campus project. The authors are grateful to Ewha Womans University for providing a place to set up the COVID-19 screening station. Therefore, the participants were easily accessible. We also thank National Culture Collection for Pathogens (NCCP, nccp.kdca.go.kr accessed on 5 October 2021) for kindly providing one strain of SARS-CoV-2 (NCCP-43330) in this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Harrison, A.G.; Lin, T.; Wang, P. Mechanisms of SARS-CoV-2 Transmission and Pathogenesis. Trends Immunol. 2020, 41, 1100–1115. [Google Scholar] [CrossRef]
  2. Gisondi, P.; PIaserico, S.; Bordin, C.; Alaibac, M.; Girolomoni, G.; Naldi, L. Cutaneous manifestations of SARS-CoV-2 infection: A clinical update. J. Eur. Acad. Dermatol. Venereol. 2020, 34, 2499–2504. [Google Scholar] [CrossRef]
  3. World Health Organization. Strategy to Achieve Global COVID-19 Vaccination by mid-2022. Available online: https://www.who.int/publications/m/item/strategy-to-achieve-global-covid-19-vaccination-by-mid-2022 (accessed on 25 May 2022).
  4. Hsu, L.; Hurrass, J.; Kossow, A.; Klobucnik, J.; Niessen, J.; Wiesmuller, G.A.; Grune, B.; Joisten, C. Breakthrough infections with the SARS-CoV-2 Delta variant: Vaccinations halved transmission risk. Public Health 2022, 204, 40–42. [Google Scholar] [CrossRef] [PubMed]
  5. Mohapatra, R.K.; Tiwari, R.; Sarangi, A.K.; Sharma, S.K.; Khandia, R.; Saikumar, G.; Dhama, K. Twin combination of Omicron and Delta variants triggering a tsunami wave of ever high surges in COVID-19 cases: A challenging global threat with a special focus on the Indian subcontinent. J. Med. Virol. 2022, 94, 1761–1765. [Google Scholar] [CrossRef]
  6. World Health Organization. WHO Coronavirus (COVID-19) Dashboard. Available online: https://covid19.who.int (accessed on 11 July 2021).
  7. Almadhi, M.A.; Abdulrahman, A.; Sharaf, S.A.; AlSaad, D.; Stevenson, N.J.; Atkin, S.L.; AlQahtani, M.M. The high prevalence of asymptomatic SARS-CoV-2 infection reveals the silent spread of COVID-19. Int J. Infect. Dis. 2021, 105, 656–661. [Google Scholar] [CrossRef]
  8. Hswen, Y.; Brownstein, J.S.; Xu, X.; Yom-Tov, E. Early detection of COVID-19 in China and the USA: Summary of the implementation of a digital decision-support and disease surveillance tool. BMJ Open 2020, 10, e041004. [Google Scholar] [CrossRef]
  9. Sharma, K.; Aggarwala, P.; Gandhi, D.; Mathias, A.; Singh, P.; Sharma, S.; Negi, S.S.; Bhargava, A.; Das, P.; Gaikwad, U.; et al. Comparative analysis of various clinical specimens in detection of SARS-CoV-2 using rRT-PCR in new and follow up cases of COVID-19 infection: Quest for the best choice. PLoS ONE 2021, 16, e0249408. [Google Scholar] [CrossRef]
  10. Gertler, M.; Krause, E.; van Loon, W.; Krug, N.; Kausch, F.; Rohardt, C.; Rossig, H.; Michel, J.; Nitsche, A.; Mall, M.A.; et al. Self-collected oral, nasal and saliva samples yield sensitivity comparable to professionally collected oro-nasopharyngeal swabs in SARS-CoV-2 diagnosis among symptomatic outpatients. Int. J. Infect. Dis. 2021, 110, 261–266. [Google Scholar] [CrossRef]
  11. Hong, K.H.; Kim, G.J.; Roh, K.H.; Sung, H.; Lee, J.; Kim, S.Y.; Kim, T.S.; Park, J.S.; Huh, H.J.; Park, Y.; et al. Update of Guidelines for Laboratory Diagnosis of COVID-19 in Korea. Ann. Lab. Med. 2022, 42, 391–397. [Google Scholar] [CrossRef]
  12. Mathews, S.S.; Varghese, L.; Trupthi, M.C.; Naomi, N.; Varghese, A.M. COVID-19 Pandemic-Training of Healthcare Workers in Obtaining a Nasopharyngeal Swab: Our Experience. Indian J. Otolaryngol. Head Neck Surg. 2021, 1–5. [Google Scholar] [CrossRef]
  13. Gadenstaetter, A.J.; Mayer, C.D.; Landegger, L.D. Nasopharyngeal versus nasal swabs for detection of SARS-CoV-2: A systematic review. Rhinology 2021, 59, 410–421. [Google Scholar] [CrossRef] [PubMed]
  14. Lincango-Naranjo, E.; Espinoza-Suarez, N.; Solis-Pazmino, P.; Vinueza-Moreano, P.; Rodriguez-Villafuerte, S.; Lincango-Naranjo, J.; Barberis-Barcia, G.; Ruiz-Sosa, C.; Rojas-Velasco, G.; Gravholt, D.; et al. Paradigms about the COVID-19 pandemic: Knowledge, attitudes and practices from medical students. BMC Med. Educ. 2021, 21, 128. [Google Scholar] [CrossRef] [PubMed]
  15. Food and Drug Administration. Coronavirus (COVID-19) Update: FDA Authorizes An-tigen Test as First Over-the-Counter Fully At-Home Diagnostic Test for COVID-19. Available online: https://www.fda.gov/news-events/press-announcements/coronavirus-covid-19-update-fda-authorizes-antigen-test-first-over-counter-fully-home-diagnostic (accessed on 20 June 2022).
  16. Brihn, A.; Chang, J.; OYong, K.; Balter, S.; Terashita, D.; Rubin, Z.; Yeganeh, N. Diagnostic Performance of an Antigen Test with RT-PCR for the Detection of SARS-CoV-2 in a Hospital Setting–Los Angeles County, California, June-August 2020. MMWR Morb. Mortal. Wkly. Rep. 2021, 70, 702–706. [Google Scholar] [CrossRef] [PubMed]
  17. Li, L.; Chen, Q.Y.; Li, Y.Y.; Wang, Y.F.; Yang, Z.F.; Zhong, N.S. Comparison among nasopharyngeal swab, nasal wash, and oropharyngeal swab for respiratory virus detection in adults with acute pharyngitis. BMC Infect. Dis. 2013, 13, 281. [Google Scholar] [CrossRef]
  18. Péré, H.; Podglajen, I.; Wack, M.; Flamarion, E.; Mirault, T.; Goudot, G.; Hauw-Berlemont, C.; Le, L.; Caudron, E.; Carrabin, S.; et al. Nasal Swab Sampling for SARS-CoV-2: A Convenient Alternative in Times of Nasopharyngeal Swab Shortage. J. Clin. Microbiol. 2020, 58, e00721-20. [Google Scholar] [CrossRef]
  19. Hanson, K.E.; Barker, A.P.; Hillyard, D.R.; Gilmore, N.; Barrett, J.W.; Orlandi, R.R.; Shakir, S.M. Self-Collected Anterior Nasal and Saliva Specimens versus Health Care Worker-Collected Nasopharyngeal Swabs for the Molecular Detection of SARS-CoV-2. J. Clin. Microbiol 2020, 58, e01824-20. [Google Scholar] [CrossRef]
  20. Wurstle, S.; Spinner, C.D.; Voit, F.; Hoffmann, D.; Hering, S.; Weidlich, S.; Schneider, J.; Zink, A.; Treiber, M.; Iakoubov, R.; et al. Self-sampling versus health care professional-guided swab collection for SARS-CoV-2 testing. Infection 2021, 49, 927–934. [Google Scholar] [CrossRef]
  21. Kojima, N.; Turner, F.; Slepnev, V.; Bacelar, A.; Deming, L.; Kodeboyina, S.; Klausner, J.D. Self-Collected Oral Fluid and Nasal Swabs Demonstrate Comparable Sensitivity to Clinician Collected Nasopharyngeal Swabs for Coronavirus Disease 2019 Detection. Clin. Infect. Dis. 2021, 73, e3106–e3109. [Google Scholar] [CrossRef]
  22. Nacher, M.; Mergeay-Fabre, M.; Blanchet, D.; Benoit, O.; Pozl, T.; Mesphoule, P.; Sainte-Rose, V.; Vialette, V.; Toulet, B.; Moua, A.; et al. Prospective Comparison of Saliva and Nasopharyngeal Swab Sampling for Mass Screening for COVID-19. Front. Med. 2021, 8, 621160. [Google Scholar] [CrossRef]
  23. Lim, H.J.; Jung, H.S.; Park, M.Y.; Baek, Y.H.; Kannappan, B.; Park, J.Y.; Yang, J.H.; Seol, J.H.; Lee, M.W.; Jung, S.K.; et al. Evaluation of Three Automated Extraction Systems for the Detection of SARS-CoV-2 from Clinical Respiratory Specimens. Life 2022, 12, 68. [Google Scholar] [CrossRef]
  24. Di Pilato, V.; Morecchiato, F.; Rizzato, C.; Quaranta, G.; Fais, R.; Gandolfo, C.; Antonelli, A.; Cusi, M.G.; Pistello, M.; Rossolini, G.M.; et al. Validation of Two Commercial Multiplex Real-Time PCR Assays for Detection of SARS-CoV-2 in Stool Donors for Fecal Microbiota Transplantation. Microorganisms 2022, 10, 284. [Google Scholar] [CrossRef] [PubMed]
  25. Hong, K.H.; Lee, S.W.; Kim, T.S.; Huh, H.J.; Lee, J.; Kim, S.Y.; Park, J.S.; Kim, G.J.; Sung, H.; Roh, K.H.; et al. Guidelines for Laboratory Diagnosis of Coronavirus Disease 2019 (COVID-19) in Korea. Ann. Lab. Med. 2020, 40, 351–360. [Google Scholar] [CrossRef] [PubMed]
  26. McHugh, M.L. Interrater reliability: The kappa statistic. Biochem. Med. 2012, 22, 276–282. [Google Scholar] [CrossRef]
  27. Tiiti, T.A.; Mashishi, T.L.; Nkwinika, V.V.; Benoy, I.; Selabe, S.G.; Bogers, J.; Lebelo, R.L. High-risk human papillomavirus detection in self-collected vaginal samples compared with healthcare worker collected cervical samples among women attending gynecology clinics at a tertiary hospital in Pretoria, South Africa. Virol. J. 2021, 18, 192. [Google Scholar] [CrossRef] [PubMed]
  28. Hossain, A.; Trishna, S.A.; Rashid, A.A.; Khair, S.; Alam, A. Unique mutations in SARS-CoV-2 omicron subvariants’ non-spike proteins: Potential impact on viral pathogenesis and host immune evasion. Microb. Pathog. 2022, 170, 105699. [Google Scholar] [CrossRef]
  29. Alexiev, I.; Giovanetti, M.; Cella, E.; Ivanov, I.; Stoikov, I.; Donchev, D.; Grigorova, L.; Gancheva, A.; Dimitrova, R.; Korsun, N.; et al. Initial Introduction and Spread of the SARS-CoV-2 AY.4.2.1 Delta Variant in Bulgaria, a Genomic Insight. J. Med. Virol. 2022, 1–5. [Google Scholar] [CrossRef]
  30. Nora, M.; Deri, D.; Veres, D.S.; Kis, Z.; Barcsay, E.; Palyi, B. Evaluating the field performance of multiple SARS-Cov-2 antigen rapid tests using nasopharyngeal swab samples. PLoS ONE 2022, 17, e0262399. [Google Scholar] [CrossRef]
  31. Otelea, M.R.; Rascu, A.; Staicu, C.; Calugareanu, L.; Ipate, M.; Teodorescu, S.; Perseca, O.; Voinoiu, A.; Neamtu, A.; Calota, V.; et al. Exhaustion in Healthcare Workers after the First Three Waves of the COVID-19 Pandemic. Int. J. Environ. Res. Public Health 2022, 19, 8871. [Google Scholar] [CrossRef]
  32. Caixeta, D.C.; Oliveira, S.W.; Cardoso-Sousa, L.; Cunha, T.M.; Goulart, L.R.; Martins, M.M.; Marin, L.M.; Jardim, A.C.G.; Siqueira, W.L.; Sabino-Silva, R. One-Year Update on Salivary Diagnostic of COVID-19. Front. Public Health 2021, 9, 589564. [Google Scholar] [CrossRef]
  33. O’Laughlin, K.; Espinosa, C.C.; Smith-Jeffcoat, S.E.; Koh, M.; Khalil, G.M.; Hoffman, A.; Rebolledo, P.A.; Schechter, M.C.; Stewart, R.J.; da Silva, J.; et al. Specimen self-collection for SARS-CoV-2 testing: Patient performance and preferences-Atlanta, Georgia, August-October 2020. PLoS ONE 2022, 17, e0264085. [Google Scholar] [CrossRef]
  34. Ursic, T.; Kogoj, R.; Sikonja, J.; Roskaric, D.; Jevsnik Virant, M.; Bogovic, P.; Petrovec, M. Performance of nasopharyngeal swab and saliva in detecting Delta and Omicron SARS-CoV-2 variants. J. Med. Virol. 2022, 94, 4704–4711. [Google Scholar] [CrossRef] [PubMed]
  35. Huang, Y.; Chen, S.; Yang, Z.; Guan, W.; Liu, D.; Lin, Z.; Zhang, Y.; Xu, Z.; Liu, X.; Li, Y. SARS-CoV-2 Viral Load in Clinical Samples from Critically Ill Patients. Am. J. Respir. Crit. Care Med. 2020, 201, 1435–1438. [Google Scholar] [CrossRef]
  36. Savela, E.S.; Viloria Winnett, A.; Romano, A.E.; Porter, M.K.; Shelby, N.; Akana, R.; Ji, J.; Cooper, M.M.; Schlenker, N.W.; Reyes, J.A.; et al. Quantitative SARS-CoV-2 Viral-Load Curves in Paired Saliva Samples and Nasal Swabs Inform Appropriate Respiratory Sampling Site and Analytical Test Sensitivity Required for Earliest Viral Detection. J. Clin. Microbiol. 2022, 60, e0178521. [Google Scholar] [CrossRef]
  37. Kohmer, N.; Eckermann, L.; Boddinghaus, B.; Gotsch, U.; Berger, A.; Herrmann, E.; Kortenbusch, M.; Tinnemann, P.; Gottschalk, R.; Hoehl, S.; et al. Self-Collected Samples to Detect SARS-CoV-2: Direct Comparison of Saliva, Tongue Swab, Nasal Swab, Chewed Cotton Pads and Gargle Lavage. J. Clin. Med. 2021, 10, 5751. [Google Scholar] [CrossRef] [PubMed]
  38. Jeong, H.W.; Kim, S.M.; Kim, H.S.; Kim, Y.I.; Kim, J.H.; Cho, J.Y.; Kim, S.H.; Kang, H.; Kim, S.G.; Park, S.J.; et al. Viable SARS-CoV-2 in various specimens from COVID-19 patients. Clin. Microbiol. Infect. 2020, 26, 1520–1524. [Google Scholar] [CrossRef] [PubMed]
  39. Badu, K.; Oyebola, K.; Zahouli, J.Z.B.; Fagbamigbe, A.F.; de Souza, D.K.; Dukhi, N.; Amankwaa, E.F.; Tolba, M.F.; Sylverken, A.A.; Mosi, L.; et al. SARS-CoV-2 Viral Shedding and Transmission Dynamics: Implications of WHO COVID-19 Discharge Guidelines. Front. Med. 2021, 8, 648660. [Google Scholar] [CrossRef]
  40. Michel, W.; Farber, J.; Dilas, M.; Heuft, H.G.; Tammer, I.; Baar, J.; Kaasch, A.J. A combined oro-nasopharyngeal swab is more sensitive than mouthwash in detecting SARS-CoV-2 by a high-throughput PCR assay. Infection 2021, 49, 527–531. [Google Scholar] [CrossRef]
  41. McCulloch, D.J.; Kim, A.E.; Wilcox, N.C.; Logue, J.K.; Greninger, A.L.; Englund, J.A.; Chu, H.Y. Comparison of Unsupervised Home Self-collected Midnasal Swabs With Clinician-Collected Nasopharyngeal Swabs for Detection of SARS-CoV-2 Infection. JAMA Netw. Open 2020, 3, e2016382. [Google Scholar] [CrossRef]
Figure 1. Comparison of Ct values for three SARS-CoV-2 genes detected in 1039 self- and HCW-collected samples that were positive for SARS-CoV-2. (A) N, (B) RdRP and S, and (C) E. The dotted lines between the x- and y-axis of the scatterplot indicate the reference Ct values of 20, 30, or 40. Each sample was tested using real-time PCR under the indicated conditions.
Figure 1. Comparison of Ct values for three SARS-CoV-2 genes detected in 1039 self- and HCW-collected samples that were positive for SARS-CoV-2. (A) N, (B) RdRP and S, and (C) E. The dotted lines between the x- and y-axis of the scatterplot indicate the reference Ct values of 20, 30, or 40. Each sample was tested using real-time PCR under the indicated conditions.
Diagnostics 12 02279 g001
Figure 2. Histograms showing the distribution of Ct values for concordant positive specimens (n = 850). (AC) Density of (A) N, (B) RdRP and S, and (C) E in the HCW-collection group. (DF) Density of (D) N, (E) RdRP and S, and (F) E in the self-collection group. The y-axis of the histograms represents the estimation of the probability density estimation, whereas the vertical line presents the mean values.
Figure 2. Histograms showing the distribution of Ct values for concordant positive specimens (n = 850). (AC) Density of (A) N, (B) RdRP and S, and (C) E in the HCW-collection group. (DF) Density of (D) N, (E) RdRP and S, and (F) E in the self-collection group. The y-axis of the histograms represents the estimation of the probability density estimation, whereas the vertical line presents the mean values.
Diagnostics 12 02279 g002
Figure 3. Distribution of the Ct values for SARS-CoV-2 in concordant positive specimens (n = 850). Boxplot of (A) N, (B) RdRP and S, and (C) E. The box plots present the median (interquartile range) values. *** p < 0.001.
Figure 3. Distribution of the Ct values for SARS-CoV-2 in concordant positive specimens (n = 850). Boxplot of (A) N, (B) RdRP and S, and (C) E. The box plots present the median (interquartile range) values. *** p < 0.001.
Diagnostics 12 02279 g003
Figure 4. Summary of clinical performance and contribution of the self-collection system.
Figure 4. Summary of clinical performance and contribution of the self-collection system.
Diagnostics 12 02279 g004
Table 1. Demography and characteristics of the study participants.
Table 1. Demography and characteristics of the study participants.
Demography/CharacteristicsSelf-Collection (n = 3990)HCW-Collection (n = 3990)
PositiveNegativePositiveNegative
Collected sample, n95430369353055
Demography
Age, years22 (20–26)24 (21–30)22 (20–26)24 (21–30)
Ct value
N27.6 (22.3–32.1)N/A20.3 (17.9–26.3)N/A
RdRP and S27.9 (22.6–32.5)N/A21.6 (19.1–27.7)N/A
E27.0 (22.0–31.9)N/A20.8 (18.2–26.6)N/A
Data are presented as the median (interquartile range). Abbreviations: N, gene encoding the nucleocapsid protein; RdRP, gene encoding the RNA-dependent RNA polymerase; S, gene encoding the spike protein; E, gene encoding the envelope protein; N/A, not available.
Table 2. Comparison of clinical diagnosis performance between self-collection and HCW-collection.
Table 2. Comparison of clinical diagnosis performance between self-collection and HCW-collection.
HCW-Collection
PositiveNegativeTotal
Self-collection
Positive, n850104954
Negative, n8529513036
Total, n93530553990
Sensitivity, % (95% CI)90.9 (88.9–92.7)
Specificity, % (95% CI)96.6 (95.9–97.2)
Cohen’s kappa0.87
McNemar’s test p-value0.19
Abbreviations: CI, confidence interval; HCW, health care worker.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lim, H.-J.; Baek, Y.-H.; Park, M.-Y.; Yang, J.-H.; Kim, M.-J.; Sung, N.; Sohn, Y.-H.; Lee, S.-H.; Park, J.-E.; Yang, Y.-J. Performance Analysis of Self-Collected Nasal and Oral Swabs for Detection of SARS-CoV-2. Diagnostics 2022, 12, 2279. https://doi.org/10.3390/diagnostics12102279

AMA Style

Lim H-J, Baek Y-H, Park M-Y, Yang J-H, Kim M-J, Sung N, Sohn Y-H, Lee S-H, Park J-E, Yang Y-J. Performance Analysis of Self-Collected Nasal and Oral Swabs for Detection of SARS-CoV-2. Diagnostics. 2022; 12(10):2279. https://doi.org/10.3390/diagnostics12102279

Chicago/Turabian Style

Lim, Ho-Jae, Young-Hyun Baek, Min-Young Park, Jae-Hyun Yang, Min-Jin Kim, Nackmoon Sung, Yong-Hak Sohn, Sun-Hwa Lee, Jung-Eun Park, and Yong-Jin Yang. 2022. "Performance Analysis of Self-Collected Nasal and Oral Swabs for Detection of SARS-CoV-2" Diagnostics 12, no. 10: 2279. https://doi.org/10.3390/diagnostics12102279

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop