Analytical Performance of COVID-19 Detection Methods (RT-PCR) : Scientific and Societal Concerns
Analytical Performance of COVID-19 Detection Methods (RT-PCR) : Scientific and Societal Concerns
Review
Analytical Performance of COVID-19 Detection Methods
(RT-PCR): Scientific and Societal Concerns †
Roberto Verna 1,2,3,‡ , Walter Alallon 4,‡ , Masami Murakami 5,‡ , Catherine P. M. Hayward 6,‡ ,
Abdel Halim Harrath 7 , Saleh H. Alwasel 7 , Nairo M. Sumita 8,‡ , Ozkan Alatas 9,‡ , Valeria Fedeli 10 ,
Praveen Sharma 11,‡ , Andrea Fuso 10 , Daniela Maria Capuano 2,3 , Maria Capalbo 12 , Antonio Angeloni 10 and
Mariano Bizzarri 10, *,‡
Received: 16 June 2021 Abstract: Background. Health and social management of the SARS-CoV-2 epidemic, responsible for
Accepted: 2 July 2021 the COVID-19 disease, requires both screening tools and diagnostic procedures. Reliable screening
Published: 6 July 2021 tests aim at identifying (truely) infectious individuals that can spread the viral infection and therefore
are essential for tracing and harnessing the epidemic diffusion. Instead, diagnostic tests should
Publisher’s Note: MDPI stays neutral supplement clinical and radiological findings, thus helping in establishing the diagnosis. Several
with regard to jurisdictional claims in analytical assays, mostly using RT-PCR-based technologies, have become commercially available for
published maps and institutional affil-
healthcare workers and clinical laboratories. However, such tests showed some critical limitations,
iations.
given that a relevant number of both false-positive and false-negative cases have been so far reported.
Moreover, those analytical techniques demonstrated to be significantly influenced by pre-analytical
biases, while the sensitivity showed a dramatic time dependency. Aim. Herein, we critically inves-
tigate limits and perspectives of currently available RT-PCR techniques, especially when referring
Copyright: © 2021 by the authors.
to the required performances in providing reliable epidemiological and clinical information. Key
Licensee MDPI, Basel, Switzerland.
Concepts. Current data cast doubt on the use of RT-PCR swabs as a screening procedure for tracing
This article is an open access article
the evolution of the current SARS-COV-2 pandemic. Indeed, the huge number of both false-positive
distributed under the terms and
conditions of the Creative Commons
and false-negative results deprives the trustworthiness of decision making based on those data.
Attribution (CC BY) license (https:// Therefore, we should refine current available analytical tests to quickly identify individuals able to
creativecommons.org/licenses/by/ really transmit the virus, with the aim to control and prevent large outbreaks.
4.0/).
Keywords: COVID-19; SARS-CoV-2; RT-PCR; false positive; false negative; pandemic; clinical pathology
Figure 1. Structure
Figure of SARS-CoV-2
1. Structure of SARS-CoV-2 virus. RNA
virus. RNAof the viral
of the genome
viral is constituted
genome by two
is constituted genes—ORF1a
by two genes—ORF1a andand
ORF1b—
ORF1b—
encoding
encoding forfor
thethe
nonstructural
nonstructuralproteins NSP,
proteins NSP,while
whilesmall
smallgenomic
genomicregion
region includes
includes S (spike protein),
protein), M
M (membrane
(membraneprotein),
pro-
tein), E (envelope
E (envelope protein),
protein), andand N (nucleocapsid
N (nucleocapsid protein)
protein) genes.
genes. The The S protein
S protein interacts
interacts with with the angiotensin-converting
the angiotensin-converting enzyme
enzyme 2 (ACE2)
2 (ACE2) receptors
receptors of theofhost
the cell
hostmembrane
cell membrane through
through a receptor-binding
a receptor-binding domain
domain (RBD)(RBD) positioned
positioned onspike
on the the spike
protein.
protein. Once the ACE2/RBD interaction has been established, the virus can be endocytosed into the cell.
Once the ACE2/RBD interaction has been established, the virus can be endocytosed into the cell.
postponed [20]. For SARS-CoV-2, it is unclear if the sensitivity of any authorized commer-
cial test has been assessed in the proper way. Current rules permit indirect demonstration
of the test performance by applying the RT-PCR test to known positive material from
symptomatic people or contrived specimens: such assessments likely overestimate test
sensitivity as swabs may lack viral particle [21]. A reference standard for determining
the sensitivity of SARS-CoV-2 tests in asymptomatic people is still lacking. At the very
beginning of the epidemic in China, at least two studies reported on the impact of missing
truly infected patients due to overestimation of RT-PCR tests sensitivity, resulting in a
false-negative rate ranging from 2 to 30% [22,23]. A recent meta-analysis carried out on
12,057 COVID-19 confirmed cases reports that there is substantial and largely unexplained
heterogeneity in the proportion of false-negative RT-PCR results for SARS-CoV-2, which
cannot be explained by differences in the statistical approach used in different studies [24].
Differences in reliability rates might result from differences in the type of specimen col-
lected, the time to onset of symptoms, the surmised viral load, at the time when the test is
performed, to product-specific factors related to the RT-PCR kit used. All this information
is either partially or unreported in most studies. Noticeably, one report [25] demonstrated
that up to 54% of COVID-19 patients may have, during the first phase of their illness, an
initial false-negative RT-PCR. Accordingly, the field is faced with very low certainty of evi-
dence. Additionally, some published studies have several biases (protocol violation to rule
in/rule out the presence of SARS-CoV-2) and/or fail to report key index test characteristics.
Site of collection of the biological specimen. The analytical specificity of an analytical test
is its capability to recognize solely the molecule that is to be identified—both qualitatively
and quantitatively—in presence of interfering substances or antigenically overlapping
compounds. For molecular tests, the relevant abundance of RNA is essential for bestowing
sensitivity to the assay. In turn, RNA abundance is strongly dependent on the type
and site of collection of the biological sample. Indeed, the sensitivity of RT-PCR for
SARS-CoV-2 is higher for lower respiratory samples than for upper respiratory tract
samples [25,26]. Surprisingly, as reported in a preliminary study of 213 COVID-19 cases,
and 866 respiratory samples obtained onset from different sites of collection during the first
week after symptom, the highest positive rate (>80%) was recorded in salivary samples,
followed by nasopharyngeal (72–73%) and throat swabs (60–61%) [27,28].
A systematic review, performed on pooled data for 8136 clinical specimens tested
for SARS-CoV-2 by RT-PCR, substantially confirmed results for different types of spec-
imens: [29] specimens from the lower respiratory tract showed a positive rate of 71.3%;
bronchoalveolar lavage fluid and saliva samples had the highest positivity rates of 91.8%
and 87.8%, respectively; oropharyngeal swab, feces, and blood showed the lowest posi-
tivity rates (7.6%, 32.8%, and 1%, respectively), whereas no SARS-CoV-2 was detected in
urine samples. Another study showed that the rate of RT-PCR detection of SARS-CoV-2
in patients is as high as 93% in bronchoalveolar lavage fluid, 72% in sputum, and 63% in
nasopharyngeal swabs, while it is only 32% in pharyngeal swabs and 29% in stool [28].
Yet, till now, there has not been an independent assessment of the overall trustworthiness
of different RT-PCR tests, a global comparative analysis of these tests applied to different
settings, or consensus on the most reliable samples across different tests (nasopharyngeal
versus saliva). A few studies found that saliva samples yielded greater detection sensitivity
and more consistent findings throughout the course of infection when compared with
samples taken via nasopharyngeal swabs [30,31]. The very preliminary investigations,
using saliva specimens, displayed huge variability in sensitivity estimates, ranging from 70
to 100%, when compared to the throat and nasopharyngeal swabs tested by RT-PCR [32,33].
As for analyses carried out on nasopharyngeal samples, differences in reported sensitivities
may reflect differences in the timing of sampling, relative to the onset of infection. Indeed,
the highest sensitivity was observed among hospitalized and critically ill patients [34],
while the lowest sensitivity has been recorded when saliva samples were collected during
the late phase from symptom onset or exposure [35]. A recent meta-analysis suggests that
the diagnostic accuracy of saliva-based nucleic acid amplification testing is similar to that
Life 2021, 11, 660 6 of 16
of nasopharyngeal swabs, especially in the ambulatory setting [36]. Overall, the current
information suggests that saliva, when obtained in the early phases of COVID-19 infection
(10 days after the symptom onset), is reliable, and it may be more practical to collect saliva
than nasopharyngeal swabs for the screening and diagnosing of the virus [37].
Viral variants. An important issue of concern that has been increasing during recent
months is the increasing recognition of different viral haplotypes, due to the occurrence of
recombination and/or mutation [38]. High variability in genomic pattern and nucleotide
sequences is in keeping with the rapid spread of the SARS-CoV-2 pandemic [39]. Fur-
thermore, as observed by an extensive survey carried out on 220 SARS-CoV-2 genomic
sequences, different strains of SARS-CoV-2 might coexist [40], thus conferring further
complexity to the diagnostic assessment of the infection. Moreover, another study revealed
that ~79% of primer-binding sequences in at least one gene used in RT-PCR were mutated,
compared to the original SARS-CoV-2 genome (Wuhan-Hu-1, NC_045512) [41]. A bewil-
dering viral diversity has been found even in single patients, with a median number of
four/five intra-individual variants [38,42]. It should be stressed that such heterogeneity in
viral RNAs not only could help explaining differences in intra-individual immunological
response and clinical pathophenotype [43] but can also undermine the accuracy of RT-PCR
detection [44]. Consequently, it is currently assumed that about 10–15% of SARS-CoV-2
variants were not detectable by at least one of the commercialized primers [45].
Figure2.2.Estimated
Figure Estimatedoverovertime
time likelihood
likelihood of of SARS-CoV-2
SARS-CoV-2 virus
virus detection
detection withwith RT-PCR
RT-PCR teststests and serological
and serological assays assays in re-
in respect
spect to symptom onset. The figure has been reconstructed on the basis of several reports
to symptom onset. The figure has been reconstructed on the basis of several reports and the estimated values are onlyand the estimated values are
only approximate averages. Viral load shows an asymmetric distribution, with an extended tail. The maximum probabil-
approximate averages. Viral load shows an asymmetric distribution, with an extended tail. The maximum probability
ity to detect infectious individuals happens after the first week since the infection and lasts for almost three weeks. Since
tothen,
detect
it isinfectious individuals
quite unlikely happens
to identify afterthat
subjects the could
first week
trulysince the infection
transmit andAs
the disease. lasts for almost three
a consequence, weeks.
no virus Since
develop-
then,
mentitoccurs
is quiteinunlikely
culture to identify
from subjects
biological that could
samples trulyRT-PCR
in which transmitpositivity
the disease.hasAs a consequence,
been ascertained no virus
when thedevelopment
cycle thresh-
occurs
old isinvery
culture
highfrom
(a Ctbiological
< 30 is samples in which
suggested, but itRT-PCR
may vary positivity has been
depending ascertained
on the when the accuracy).
swab procedure cycle threshold is very
Unlike low-
high (a Ct < methods
sensitivity 30 is suggested,
(dashed but it may
line), thevary
highdepending
sensitivityonofthetheswab procedure
RT-PCR method accuracy). Unlike low-sensitivity
could therefore methods
lead to disclosing more
positives
(dashed that,
line), onhigh
the the sensitivity
other hand,ofare thenot contagious
RT-PCR method (solid
could line). Conversely,
therefore lead to false-negative
disclosing more results maythat,
positives occuronduring
the otherthe
first week,
hand, are notwhen active viral
contagious (solidreplication does notfalse-negative
line). Conversely, reach the sensitivity leveloccur
results may required by the
during theRT-PCR test.
first week, For comparison,
when active viral
serologicaldoes
replication analysis shows
not reach thea steady
sensitivityincrease
level in both IgM
required andRT-PCR
by the IgG values
test.only after 4–5 weeks.
For comparison, Thereafter,
serological IgMshows
analysis progres-a
sively decreases after 7–8 weeks, whereas IgG still persists for several months.
steady increase in both IgM and IgG values only after 4–5 weeks. Thereafter, IgM progressively decreases after 7–8 weeks,
whereas IgG still persists for several months.
6. Critical Objectives and False-Positive Results
In theObjectives
6. Critical public health
andsetting, when we
False-Positive are faced with a highly contagious epidemic, a
Results
critical objective is to optimize the early identification of infected individuals that can
In the public health setting, when we are faced with a highly contagious epidemic,
(potentially) transmit the microbe. This is especially relevant in detecting SARS-CoV-2-
a critical objective is to optimize the early identification of infected individuals that can
positive people, who, in many cases, are unaware of their infection. Epidemiologic data
(potentially) transmit the microbe. This is especially relevant in detecting SARS-CoV-2-
have shown that a huge reservoir of asymptomatic/paucisymptomatic subjects has driv-
positive people, who, in many cases, are unaware of their infection. Epidemiologic data
en the diffusion of the current pandemic of COVID-19 [52]. Clinical and epidemiological
have shown that a huge reservoir of asymptomatic/paucisymptomatic subjects has driven
studies
the showof
diffusion that
thethe infectious
current periodof
pandemic begins about 2[52].
COVID-19 daysClinical
after exposure and continues
and epidemiological
to about 12 days after symptom emergence [53]. Overall, the infectious period
studies show that the infectious period begins about 2 days after exposure and continues lasts, on
average, for about two weeks, and during this time, the viral load (RNA
to about 12 days after symptom emergence [53]. Overall, the infectious period lasts,copies per on
ml)
is likely for
average, to increase
about twoprogressively.
weeks, and Therefore,
during thistimely identification
time, the viral load of persons
(RNA that
copies can
per mL)ac-
is likely to increase progressively. Therefore, timely identification of persons that can
actually transmit the virus is mandatory to put in place confinement measures and identify
probable contacts.
Life 2021, 11, 660 8 of 16
However, positive individuals do not overlap automatically with those that can
effectively transmit the virus, although some variants are emerging to have higher rates of
infectivity. Accordingly, the ideal test is not necessarily the one that determines whether
a person has any evidence of SARS-CoV-2—as determined by current PCR-RT-based
swabs—but the one that quickly and accurately identifies those that are truly capable of
transmitting the infection in order to prevent large outbreaks. In other words, we need a
reliable test that could identify the “infecting” individuals. The canonical rules, established
by Koch’s postulates [54], stating that the microorganism must be isolated from the infected
individual and should show growth in culture, have been confirmed in animal models
of SARS-CoV-2 [55]. Indirect evidence of virus replication capability is provided by tests
that identify viral subgenomic mRNA, that can be transcribed in infected cells or detected
in infected cells by fluorescent in situ hybridization techniques that recognize the virus
associated with cells [56]. Of course, this kind of testing is neither rapid nor cheap, and
it is therefore not applicable, so far, for large population screening. However, even if the
antigenic and the genetic “rapid” testing still remain the most useful for tracing the spread
of the virus, it is desirable that more diagnostic tests are settled up in view of a second
phase of the “SARS-CoV2 affair” when the urge for rapid population screening will be less
mandatory and more accurate diagnosis will be relevant.
Overall, all authorized molecular tests (that amplify viral RNA) have higher sensitivity
than antigen tests. Yet, new rapid diagnostic tools, based on lateral flow assays for COVID-
19 antigens, promise to be a reliable alternative for identifying infectious patients [57]. Such
tests capture viral proteins in a lateral flow format that can give results in few minutes and
thus greatly help to rapidly identify those individuals at the highest risk for transmitting
disease [58]. Although less sensitive than reverse transcriptase–polymerase chain reaction
tests, early data suggest that antigen tests can be used to diagnose individuals that are
infectious with COVID-19 [59]. In this study, positivity for viral antigens matched with
virus isolation using an optimal SARS-CoV-2 isolation procedure, i.e., antigen detection
strictly correlates with the presence of virus and can therefore represent a reliable tool
in monitoring the evolution of viral infectivity within the population (epidemiological
surveillance).
Data misinterpretation. Diagnostics can be used in various manners, the so-called use
cases: triage of symptomatic individuals in an epidemic or endemic setting, triage of at-
risk presymptomatic and symptomatic individuals in endemic settings, and confirmatory
testing. The use determines the way in which diagnostic tests are optimally used, namely,
the critical issue is to correctly distinguish between diagnostic and surveillance (screening)
tests, the latter being conceived for ascertaining the epidemiological course of the epidemic,
whereas the former is more critical for the management of individual patients.
For epidemiological testing, the key question is not how well molecules can be detected
in a single sample but how effectively infections can be detected in a population by the
repeated use of a given test as part of an overall testing strategy—the sensitivity of the
testing regimen. Clinical tests are designed for assessing the reliability of diagnosis in
symptomatic individuals and require high sensitivity. On the other hand, tests used in
surveillance regimens should be tailored to detect those individuals that can really diffuse
the virus (true “infecting” persons). RT-PCR detects RNA, not an infectious virus; thus, its
ability to determine the duration of infectivity of patients is very limited, while infectivity
is a critical determinant in informing public health guidelines/interventions. As already
observed in other instances, a critical drawback of RT-PCR tests (but that can be extended
to serological tests too) is that they cannot determine virus infectivity: overall, RT-PCR
sensitivity is good but its specificity for detecting the replicative virus is poor [60].
A recent paper has highlighted that infectivity—recognized by the capability to re-
trieve the virus growing in culture according to Koch’s postulate—is dramatically impaired
when cycle threshold (Ct) values are >24 [61]. A direct relationship has been observed
between Ct values of RT-PCR and the viral load, even if the relationship is less than linear
for low viral loads [62]. Noteworthy, for every one-unit increase in Ct, the odds ratio for
Life 2021, 11, 660 9 of 16
infectivity decreased by 32%. Another report shows that for Ct = 25, the virus can be
identified in up to 70% of samples, while at Ct = 30, this value drops to 20%; for Ct = 35,
only in 3% of cultures the virus can retrieved [63]. Therefore, the straightforward conse-
quence is that almost 50% of newly diagnosed “positive” patients are in fact noninfectious
individuals, given that in these cases, the PCR Ct averages >30, indicating low or even no
viral counts [64]. Indeed, besides the fact that these low levels of detectable RNAs could be
explained by an early or late-stage infection, the prolonged duration of the RNA-positive
tail—during which individuals continue to “release” viral RNA or its fragments—indicates
that a relevant proportion of infected persons are recognized once the infectious period
has already passed [65]. It is generally agreed that replication-competent virus cannot
be successfully cultured more than 9 days after the onset of illness, with a statistically
estimated likelihood of recovering replication-competent virus that approaches zero by
10 days [66,67]. Conclusively, “after about 8 days of onset of symptoms, infectious virus
is no longer present in respiratory tract specimens, despite high amounts of SARS-CoV-2
RNA that are measurable by RT-PCR” [68].
Overall, it has been estimated, in a different cohort of patients, that 88% and 95%
of their specimens no longer yielded replication-competent virus after 10 and 15 days,
respectively, following symptom onset [69,70]. This means the current COVID-19 test
standards for the PCR test would pick up an excessive number of false positives. However,
despite these warnings, an update to the CDC instructions for PCR testing from 1 December
2020, still uses a Ct of 40 [71].
Nonetheless, the implications are relevant, as hundreds of thousands of people
presently being confined based on positive RT-PCR tests are likely to have already passed
the transmissible phase of their infection. These results were anticipated by several investi-
gations [56,72] and prompted different scholars to propose a cutoff Ct value at Ct ≤ 30, with
a duration of eviction of approximately 10 days [73]. Interestingly, prolonged (i.e., with a
duration > 20 days) persistence of positive RT-PCR test, with low Ct values, may indicate
subgroups of infected patients with immunocompromised state or more severe disease,
as suggested by van Kampen [74]. Additionally, it may be surmised that tests with high
Ct thresholds may detect not just live viruses but genetic fragments, leftovers from other
infections (i.e., other Coronavirus for which a cross-reactivity has been documented) [75,76]
that pose no particular risk. Again, these considerations—albeit correct—hardly overcome
the wall of the “field practice.” As a matter of fact, to be able at ascertaining a Ct cutoff to
discern between infecting and noninfective individuals, one should be sure the starting
specimen are homogeneous. Actually, the pre-analytic bias plays a non-neglectable role in
the execution of the swab since different operators introduce a great variability in the sam-
pling. It is clearly arguable that two different specimens taken from the same individuals
can result in very different Cts depending on how accurately the swab has been executed.
The New York Times recently raised the alarm that the number of amplification cycles
needed to find the virus “is never included in the results sent to doctors and coronavirus
patients, although it could tell them how infectious the patients are. In three sets of testing
data that include cycle thresholds, compiled by officials in Massachusetts, New York, and
Nevada, up to 90 percent of people testing positive carried barely any virus” [77].
It is therefore mandatory to use tests that could capture infected people while they
are still infectious. Identification of such persons is a critical objective deemed to reduce the
population prevalence of a respiratory virus. In this respect, as stressed by a recent paper,
“the benchmark standard clinical polymerase chain reaction (PCR) test fails when used in
a surveillance regimen” [67]. Indeed, the distribution over time of RT-PCR positivity in
infected people shows that the diagnostic test still remains positive for longer times after
the stage at which an individual is no longer infectious [78].
Unfortunately, regulatory agencies have not established distinct and clear rules for
validating, as separate tests, those to be used as analytical diagnostic tools versus tests for
ascertaining infectivity and hence public health efforts to reduce community transmission.
Moreover, a reliable assessment of the course of the epidemic worldwide needs different
Life 2021, 11, 660 10 of 16
countries to adopt a common approach for validating performances of both diagnostic tests
and tests used to screen for infectious persons. This is especially urgent when epidemiolog-
ical data (i.e., the number of true infectious people) serve as a base for political decision
making. Conversely, differences in RT-PCR tests, LoDs, or Ct cutoff may contribute to
explaining controversial epidemiological findings, given that some differences among coun-
tries with similar structural sociological traits (population mean age and density, quality
of health services, geographical position) could be ascribed to variances in RT-PCR-based
data acquisition.
As already proposed [79], to improve its reliability, the RT-PCR test should be continu-
ously calibrated against a reference culture in Vero E6 cells in which cytopathic effect has
been observed. The cycle threshold values on each platform for patients who have positive
and negative viral cultures should be correlated with RT-PCR results and the resulting
calibration curve could then be performed to estimate virus viability from the cycle thresh-
old with some certainty [80]. Moreover, evidence shows that viral loads are subject to a
different evolution in symptomatic and asymptomatic people [81]. Conclusively, the gener-
ation of false-positive or false-negative test results jeopardizes the health of the individual
patient and may also derange and disrupt the efficacy of public health policies, emergency
plans, and restrictive measures established by national and international authorities for
containing the outbreak.
Secondly, an alternative to RT-PCR tests could be represented by rapid lateral-flow
antigen tests, and rapid lateral-flow tests based on CRISPR gene-editing technology [82].
These tools provide a sensitive and robust means for high-throughput COVID-19 diagnosis
suitable for use in screening settings and display the potential to enable reliable large-scale
diagnosis [83]. Notably, lateral-flow antigen tests do not have an amplification step, and
their analytic limit of detection is usually 100/1000 times less than RT-PCR tests; to reliably
identify the people that can really “transmit” the virus, such tests need to be adequately
sensitive and would benefit from a clear cutoff value that is established to distinguish
the “infectious” individuals among “positive” individuals. Undoubtedly, the adoption of
such a strategy will have huge consequences for harnessing the epidemic outbreak and
successfully manage the disease spreading.
Altogether, these considerations further outline that clinical symptoms and molecular
analytical tools should be conjugated to perform a correct diagnostic assessment. Some
diseases can be diagnosed based on a test alone; most diseases, however, are defined by the
cluster of symptoms and signs, in addition to test results. In no case can a medical diagnosis
be replaced by simple molecular tests. Indeed, interpreting the results of RT-PCR requires
consideration of patient characteristics, such as symptoms and their severity, contacts
history, presence of preexisting morbidities and drug history, the cycle threshold value,
the number of days from symptom onset to test, and the specimen donor’s age [84]. As
markedly recommended by a recent Cochrane report, a single symptom or sign could not
accurately diagnose COVID-19 [85]. Furthermore, the Oxford Centre for Evidence-Based
Medicine suggests that “the PCR test positivity counts should include a standardized
threshold level of detection, and at a minimum, the recording of the presence or absence
of symptoms. As a disease, the COVID-19 case definition should constitute a disorder
that produces a specific set of symptoms and signs. The in-hospital case definition should,
therefore, also record the CT lung findings and associated blood tests” [86].
7. Conclusions
Reliability of analytical tools in identifying infected individuals, i.e., persons that can
transmit the virus, is mandatory to assess the evolution of the SARS-Cov-2 pandemic and to
provide solid foundations for policy decision making. The life and the liberty of hundreds
of millions of people, as well as the economy of countries around the globe, ultimately
depend on such appropriate assessments. Unfortunately, several scientific studies and
administrative official reports indicate that epidemiological data related to the prevalence
of COVID-19 infection among people are likely to be significantly biased by the relevant
Life 2021, 11, 660 11 of 16
strategies is unable to prevent outbreaks [94]. Health authorities should be asked to ur-
gently address such issues in order to establish a proper strategy for managing the current
pandemic, as well as prepare for future threats of a similar kind.
Given that such a problem has been addressed only marginally by few studies, an ex-
tended recognition aimed at assessing the incidence of both false-positive and false-negative
results is urgently warranted. The present review attempts to provide a compelling survey
of available published data, some studies may have been lost notwithstanding. However,
some questions have been left aside and deserve to be studied by future inquiries. For
instance, specific epidemiological investigations should be planned to evaluate how false
negative/positive results arise in correlation with different levels of infection prevalence.
In addition, it must be investigated the relationship between the disappearance of the
virus (analyzed by culturing biological samples to find replicating viral particles) and the
concomitant values of RT-PCR: how long RT-PCR stands positive since the virus has been
removed from biological fluids? Moreover, this information needs to be complemented
with data of seroprevalence, obtained by testing people about the presence of immunologi-
cal markers (IgG, IgM, and IgA) that are the only trustworthy parameters that can provide
a proper estimate of the virus diffusion into the general population. Even more important,
appraisal of immunological status would allow appreciating the extent of the acquired
immunization, a critical health indicator that, after more than 18 months of the pandemic,
still needs to be acquired. Future studies should timely investigate those challenging
questions to plan a better-tailored health strategy aimed at grasping the overall complexity
of the current pandemic, as highlighted by the current review.
Author Contributions: Conceptualization, R.V., W.A., M.M., C.P.M.H., A.H.H., S.H.A., N.M.S., O.A.,
V.F., P.S., A.F., D.M.C., M.C., A.A., M.B.; methodology, A.F., M.C.; validation, M.M., C.P.M.H.; formal
analysis, P.S., O.A.; investigation, C.P.M.H., D.M.C., A.A.; resources, W.A., M.M.; writing—original
draft preparation, M.B.; writing—review and editing, R.V., M.B., V.F., A.F.; visualization, A.H.H.,
S.H.A., N.M.S., O.A.; supervision, R.V., M.B., A.F., A.A.; project administration, R.V., M.B., A.A. All
authors have read and agreed to the published version of the manuscript.
Funding: This research received no external funding.
Institutional Review Board Statement: Not applicable.
Informed Consent Statement: Not applicable.
Data Availability Statement: Data were obtained from an extended survey based on published
article reported.
Acknowledgments: Abdel Halim Harrath, Saleh H. Alwasel, and Mariano Bizzarri extend their
appreciation to the International Scientific Partnership Program ISPP at King Saud University (KSU)
for supporting this research work through ISPP-122.
Conflicts of Interest: The author declares that he has no known competing financial interests or
personal relationships that could have appeared to influence the work reported in this paper.
References
1. Jacobs, J.; Hardy, L.; Semret, M.; Lunguya, O.; Phe, T.; Affolabi, D.; Yansouni, C.; Vandenberg, O. Diagnostic Bacteriology in
District Hospitals in Sub-Saharan Africa: At the Forefront of the Containment of Antimicrobial Resistance. Front. Med. (Lausanne)
2019. [CrossRef]
2. Lagu, T.; Kulkarni, N.; Mahant, S.; Shah, S.S. The Light at the End of the Tunnel: Reflections on 2020 and Hopes for 2021. J. Hosp.
Med. 2021, 16, 5–6. [CrossRef] [PubMed]
3. Vandenberg, O.; Martiny, D.; Rochas, O.; van Belkum, A.; Kozlakidis, Z. Considerations for diagnostic COVID-19 tests. Nat. Rev.
Microbiol. 2020, 14, 1–13. [CrossRef] [PubMed]
4. Gorbalenya, A.E.; Baker, S.C.; Baric, R.S.; de Groot, R.J.; Drosten, C.; Gulyaeva, A.A.; Haagmans, B.L.; Lauber, C.; Leontovich,
A.M.; Neuman, B.W.; et al. The species Severe acute respiratory syndrome-related coronavirus: Classifying 2019-nCoV and
naming it SARS-CoV-2. Nat. Microbiol. 2020, 5. [CrossRef]
5. Yan, Y.; Chang, L.; Wang, L. Laboratory testing of SARS-CoV, MERS-CoV, and SARS-CoV-2 (2019-nCoV): Current status,
challenges, and countermeasures. Rev. Med. Virol. 2020, 30, e2106. [CrossRef] [PubMed]
Life 2021, 11, 660 13 of 16
6. Padoan, A.; Bonfante, F.; Pagliari, M.; Bortolami, A.; Negrini, D.; Zuin, S.; Bozzato, D.; Cosma, C.; Sciacovelli, L.; Plebani, M.
Analytical and clinical performances of five immunoassays for the detection of SARS-CoV-2 antibodies in comparison with
neutralization activity. EBioMedicine 2020, 62, 103101. [CrossRef] [PubMed]
7. Sheridan, C. Coronavirus and the race to distribute reliable diagnostics. Nat. Biotechnol. 2020, 38, 382–384. [CrossRef]
8. Lippi, G.; Simundic, A.M.; Plebani, M. Potential preanalytical and analytical vulnerabilities in the laboratory diagnosis of
coronavirus disease 2019 (COVID-19). Clin. Chem. Lab. Med. 2020, 58, 1070–1076. [CrossRef]
9. Interim Guidelines for Collecting, Handling, and Testing Clinical Specimens for COVID-19. Available online: https://www.cdc.
gov/coronavirus/2019-ncov/lab/guidelines-clinical-specimens.html (accessed on 25 May 2021).
10. Irving, S.A.; Vandermause, M.F.; Shay, D.K.; Belongia, E.A. Comparison of nasal and nasopharyngeal swabs for influenza
detection in adults. Clin. Med. Res. 2012, 10, 215–218. [CrossRef]
11. Loeffelholz, M.J.; Tang, Y.W. Laboratory diagnosis of emerging human coronavirus infections—The state of the art. Emerg.
Microbes Infect. 2020, 9, 747–756. [CrossRef]
12. MacKay, M.J.; Hooker, A.C.; Afshinnekoo, E.; Salit, M.; Kelly, J.; Feldstein, J.V.; Haft, N.; Schenkel, D.; Nambi, S.; Cai, Y.; et al.
The COVID-19 XPRIZE and the need for scalable, fast, and widespread testing. Nat. Biotechnol. 2020, 38, 1021–1024. [CrossRef]
[PubMed]
13. Arnaout, R.; Lee, R.A.; Lee, G.R.; Callahan, C.; Yen, C.F.; Smith, K.P.; Arora, R.; Kirby, J.E. SARS-CoV2 Testing: The Limit of
Detection Matters. bioRxiv 2020. [CrossRef]
14. Nalla, A.K.; Casto, A.M.; Huang, M.W.; Perchetti, G.A.; Sampoleo, R.; Shrestha, L.; Wei, Y.; Zhu, H.; Jerome, K.R.; Greninger, A.L.
Comparative Performance of SARS-CoV-2 Detection Assays Using Seven Different Primer-Probe Sets and One Assay Kit. J. Clin.
Microbiol. 2020, 58, e00557-20. [CrossRef]
15. Division of Viral Diseases. 2019-Novel Coronavirus (2019-nCoV) Real-Time rRT-PCR Panel Primers and Probes; Centers for Disease
Control and Prevention: Atlanta, GA, USA, 2020. Available online: https://www.cdc.gov/coronavirus/2019-ncov/downloads/
rt-pcr-panel-primer-probes.pdf (accessed on 20 May 2021).
16. Corman, V.M.; Landt, O.; Kaiser, M.; Molenkamp, R.; Meijer, A.; Chu, D.K.; Bleicker, T.; Brünink, S.; Schneider, J.; Schmidt, M.L.;
et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Euro Surveill. 2020, 25, 2000045. [CrossRef]
17. Laboratory Testing for Coronavirus Disease 2019 (COVID-19) in Suspected Human Cases. Interim Guidance 2 March 2020.
Available online: https://apps.who.int/iris/rest/bitstreams/1271387/retrieve (accessed on 9 March 2020).
18. Lee, S.H. Testing for SARS-CoV-2 in cellular components by routine nested RT-PCR followed by DNA sequencing. Int. J. Geriatr.
Rehabil. 2020, 2, 69–96.
19. FDA. SARS-CoV-2 Reference Panel Comparative Data. Available online: https://www.fda.gov/medical-devices/coronavirus-
covid-19-and-medical-devices/sars-cov-2-reference-panel-comparative-data (accessed on 20 September 2020). [CrossRef]
20. Woloshin, S.; Patel, N.; Kesselheim, A.S. False Negative Tests for SARS-CoV-2 Infection - Challenges and Implications. N. Engl. J.
Med. 2020, 383, e38. [CrossRef]
21. U.S. Food and Drug Administration. Emergency Use Authorization (EUA) Information, and List of All Current EUAs. Avail-
able online: https://www.fda.gov/emergency-preparedness-and-response/mcm-legal-regulatory-and-policy-framework/
emergency-use-authorization (accessed on 26 May 2021).
22. Yang, Y.; Yang, M.; Yuan, J.; Wang, F.; Wang, Z.; Li, J.; Zhang, M.; Xing, L.; Wei, J.; Peng, L.; et al. Comparative Sensitivity of
Different Respiratory Specimen Types for Molecular Diagnosis and Monitoring of SARS-CoV-2 Shedding. Innovation 2020, 1,
100061. [CrossRef] [PubMed]
23. Zhao, J.; Yuan, Q.; Wang, H.; Liu, W.; Liao, X.; Su, Y.; Wang, X.; Yuan, J.; Li, T.; Li, J.; et al. Antibody Responses to SARS-CoV-2 in
Patients With Novel Coronavirus Disease 2019. Clin. Infect. Dis. 2020, 71, 2027–2034. [CrossRef]
24. Arevalo-Rodriguez, I.; Buitrago-Garcia, D.; Simancas-Racines, D.; Zambrano-Achig, P.; Del Campo, R.; Ciapponi, A.; Sued, O.;
Martinez-García, L.; Rutjes, A.W.; Low, N.; et al. False-negative results of initial RT-PCR assays for COVID-19: A systematic
review. PLoS ONE 2020, 15, e0242958. [CrossRef] [PubMed]
25. Loeffelholz, M.J.; Alland, D.; Butler-Wu, S.M.; Pandey, U.; Perno, C.F.; Nava, A.; Carroll, K.C.; Mostafa, H.; Davies, E.; McEwan,
A.; et al. Multicenter Evaluation of the Cepheid Xpert Xpress SARS-CoV-2 Test. J. Clin. Microbiol. 2020, 58, e00926-20. [CrossRef]
[PubMed]
26. Lieberman, J.A.; Pepper, G.; Naccache, S.N.; Huang, M.L.; Jerome, K.R.; Greninger, A.L. Comparison of Commercially Available
and Laboratory-Developed Assays for In Vitro Detection of SARS-CoV-2 in Clinical Laboratories. J. Clin. Microbiol. 2020, 58,
e00821-20. [CrossRef] [PubMed]
27. Woelfel, R.; Corman, V.M.; Guggemos, W.; Seilmaier, M.; Zange, S.; Mueller, M.A.; Niemeyer, D.; Kelly, T.C.J.; Vollmar, P.; Rothe,
C.; et al. Clinical presentation, and virological assessment of hospitalized cases of coronavirus disease 2019 in a travel-associated
transmission cluster. medRxiv 2020. [CrossRef]
28. Wang, W.; Xu, Y.; Gao, R.; Lu, R.; Han, K.; Wu, G.; Tan, W. Detection of SARS-CoV-2 in Different Types of Clinical Specimens.
JAMA 2020, 323, 1843–1844. [CrossRef]
29. Bwire, G.M.; Majigo, M.V.; Njiro, B.J.; Mawazo, A. Detection profile of SARS-CoV-2 using RT-PCR in different types of clinical
specimens: A systematic review and meta-analysis. J. Med. Virol. 2021, 93, 719–725. [CrossRef] [PubMed]
Life 2021, 11, 660 14 of 16
30. Wyllie, A.L.; Fournier, J.; Casanovas-Massana, A.; Campbell, M.; Warren, J.L.; Geng, B.; Muenker, M.C.; Moore, A.J.; Vogels,
C.B.F.; Petrone, M.E.; et al. Saliva or nasopharyngeal swab specimens for detection of SARS-CoV-2. N. Engl. J. Med. 2020, 383,
1283–1286. [CrossRef] [PubMed]
31. Rao, M.; Rashid, F.A.; Sabri, F.S.A.H.; Jamil, N.N.; Zain, R.; Hashim, R.; Amran, F.; Kok, H.T.; Samad, M.A.A.; Ahmad, N.
Comparing Nasopharyngeal Swab and Early Morning Saliva for the Identification of Severe Acute Respiratory Syndrome
Coronavirus 2 (SARS-CoV-2). Clin. Infect. Dis. 2021, 72, e352–e356. [CrossRef]
32. Pasomsub, E.; Watcharananan, S.P.; Boonyawat, K.; Janchompoo, P.; Wongtabtim, G.; Suksuwan, W.; Sungkanuparph, S.;
Phuphuakrat, A. Saliva sample as a non-invasive specimen for the diagnosis of coronavirus disease 2019: A cross-sectional study.
Clin. Microbiol. Infect. 2021, 27, 285.e1–285.e4. [CrossRef]
33. To, K.K.; Tsang, O.T.; Yip, C.C.; Chan, K.H.; Wu, T.C.; Chan, J.M.; Leung, W.S.; Chik, T.S.; Choi, C.Y.; Kandamby, D.H.; et al.
Consistent Detection of 2019 Novel Coronavirus in Saliva. Clin. Infect. Dis. 2020, 71, 841–843. [CrossRef]
34. Azzi, L.; Carcano, G.; Gianfagna, F.; Grossi, P.; Gasperina, D.D.; Genoni, A.; Fasano, M.; Sessa, F.; Tettamanti, L.; Carinci, F.; et al.
Saliva is a reliable tool to detect SARS-CoV-2. J. Infect. 2020, 81, e45–e50. [CrossRef]
35. Becker, D.; Sandoval, E.; Amin, A.; De Hoff, P.; Diets, A.; Leonetti, N.; Lim, Y.W.; Elliott, C.; Laurent, L.; Grzymski, J.; et al. Saliva
is less sensitive than nasopharyngeal swabs for COVID-19 detection in the community setting. MedRxiv 2020. [CrossRef]
36. Butler-Laporte, G.; Lawandi, A.; Schiller, I.; Yao, M.; Dendukuri, N.; McDonald, E.G.; Lee, T.C. Comparison of Saliva and
Nasopharyngeal Swab Nucleic Acid Amplification Testing for Detection of SARS-CoV-2: A Systematic Review and Meta-analysis.
JAMA Intern. Med. 2021, 181, 353–360. [CrossRef] [PubMed]
37. Nagura-Ikeda, M.; Imai, K.; Tabata, S.; Miyoshi, K.; Murahara, N.; Mizuno, T.; Horiuchi, M.; Kato, K.; Imoto, Y.; Iwata, M.; et al.
Clinical Evaluation of Self-Collected Saliva by Quantitative Reverse Transcription-PCR (RT-qPCR), Direct RT-qPCR, Reverse
Transcription-Loop-Mediated Isothermal Amplification, and a Rapid Antigen Test To Diagnose COVID-19. J. Clin. Microbiol.
2020, 58, e01438-20. [CrossRef] [PubMed]
38. Yi, H. 2019 Novel Coronavirus Is Undergoing Active Recombination. Clin. Infect. Dis. 2020, 71, 884–887. [CrossRef] [PubMed]
39. Phan, T. Genetic diversity and evolution of SARS-CoV-2. Infect. Genet Evol. 2020. [CrossRef]
40. Pachetti, M.; Marini, B.; Benedetti, F.; Giudici, F.; Mauro, E.; Storici, P.; Masciovecchio, C.; Angeletti, S.; Ciccozzi, M.; Gallo, R.C.;
et al. Emerging SARS-CoV-2 mutation hot spots include a novel RNA-dependent-RNA polymerase variant. J. Transl. Med. 2020,
18, 179. [CrossRef]
41. Osório, N.S.; Correia-Neves, M. Implication of SARS-CoV-2 evolution in the sensitivity of RT-qPCR diagnostic assays. Lancet
Infect. Dis. 2020, 28, 166–167. [CrossRef]
42. Shen, Z.; Xiao, Y.; Kang, L.; Ma, W.; Shi, L.; Zhang, L.; Zhou, Z.; Yang, J.; Zhong, J.; Yang, D.; et al. Genomic Diversity of Severe
Acute Respiratory Syndrome-Coronavirus 2 in Patients With Coronavirus Disease 2019. Clin. Infect. Dis. 2020, 71, 713–720.
[CrossRef]
43. Jiang, F.; Deng, L.; Zhang, L.; Cai, Y.; Cheung, C.W.; Xia, Z. Review of the Clinical Characteristics of Coronavirus Disease 2019
(COVID-19). J. Gen. Intern. Med. 2020, 35, 1545–1549. [CrossRef]
44. Krishnan, A.; Hamilton, J.P.; Alqahtani, S.A.; A Woreta, T. A narrative review of coronavirus disease 2019 (COVID-19): Clinical,
epidemiological characteristics, and systemic manifestations. Intern. Emerg. Med. 2021, 16, 1–16. [CrossRef]
45. Afzal, A. Molecular diagnostic technologies for COVID-19: Limitations and challenges. J. Adv. Res. 2020, 26, 149–159. [CrossRef]
46. Kim, J.Y.; Ko, J.H.; Kim, Y.; Kim, Y.J.; Kim, J.M.; Chung, Y.S.; Kim, H.M.; Han, M.G.; Kim, S.Y.; Chin, B.S. Viral Load Kinetics of
SARS-CoV-2 Infection in First Two Patients in Korea. J. Korean Med. Sci. 2020, 35, e86. [CrossRef]
47. Sethuraman, N.; Jeremiah, S.S.; Ryo, A. Interpreting Diagnostic Tests for SARS-CoV-2. JAMA 2020, 323, 2249–2251. [CrossRef]
[PubMed]
48. Kucirka, L.M.; Lauer, S.A.; Laeyendecker, O.; Boon, D.; Lessler, J. Variation in False-Negative Rate of Reverse Transcriptase
Polymerase Chain Reaction-Based SARS-CoV-2 Tests by Time Since Exposure. Ann. Intern. Med. 2020, 173, 262–267. [CrossRef]
[PubMed]
49. Poon, L.L.; Chan, K.H.; Wong, O.K.; Yam, W.C.; Yuen, K.Y.; Guan, Y.; Lo, Y.M.; Peiris, J.S. Early diagnosis of SARS coronavirus
infection by real time RT-PCR. J. Clin. Virol. 2003, 28, 233–238. [CrossRef] [PubMed]
50. de Sousa, R.; Reusken, C.; Koopmans, M. MERS coronavirus: Data gaps for laboratory preparedness. J. Clin. Virol. 2014, 59, 4–11.
[CrossRef] [PubMed]
51. Kobayashi, T.; Jung, S.M.; Linton, N.M.; Kinoshita, R.; Hayashi, K.; Miyama, T.; Anzai, A.; Yang, Y.; Yuan, B.; Akhmetzhanov,
A.R.; et al. Communicating the Risk of Death from Novel Coronavirus Disease (COVID-19). J. Clin. Med. 2020, 9, 580. [CrossRef]
52. Ferretti, L.; Wymant, C.; Kendall, M.; Zhao, L.; Nurtay, A.; Abeler-Dörner, L.; Parker, M.; Bonsall, D.; Fraser, C. Quantifying
SARS-CoV-2 transmission suggests epidemic control with digital contact tracing. Science 2020, 368, eabb6936. [CrossRef]
53. Cevik, M.; Tate, M.; Lloyd, O.; Maraolo, A.E.; Schafers, J.; Ho, A. SARS-CoV-2, SARS-CoV, and MERS-CoV viral load dynamics,
duration of viral shedding, and infectiousness: A systematic review and meta-analysis. Lancet Microbe 2021, 2, e13–e22. [CrossRef]
54. Inglis, T.J. Principia aetiologica: Taking causality beyond Koch’s postulates. J. Med Microbiol. 2007, 56, 1419–1422. [CrossRef]
55. Sia, S.F.; Yan, L.M.; Chin, A.W.H.; Fung, K.; Choy, K.T.; Wong, A.Y.L.; Kaewpreedee, P.; Perera, R.A.P.M.; Poon, L.L.M.; Nicholls,
J.M.; et al. Pathogenesis and transmission of SARS-CoV-2 in golden hamsters. Nature 2020, 583, 834–838. [CrossRef]
56. Wölfel, R.; Corman, V.M.; Guggemos, W.; Seilmaier, M.; Zange, S.; Müller, M.A.; Niemeyer, D.; Jones, T.C.; Vollmar, P.; Rothe, C.;
et al. Virological assessment of hospitalized patients with COVID-2019. Nature 2020, 581, 465–469. [CrossRef]
Life 2021, 11, 660 15 of 16
57. Lambert-Niclot, S.; Cuffel, A.; Le Pape, S.; Vauloup-Fellous, C.; Morand-Joubert, L.; Roque-Afonso, A.M.; Le Goff, J.; Delaugerre,
C. Evaluation of a Rapid Diagnostic Assay for Detection of SARS-CoV-2 Antigen in Nasopharyngeal Swabs. J. Clin. Microbiol.
2020, 58, e00977-20. [CrossRef]
58. Manabe, Y.C.; Sharfstein, J.S.; Armstrong, K. The Need for More and Better Testing for COVID-19. JAMA 2020. [CrossRef]
59. Pekosz, A.; Parvu, V.; Li, M.; Andrews, J.C.; Manabe, Y.C.; Kodsi, S.; Gary, D.S.; Roger-Dalbert, C.; Leitch, J.; Cooper, C.K.
Antigen-Based Testing but Not Real-Time Polymerase Chain Reaction Correlates With Severe Acute Respiratory Syndrome
Coronavirus 2 Viral Culture. Clin. Infect. Dis. 2021, 20, ciaa1706. [CrossRef]
60. Strong, J.E.; Feldmann, H. The crux of Ebola diagnostics. J. Infect. Dis. 2017, 216, 1340–1342. [CrossRef] [PubMed]
61. Bullard, J.; Dust, K.; Funk, D.; Strong, J.E.; Alexander, D.; Garnett, L.; Boodman, C.; Bello, A.; Hedley, A.; Schiffman, Z.; et al.
Predicting Infectious Severe Acute Respiratory Syndrome Coronavirus 2 From Diagnostic Samples. Clin. Infect. Dis. 2020, 71,
2663–2666. [CrossRef]
62. Yu, F.; Yan, L.; Wang, N.; Yang, S.; Wang, L.; Tang, Y.; Gao, G.; Wang, S.; Ma, C.; Xie, R.; et al. Quantitative Detection and Viral
Load Analysis of SARS-CoV-2 in Infected Patients. Clin. Infect. Dis. 2020, 71, 793–798. [CrossRef] [PubMed]
63. Jaafar, R.; Aherfi, S.; Wurtz, N.; Grimaldier, C.; Van Hoang, T.; Colson, P.; Raoult, D.; La Scola, B. Correlation Between 3790
Quantitative Polymerase Chain Reaction-Positives Samples and Positive Cell Cultures, Including 1941 Severe Acute Respiratory
Syndrome Coronavirus 2 Isolates. Clin. Infect. Dis. 2021, 72, e921. [CrossRef] [PubMed]
64. Mina, M.J.; Parker, R.; Larremore, D.B. Rethinking Covid-19 Test Sensitivity—A Strategy for Containment. N. Engl. J. Med. 2020,
383, e120. [CrossRef]
65. COVID-19 Investigation Team. Clinical and virologic characteristics of the first 12 patients with coronavirus disease 2019
(COVID-19) in the United States. Nat. Med. 2020, 26, 861–868. [CrossRef]
66. Arons, M.M.; Hatfield, K.M.; Reddy, S.C.; Kimball, A.; James, A.; Jacobs, J.R.; Taylor, J.; Spicer, K.; Bardossy, A.C.; Oakley, L.P.;
et al. Presymptomatic SARS-CoV-2 Infections and Transmission in a Skilled Nursing Facility. N. Engl. J. Med. 2020, 382, 2081–2090.
[CrossRef] [PubMed]
67. Zou, L.; Ruan, F.; Huang, M.; Liang, L.; Huang, H.; Hong, Z.; Yu, J.; Kang, M.; Song, Y.; Xia, J.; et al. SARS-CoV-2 Viral Load in
Upper Respiratory Specimens of Infected Patients. N. Engl. J. Med. 2020, 382, 1177–1179. [CrossRef] [PubMed]
68. Lednicky, J.A. A practical and economic approach for assessing potential SARS-CoV-2 transmission risk in COVID-19 patients.
Clin. Infect. Dis. 2020. [CrossRef]
69. Lu, J.; Peng, J.; Xiong, Q.; Liu, Z.; Lin, H.; Tan, X.; Kang, M.; Yuan, R.; Zeng, L.; Zhou, P.; et al. Clinical, immunological, and
virological characterization of COVID-19 patients that test re-positive for SARS-CoV-2 by RT-PCR. Medrxiv 2020. Preprint.
[CrossRef]
70. Korea Centers for Disease Control and Prevention. Findings from Investigation and Analysis of Re-Positive Cases. 19 May 2020.
Available online: https://www.cdc.go.kr/board/board.es?mid=a30402000000&bid=0030&act=view&list_no=367267&nPage=
1external (accessed on 28 May 2021).
71. Available online: https://www.fda.gov/media/134922/download (accessed on 28 May 2021).
72. La Scola, B.; Le Bideau, M.; Andreani, J.; Hoang, V.T.; Grimaldier, C.; Colson, P.; Gautret, P.; Raoult, D. Viral RNA load as
determined by cell culture as a management tool for discharge of SARS-CoV-2 patients from infectious disease wards. Eur. J. Clin.
Microbiol. Infect. Dis. 2020, 39, 1059–1061. [CrossRef] [PubMed]
73. Singanayagam, A.; Patel, M.; Charlett, A.; Lopez Bernal, J.; Saliba, V.; Ellis, J.; Ladhani, S.; Zambon, M.; Gopal, R. Duration
of infectiousness and correlation with RT-PCR cycle threshold values in cases of COVID-19, England, January to May 2020.
Eurosurveillance 2020, 25, 2001483. [CrossRef]
74. van Kampen, J.J.A.; van de Vijver, D.A.M.C.; Fraaij, P.L.A.; Haagmans, B.L.; Lamers, M.M.; Okba, N.; van den Akker, J.P.C.;
Endeman, H.; Gommers, D.A.M.P.J.; Cornelissen, J.J.; et al. Duration and key determinants of infectious virus shedding in
hospitalized patients with coronavirus disease-2019 (COVID-19). Nat. Commun. 2021, 12, 267. [CrossRef]
75. Hicks, J.; Klumpp-Thomas, C.; Kalish, H.; Shunmugavel, A.; Mehalko, J.; Denson, J.P.; Snead, K.R.; Drew, M.; Corbett, K.S.;
Graham, B.S.; et al. Serologic Cross-Reactivity of SARS-CoV-2 with Endemic and Seasonal Betacoronaviruses. J. Clin. Immunol.
2021, 16, 1–8. [CrossRef]
76. Ma, Z.; Li, P.; Ji, Y.; Ikram, A.; Pan, Q. Cross-reactivity towards SARS-CoV-2: The potential role of low-pathogenic human
coronaviruses. Lancet Microbe 2020, 1, e151. [CrossRef]
77. Your Coronavirus Test Is Positive. Maybe It Shouldn’t Be. The New York Times, August 2020. Available online: https:
//www.nytimes.com/2020/08/29/health/coronavirus-testing.html (accessed on 3 March 2021).
78. He, X.; Lau, E.H.Y.; Wu, P.; Deng, X.; Wang, J.; Hao, X.; Lau, Y.C.; Wong, J.Y.; Guan, Y.; Tan, X.; et al. Temporal dynamics in viral
shedding and transmissibility of COVID-19. Nat. Med. 2020, 26, 672–675. [CrossRef]
79. Borczuk, A.C.; Salvatore, S.P.; Seshan, S.V.; Patel, S.S.; Bussel, J.B.; Mostyka, M.; Elsoukkary, S.; He, B.; Del Vecchio, C.; Fortarezza,
F.; et al. COVID-19 pulmonary pathology: A multi-institutional autopsy cohort from Italy and New York City. Mod. Pathol. 2020,
33, 2156–2168. [CrossRef]
80. Henderson, D.K.; Weber, D.J.; Babcock, H.; Hayden, M.K.; Malani, A.; Wright, S.B.; Murthy, A.R.; Guzman-Cottrill, J.; Haessler, S.;
Rock, C.; et al. The perplexing problem of persistently PCR-positive personnel. Infect. Control Hosp. Epidemiol. 2021, 42, 203–204.
[CrossRef]
Life 2021, 11, 660 16 of 16
81. Pan, Y.; Long, L.; Zhang, D.; Yuan, T.; Cui, S.; Yang, P.; Wang, Q.; Ren, S. Potential False-Negative Nucleic Acid Testing Results for
Severe Acute Respiratory Syndrome Coronavirus 2 from Thermal Inactivation of Samples with Low Viral Loads. Clin. Chem.
2020, 66, 794–801. [CrossRef] [PubMed]
82. Guo, L.; Sun, X.; Wang, X.; Liang, C.; Jiang, H.; Gao, Q.; Dai, M.; Qu, B.; Fang, S.; Mao, Y.; et al. SARS-CoV-2 detection with
CRISPR diagnostics. Cell Discov. 2020, 6, 34. [CrossRef] [PubMed]
83. Huang, Z.; Tian, D.; Liu, Y.; Lin, Z.; Lyon, C.J.; Lai, W.; Fusco, D.; Drouin, A.; Yin, X.; Hu, T.; et al. Ultra-sensitive and
high-throughput CRISPR-p owered COVID-19 diagnosis. Biosens. Bioelectron. 2020, 164, 112316. [CrossRef] [PubMed]
84. Tom, M.R.; Mina, M.J. To Interpret the SARS-CoV-2 Test, Consider the Cycle Threshold Value. Clin. Infect. Dis. 2020, 71, 2252–2254.
[CrossRef] [PubMed]
85. Struyf, T.; Deeks, J.J.; Dinnes, J.; Takwoingi, Y.; Davenport, C.; Leeflang, M.M.; Spijker, R.; Hooft, L.; Emperador, D.; Dittrich, S.;
et al. Cochrane COVID-19 Diagnostic Test Accuracy Group. Signs and symptoms to determine if a patient presenting in primary
care or hospital outpatient settings has COVID-19 disease. Cochrane Database Syst. Rev. 2020. [CrossRef]
86. Available online: https://www.cebm.net/covid-19/when-is-covid-covid/ (accessed on 4 April 2021).
87. Covid, Lombardia errore nel calcolo dell’Rt: Migliaia di guariti sono stati conteggiati come ancora positivi (“Covid, Lom-
bardy, Error in the Calculation of the RT: Thousands of Recovered Have Been Counted as Still Positive”). Available on-
line: https://www.corriere.it/cronache/21_gennaio_23/lombardia-errore-dati-migliaia-guariti-sono-stati-conteggiati-come-
ancora-positivi-a94fa550-5d3f-11eb-ae12-b118d8ea2872.shtml (accessed on 30 April 2021).
88. Shuren, J.; Stenzel, T. Covid-19 Molecular Diagnostic Testing—Lessons Learned. N. Engl. J. Med. 2020, 383, e97. [CrossRef]
89. Watson, J.; Whiting, P.F.; Brush, J.E. Interpreting a covid-19 test result. BMJ 2020, 369, m1808. [CrossRef]
90. European Centre for Disease Prevention and Control. Transmission of COVID-19. 30 June 2020. Available online: https:
//www.ecdc.europa.eu/en/covid-19/latestevidence/transmission (accessed on 8 August 2020).
91. Ioannidis, J.P.A. Global perspective of COVID-19 epidemiology for a full-cycle pandemic. Eur. J. Clin. Investig. 2020, 50, e13423.
[CrossRef]
92. Ioannidis, J.P.A.; Cripps, S.; Tanner, M.A. Forecasting for COVID-19 has failed. Int. J. Forecast 2020. [CrossRef]
93. Bizzarri, M.; Di Traglia, M.; Giuliani, A.; Vestri, A.; Fedeli, V.; Prestininzi, A. New statistical RI index allow to better track the
dynamics of COVID-19 outbreak in Italy. Sci. Rep. 2020, 10, 22365. [CrossRef] [PubMed]
94. Chu, D.K.; Akl, E.A.; Duda, S.; Solo, K.; Yaacoub, S.; Schünemann, H.J.; COVID-19 Systematic Urgent Review Group Effort
(SURGE) study authors. Physical distancing, face masks, and eye protection to prevent person-to-person transmission of
SARS-CoV-2 and COVID-19: A systematic review and meta-analysis. Lancet 2020, 395, 1973–1987. [CrossRef]