74
views
0
recommends
+1 Recommend
1 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Rapid, point‐of‐care antigen and molecular‐based tests for diagnosis of SARS‐CoV‐2 infection

      systematic-review

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Background

          Accurate rapid diagnostic tests for SARS‐CoV‐2 infection could contribute to clinical and public health strategies to manage the COVID‐19 pandemic. Point‐of‐care antigen and molecular tests to detect current infection could increase access to testing and early confirmation of cases, and expediate clinical and public health management decisions that may reduce transmission.

          Objectives

          To assess the diagnostic accuracy of point‐of‐care antigen and molecular‐based tests for diagnosis of SARS‐CoV‐2 infection. We consider accuracy separately in symptomatic and asymptomatic population groups.

          Search methods

          Electronic searches of the Cochrane COVID‐19 Study Register and the COVID‐19 Living Evidence Database from the University of Bern (which includes daily updates from PubMed and Embase and preprints from medRxiv and bioRxiv) were undertaken on 30 Sept 2020. We checked repositories of COVID‐19 publications and included independent evaluations from national reference laboratories, the Foundation for Innovative New Diagnostics and the Diagnostics Global Health website to 16 Nov 2020. We did not apply language restrictions.

          Selection criteria

          We included studies of people with either suspected SARS‐CoV‐2 infection, known SARS‐CoV‐2 infection or known absence of infection, or those who were being screened for infection. We included test accuracy studies of any design that evaluated commercially produced, rapid antigen or molecular tests suitable for a point‐of‐care setting (minimal equipment, sample preparation, and biosafety requirements, with results within two hours of sample collection). We included all reference standards that define the presence or absence of SARS‐CoV‐2 (including reverse transcription polymerase chain reaction (RT‐PCR) tests and established diagnostic criteria).

          Data collection and analysis

          Studies were screened independently in duplicate with disagreements resolved by discussion with a third author. Study characteristics were extracted by one author and checked by a second; extraction of study results and assessments of risk of bias and applicability (made using the QUADAS‐2 tool) were undertaken independently in duplicate. We present sensitivity and specificity with 95% confidence intervals (CIs) for each test and pooled data using the bivariate model separately for antigen and molecular‐based tests. We tabulated results by test manufacturer and compliance with manufacturer instructions for use and according to symptom status.

          Main results

          Seventy‐eight study cohorts were included (described in 64 study reports, including 20 pre‐prints), reporting results for 24,087 samples (7,415 with confirmed SARS‐CoV‐2). Studies were mainly from Europe (n = 39) or North America (n = 20), and evaluated 16 antigen and five molecular assays.

          We considered risk of bias to be high in 29 (37%) studies because of participant selection; in 66 (85%) because of weaknesses in the reference standard for absence of infection; and in 29 (37%) for participant flow and timing. Studies of antigen tests were of a higher methodological quality compared to studies of molecular tests, particularly regarding the risk of bias for participant selection and the index test. Characteristics of participants in 35 (45%) studies differed from those in whom the test was intended to be used and the delivery of the index test in 39 (50%) studies differed from the way in which the test was intended to be used. Nearly all studies (97%) defined the presence or absence of SARS‐CoV‐2 based on a single RT‐PCR result, and none included participants meeting case definitions for probable COVID‐19.

          Antigen tests

          Forty‐eight studies reported 58 evaluations of antigen tests. Estimates of sensitivity varied considerably between studies. There were differences between symptomatic (72.0%, 95% CI 63.7% to 79.0%; 37 evaluations; 15530 samples, 4410 cases) and asymptomatic participants (58.1%, 95% CI 40.2% to 74.1%; 12 evaluations; 1581 samples, 295 cases). Average sensitivity was higher in the first week after symptom onset (78.3%, 95% CI 71.1% to 84.1%; 26 evaluations; 5769 samples, 2320 cases) than in the second week of symptoms (51.0%, 95% CI 40.8% to 61.0%; 22 evaluations; 935 samples, 692 cases). Sensitivity was high in those with cycle threshold (Ct) values on PCR ≤25 (94.5%, 95% CI 91.0% to 96.7%; 36 evaluations; 2613 cases) compared to those with Ct values >25 (40.7%, 95% CI 31.8% to 50.3%; 36 evaluations; 2632 cases). Sensitivity varied between brands. Using data from instructions for use (IFU) compliant evaluations in symptomatic participants, summary sensitivities ranged from 34.1% (95% CI 29.7% to 38.8%; Coris Bioconcept) to 88.1% (95% CI 84.2% to 91.1%; SD Biosensor STANDARD Q). Average specificities were high in symptomatic and asymptomatic participants, and for most brands (overall summary specificity 99.6%, 95% CI 99.0% to 99.8%).

          At 5% prevalence using data for the most sensitive assays in symptomatic people (SD Biosensor STANDARD Q and Abbott Panbio), positive predictive values (PPVs) of 84% to 90% mean that between 1 in 10 and 1 in 6 positive results will be a false positive, and between 1 in 4 and 1 in 8 cases will be missed. At 0.5% prevalence applying the same tests in asymptomatic people would result in PPVs of 11% to 28% meaning that between 7 in 10 and 9 in 10 positive results will be false positives, and between 1 in 2 and 1 in 3 cases will be missed.

          No studies assessed the accuracy of repeated lateral flow testing or self‐testing.

          Rapid molecular assays

          Thirty studies reported 33 evaluations of five different rapid molecular tests. Sensitivities varied according to test brand. Most of the data relate to the ID NOW and Xpert Xpress assays. Using data from evaluations following the manufacturer’s instructions for use, the average sensitivity of ID NOW was 73.0% (95% CI 66.8% to 78.4%) and average specificity 99.7% (95% CI 98.7% to 99.9%; 4 evaluations; 812 samples, 222 cases). For Xpert Xpress, the average sensitivity was 100% (95% CI 88.1% to 100%) and average specificity 97.2% (95% CI 89.4% to 99.3%; 2 evaluations; 100 samples, 29 cases). Insufficient data were available to investigate the effect of symptom status or time after symptom onset.

          Authors' conclusions

          Antigen tests vary in sensitivity. In people with signs and symptoms of COVID‐19, sensitivities are highest in the first week of illness when viral loads are higher. The assays shown to meet appropriate criteria, such as WHO's priority target product profiles for COVID‐19 diagnostics (‘acceptable’ sensitivity ≥ 80% and specificity ≥ 97%), can be considered as a replacement for laboratory‐based RT‐PCR when immediate decisions about patient care must be made, or where RT‐PCR cannot be delivered in a timely manner. Positive predictive values suggest that confirmatory testing of those with positive results may be considered in low prevalence settings. Due to the variable sensitivity of antigen tests, people who test negative may still be infected.

          Evidence for testing in asymptomatic cohorts was limited. Test accuracy studies cannot adequately assess the ability of antigen tests to differentiate those who are infectious and require isolation from those who pose no risk, as there is no reference standard for infectiousness. A small number of molecular tests showed high accuracy and may be suitable alternatives to RT‐PCR. However, further evaluations of the tests in settings as they are intended to be used are required to fully establish performance in practice.

          Several important studies in asymptomatic individuals have been reported since the close of our search and will be incorporated at the next update of this review. Comparative studies of antigen tests in their intended use settings and according to test operator (including self‐testing) are required.

          Plain language summary

          How accurate are rapid tests for diagnosing COVID‐19?

          What are rapid point‐of‐care tests for COVID‐19?

          Rapid point‐of‐care tests aim to confirm or rule out COVID‐19 infection in people with or without COVID‐19 symptoms. They:

          ‐ are portable, so they can be used wherever the patient is (at the point of care);

          ‐ are easy to perform, with a minimum amount of extra equipment or complicated preparation steps;

          ‐ are less expensive than standard laboratory tests;

          ‐ do not require a specialist operator or setting; and

          ‐ provide results ‘while you wait’.

          We were interested in two types of commercially available, rapid point‐of‐care tests: antigen and molecular tests. Antigen tests identify proteins on the virus; they come in disposable plastic cassettes, similar to pregnancy tests. Rapid molecular tests detect the virus’s genetic material in a similar way to laboratory methods, but using smaller devices that are easy to transport or to set up outside of a specialist laboratory. Both test nose or throat samples.

          Why is this question important?

          People with suspected COVID‐19 need to know quickly whether they are infected, so that they can self‐isolate, receive treatment, and inform close contacts. Currently, COVID‐19 infection is confirmed by a laboratory test called RT‐PCR, which uses specialist equipment and often takes at least 24 hours to produce a result.

          Rapid point‐of‐care tests could open access to testing for many more people, with and without symptoms, potentially in locations other than healthcare settings. If they are accurate, faster diagnosis could allow people to take appropriate action more quickly, with the potential to reduce the spread of COVID‐19.

          What did we want to find out?

          We wanted to know whether commercially available, rapid point‐of‐care antigen and molecular tests are accurate enough to diagnose COVID‐19 infection reliably, and to find out if accuracy differs in people with and without symptoms.

          What did we do?

          We looked for studies that measured the accuracy of any commercially produced, rapid antigen or molecular point‐of‐care test, in people tested for COVID‐19 using RT‐PCR. People could be tested in hospital or the community. Studies could test people with or without symptoms.

          Tests had to use minimal equipment, be performed safely without risking infection from the sample, and have results available within two hours of the sample being collected.

          What we found

          We included 64 studies in the review. They investigated a total of 24,087 nose or throat samples; COVID‐19 was confirmed in 7415 of these samples. Studies investigated 16 different antigen tests and five different molecular tests. They took place mainly in Europe and North America.

          Main results

          Antigen tests

          In people with confirmed COVID‐19, antigen tests correctly identified COVID‐19 infection in an average of 72% of people with symptoms, compared to 58% of people without symptoms. Tests were most accurate when used in the first week after symptoms first developed (an average of 78% of confirmed cases had positive antigen tests). This is likely to be because people have the most virus in their system in the first days after they are infected.

          In people who did not have COVID‐19, antigen tests correctly ruled out infection in 99.5% of people with symptoms and 98.9% of people without symptoms.

          Different brands of tests varied in accuracy. Pooled results for one test (SD Biosensor STANDARD Q) met World Health Organization (WHO) standards as ‘acceptable’ for confirming and ruling out COVID‐19 in people with signs and symptoms of COVID‐19. Two more tests met the WHO acceptable standards (Abbott Panbio and BIONOTE NowCheck) in at least one study.

          Using summary results for SD Biosensor STANDARD Q, if 1000 people with symptoms had the antigen test, and 50 (5%) of them really had COVID‐19:

          ‐ 53 people would test positive for COVID‐19. Of these, 9 people (17%) would not have COVID‐19 (false positive result).

          ‐ 947 people would test negative for COVID‐19. Of these, 6 people (0.6%) would actually have COVID‐19 (false negative result).

          In people with no symptoms of COVID‐19 the number of confirmed cases is expected to be much lower than in people with symptoms. Using summary results for SD Biosensor STANDARD Q in a bigger population of 10,000 people with no symptoms, where 50 (0.5%) of them really had COVID‐19:

          ‐ 125 people would test positive for COVID‐19. Of these, 90 people (72%) would not have COVID‐19 (false positive result).

          ‐ 9,875 people would test negative for COVID‐19. Of these, 15 people (0.2%) would actually have COVID‐19 (false negative result).

          Molecular tests

          Although overall results for diagnosing and ruling out COVID‐19 were good (95.1% of infections correctly diagnosed and 99% correctly ruled out), 69% of the studies used the tests in laboratories instead of at the point‐of‐care and few studies followed test manufacturer instructions. Most of the data relate to the ID NOW and Xpert Xpress tests. We noted a large difference in COVID‐19 detection between the two tests, but we cannot be certain about whether results will remain the same in a real world setting. We could not investigate differences in people with or without symptoms, nor time from when symptoms first showed because the studies did not provide enough information about their participants.

          How reliable were the results of the studies?

          In general, studies that assessed antigen tests used more rigorous methods than those that assessed molecular tests, particularly when selecting participants and performing the tests. Sometimes studies did not perform the test on the people for whom it was intended and did not follow the manufacturers’ instructions for using the test. Sometimes the tests were not carried out at the point‐of‐care. Nearly all the studies (97%) relied on a single negative RT‐PCR result as evidence of no COVID‐19 infection. Results from different test brands varied, and few studies directly compared one test brand with another. Finally, not all studies gave enough information about their participants for us to judge how long they had had symptoms, or even whether or not they had symptoms.

          What does this mean?

          Some antigen tests are accurate enough to replace RT‐PCR when used in people with symptoms. This would be most useful when quick decisions are needed about patient care, or if RT‐PCR is not available. Antigen tests may be most useful to identify outbreaks, or to select people with symptoms for further testing with PCR, allowing self‐isolation or contact tracing and reducing the burden on laboratory services. People who receive a negative antigen test result may still be infected.

          Several point‐of‐care molecular tests show very high accuracy and potential for use, but more evidence of their performance when evaluated in real life settings is required.

          We need more evidence on rapid testing in people without symptoms, on the accuracy of repeated testing, testing in non‐healthcare settings such as schools (including self‐testing), and direct comparisons of test brands, with testers following manufacturers’ instructions.

          How up‐to‐date is this review?

          This review updates our previous review and includes evidence published up to 30 September 2020.

          Related collections

          Most cited references286

          • Record: found
          • Abstract: found
          • Article: not found

          QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies.

          In 2003, the QUADAS tool for systematic reviews of diagnostic accuracy studies was developed. Experience, anecdotal reports, and feedback suggested areas for improvement; therefore, QUADAS-2 was developed. This tool comprises 4 domains: patient selection, index test, reference standard, and flow and timing. Each domain is assessed in terms of risk of bias, and the first 3 domains are also assessed in terms of concerns regarding applicability. Signalling questions are included to help judge risk of bias. The QUADAS-2 tool is applied in 4 phases: summarize the review question, tailor the tool and produce review-specific guidance, construct a flow diagram for the primary study, and judge bias and applicability. This tool will allow for more transparent rating of bias and applicability of primary diagnostic accuracy studies.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Complex Immune Dysregulation in COVID-19 Patients with Severe Respiratory Failure

            Summary Proper management of COVID-19 mandates better understanding of disease pathogenesis. The sudden clinical deterioration 7–8 days after initial symptom onset suggests that severe respiratory failure (SRF) in COVID-19 is driven by a unique pattern of immune dysfunction. We studied immune responses of 54 COVID-19 patients, 28 of whom had SRF. All patients with SRF displayed either macrophage activation syndrome (MAS) or very low human leukocyte antigen D related (HLA-DR) expression accompanied by profound depletion of CD4 lymphocytes, CD19 lymphocytes, and natural killer (NK) cells. Tumor necrosis factor-α (TNF-α) and interleukin-6 (IL-6) production by circulating monocytes was sustained, a pattern distinct from bacterial sepsis or influenza. SARS-CoV-2 patient plasma inhibited HLA-DR expression, and this was partially restored by the IL-6 blocker Tocilizumab; off-label Tocilizumab treatment of patients was accompanied by increase in circulating lymphocytes. Thus, the unique pattern of immune dysregulation in severe COVID-19 is characterized by IL-6-mediated low HLA-DR expression and lymphopenia, associated with sustained cytokine production and hyper-inflammation.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies

              Systematic reviews of diagnostic test accuracy synthesize data from primary diagnostic studies that have evaluated the accuracy of 1 or more index tests against a reference standard, provide estimates of test performance, allow comparisons of the accuracy of different tests, and facilitate the identification of sources of variability in test accuracy.
                Bookmark

                Author and article information

                Journal
                Cochrane Database Syst Rev
                Cochrane Database Syst Rev
                14651858
                10.1002/14651858
                The Cochrane Database of Systematic Reviews
                John Wiley & Sons, Ltd (Chichester, UK )
                1469-493X
                24 March 2021
                March 2021
                24 March 2021
                : 2021
                : 3
                : CD013705
                Affiliations
                deptTest Evaluation Research Group, Institute of Applied Health Research University of Birmingham Birmingham UK
                deptNIHR Birmingham Biomedical Research Centre University Hospitals Birmingham NHS Foundation Trust and University of Birmingham BirminghamUK
                deptTest Evaluation Research Group, Institute of Applied Health Research University of Birmingham BirminghamUK
                deptDepartment of Clinical Sciences Liverpool School of Tropical Medicine LiverpoolUK
                FIND GenevaSwitzerland
                deptGlobal Malaria Programme World Health Organization Geneva Switzerland
                deptDepartment of Public Health and Primary Care KU Leuven LeuvenBelgium
                deptDivision of Health Sciences, Warwick Medical School University of Warwick CoventryUK
                deptCochrane Netherlands Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University Utrecht Netherlands
                deptDepartment of Clinical Epidemiology, Biostatistics and Bioinformatics Amsterdam University Medical Centers, University of Amsterdam AmsterdamNetherlands
                deptDepartment of Radiology University of Ottawa OttawaCanada
                deptMedical Library Amsterdam UMC, University of Amsterdam, Amsterdam Public Health AmsterdamNetherlands
                deptCochrane Netherlands Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University UtrechtNetherlands
                Article
                CD013705.pub2 CD013705
                10.1002/14651858.CD013705.pub2
                8078597
                33760236
                1f028f99-6cf1-418c-9d2e-f241e560642e
                Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane Collaboration.

                This is an open access article under the terms of the Creative Commons Attribution-Non-Commercial Licence, which permits use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes.

                History
                Categories
                Diagnosis
                Infectious disease
                COVID-19

                Comments

                Comment on this article