MétaCan
Menu
Back to cohort
Record W3038707046 · doi:10.1136/bmj.m2516

Diagnostic accuracy of serological tests for covid-19: systematic review and meta-analysis

2020· review· en· W3038707046 on OpenAlexafffund
Mayara Lisboa Bastos, Gamuchirai Tavaziva, S.K. Abidi, Jonathon R. Campbell, Louis‐Patrick Haraoui, James C. Johnston, Zhiyi Lan, Stephanie Law, Emily MacLean, Anete Trajman, Dick Menzies, Andrea Benedetti, Faiz Ahmad Khan

Bibliographic record

VenueBMJ · 2020
Typereview
Languageen
FieldMedicine
TopicSARS-CoV-2 detection and testing
Canadian institutionsUniversity of British ColumbiaMcGill UniversityUniversité de SherbrookeMcGill University Health Centre
FundersCanadian Institutes of Health ResearchMcGill University
KeywordsSerologyMeta-analysisMedicinePopulationPublication biasInternal medicineImmunologyAntibody

Abstract

fetched live from OpenAlex

OBJECTIVE: To determine the diagnostic accuracy of serological tests for coronavirus disease-2019 (covid-19). DESIGN: Systematic review and meta-analysis. DATA SOURCES: Medline, bioRxiv, and medRxiv from 1 January to 30 April 2020, using subject headings or subheadings combined with text words for the concepts of covid-19 and serological tests for covid-19. ELIGIBILITY CRITERIA AND DATA ANALYSIS: Eligible studies measured sensitivity or specificity, or both of a covid-19 serological test compared with a reference standard of viral culture or reverse transcriptase polymerase chain reaction. Studies were excluded with fewer than five participants or samples. Risk of bias was assessed using quality assessment of diagnostic accuracy studies 2 (QUADAS-2). Pooled sensitivity and specificity were estimated using random effects bivariate meta-analyses. MAIN OUTCOME MEASURES: The primary outcome was overall sensitivity and specificity, stratified by method of serological testing (enzyme linked immunosorbent assays (ELISAs), lateral flow immunoassays (LFIAs), or chemiluminescent immunoassays (CLIAs)) and immunoglobulin class (IgG, IgM, or both). Secondary outcomes were stratum specific sensitivity and specificity within subgroups defined by study or participant characteristics, including time since symptom onset. RESULTS: 5016 references were identified and 40 studies included. 49 risk of bias assessments were carried out (one for each population and method evaluated). High risk of patient selection bias was found in 98% (48/49) of assessments and high or unclear risk of bias from performance or interpretation of the serological test in 73% (36/49). Only 10% (4/40) of studies included outpatients. Only two studies evaluated tests at the point of care. For each method of testing, pooled sensitivity and specificity were not associated with the immunoglobulin class measured. The pooled sensitivity of ELISAs measuring IgG or IgM was 84.3% (95% confidence interval 75.6% to 90.9%), of LFIAs was 66.0% (49.3% to 79.3%), and of CLIAs was 97.8% (46.2% to 100%). In all analyses, pooled sensitivity was lower for LFIAs, the potential point-of-care method. Pooled specificities ranged from 96.6% to 99.7%. Of the samples used for estimating specificity, 83% (10 465/12 547) were from populations tested before the epidemic or not suspected of having covid-19. Among LFIAs, pooled sensitivity of commercial kits (65.0%, 49.0% to 78.2%) was lower than that of non-commercial tests (88.2%, 83.6% to 91.3%). Heterogeneity was seen in all analyses. Sensitivity was higher at least three weeks after symptom onset (ranging from 69.9% to 98.9%) compared with within the first week (from 13.4% to 50.3%). CONCLUSION: Higher quality clinical studies assessing the diagnostic accuracy of serological tests for covid-19 are urgently needed. Currently, available evidence does not support the continued use of existing point-of-care serological tests. STUDY REGISTRATION: PROSPERO CRD42020179452.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.023
metaresearch head score (Gemma)0.064
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Meta-analysis · Consensus signal: Meta-analysis
GenreCandidate signal: Review · Consensus signal: Review
Teacher disagreement score0.023
Threshold uncertainty score0.122

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0230.064
Meta-epidemiology (narrow)0.0030.002
Meta-epidemiology (broad)0.0180.035
Bibliometrics0.0080.008
Science and technology studies0.0010.001
Scholarly communication0.0030.002
Open science0.0030.002
Research integrity0.0020.002
Insufficient payload (model declined to judge)0.0030.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.389
GPT teacher head0.500
Teacher spread0.111 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designMeta-analysis
Domainnot available
GenreReview

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations921
Published2020
Admission routes2
Has abstractyes

Explore more

Same venueBMJSame topicSARS-CoV-2 detection and testingFrench-language works237,207