Overlapping research efforts in a global pandemic: a rapid systematic review of COVID-19-related individual participant data meta-analyses
Bibliographic record
Abstract
BACKGROUND: Individual participant data meta-analyses (IPD-MAs), which involve harmonising and analysing participant-level data from related studies, provide several advantages over aggregate data meta-analyses, which pool study-level findings. IPD-MAs are especially important for building and evaluating diagnostic and prognostic models, making them an important tool for informing the research and public health responses to COVID-19. METHODS: We conducted a rapid systematic review of protocols and publications from planned, ongoing, or completed COVID-19-related IPD-MAs to identify areas of overlap and maximise data request and harmonisation efforts. We searched four databases using a combination of text and MeSH terms. Two independent reviewers determined eligibility at the title-abstract and full-text stages. Data were extracted by one reviewer into a pretested data extraction form and subsequently reviewed by a second reviewer. Data were analysed using a narrative synthesis approach. A formal risk of bias assessment was not conducted. RESULTS: We identified 31 COVID-19-related IPD-MAs, including five living IPD-MAs and ten IPD-MAs that limited their inference to published data (e.g., case reports). We found overlap in study designs, populations, exposures, and outcomes of interest. For example, 26 IPD-MAs included RCTs; 17 IPD-MAs were limited to hospitalised patients. Sixteen IPD-MAs focused on evaluating medical treatments, including six IPD-MAs for antivirals, four on antibodies, and two that evaluated convalescent plasma. CONCLUSIONS: Collaboration across related IPD-MAs can leverage limited resources and expertise by expediting the creation of cross-study participant-level data datasets, which can, in turn, fast-track evidence synthesis for the improved diagnosis and treatment of COVID-19. TRIAL REGISTRATION: 10.17605/OSF.IO/93GF2.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Direct model labels (unvalidated)
Per-model category and study-design labels from the labeling rounds. They are machine output, unvalidated, and the disagreement between models ships as data. No study design here is MEDLINE-validated yet.
| Model arm | Categories | Study design | Confidence |
|---|---|---|---|
| gemma | MetaresearchMeta-epidemiology (broad) Domain: Methods · Genre: Review About the Canadian research system: no · About a Canadian topic: no | Systematic review | low |
| gpt | MetaresearchMeta-epidemiology (broad) Domain: Methods · Genre: Review About the Canadian research system: no · About a Canadian topic: no | Systematic review | medium |
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.223 | 0.487 |
| Meta-epidemiology (narrow) | 0.003 | 0.004 |
| Meta-epidemiology (broad) | 0.020 | 0.031 |
| Bibliometrics | 0.035 | 0.024 |
| Science and technology studies | 0.002 | 0.003 |
| Scholarly communication | 0.010 | 0.011 |
| Open science | 0.006 | 0.009 |
| Research integrity | 0.005 | 0.005 |
| Insufficient payload (model declined to judge) | 0.007 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedLabeled directly by 2 models reading the full record.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".