MétaCan
Menu
Back to cohort
Record W2151225337 · doi:10.1186/1741-7015-9-79

Network meta-analysis-highly attractive but more methodological research is needed

2011· article· en· W2151225337 on OpenAlexfundno aff
Tianjing Li, Milo A. Puhan, S. Swaroop Vedula, Sonal Singh, Kay Dickersin

Bibliographic record

VenueBMC Medicine · 2011
Typearticle
Languageen
FieldDecision Sciences
TopicMeta-analysis and systematic reviews
Canadian institutionsnot available
FundersNational Eye InstituteJohns Hopkins Bloomberg School of Public HealthNational Institutes of HealthUniversiteit van AmsterdamUniversity of East AngliaUniversity of OttawaMcMaster UniversityJohns Hopkins University
KeywordsMeta-analysisSystematic reviewMedicineContext (archaeology)Management scienceData scienceMEDLINERisk analysis (engineering)Computer sciencePathology

Abstract

fetched live from OpenAlex

Network meta-analysis, in the context of a systematic review, is a meta-analysis in which multiple treatments (that is, three or more) are being compared using both direct comparisons of interventions within randomized controlled trials and indirect comparisons across trials based on a common comparator. To ensure validity of findings from network meta-analyses, the systematic review must be designed rigorously and conducted carefully. Aspects of designing and conducting a systematic review for network meta-analysis include defining the review question, specifying eligibility criteria, searching for and selecting studies, assessing risk of bias and quality of evidence, conducting a network meta-analysis, interpreting and reporting findings. This commentary summarizes the methodologic challenges and research opportunities for network meta-analysis relevant to each aspect of the systematic review process based on discussions at a network meta-analysis methodology meeting we hosted in May 2010 at the Johns Hopkins Bloomberg School of Public Health. Since this commentary reflects the discussion at that meeting, it is not intended to provide an overview of the field.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.346
metaresearch head score (Gemma)0.635
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Methods · Consensus signal: Methods
Study designCandidate signal: Theoretical or conceptual · Consensus signal: none
GenreCandidate signal: Commentary · Consensus signal: none
Teacher disagreement score0.654
Threshold uncertainty score0.807

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.3460.635
Meta-epidemiology (narrow)0.0030.002
Meta-epidemiology (broad)0.0120.012
Bibliometrics0.0100.012
Science and technology studies0.0030.004
Scholarly communication0.0140.020
Open science0.0050.005
Research integrity0.0060.012
Insufficient payload (model declined to judge)0.0080.002

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.992
GPT teacher head0.695
Teacher spread0.297 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designTheoretical or conceptual
DomainMethods
GenreCommentary

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations366
Published2011
Admission routes1
Has abstractyes

Explore more

Same venueBMC MedicineSame topicMeta-analysis and systematic reviewsFrench-language works237,207