MétaCan
Menu
Back to cohort
Record W4405223579 · doi:10.1093/jnci/djae318

Justification, margin values, and analysis populations for oncologic noninferiority and equivalence trials: a meta-epidemiological study

2024· article· en· W4405223579 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueJNCI Journal of the National Cancer Institute · 2024
Typearticle
Languageen
FieldMathematics
TopicStatistical Methods in Clinical Trials
Canadian institutionsLondon Health Sciences CentreWestern University
FundersNational Cancer InstituteUniversity of Texas MD Anderson Cancer CenterNational Institutes of HealthAndrew Sabin Family Foundation
KeywordsMargin (machine learning)Equivalence (formal languages)Clinical endpointMeta-analysisPopulationMedicineStatisticsClinical trialMathematicsComputer scienceInternal medicine

Abstract

fetched live from OpenAlex

BACKGROUND: Noninferiority and equivalence trials evaluate whether an experimental therapy's effect on the primary endpoint is contained within an acceptable margin compared with standard of care. The reliability and impact of this conclusion, however, is largely dependent on the justification for this design, the choice of margin, and the analysis population used. METHODS: A meta-epidemiological study was performed of phase 3 randomized noninferiority and equivalence oncologic trials registered at ClinicalTrials.gov. Data were extracted from each trial's registration page and primary manuscript. RESULTS: We identified 65 noninferiority and 10 equivalence trials that collectively enrolled 61 632 patients. Of these, 61 (81%) trials demonstrated noninferiority or equivalence. A total of 65 (87%) trials were justified in the use of a noninferiority or equivalence design either because of an inherent advantage (53 trials), a statistically significant quality-of-life improvement (6 trials), or a statistically significant toxicity improvement (6 trials) of the interventional treatment relative to the control arm. Additionally, 69 (92.0%) trials reported a prespecified noninferiority or equivalence margin of which only 23 (33.3%) provided justification for this margin based on prior literature. For trials with time-to-event primary endpoints, the median noninferiority margin was a hazard ratio of 1.22 (range = 1.08-1.52). Investigators reported a per-protocol analysis for the primary endpoint in only 28 (37%) trials. CONCLUSIONS: Although most published noninferiority and equivalence trials have clear justification for their design, few provide rationale for the chosen margin or report a per-protocol analysis. These findings underscore the need for rigorous standards in trial design and reporting.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Direct model labels (unvalidated)

Per-model category and study-design labels from the labeling rounds. They are machine output, unvalidated, and the disagreement between models ships as data. No study design here is MEDLINE-validated yet.

Model armCategoriesStudy designConfidence
gemmaMetaresearchMeta-epidemiology (broad)
Domain: Methods · Genre: Empirical
About the Canadian research system: no · About a Canadian topic: no
Meta-analysislow
gptMetaresearchMeta-epidemiology (narrow)Meta-epidemiology (broad)
Domain: Methods · Genre: Empirical
About the Canadian research system: no · About a Canadian topic: no
Meta-analysismedium
models splitAgreement compares identical category sets and study designs across arms.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.028
metaresearch head score (Gemma)0.232
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Theoretical or conceptual · Consensus signal: Theoretical or conceptual
GenreCandidate signal: Methods · Consensus signal: none
Teacher disagreement score0.300
Threshold uncertainty score0.978

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0280.232
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0020.001
Bibliometrics0.0000.001
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.938
GPT teacher head0.706
Teacher spread0.232 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it