MétaCan
Menu
Back to cohort
Record W2088680000 · doi:10.1186/1471-2407-13-193

Fool’s gold, lost treasures, and the randomized clinical trial

2013· article· en· W2088680000 on OpenAlexafffund
David J. Stewart, Razelle Kurzrock

Bibliographic record

VenueBMC Cancer · 2013
Typearticle
Languageen
FieldMathematics
TopicStatistical Methods in Clinical Trials
Canadian institutionsUniversity of Ottawa
FundersUniversity of Toronto
KeywordsRandomized controlled trialMedicineClinical trialPopulationIntensive care medicineClinical endpointGold standard (test)OncologyInternal medicine

Abstract

fetched live from OpenAlex

BACKGROUND: Randomized controlled trials with a survival endpoint are the gold standard for clinical research, but have failed to achieve cures for most advanced malignancies. The high costs of randomized clinical trials slow progress (thereby causing avoidable loss of life) and increase health care costs. DISCUSSION: A malignancy may be caused by several different mutations. Therapies effective vs one mutation may be discarded due to lack of statistical significance across the entire population. Conversely, expensive large randomized trials may have sufficient statistical power to demonstrate benefit despite the therapy only working in subgroups. Non-cost-effective therapy is then applied to all patients (including subgroups it cannot help). Randomized trials comparing therapies with different mechanisms of action are misleading since they may conclude the therapies are "equivalent" despite benefitting different subpopulations, or may erroneously conclude that one therapy is superior simply because it targets a larger subpopulation. Furthermore, minor variances in patient selection may determine study outcome, a therapy may be discarded as ineffective despite substantial benefit in one subpopulation if harmful in another, randomized trials may more effectively detect therapies with minor benefit in most patients vs marked benefit in subpopulations, and randomized trials in unselected patients may erroneously conclude that "shot-gun" combinations are superior to single agents when sequential administration of personalized single agents might work better and spare patients treatment with drugs that cannot help them. We must identify predictive biomarkers early by comparing responding to progressing patients in phase I-II trials. Enriching randomized trials for biomarker-positive patients can markedly reduce required patient numbers and costs despite expensive screening for biomarker-positive patients. Available data support approval of new drugs without randomized trials if they yield single-agent sustained responses in patients refractory to standard therapies. Conversely, new approaches are needed to guide development of drug combinations since both standard phase II approaches and phase II-III randomized trials have a high risk of misleading. SUMMARY: Traditional randomized clinical trials approaches are often inefficient, wasteful, and unreliable. New clinical research paradigms are needed. The primary outcome of clinical research should be "Who (if anyone) benefits?" rather than "Does the overall group benefit?"

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.443
metaresearch head score (Gemma)0.661
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Methods · Consensus signal: Methods
Study designCandidate signal: Theoretical or conceptual · Consensus signal: Theoretical or conceptual
GenreCandidate signal: Commentary · Consensus signal: Commentary
Teacher disagreement score0.557
Threshold uncertainty score0.687

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.4430.661
Meta-epidemiology (narrow)0.0030.002
Meta-epidemiology (broad)0.0110.006
Bibliometrics0.0080.007
Science and technology studies0.0040.028
Scholarly communication0.0130.018
Open science0.0060.006
Research integrity0.0170.019
Insufficient payload (model declined to judge)0.0130.002

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.647
GPT teacher head0.602
Teacher spread0.044 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designTheoretical or conceptual
DomainMethods
GenreCommentary

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations51
Published2013
Admission routes2
Has abstractyes

Explore more

Same venueBMC CancerSame topicStatistical Methods in Clinical TrialsFrench-language works237,207