MétaCan
Menu
Back to cohort
Record W3196174409 · doi:10.1002/ijc.33764

Resource stratified guidelines for cancer: Are they all the same? <scp>Interguideline</scp> concordance for systemic treatment recommendations

2021· article· en· W3196174409 on OpenAlexaff
Brooke E. Wilson, Mitchell J. Elliott, Sallie‐Anne Pearson, Eitan Amir, Michael Bartoň

Bibliographic record

VenueInternational Journal of Cancer · 2021
Typearticle
Languageen
FieldEconomics, Econometrics and Finance
TopicHealth Systems, Economic Evaluations, Quality of Life
Canadian institutionsPrincess Margaret Cancer CentreUniversity of Toronto
FundersNational Breast Cancer Foundation
KeywordsConcordanceMeta-analysisResource (disambiguation)MedicineStatisticsActuarial scienceComputer scienceInternal medicineMathematicsBusiness

Abstract

fetched live from OpenAlex

Abstract A number of organizations are producing resource stratified guidelines (RSGs) for cancer. Despite using similar definitions of resource levels, systemic treatment recommendations often differ between organizations. We systematically searched for RSGs focusing on solid tumors. We qualitatively compared the methods used to generate guidelines using the AGREE‐II appraisal tool. We extracted systemic treatment recommendations and assessed interguideline concordance using the Gwet AC1 coefficient, stratified by resource level, treatment setting and cancer type. We identified 69 RSGs cancer covering 15 solid tumors produced by four organizations. Despite using common resource‐level definitions (Basic, Core/Limited, Enhanced and Maximal), recommendations differed between organizations. Concordance for chemotherapy recommendations was poor in Basic (58.3%, Gwet 0.20), fair in Core (58.3%, Gwet 0.32) and excellent in Enhanced (92.4%, Gwet 0.92) and Maximal settings (95.4%, Gwet 0.95). Concordance rates for endocrine therapy were good in Basic (80% Gwet 0.61), and excellent in Core (90%, Gwet 0.87), Enhanced (90%, Gwet 0.89) and Maximal settings (90%, Gwet 0.89). There was moderate to excellent concordance in targeted therapy recommendations across all resource levels. Differences in recommendations appeared driven by different opinions among the chosen panel of experts regarding what is resource appropriate. Overall, we found that countries looking to base treatment and health‐policy on RSGs will find conflicting information depending on which guidelines are used, particularly for chemotherapy in Basic and Core settings. Improved transparency regarding the methods used to determine the value of a therapy for a given resource level is needed.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.191
metaresearch head score (Gemma)0.568
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Evaluation · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.809
Threshold uncertainty score0.998

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.1910.568
Meta-epidemiology (narrow)0.0000.001
Meta-epidemiology (broad)0.0020.002
Bibliometrics0.0110.012
Science and technology studies0.0010.002
Scholarly communication0.0050.004
Open science0.0020.004
Research integrity0.0020.003
Insufficient payload (model declined to judge)0.0030.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.474
GPT teacher head0.520
Teacher spread0.046 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designObservational
DomainEvaluation
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations8
Published2021
Admission routes1
Has abstractyes

Explore more

Same venueInternational Journal of CancerSame topicHealth Systems, Economic Evaluations, Quality of LifeFrench-language works237,207