MétaCan
Menu
Back to cohort
Record W4394567107 · doi:10.7759/cureus.57839

Evaluating Peer Review of Palliative Radiation Plans at a Canadian Tertiary Care Cancer Center

2024· article· en· W4394567107 on OpenAlexaffabout
Stephanie Gulstene, Adam Mutsaers, Melissa O’Neil, Andrew Warner, George Rodrigues

Bibliographic record

VenueCureus · 2024
Typearticle
Languageen
FieldMedicine
TopicManagement of metastatic bone disease
Canadian institutionsWestern University
Fundersnot available
KeywordsTomotherapyQuality assurancePalliative careAttendanceMedicineMedical physicsRadiation therapyNursingInternal medicinePolitical science

Abstract

fetched live from OpenAlex

INTRODUCTION: Peer review (PR) of palliative-intent radiation plans is an important but understudied component of quality assurance. This retrospective review aims to improve our understanding of palliative PR by examining the characteristics of reviewed plans and peer feedback along with the associated time burden of two different types of PR processes. METHODS: This single-institution, quality assurance project assessed palliative PR between 2018 and 2020. Initially, the PR involved a multi-disciplinary team PR. Subsequently, it transitioned to independent PR by a single physician. Characteristics of reviewed plans and feedback on PR were captured and abstracted. Time requirements of PR were based on self-reported estimates and attendance records. RESULTS: A total of 1942 cases were reviewed, representing 85.7% (1942/2266) of all palliative-intent plans between 2018 and 2020. A total of 41.1% (n=799) were simple (2D/3D) radiation plans while 56.0% (n=1087) were complex (volumetric modulated arc therapy (VMAT) or tomotherapy) plans. Approximately one-third (30.4%, n=590) of all plans were stereotactic treatments. The rate of any peer feedback was 2.3% (n=45), while the rate of a specific recommended or implemented change was 1.2% (n=24) and 0.9% (n=18), respectively. PR before the start of treatment was associated with more frequent recommended (p=0.005) and implemented changes (p=0.008). Most other factors, including plan complexity and use of stereotactic radiation, were not predictive in this analysis. Comparing the independent versus team PR approach, there was no significant difference in recommended or implemented changes. The mean±standard deviation (SD) staff time required per plan reviewed was 36±6 and 37±6 minutes, including 21±6 and 10±6 minutes of physician time, for team and independent PR, respectively. CONCLUSION: This work highlights the high frequency of complex and stereotactic radiation in the palliative setting, along with the importance of timely PR and the potential benefit of reviewing even simple, 2D/3D radiation plans. Additionally, from a process perspective, our work showed that independent PR may require less dedicated physician time.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.031
metaresearch head score (Gemma)0.186
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Evaluation · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.980
Threshold uncertainty score0.414

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0310.186
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0060.005
Science and technology studies0.0040.002
Scholarly communication0.0030.002
Open science0.0030.004
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0040.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.065
GPT teacher head0.414
Teacher spread0.349 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designObservational
DomainEvaluation
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations2
Published2024
Admission routes2
Has abstractyes

Explore more

Same venueCureusSame topicManagement of metastatic bone diseaseFrench-language works237,207