MétaCan
Menu
Back to cohort

Consensus Statement for Protocols of Factorial Randomized Trials

2023· article· en· W4389326950 on OpenAlexaff
Brennan C Kahan, Sophie Hall, Elaine Beller, Megan Birchenall, Diana Elbourne, Edmund Juszczak, Paul Little, John Fletcher, Robert Golub, Beatriz Goulão, Sally Hopewell, Nazrul Islam, Merrick Zwarenstein, An‐Wen Chan, Alan Montgomery

Bibliographic record

VenueJAMA Network Open · 2023
Typearticle
Languageen
FieldDecision Sciences
TopicMeta-analysis and systematic reviews
Canadian institutionsWomen's College HospitalUniversity of TorontoWestern University
FundersMedical Research CouncilNational Institute for Health and Care Research
KeywordsChecklistConsolidated Standards of Reporting TrialsProtocol (science)Research designDelphi methodRandomized controlled trialMEDLINEMedicineClinical trialMedical educationPsychological interventionPsychologyFamily medicineAlternative medicineComputer scienceNursingStatisticsMathematicsPolitical scienceArtificial intelligencePathology

Abstract

fetched live from OpenAlex

Importance: Trial protocols outline a trial's objectives as well as the methods (design, conduct, and analysis) that will be used to meet those objectives, and transparent reporting of trial protocols ensures objectives are clear and facilitates appraisal regarding the suitability of study methods. Factorial trials, in which 2 or more interventions are assessed in the same set of participants, have unique methodological considerations. However, no extension of the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) 2013 Statement, which provides guidance on reporting of trial protocols, for factorial trials is available. Objective: To develop a consensus-based extension to the SPIRIT 2013 Statement for factorial trials. Evidence Review: The SPIRIT extension for factorial trials was developed using the Enhancing the Quality and Transparency of Health Research (EQUATOR) methodological framework. First, a list of reporting recommendations was generated using a scoping review of methodological articles identified using a MEDLINE search (inception to May 2019), which was supplemented with relevant articles from the personal collections of the authors. Second, a 3-round Delphi survey (January to June 2022, completed by 104 panelists from 14 countries) was conducted to assess the importance of items and identify additional recommendations. Third, a hybrid consensus meeting was held, attended by 15 panelists to finalize selection and wording of the checklist. Findings: This SPIRIT extension for factorial trials modified 9 of the 33 items in the SPIRIT 2013 checklist. Key reporting recommendations were that the rationale for using a factorial design should be provided, including whether an interaction is hypothesized; the treatment groups that will form the main comparisons should be identified; and statistical methods for each main comparison should be provided, including how interactions will be assessed. Conclusions and Relevance: In this consensus statement, 9 factorial-specific items were provided that should be addressed in all protocols of factorial trials to increase the trial's utility and transparency.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.686
metaresearch head score (Gemma)0.285
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Scholarly communication, Insufficient payload (model declined to judge)
Consensus categoriesMetaresearch, Insufficient payload (model declined to judge)
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Protocol · Consensus signal: Protocol
Teacher disagreement score0.401
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.6860.285
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0120.003
Bibliometrics0.0000.001
Science and technology studies0.0000.000
Scholarly communication0.0020.000
Open science0.0030.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0070.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.926
GPT teacher head0.662
Teacher spread0.265 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; both teacher heads agree on what is shown here.

Study designNot applicable
Domainnot available
GenreProtocol

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations27
Published2023
Admission routes1
Has abstractyes

Explore more

Same venueJAMA Network OpenSame topicMeta-analysis and systematic reviewsFrench-language works237,207