MétaCan
Menu
Back to cohort
Record W4311249208 · doi:10.1001/jama.2022.21022

Guidelines for Reporting Outcomes in Trial Reports

2022· review· en· W4311249208 on OpenAlexafffund
Nancy J. Butcher, Andrea Monsour, Emma J. Mew, An‐Wen Chan, David Moher, Evan Mayo‐Wilson, Caroline B. Terwee, Alyssandra Chee-A-Tow, Ami Baba, Frank Gavin, Jeremy Grimshaw, Lauren E. Kelly, Leena Saeed, Lehana Thabane, Lisa Askie, Maureen Smith, Mufiza Farid‐Kapadia, Paula Williamson, Péter Szatmári, Peter Tugwell, Robert Golub, Suneeta Monga, Sunita Vohra, Susan Marlin, Wendy J. Ungar, Martin Offringa

Bibliographic record

VenueJAMA · 2022
Typereview
Languageen
FieldSocial Sciences
TopicDelphi Technique in Research
Canadian institutionsQueen's UniversityUniversity of AlbertaBruyèreRobarts Clinical TrialsMcMaster UniversityWomen's College HospitalImpactChildren's Hospital Research Institute of ManitobaCentre for Addiction and Mental HealthToronto Public HealthUniversity of ManitobaOttawa HospitalUniversity of OttawaInstitute for Clinical Evaluative SciencesUniversity of TorontoSickKids FoundationHospital for Sick Children
FundersMedical Research CouncilCanadian Institutes of Health Research
KeywordsConsolidated Standards of Reporting TrialsMedicineMEDLINEClinical trialFamily medicineSystematic reviewTransparency (behavior)Delphi methodMedical educationPathology

Abstract

fetched live from OpenAlex

Importance: Clinicians, patients, and policy makers rely on published results from clinical trials to help make evidence-informed decisions. To critically evaluate and use trial results, readers require complete and transparent information regarding what was planned, done, and found. Specific and harmonized guidance as to what outcome-specific information should be reported in publications of clinical trials is needed to reduce deficient reporting practices that obscure issues with outcome selection, assessment, and analysis. Objective: To develop harmonized, evidence- and consensus-based standards for reporting outcomes in clinical trial reports through integration with the Consolidated Standards of Reporting Trials (CONSORT) 2010 statement. Evidence Review: Using the Enhancing the Quality and Transparency of Health Research (EQUATOR) methodological framework, the CONSORT-Outcomes 2022 extension of the CONSORT 2010 statement was developed by (1) generation and evaluation of candidate outcome reporting items via consultation with experts and a scoping review of existing guidance for reporting trial outcomes (published within the 10 years prior to March 19, 2018) identified through expert solicitation, electronic database searches of MEDLINE and the Cochrane Methodology Register, gray literature searches, and reference list searches; (2) a 3-round international Delphi voting process (November 2018-February 2019) completed by 124 panelists from 22 countries to rate and identify additional items; and (3) an in-person consensus meeting (April 9-10, 2019) attended by 25 panelists to identify essential items for the reporting of outcomes in clinical trial reports. Findings: The scoping review and consultation with experts identified 128 recommendations relevant to reporting outcomes in trial reports, the majority (83%) of which were not included in the CONSORT 2010 statement. All recommendations were consolidated into 64 items for Delphi voting; after the Delphi survey process, 30 items met criteria for further evaluation at the consensus meeting and possible inclusion in the CONSORT-Outcomes 2022 extension. The discussions during and after the consensus meeting yielded 17 items that elaborate on the CONSORT 2010 statement checklist items and are related to completely defining and justifying the trial outcomes, including how and when they were assessed (CONSORT 2010 statement checklist item 6a), defining and justifying the target difference between treatment groups during sample size calculations (CONSORT 2010 statement checklist item 7a), describing the statistical methods used to compare groups for the primary and secondary outcomes (CONSORT 2010 statement checklist item 12a), and describing the prespecified analyses and any outcome analyses not prespecified (CONSORT 2010 statement checklist item 18). Conclusions and Relevance: This CONSORT-Outcomes 2022 extension of the CONSORT 2010 statement provides 17 outcome-specific items that should be addressed in all published clinical trial reports and may help increase trial utility, replicability, and transparency and may minimize the risk of selective nonreporting of trial results.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.539
metaresearch head score (Gemma)0.828
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Reporting · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Methods · Consensus signal: Methods
Teacher disagreement score0.461
Threshold uncertainty score0.569

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.5390.828
Meta-epidemiology (narrow)0.0060.008
Meta-epidemiology (broad)0.0120.018
Bibliometrics0.0370.052
Science and technology studies0.0070.016
Scholarly communication0.0330.017
Open science0.0170.014
Research integrity0.0270.037
Insufficient payload (model declined to judge)0.0260.042

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.709
GPT teacher head0.646
Teacher spread0.064 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designNot applicable
DomainReporting
GenreMethods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations707
Published2022
Admission routes2
Has abstractyes

Explore more

Same venueJAMASame topicDelphi Technique in ResearchFrench-language works237,207