MétaCan
Menu
Back to cohort
Record W3192688210 · doi:10.1136/bmjopen-2020-048218

Comparing the reporting and conduct quality of exercise and pharmacological randomised controlled trials: a systematic review

2021· review· en· W3192688210 on OpenAlexaff
Scott C. Adams, Julia McMillan, Kirsten Salline, Jessica A. Lavery, Chaya S. Moskowitz, Konstantina Matsoukas, Maggie M. Z. Chen, Daniel Santa Mina, Jessica M. Scott, Lee W. Jones

Bibliographic record

VenueBMJ Open · 2021
Typereview
Languageen
FieldDecision Sciences
TopicMeta-analysis and systematic reviews
Canadian institutionsTed Rogers Centre for Heart ResearchToronto General HospitalUniversity of Toronto
FundersNational Cancer InstituteGuts UK CharityMemorial Sloan-Kettering Cancer Center
KeywordsMedicineRandomized controlled trialConsolidated Standards of Reporting TrialsJadad scalePhysical therapySample size determinationMEDLINEBlindingClinical trialCINAHLInternal medicinePsychological interventionCochrane Library

Abstract

fetched live from OpenAlex

OBJECTIVE: Evaluate the quality of exercise randomised controlled trial (RCT) reporting and conduct in clinical populations (ie, adults with or at risk of chronic conditions) and compare with matched pharmacological RCTs. DESIGN: Systematic review. DATA SOURCES: Embase (Elsevier), PubMed (NLM) and CINAHL (EBSCO). STUDY SELECTION: RCTs of exercise in clinical populations with matching pharmacological RCTs published in leading clinical, medical and specialist journals with impact factors ≥15. REVIEW METHODS: Overall RCT quality was evaluated by two independent reviewers using three research reporting guidelines (ie, Consolidated Standards of Reporting Trials (CONSORT; pharmacological RCTs)/CONSORT for non-pharmacological treatments; exercise RCTs), CONSORT-Harms, Template for Intervention Description and Replication) and two risk of bias assessment (research conduct) tools (ie, Cochrane Risk of Bias, Jadad Scale). We compared research reporting and conduct quality within exercise RCTs with matched pharmacological RCTs, and examined factors associated with quality in exercise and pharmacological RCTs, separately. FINDINGS: Forty-eight exercise RCTs (11 658 patients; median sample n=138) and 48 matched pharmacological RCTs were evaluated (18 501 patients; median sample n=160). RCTs were conducted primarily in cardiovascular medicine (43%) or oncology (31%). Overall quality score (composite of all research reporting and conduct quality scores; primary endpoint) for exercise RCTs was 58% (median score 46 of 80; IQR: 39-51) compared with 77% (53 of 68; IQR: 47-58) in the matched pharmacological RCTs (p≤0.001). Individual quality scores for trial reporting and conduct were lower in exercise RCTs compared with matched pharmacological RCTs (p≤0.03). Factors associated with higher overall quality scores for exercise RCTs were journal impact factor (≥25), sample size (≥152) and publication year (≥2013). CONCLUSIONS AND RELEVANCE: Research reporting and conduct quality within exercise RCTs is inferior to matched pharmacological RCTs. Suboptimal RCT reporting and conduct impact the fidelity, interpretation, and reproducibility of exercise trials and, ultimately, implementation of exercise in clinical populations. PROSPERO REGISTRATION NUMBER: CRD42018095033.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.330
metaresearch head score (Gemma)0.728
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Meta-epidemiology (broad)
Consensus categoriesMetaresearch
DomainCandidate signal: Reporting · Consensus signal: none
Study designCandidate signal: Systematic review · Consensus signal: Systematic review
GenreCandidate signal: Review · Consensus signal: Review
Teacher disagreement score0.982
Threshold uncertainty score0.826

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.3300.728
Meta-epidemiology (narrow)0.0020.004
Meta-epidemiology (broad)0.0180.016
Bibliometrics0.0190.018
Science and technology studies0.0020.005
Scholarly communication0.0090.010
Open science0.0050.004
Research integrity0.0050.003
Insufficient payload (model declined to judge)0.0030.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.971
GPT teacher head0.729
Teacher spread0.243 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designSystematic review
DomainReporting
GenreReview

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations23
Published2021
Admission routes1
Has abstractyes

Explore more

Same venueBMJ OpenSame topicMeta-analysis and systematic reviewsFrench-language works237,207