MétaCan
Menu
Back to cohort
Record W2134083686 · doi:10.1186/2046-4053-1-24

Does journal endorsement of reporting guidelines influence the completeness of reporting of health research? A systematic review protocol

2012· review· en· W2134083686 on OpenAlexafffund
Larissa Shamseer, Adrienne Stevens, Becky Skidmore, Lucy Turner, Douglas G. Altman, Allison Hirst, John Hoey, Anita Palepu, Iveta Simera, Kenneth F. Schulz, David Moher

Bibliographic record

VenueSystematic Reviews · 2012
Typereview
Languageen
FieldDecision Sciences
TopicMeta-analysis and systematic reviews
Canadian institutionsSt. Paul's HospitalQueen's UniversityOttawa Hospital
FundersMedical Research CouncilCancer Research UKCanadian Institutes of Health ResearchUniversity of Ottawa
KeywordsMedicineProtocol (science)Data extractionSystematic reviewMEDLINETransparency (behavior)Health careResearch designCochrane LibraryScopusMedical educationFamily medicineAlternative medicineComputer science

Abstract

fetched live from OpenAlex

BACKGROUND: Reporting of health research is often inadequate and incomplete. Complete and transparent reporting is imperative to enable readers to assess the validity of research findings for use in healthcare and policy decision-making. To this end, many guidelines, aimed at improving the quality of health research reports, have been developed for reporting a variety of research types. Despite efforts, many reporting guidelines are underused. In order to increase their uptake, evidence of their effectiveness is important and will provide authors, peer reviewers and editors with an important resource for use and implementation of pertinent guidance. The objective of this study was to assess whether endorsement of reporting guidelines by journals influences the completeness of reporting of health studies. METHODS: Guidelines providing a minimum set of items to guide authors in reporting a specific type of research, developed with explicit methodology, and using a consensus process will be identified from an earlier systematic review and from the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network's reporting guidelines library. MEDLINE, EMBASE, the Cochrane Methodology Register and Scopus will be searched for evaluations of those reporting guidelines; relevant evaluations from the recently conducted CONSORT systematic review will also be included. Single data extraction with 10% verification of study characteristics, 20% of outcomes and complete verification of aspects of study validity will be carried out. We will include evaluations of reporting guidelines that assess the completeness of reporting: (1) before and after journal endorsement, and/or (2) between endorsing and non-endorsing journals. For a given guideline, analyses will be conducted for individual and the total sum of items. When possible, standard, pooled effects with 99% confidence intervals using random effects models will be calculated. DISCUSSION: Evidence on which guidelines have been evaluated and which are associated with improved completeness of reporting is important for various stakeholders, including editors who consider which guidelines to endorse in their journal editorial policies.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.926
metaresearch head score (Gemma)0.864
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Meta-epidemiology (narrow), Meta-epidemiology (broad), Open science
Consensus categoriesMetaresearch, Meta-epidemiology (narrow), Meta-epidemiology (broad)
DomainCandidate signal: Reporting · Consensus signal: Reporting
Study designCandidate signal: Systematic review · Consensus signal: Systematic review
GenreCandidate signal: Review · Consensus signal: Review
Teacher disagreement score0.315
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.9260.864
Meta-epidemiology (narrow)0.0020.000
Meta-epidemiology (broad)0.1280.020
Bibliometrics0.0020.007
Science and technology studies0.0010.000
Scholarly communication0.0010.000
Open science0.0090.001
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.953
GPT teacher head0.705
Teacher spread0.248 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; both teacher heads agree on what is shown here.

Study designSystematic review
DomainReporting
GenreReview

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations29
Published2012
Admission routes2
Has abstractyes

Explore more

Same venueSystematic ReviewsSame topicMeta-analysis and systematic reviewsFrench-language works237,207