MétaCan
Menu
Back to cohort
Record W2894006377 · doi:10.2147/jmdh.s155103

Does the medical literature remain inadequately described despite having reporting guidelines for 21 years? – A systematic review of reviews: an update

2018· review· en· W2894006377 on OpenAlexaff
Yanling Jin, Nitika Sanger, Ieta Shams, Candice Luo, Hamnah Shahid, Guowei Li, Meha Bhatt, Laura Zielinski, Bianca Bantoto, Mei Wang, Luciana Patrícia Fernandes Abbade, Ikunna Nwosu, Alvin Leenus, Lawrence Mbuagbaw, Muhammad Maaz, Yaping Chang, Guangwen Sun, Mitchell Levine, Jonathan D. Adachi, Lehana Thabane, Zainab Samaan

Bibliographic record

VenueJournal of Multidisciplinary Healthcare · 2018
Typereview
Languageen
FieldVeterinary
TopicAnimal testing and alternatives
Canadian institutionsSt. Joseph’s Healthcare HamiltonHamilton Health SciencesMcMaster UniversityImpact
Fundersnot available
KeywordsObservational studyStrengthening the reporting of observational studies in epidemiologyConsolidated Standards of Reporting TrialsSystematic reviewCINAHLMedicineMEDLINEAlternative medicineFamily medicineMeta-analysisPsychological interventionPathologyNursing

Abstract

fetched live from OpenAlex

PURPOSE: Reporting guidelines (eg, Consolidated Standards of Reporting Trials [CONSORT] statement) are intended to improve reporting standards and enhance the transparency and reproducibility of research findings. Despite accessibility of such guidelines, researchers are not required to adhere to them. Our goal was to determine the current status of reporting quality in the medical literature and examine whether adherence of reporting guidelines has improved since the inception of reporting guidelines. MATERIALS AND METHODS: Eight reporting guidelines, such as CONSORT, Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), STrengthening the Reporting of OBservational studies in Epidemiology (STROBE), Quality of Reporting of Meta-analysis (QUOROM), STAndards for Reporting of Diagnostic accuracy (STARD), Animal Research: Reporting In Vivo Experiments (ARRIVE), Consolidated Health Economic Evaluation Reporting Standards (CHEERS), and Meta-analysis of Observational Studies in Epidemiology (MOOSE) were examined. Our inclusion criteria included reviews published between January 1996 to September 2016 which investigated the adherence to reporting guidelines in the literature that addressed clinical trials, systematic reviews, observational studies, meta-analysis, diagnostic accuracy, economic evaluations, and preclinical animal studies that were in English. All reviews were found on Web of Science, Excerpta Medical Database (EMBASE), MEDLINE, and Cumulative Index to Nursing and Allied Health Literature (CINAHL). RESULTS: Among the general searching of 26,819 studies by using the designed searching method, 124 studies were included post screening. We found that 87.9% of the included studies reported suboptimal adherence to reporting guidelines. Factors associated with poor adherence included non-pharmacological interventions, year of publication, and trials concluding with significant results. Improved adherence was associated with better study designs such as allocation concealment, random sequence, large sample sizes, adequately powered studies, multiple authorships, and being published in journals endorsing guidelines. CONCLUSION: We conclude that the level of adherence to reporting guidelines remains suboptimal. Endorsement of reporting guidelines by journals is important and recommended.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.304
metaresearch head score (Gemma)0.655
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Reporting · Consensus signal: none
Study designCandidate signal: Systematic review · Consensus signal: Systematic review
GenreCandidate signal: Review · Consensus signal: Review
Teacher disagreement score0.696
Threshold uncertainty score0.858

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.3040.655
Meta-epidemiology (narrow)0.0020.005
Meta-epidemiology (broad)0.0100.009
Bibliometrics0.0460.044
Science and technology studies0.0030.007
Scholarly communication0.0150.022
Open science0.0060.007
Research integrity0.0090.005
Insufficient payload (model declined to judge)0.0040.002

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.525
GPT teacher head0.573
Teacher spread0.049 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designSystematic review
DomainReporting
GenreReview

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations146
Published2018
Admission routes1
Has abstractyes

Explore more

Same venueJournal of Multidisciplinary HealthcareSame topicAnimal testing and alternativesFrench-language works237,207