MétaCan
Menu
Back to cohort
Record W2918535037 · doi:10.1136/bmjopen-2018-022769

Reporting guidelines for health research: protocol for a cross-sectional analysis of the EQUATOR Network Library

2019· article· en· W2918535037 on OpenAlexaff
Ferrán Catalá-López, Adolfo Alonso‐Arroyo, Matthew J. Page, Brian Hutton, Manuel Ridao-López, Rafael Tabarés‐Seisdedos, Rafael Aleixandre‐Benavent, David Moher

Bibliographic record

VenueBMJ Open · 2019
Typearticle
Languageen
FieldDecision Sciences
TopicMeta-analysis and systematic reviews
Canadian institutionsUniversity of OttawaOttawa Hospital
FundersCentro de Investigación Biomédica en Red de Salud Mental
KeywordsChecklistMedicineTransparency (behavior)DocumentationProtocol (science)CitationMEDLINEQuality (philosophy)Medical educationAlternative medicineComputer scienceWorld Wide WebPsychologyPolitical science

Abstract

fetched live from OpenAlex

INTRODUCTION: Transparency and completeness of health research is highly variable, with important deficiencies in the reporting of methods and results of studies. Reporting guidelines aim to improve transparency and quality of research reports, and are often developed by consortia of journal editors, peer reviewers, authors, consumers and other key stakeholders. The objective of this study will be to investigate the characteristics of scientific collaboration among developers and the citation metrics of reporting guidelines of health research. METHODS AND ANALYSIS: This is the study protocol for a cross-sectional analysis of completed reporting guidelines indexed in the Enhancing the QUAlity and Transparency Of health Research Network Library. We will search PubMed/MEDLINE and the Web of Science. Screening, selection and data abstraction will be conducted by one researcher and verified by a second researcher. Potential discrepancies will be resolved via discussion. We will include published papers of reporting guidelines written in English. Published papers will have to meet the definition of a reporting guideline related to health research (eg, a checklist, flow diagram or explicit text), with no restrictions by study design, medical specialty, disease or condition. Raw data from each included paper (including title, publication year, journal, subject category, keywords, citations, and the authors' names, author's affiliated institution and country) will be exported from the Web of Science. Descriptive analyses will be conducted (including the number of papers, citations, authors, countries, journals, keywords and main collaboration metrics). We will identify the most prolific authors, institutions, countries, journals and the most cited papers. Network analyses will be carried out to study the structure of collaborations. ETHICS AND DISSEMINATION: No ethical approval will be required. Findings from this study will be published in peer-reviewed journals. All data will be deposited in a cross-disciplinary public repository. It is anticipated the study findings could be relevant to a variety of audiences.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.353
metaresearch head score (Gemma)0.385
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Reporting · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Protocol · Consensus signal: Protocol
Teacher disagreement score0.647
Threshold uncertainty score0.798

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.3530.385
Meta-epidemiology (narrow)0.0040.005
Meta-epidemiology (broad)0.0070.009
Bibliometrics0.0160.018
Science and technology studies0.0070.006
Scholarly communication0.0080.009
Open science0.0050.006
Research integrity0.0070.008
Insufficient payload (model declined to judge)0.0780.032

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.985
GPT teacher head0.785
Teacher spread0.200 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designObservational
DomainReporting
GenreProtocol

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations18
Published2019
Admission routes1
Has abstractyes

Explore more

Same venueBMJ OpenSame topicMeta-analysis and systematic reviewsFrench-language works237,207