MétaCan
Menu
Back to cohort
Record W3121098217 · doi:10.1186/s13012-020-01066-z

The reporting checklist for public versions of guidelines: RIGHT-PVG

2021· review· en· W3121098217 on OpenAlexaff
Xiaoqin Wang, Yaolong Chen, Elie A. Akl, Ružica Tokalić, Ana Marušić, Amir Qaseem, Yngve Falck–Ytter, Myeong Soo Lee, Madelin R. Siedler, Sarah Barber, Mingming Zhang, Edwin Chan, Janne Estill, Joey SW Kwong, Akiko Okumura, Qi Zhou, Kehu Yang, Susan L. Norris

Bibliographic record

VenueImplementation Science · 2021
Typereview
Languageen
FieldMedicine
TopicClinical practice guidelines implementation
Canadian institutionsMcMaster University
FundersNational Social Science Fund of ChinaKorea Institute of Oriental MedicineWorld Health Organization
KeywordsChecklistDelphi methodMedicineDelphiSample (material)Public healthMedical educationHealth informaticsQuality (philosophy)MEDLINEHealth administrationFamily medicineNursingPsychologyComputer sciencePolitical science

Abstract

fetched live from OpenAlex

BACKGROUND: Public or patient versions of guidelines (PVGs) are derivative documents that "translate" recommendations and their rationale from clinical guidelines for health professionals into a more easily understandable and usable format for patients and the public. PVGs from different groups and organizations vary considerably in terms of quality of their reporting. In order to address this issue, we aimed to develop a reporting checklist for developers of PVGs and other potential users. METHODS: First, we collected a list of potential items through reviewing a sample of PVGs, existing guidance for developing and reporting PVGs or other similar evidence-based patient tools, as well as qualitative studies on original studies of patients' needs about the content and/or reporting of information in PVGs or similar evidence-based patient tools. Second, we conducted a two-round Delphi consultation to determine the level of consensus on the items to be included in the final reporting checklist. Third, we invited two external reviewers to provide comments on the checklist. RESULTS: We generated the initial list of 45 reporting items based on a review of a sample of 30 PVGs, four PVG guidance documents, and 46 relevant studies. After the two-round Delphi consultation, we formed a checklist of 17 items grouped under 12 topics for reporting PVGs. CONCLUSION: The RIGHT-PVG reporting checklist provides an international consensus on the important criteria for reporting PVGs.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.406
metaresearch head score (Gemma)0.651
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Reporting · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Methods · Consensus signal: none
Teacher disagreement score0.594
Threshold uncertainty score0.732

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.4060.651
Meta-epidemiology (narrow)0.0030.003
Meta-epidemiology (broad)0.0040.008
Bibliometrics0.0190.012
Science and technology studies0.0040.005
Scholarly communication0.0070.011
Open science0.0080.011
Research integrity0.0080.010
Insufficient payload (model declined to judge)0.0160.009

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.784
GPT teacher head0.700
Teacher spread0.084 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designNot applicable
DomainReporting
GenreMethods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations59
Published2021
Admission routes1
Has abstractyes

Explore more

Same venueImplementation ScienceSame topicClinical practice guidelines implementationFrench-language works237,207