MétaCan
Menu
Back to cohort
Record W6958854659 · doi:10.6084/m9.figshare.c.5265727

The reporting checklist for public versions of guidelines: RIGHT-PVG

2021· other· en· W6958854659 on OpenAlexaff

Bibliographic record

VenueFigshare · 2021
Typeother
Languageen
FieldAgricultural and Biological Sciences
TopicSoybean genetics and cultivation
Canadian institutionsMcMaster University
Fundersnot available
KeywordsChecklistDelphi methodSample (material)DelphiQuality (philosophy)MEDLINEDocumentationMandatory reporting

Abstract

fetched live from OpenAlex

Abstract Background Public or patient versions of guidelines (PVGs) are derivative documents that “translate” recommendations and their rationale from clinical guidelines for health professionals into a more easily understandable and usable format for patients and the public. PVGs from different groups and organizations vary considerably in terms of quality of their reporting. In order to address this issue, we aimed to develop a reporting checklist for developers of PVGs and other potential users. Methods First, we collected a list of potential items through reviewing a sample of PVGs, existing guidance for developing and reporting PVGs or other similar evidence-based patient tools, as well as qualitative studies on original studies of patients’ needs about the content and/or reporting of information in PVGs or similar evidence-based patient tools. Second, we conducted a two-round Delphi consultation to determine the level of consensus on the items to be included in the final reporting checklist. Third, we invited two external reviewers to provide comments on the checklist. Results We generated the initial list of 45 reporting items based on a review of a sample of 30 PVGs, four PVG guidance documents, and 46 relevant studies. After the two-round Delphi consultation, we formed a checklist of 17 items grouped under 12 topics for reporting PVGs. Conclusion The RIGHT-PVG reporting checklist provides an international consensus on the important criteria for reporting PVGs.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.335
metaresearch head score (Gemma)0.633
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Reporting · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Methods · Consensus signal: Methods
Teacher disagreement score0.665
Threshold uncertainty score0.820

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.3350.633
Meta-epidemiology (narrow)0.0030.003
Meta-epidemiology (broad)0.0030.005
Bibliometrics0.0150.008
Science and technology studies0.0040.004
Scholarly communication0.0070.011
Open science0.0070.011
Research integrity0.0070.008
Insufficient payload (model declined to judge)0.0260.015

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.176
GPT teacher head0.313
Teacher spread0.137 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designNot applicable
DomainReporting
GenreMethods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2021
Admission routes1
Has abstractyes

Explore more

Same venueFigshareSame topicSoybean genetics and cultivationFrench-language works237,207