MétaCan
Menu
Back to cohort
Record W4367315111 · doi:10.1186/s40900-023-00433-6

Key issues for stakeholder engagement in the development of health and healthcare guidelines

2023· article· en· W4367315111 on OpenAlexaff
Jennifer Petkovic, Olivia Magwood, Lyubov Lytvyn, Joanne Khabsa, Thomas W. Concannon, Vivian Welch, Alex Todhunter‐Brown, Marisha E. Palm, Elie A. Akl, Lawrence Mbuagbaw, Thurayya Arayssi, Marc T. Avey, Ana Marušić, Richard Morley, Michael Saginur, Nevilene Slingers, Ligia Texeira, Asma Ben Brahem, Soumyadeep Bhaumik, Imad Bou Akl, Sally Crowe, Laura Dormer, Chinyere E. Ekanem, Eddy Lang, Behrang Kianzad, Tanja Kuchenmüller, Lorenzo Moja, Kevin Pottie, Holger J. Schünemann, Peter Tugwell

Bibliographic record

VenueResearch Involvement and Engagement · 2023
Typearticle
Languageen
FieldMedicine
TopicClinical practice guidelines implementation
Canadian institutionsWestern UniversityBruyèreCanadian Council on Animal CareOttawa HospitalMontfort HospitalMcMaster University Medical CentreSt. Joseph’s Healthcare HamiltonUniversity of CalgaryImpactAlberta Health ServicesMcMaster UniversityUniversity of Ottawa
Fundersnot available
KeywordsStakeholder engagementKey (lock)Health careStakeholderProcess managementBusinessPublic relationsPolitical scienceComputer science

Abstract

fetched live from OpenAlex

Established in 2015, the Multi-Stakeholder Engagement (MuSE) Consortium is an international network of over 120 individuals interested in stakeholder engagement in research and guidelines. The MuSE group is developing guidance for stakeholder engagement in the development of health and healthcare guideline development. The development of this guidance has included multiple meetings with stakeholders, including patients, payers/purchasers of health services, peer review editors, policymakers, program managers, providers, principal investigators, product makers, the public, and purchasers of health services and has identified a number of key issues. These include: (1) Definitions, roles, and settings (2) Stakeholder identification and selection (3) Levels of engagement, (4) Evaluation of engagement, (5) Documentation and transparency, and (6) Conflict of interest management. In this paper, we discuss these issues and our plan to develop guidance to facilitate stakeholder engagement in all stages of the development of health and healthcare guideline development.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.643
metaresearch head score (Gemma)0.656
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.643
Threshold uncertainty score0.441

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.6430.656
Meta-epidemiology (narrow)0.0020.003
Meta-epidemiology (broad)0.0030.003
Bibliometrics0.0050.005
Science and technology studies0.0240.054
Scholarly communication0.0400.050
Open science0.0100.037
Research integrity0.0360.053
Insufficient payload (model declined to judge)0.0090.002

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.906
GPT teacher head0.646
Teacher spread0.259 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designQualitative
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations61
Published2023
Admission routes1
Has abstractyes

Explore more

Same venueResearch Involvement and EngagementSame topicClinical practice guidelines implementationFrench-language works237,207