Guidance for engagement in health guideline development: A scoping review
Bibliographic record
Abstract
Background: Health guideline developers engage with interested people and groups to ensure that guidelines and their recommendations are relevant and useful to those who will be affected by them. These 'interest-holders' include patients, payers/purchasers of health services, payers of health research, peer review editors, product makers, programme managers, policymakers, providers, principal investigators, and the public. The Guidelines International Network (GIN) and McMaster University Guideline Development Checklist describes 146 steps of the guideline process organized into 18 topics. While one topic focuses on engagement, it does not describe how to engage with interest-holders. In addition, interest-holder input could be sought throughout the guideline development process. This scoping review is part of a series of four related reviews. The three other reviews address barriers and facilitators to engagement in guideline development, managing conflicts of interest in guideline development, and assessing the impact of interest-holder engagement on guideline development. The four reviews will inform the development of guidance for multi-interest-holder engagement in guideline development; the GIN-McMaster Guideline Development Checklist Extension for Engagement. Objectives: The objective of this scoping review is to identify, describe, and summarise existing guidance and methods for multi-interest-holder engagement throughout the health guideline development process. Search Methods: We conducted one comprehensive search for studies of engagement in guidelines to meet the inclusion criteria of one or more of the four systematic reviews in this series. We searched MEDLINE (OVID), CINAHL (EBSCO), EMBASE (OVID), PsycInfo (OVID) and SCOPUS databases up to September 2022. We did not include limits for date, study design, or language. We searched websites of agencies and organizations that engage interest-holder groups, such as the Agency for Healthcare Research and Quality (AHRQ), CIHR Strategy for Patient-Oriented Research (SPOR), National Institute for Health and Care Research (NIHR) Be Part of Research, Guidelines International Network (G-I-N), the National Institute for Health and Care Excellence, and the PatientCentred Outcomes Research Institute (PCORI). We handsearched the websites of guideline producing agencies. We solicited additional grey literature from the members of the MuSE Consortium. Selection Criteria: Studies were included in this review if they reported on engagement of any of our identified groups, patients, payers/funders of research, payers/purchasers of health services, policymakers, programme managers, providers, principal investigators/researchers, peer review editors, product makers in the development of a health guideline. Titles and abstracts of identified citations were screened independently, in duplicate. The full text of potentially relevant papers were screened for eligibility into one or more of the four reviews in the series. Screening was done independently, by two reviewers. The team held weekly meetings with all reviewers involved in screening to discuss and resolve conflicts. Data Collection and Analysis: Two reviewers extracted relevant data into a pilot-tested data extraction form using Excel. We used the GIN-McMaster guideline development checklist as a framework for extracting the available guidance for each of our identified interest-holder groups throughout the development process. We presented descriptive statistics of the number of papers reporting guidance for each groups across the steps of the guideline process. We synthesized the relevant text using a qualitative meta-summary approach. Main Results: We included 16 papers (from 17 reports). These papers were from Australia, Denmark, the Netherlands, the UK, and the USA, and eight papers were international (countries not specified). The papers provided guidance for at least one of our interest-holder groups for at least one stage of guideline development. We mapped this guidance to the GIN-McMaster Guideline Development Checklist to identify the available guidance for each of our interest-holder groups across all stages of the guideline development process. Guidance was available for patient engagement in 15 of the 16 papers. At least two papers provided guidance for each of the 18 topics of the GIN-McMaster Guideline Development Checklist. For healthcare providers, 9 papers provided guidance for their engagement across 10 of the 18 guideline development topics. Guidance for engaging with the public was provided for 14 of the 18 topics and reported in 4 of our included papers. For payers/purchasers of health services, policymakers, product makers, programme managers, and principal investigators, 2-3 papers provided guidance for these groups across 4-7 topics of the GIN-McMaster checklist. We did not identify any specific guidance for payers of health research or for editors of peer-reviewed journals. Authors' Conclusions: Guidance for interst-holder engagement in guidelines is available but has focused primarily on patients. We will utilize the guidance identified in this scoping review to inform the GIN-McMaster Guideline Development Checklist Extension for engagement. Combined with the information obtained from the other systematic reviews in this series, we will address the gaps in guidance for the other identified interest-holder groups.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.063 | 0.045 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.015 | 0.002 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.002 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; both teacher heads agree on what is shown here.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".