Towards high-quality, useful practice guidelines for child and youth mental health disorders: protocol for a systematic review and consensus exercise
Bibliographic record
Abstract
INTRODUCTION: The quality of clinical practice guidelines (PGs) has not been evaluated in child and youth mental health (CYMH). To address this gap, we will: (1) conduct a systematic review (SR) to answer the question 'among eligible PGs relevant to the prevention or treatment of CYMH conditions, which PGs meet criteria for minimum and high quality?'; (2) apply nominal group methods to create recommendations for how CYMH PG quality, completeness and usefulness can be strengthened. METHODS AND ANALYSIS: SR: Potentially eligible PGs will be identified in 12 databases using a reproducible search strategy developed by a research librarian. Trained raters will: (1) apply prespecified criteria to identify eligible PGs relevant to depression, anxiety, suicidality, bipolar disorder, behaviour disorder (attention-deficit hyperactivity disorder, oppositional defiant disorder, conduct disorder) and substance use disorder; (2) extract descriptive data and (3) assess PG quality using the Appraisal of Guidelines for Research and Evaluation (AGREE II) tool. Scores on three AGREE II domains (rigour of development, stakeholder involvement, editorial independence) will designate PGs as minimum (≥50%) or high quality (≥70%). Nominal group: Four CYMH PG knowledge user groups (clinicians, mental health service planners, youth and adult family members) will participate in structured exercises derived using nominal group methods to generate recommendations to improve PG quality, completeness and usefulness. ETHICS AND DISSEMINATION: Ethics approval is not required. Study products will be disseminated as follows. A cross-platform website will house eligible CYMH PGs and their quality ratings. Twitter and Facebook tools will promote it to a wide variety of PG users. Data from Google Analytics, Twitonomy and Altmetrics will inform usage evaluation. Complementary educational workshops will be conducted for CYMH professionals. Print materials and journal articles will be produced. PROSPERO REGISTRATION NUMBER: CRD42017060738.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.020 | 0.082 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.006 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.001 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".