Best Practices Guidelines for the Engagement of People With Lived Experience and Family Members in Mental Health and Substance Use Health Research: A Modified Delphi Consensus Study
Bibliographic record
Abstract
INTRODUCTION: People with lived experience of mental health and/or substance use conditions and their families (PWLE) are increasingly engaged in research, yet rigorous guidelines for engagement are lacking. This study aims to co-design best practice guidelines to support the authentic, meaningful engagement of PWLE in mental health and/or substance use health research. METHODS: A multi-panel modified Delphi study was conducted with 61 expert panelists (35 PWLE and family members, 26 researchers/research support staff from across Canada). Participants rated 56 recommendations for importance and clarity. Consensus was defined as ≥ 70% of participants rating items at 6 or 7 on a 7-point Likert scale ('very important' or 'essential'). Qualitative feedback was analysed using content analysis to identify new items and reviewed for improvements in item clarity. After each round, items not meeting the established threshold of importance were removed. Items with low clarity scores were reworded. A PWLE advisory panel was actively involved throughout the study's design, implementation, interpretation, and reporting, ensuring that the perspectives of people with lived experience were integrated throughout the research process. RESULTS: Three Delphi Rounds were conducted. In Round 1, importance ratings ranged from 51.7% to 96.7% of participants ranking the items above the established threshold (average 80.1%), with clarity ratings ranging from 39.3% to 86.9% (average 70.7%) and an average importance coefficient of variation (CV) of 0.16. Four items were deleted, two new items were added and fifty-five items were revised. In Round 2, 60 (98.4%) participants responded. Importance ratings ranged from 57.6% to 96.7% (average 80.2%; average CV = 0.20). Clarity ratings ranged from 50.9% to 93.2% (average 77.9%). Five items were deleted and eleven revised. In Round 3, 60 (98.4%) participants provided importance ratings ranging from 66.7% to 98.3% (average 80.8%; average CV = 0.20), and clarity ratings ranging from 63.3% to 94.9% (average 81.1%). Three items were deleted and nine were revised. Forty-four final best practices are proposed. CONCLUSION: These co-developed best practice guidelines offer recommendations for meaningful PWLE engagement in mental health and/or substance use health research. By following these guidelines, research teams can ensure that PWLE contributions are genuinely valued and effectively integrated, ultimately enhancing the quality and impact of the research and fostering authentic collaboration. PATIENT AND PUBLIC INVOLVEMENT: People with lived experience were engaged throughout the project as key team members, from a patient-oriented research perspective. They are also co-authors on this manuscript.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.004 | 0.001 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.004 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".