MétaCan
Menu
Back to cohort
Record W4390860703 · doi:10.2196/49110

Co-Production of a Flexibly Delivered Relapse Prevention Tool to Support the Self-Management of Long-Term Mental Health Conditions: Co-Design and User Testing Study

2024· article· en· W4390860703 on OpenAlexvenueno aff
Alyssa Milton, Ingrid Ozols, T. A. Cassidy, Dana Jordan, Ellie Brown, Urška Arnautovska, Jim Cook, D.L. Phung, Brynmor Lloyd‐Evans, Sonia Johnson, Ian B. Hickie

Bibliographic record

VenueJMIR Formative Research · 2024
Typearticle
Languageen
FieldHealth Professions
TopicMental Health and Patient Involvement
Canadian institutionsnot available
FundersOne Door Mental HealthUniversity College LondonNational Institute for Health and Care Research
KeywordsMental healthUsabilityThematic analysisPsychological interventionApplied psychologySelf-managementParticipatory designPeer supportSystem usability scalePsychologyKnowledge managementQualitative researchEngineeringNursingComputer scienceMedicineHuman–computer interactionHeuristic evaluationOperations management

Abstract

fetched live from OpenAlex

BACKGROUND: Supported self-management interventions, which assist individuals in actively understanding and managing their own health conditions, have a robust evidence base for chronic physical illnesses, such as diabetes, but have been underused for long-term mental health conditions. OBJECTIVE: This study aims to co-design and user test a mental health supported self-management intervention, My Personal Recovery Plan (MyPREP), that could be flexibly delivered via digital and traditional paper-based mediums. METHODS: This study adopted a participatory design, user testing, and rapid prototyping methodologies, guided by 2 frameworks: the 2021 Medical Research Council framework for complex interventions and an Australian co-production framework. Participants were aged ≥18 years, self-identified as having a lived experience of using mental health services or working in a peer support role, and possessed English proficiency. The co-design and user testing processes involved a first round with 6 participants, focusing on adapting a self-management resource used in a large-scale randomized controlled trial in the United Kingdom, followed by a second round with 4 new participants for user testing the co-designed digital version. A final round for gathering qualitative feedback from 6 peer support workers was conducted. Data analysis involved transcription, coding, and thematic interpretation as well as the calculation of usability scores using the System Usability Scale. RESULTS: The key themes identified during the co-design and user testing sessions were related to (1) the need for self-management tools to be flexible and well-integrated into mental health services, (2) the importance of language and how language preferences vary among individuals, (3) the need for self-management interventions to have the option of being supported when delivered in services, and (4) the potential of digitization to allow for a greater customization of self-management tools and the development of features based on individuals' unique preferences and needs. The MyPREP paper version received a total usability score of 71, indicating C+ or good usability, whereas the digital version received a total usability score of 85.63, indicating A or excellent usability. CONCLUSIONS: There are international calls for mental health services to promote a culture of self-management, with supported self-management interventions being routinely offered. The resulting co-designed prototype of the Australian version of the self-management intervention MyPREP provides an avenue for supporting self-management in practice in a flexible manner. Involving end users, such as consumers and peer workers, from the beginning is vital to address their need for personalized and customized interventions and their choice in how interventions are delivered. Further implementation-effectiveness piloting of MyPREP in real-world mental health service settings is a critical next step.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Direct model labels (unvalidated)

Per-model category and study-design labels from the labeling rounds. They are machine output, unvalidated, and the disagreement between models ships as data. No study design here is MEDLINE-validated yet.

Model armCategoriesStudy designConfidence
gemmano category
Domain: not available · Genre: Empirical
About the Canadian research system: no · About a Canadian topic: no
Qualitativehigh
gptno category
Domain: not available · Genre: Empirical
About the Canadian research system: no · About a Canadian topic: no
Qualitativehigh
models agreeAgreement compares identical category sets and study designs across arms.

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.032
metaresearch head score (Gemma)0.068
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.032
Threshold uncertainty score0.171

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0320.068
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.002
Bibliometrics0.0020.001
Science and technology studies0.0010.002
Scholarly communication0.0020.002
Open science0.0020.003
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0030.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.332
GPT teacher head0.557
Teacher spread0.225 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Labeled directly by 2 models reading the full record.

The models applied no category: nothing in the taxonomy fit this work.
Study designQualitative
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations11
Published2024
Admission routes1
Has abstractyes

Explore more

Same venueJMIR Formative ResearchSame topicMental Health and Patient InvolvementFrench-language works237,207