MétaCan
Menu
Back to cohort
Record W4392370751 · doi:10.2196/57238

Designing, Developing, and Testing a Chatbot for Parents and Caregivers of Children and Young People With Rheumatological Conditions (the IMPACT Study): Protocol for a Co-Designed Proof-of-Concept Study

2024· article· en· W4392370751 on OpenAlexaffvenue
Polly Livermore, Klaudia Kupiec, Lucy R. Wedderburn, Andrea Knight, Ameenat Lola Solebo, Roz Shafran, Glenn Robert, Neil J. Sebire, Faith Gibson

Bibliographic record

VenueJMIR Research Protocols · 2024
Typearticle
Languageen
FieldPsychology
TopicDigital Mental Health Interventions
Canadian institutionsHospital for Sick ChildrenUniversity of Toronto
FundersMedical Research CouncilVersus Arthritis
KeywordsMedicineChatbotIntervention (counseling)Protocol (science)Test (biology)Focus groupHealth careNursingFamily medicineAlternative medicineWorld Wide Web

Abstract

fetched live from OpenAlex

BACKGROUND: Pediatric rheumatology is a term that encompasses over 80 conditions affecting different organs and systems. Children and young people with rheumatological chronic conditions are known to have high levels of mental health problems and therefore are at risk of poor health outcomes. Clinical psychologists can help children and young people manage the daily difficulties of living with one of these conditions; however, there are insufficient pediatric psychologists in the United Kingdom. We urgently need to consider other ways of providing early, essential support to improve their current well-being. One way of doing this is to empower parents and caregivers to have more of the answers that their children and young people need to support them further between their hospital appointments. OBJECTIVE: The objective of this co-designed proof-of-concept study is to design, develop, and test a chatbot intervention to support parents and caregivers of children and young people with rheumatological conditions. METHODS: This study will explore the needs and views of children and young people with rheumatological conditions, their siblings, parents, and caregivers, as well as health care professionals working in pediatric rheumatology. We will ask approximately 100 participants in focus groups where they think the gaps are in current clinical care and what ideas they have for improving upon them. Creative experience-based co-design workshops will then decide upon top priorities to develop further while informing the appearance, functionality, and practical delivery of a chatbot intervention. Upon completion of a minimum viable product, approximately 100 parents and caregivers will user-test the chatbot intervention in an iterative sprint methodology to determine its worth as a mechanism for support for parents. RESULTS: A total of 73 children, young people, parents, caregivers, and health care professionals have so far been enrolled in the study, which began in November 2023. The anticipated completion date of the study is April 2026. The data analysis is expected to be completed in January 2026, with the results being published in April 2026. CONCLUSIONS: This study will provide evidence on the accessibility, acceptability, and usability of a chatbot intervention for parents and caregivers of children and young people with rheumatological conditions. If proven useful, it could lead to a future efficacy trial of one of the first chatbot interventions to provide targeted and user-suggested support for parents and caregivers of children with chronic health conditions in health care services. This study is unique in that it will detail the needs and wants of children, young people, siblings, parents, and caregivers to improve the current support given to families living with pediatric rheumatological conditions. It will be conducted across the whole of the United Kingdom for all pediatric rheumatological conditions at all stages of the disease trajectory. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/57238.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.055
metaresearch head score (Gemma)0.066
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Protocol · Consensus signal: Protocol
Teacher disagreement score0.055
Threshold uncertainty score0.291

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0550.066
Meta-epidemiology (narrow)0.0030.003
Meta-epidemiology (broad)0.0030.003
Bibliometrics0.0020.001
Science and technology studies0.0040.004
Scholarly communication0.0030.003
Open science0.0040.004
Research integrity0.0060.006
Insufficient payload (model declined to judge)0.0350.007

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.273
GPT teacher head0.592
Teacher spread0.319 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreProtocol

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations8
Published2024
Admission routes2
Has abstractyes

Explore more

Same venueJMIR Research ProtocolsSame topicDigital Mental Health InterventionsFrench-language works237,207