Analyzing User Engagement Within a Patient-Reported Outcomes Texting Tool for Diabetes Management: Engagement Phenotype Study
Bibliographic record
Abstract
BACKGROUND: Patient-reported outcomes (PROs) capture patients' views on their health conditions and its management, and are increasingly used in clinical trials, including those targeting type 2 diabetes (T2D). Mobile health (mHealth) tools offer novel solutions for collecting PRO data in real time. Although patients are at the center of any PRO-based intervention, few studies have examined user engagement with PRO mHealth tools. OBJECTIVE: This study aimed to evaluate user engagement with a PRO mHealth tool for T2D management, identify patterns of user engagement and similarities and differences between the patients, and identify the characteristics of patients who are likely to drop out or be less engaged with a PRO mHealth tool. METHODS: We extracted user engagement data from an ongoing clinical trial that tested the efficacy of a PRO mHealth tool designed to improve hemoglobin A1c levels in patients with uncontrolled T2D. To date, 61 patients have been randomized to the intervention, where they are sent 6 PRO text messages a day that are relevant to T2D self-management (healthy eating and medication adherence) over the 12-month study. To analyze user engagement, we first compared the response rate (RR) and response time between patients who completed the 12-month intervention and those who dropped out early (noncompleters). Next, we leveraged latent class trajectory modeling to classify patients from the completer group into 3 subgroups based on similarity in the longitudinal engagement data. Finally, we investigated the differences between the subgroups of completers from various cross-sections (time of the day and day of the week) and PRO types. We also explored the patient demographics and their distribution among the subgroups. RESULTS: Overall, 19 noncompleters had a lower RR to PRO questions and took longer to respond to PRO questions than 42 completers. Among completers, the longitudinal RRs demonstrated differences in engagement patterns over time. The completers with the lowest engagement showed peak engagement during month 5, almost at the midstage of the program. The remaining subgroups showed peak engagement at the beginning of the intervention, followed by either a steady decline or sustained high engagement. Comparisons of the demographic characteristics showed significant differences between the high engaged and low engaged subgroups. The high engaged completers were predominantly older, of Hispanic descent, bilingual, and had a graduate degree. In comparison, the low engaged subgroup was composed mostly of African American patients who reported the lowest annual income, with one of every 3 patients earning less than US $20,000 annually. CONCLUSIONS: There are discernible engagement phenotypes based on individual PRO responses, and their patterns vary in the timing of peak engagement and demographics. Future studies could use these findings to predict engagement categories and tailor interventions to promote longitudinal engagement. TRIAL REGISTRATION: Clinicaltrials.gov NCT03652389; https://clinicaltrials.gov/ct2/show/NCT03652389. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/18554.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.005 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.006 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.001 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".