MétaCan
Menu
Back to cohort
Record W4321226584 · doi:10.1038/s41746-023-00749-3

Long-term participant retention and engagement patterns in an app and wearable-based multinational remote digital depression study

2023· article· en· W4321226584 on OpenAlexaff
Yuezhou Zhang, Abhishek Pratap, Amos Folarin, Shaoxiong Sun, Nicholas Cummins, Faith Matcham, Srinivasan Vairavan, Judith Dineley, Yatharth Ranjan, Zulqarnain Rashid, Pauline Conde, Callum Stewart, Katie M White, Carolin Oetzmann, Alina Ivan, Femke Lamers, Sara Siddi, Carla Hernández, Sara Simblett, Raluca Nica, David C. Mohr, Inez Myin‐Germeys, Til Wykes, Josep María Haro, Brenda W.J.H. Penninx, Peter Annas, Vaibhav A. Narayan, Matthew Hotopf, Richard Dobson

Bibliographic record

Venuenpj Digital Medicine · 2023
Typearticle
Languageen
FieldPsychology
TopicDigital Mental Health Interventions
Canadian institutionsKrembil FoundationUniversity of Toronto
FundersEconomic and Social Research CouncilEngineering and Physical Sciences Research CouncilScottish GovernmentChief Scientist Office, Scottish Government Health and Social Care DirectorateNIHR BioResourceGIESKES-STRIJBIS FONDSInstitut Català de la SalutInnovative Medicines InitiativeKing's Health PartnersZonMwNational Institute for Health Research Applied Research Collaboration South LondonSouth London and Maudsley NHS Foundation TrustNIHR Maudsley Biomedical Research CentreHealth and Social Care Research and Development DivisionPublic Health AgencyEuropean CommissionKing's College LondonMedical Research CouncilDepartment of Health and Social CareNHS Blood and TransplantNational Institute for Health and Care ResearchUK Research and InnovationWellcome TrustUniversity College LondonBritish Heart FoundationEuropean Federation of Pharmaceutical Industries and AssociationsKing's College Hospital NHS Foundation TrustAlzheimer's Society
KeywordsmHealthData collectionGeneralizability theoryWearable technologyDepression (economics)Wearable computerPsychologyDigital healthMedicineComputer scienceHealth carePsychiatryDevelopmental psychology

Abstract

fetched live from OpenAlex

Recent growth in digital technologies has enabled the recruitment and monitoring of large and diverse populations in remote health studies. However, the generalizability of inference drawn from remotely collected health data could be severely impacted by uneven participant engagement and attrition over the course of the study. We report findings on long-term participant retention and engagement patterns in a large multinational observational digital study for depression containing active (surveys) and passive sensor data collected via Android smartphones, and Fitbit devices from 614 participants for up to 2 years. Majority of participants (67.6%) continued to remain engaged in the study after 43 weeks. Unsupervised clustering of participants' study apps and Fitbit usage data showed 3 distinct engagement subgroups for each data stream. We found: (i) the least engaged group had the highest depression severity (4 PHQ8 points higher) across all data streams; (ii) the least engaged group (completed 4 bi-weekly surveys) took significantly longer to respond to survey notifications (3.8 h more) and were 5 years younger compared to the most engaged group (completed 20 bi-weekly surveys); and (iii) a considerable proportion (44.6%) of the participants who stopped completing surveys after 8 weeks continued to share passive Fitbit data for significantly longer (average 42 weeks). Additionally, multivariate survival models showed participants' age, ownership and brand of smartphones, and recruitment sites to be associated with retention in the study. Together these findings could inform the design of future digital health studies to enable equitable and balanced data collection from diverse populations.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.299
Threshold uncertainty score0.754

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.001
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.133
GPT teacher head0.428
Teacher spread0.295 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations56
Published2023
Admission routes1
Has abstractyes

Explore more

Same venuenpj Digital MedicineSame topicDigital Mental Health InterventionsFrench-language works237,207