MétaCan
Menu
Back to cohort
Record W4281655592 · doi:10.2196/39010

Passive Mobile Self-tracking of Mental Health by Veterans With Serious Mental Illness: Protocol for a User-Centered Design and Prospective Cohort Study

2022· article· en· W4281655592 on OpenAlexvenueno aff
Alexander S. Young, Abigail Choi, Shay Cannedy, Lauren Hoffmann, Lionel Levine, Li‐Jung Liang, Melissa Medich, Rebecca S. Oberman, Tanya T. Olmos‐Ochoa

Bibliographic record

VenueJMIR Research Protocols · 2022
Typearticle
Languageen
FieldPsychology
TopicDigital Mental Health Interventions
Canadian institutionsnot available
FundersU.S. Department of Veterans Affairs
KeywordsUsabilitymHealthMental healthFocus groupMobile phoneMedicineMental illnessApplied psychologyPsychologyPsychological interventionComputer sciencePsychiatryHuman–computer interaction

Abstract

fetched live from OpenAlex

BACKGROUND: Serious mental illnesses (SMI) are common, disabling, and challenging to treat, requiring years of monitoring and treatment adjustments. Stress or reduced medication adherence can lead to rapid worsening of symptoms and behaviors. Illness exacerbations and relapses generally occur with little or no clinician awareness in real time, leaving limited opportunity to modify treatments. Previous research suggests that passive mobile sensing may be beneficial for individuals with SMI by helping them monitor mental health status and behaviors, and quickly detect worsening mental health for prompt assessment and intervention. However, there is too little research on its feasibility and acceptability and the extent to which passive data can predict changes in behaviors or symptoms. OBJECTIVE: The aim of this research is to study the feasibility, acceptability, and safety of passive mobile sensing for tracking behaviors and symptoms of patients in treatment for SMI, as well as developing analytics that use passive data to predict changes in behaviors and symptoms. METHODS: A mobile app monitors and transmits passive mobile sensor and phone utilization data, which is used to track activity, sociability, and sleep in patients with SMI. The study consists of a user-centered design phase and a mobile sensing phase. In the design phase, focus groups, interviews, and usability testing inform further app development. In the mobile sensing phase, passive mobile sensing occurs with participants engaging in weekly assessments for 9 months. Three- and nine-month interviews study the perceptions of passive mobile sensing and ease of app use. Clinician interviews before and after the mobile sensing phase study the usefulness and feasibility of app utilization in clinical care. Predictive analytic models are built, trained, and selected, and make use of machine learning methods. Models use sensor and phone utilization data to predict behavioral changes and symptoms. RESULTS: The study started in October 2020. It has received institutional review board approval. The user-centered design phase, consisting of focus groups, usability testing, and preintervention clinician interviews, was completed in June 2021. Recruitment and enrollment for the mobile sensing phase began in October 2021. CONCLUSIONS: Findings may inform the development of passive sensing apps and self-tracking in patients with SMI, and integration into care to improve assessment, treatment, and patient outcomes. TRIAL REGISTRATION: ClinicalTrials.gov NCT05023252; https://clinicaltrials.gov/ct2/show/NCT05023252. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/39010.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.053
metaresearch head score (Gemma)0.048
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Protocol · Consensus signal: Protocol
Teacher disagreement score0.053
Threshold uncertainty score0.283

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0530.048
Meta-epidemiology (narrow)0.0030.003
Meta-epidemiology (broad)0.0030.004
Bibliometrics0.0030.003
Science and technology studies0.0050.002
Scholarly communication0.0030.002
Open science0.0020.002
Research integrity0.0040.005
Insufficient payload (model declined to judge)0.0380.008

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.154
GPT teacher head0.568
Teacher spread0.415 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreProtocol

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations13
Published2022
Admission routes1
Has abstractyes

Explore more

Same venueJMIR Research ProtocolsSame topicDigital Mental Health InterventionsFrench-language works237,207