MétaCan
Menu
Back to cohort
Record W4409957687 · doi:10.2196/56086

Scalable Precision Psychiatry With an Objective Measure of Psychological Stress: Prospective Real-World Study

2025· article· en· W4409957687 on OpenAlexaff
Helena Wang, Norman A. S. Farb, Bechara J. Saab

Bibliographic record

VenueJournal of Medical Internet Research · 2025
Typearticle
Languageen
FieldPsychology
TopicDigital Mental Health Interventions
Canadian institutionsThe Scarborough HospitalUniversity of Toronto
Fundersnot available
KeywordsPreprintMeasure (data warehouse)PsychologyClinical psychologyStress (linguistics)PsychiatryMedicineComputer scienceData miningWorld Wide Web

Abstract

fetched live from OpenAlex

Background Before meaningful progress toward precision psychiatry is possible, objective (unbiased) assessment of patient mental well-being must be validated and adopted broadly. Objective This study aims to compare the fidelity of a precision psychiatry therapy recommendation algorithm when trained with an objective quantification of psychological stress versus subjective ecological momentary assessments (EMAs) of stress and mood. Methods From 2786 unique individuals engaging between March 2015 and December 2022 in English language psychotherapy sessions and providing pre- and postsession self-report and facial biometric data via a mobile health platform (Mobio Interactive Pte Ltd, Singapore), analysis was conducted on 67 “super users” that completed a minimum of 28 sessions with all pre- and postsession measures. The platform used has previously demonstrated reduced psychiatric symptom severity and improved overall mental well-being. Psychotherapy recordings (“sessions”) within the platform, available asynchronously and on demand, span mindfulness, meditation, cognitive behavioral therapy, client-centered therapy, music therapy, and self-hypnosis. The platform also has the unusual ability to rapidly assess mental well-being without bias via an easy-to-use objective measure of psychological stress derived from artificial intelligence–based analysis of facial biomarkers (objective stress level [OSL]). In tandem with the objective measure, EMAs obtain self-reported values of stress (SRS) and mood (SRM). ∆OSL, ∆SRS, and ∆SRM (with delta referring to the presession subtracted from the postsession measurement) were used to independently train a therapy recommendation algorithm designed to predict what future sessions would prove most efficacious for each individual. Algorithm predictions were compared against the efficacy of the individual’s self-selected sessions. Results The objective measure of psychological stress provided a differentiated delta for the measurement of therapeutic efficacy compared to the 2 EMA deltas, as shown by clear divergence in ∆OSL vs ∆SRS or ∆SRM (r<0.03), while the EMA deltas showed significant convergence (r=0.53, P<.01). The recommendation algorithm selected increasingly efficacious therapy sessions as a function of training data when trained with either ∆OSL (F1,16=5.37, P=.03) or ∆SRM data (F1,16=3.69, P<.05). However, the sequential improvement in prediction efficacy only surpassed the efficacy of self-selected therapy when the algorithm was trained using objective data (P<.01). Training the algorithm with EMA data showed potential trends that did not reach significance (∆SRS: P=.09; ∆SRM: P=.12). As a final insight, self-selected therapy sessions were overrepresented among the algorithmically recommended sessions, an effect most pronounced when the algorithm was trained with ∆OSL data (F1,14=30.94, P<.001). Conclusions These prospective data demonstrate that a rapid, scalable, and objective measure of psychological stress, in combination with a robust recommendation algorithm, can autonomously identify clinically meaningful therapy for individuals. More broadly, this work illustrates the potential for objective data on mental well-being to improve precision psychiatry and the capacity for mental health care professionals to match global demand. Trial Registration ClinicalTrials.gov NCT06265909; https://clinicaltrials.gov/ct2/show/NCT06265909

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.007
metaresearch head score (Gemma)0.025
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.007
Threshold uncertainty score0.036

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0070.025
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0010.001
Science and technology studies0.0010.001
Scholarly communication0.0010.001
Open science0.0010.001
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0020.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.096
GPT teacher head0.535
Teacher spread0.439 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations5
Published2025
Admission routes1
Has abstractyes

Explore more

Same venueJournal of Medical Internet ResearchSame topicDigital Mental Health InterventionsFrench-language works237,207