MétaCan
Menu
← Back to cohort
Record W4385472854 · doi:10.2196/48365

Real-World User Demographics of Three Web-Based Digital Mental Health Interventions Provided by the US Department of Veterans Affairs: Observational Study Using Web Analytics Data

2023· article· en· W4385472854 on OpenAlexvenueaboutno aff
Arthur T. Ryan, Kelly A. Stearns‐Yoder, Lisa A. Brenner

Bibliographic record

VenueJMIR Formative Research · 2023
Typearticle
Languageen
FieldPsychology
TopicDigital Mental Health Interventions
Canadian institutionsnot available
FundersNational Institutes of HealthUniversity of OxfordU.S. Department of Veterans AffairsU.S. Department of Defense
KeywordsMental healthPopulationPsychological interventionVeterans AffairsAnalyticsMedicineGerontologyPsychiatryComputer scienceData scienceEnvironmental health

Abstract

fetched live from OpenAlex

BACKGROUND: Unguided digital mental health interventions (UDMHIs) have the potential to provide low-cost and effective mental health care at scale. Controlled trials have demonstrated the efficacy of UDMHIs to address mental health symptoms and conditions. However, few previous publications have described the demographics of real-world users of UDMHIs that are freely available to the public. The US Department of Veterans Affairs has created and hosts several UDMHIs on its Veteran Training Portal website. These web-based, free-to-use, and publicly available UDMHIs include Path to Better Sleep, Anger and Irritability Management Skills, and Moving Forward, which focus on insomnia, problematic anger, and depression symptoms, respectively. OBJECTIVE: This study aimed to examine the user demographics of these 3 UDMHIs in the year 2021. In addition, it aimed to compare the age and gender distribution of the users of those 3 UDMHIs with one another and with the age and gender distribution of the total US veteran population. METHODS: Google Analytics was used to collect user data for each of the 3 UDMHIs. The age and gender distribution of the users of each UDMHI was compared with that of the other UDMHIs as well as with that of the overall US veteran population using chi-square tests. Information on the total number of users, the country they were in, and the devices they used to access the UDMHIs was also collected and reported. RESULTS: In 2021, the 3 UDMHIs together recorded 29,306 unique users. The estimated age range and gender were available for 24.12% (7068/29,306) of those users. Each UDMHI's age and gender distribution significantly differed from that of the other UDMHIs and from that of the overall US veteran population (P<.001 on all chi-square tests). Women and younger age groups were overrepresented among UDMHI users compared with the overall US veteran population. The majority of devices used to access the UDMHIs were desktop or laptop devices, although a substantial proportion of devices used were mobile devices (10,199/29,752, 34.28%). Most users (27,789/29,748, 93.41%) were located in the United States, with users from Canada, the United Kingdom, and Australia accounting for another 2.61% (775/29,748) of total users. CONCLUSIONS: Our use of Google Analytics data provided useful information about the users of 3 free and publicly available UDMHIs provided by the US Department of Veterans Affairs. Although our findings should be considered in light of the limitations of autonomously collected web analytics data, they still offer useful information for health care policy makers, administrators, and UDMHI developers.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.002
metaresearch head score (Gemma)0.009
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.026
Threshold uncertainty score0.051

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0020.009
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.001
Bibliometrics0.0020.002
Science and technology studies0.0010.000
Scholarly communication0.0010.002
Open science0.0010.002
Research integrity0.0010.002
Insufficient payload (model declined to judge)0.0020.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.401
GPT teacher head0.551
Teacher spread0.150 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations1
Published2023
Admission routes2
Has abstractyes

Explore more

Same venueJMIR Formative Research→Same topicDigital Mental Health Interventions→French-language works237,207→