Development of a Framework for the Implementation of Synchronous Digital Mental Health: Realist Synthesis of Systematic Reviews
Bibliographic record
Abstract
BACKGROUND: The use of technologies has served to reduce gaps in access to treatment, and digital health interventions show promise in the care of mental health problems. However, to understand what and how these interventions work, it is imperative to document the aspects related to their challenging implementation. OBJECTIVE: The aim of this study was to determine what evidence is available for synchronous digital mental health implementation and to develop a framework, informed by a realist review, to explain what makes digital mental health interventions work for people with mental health problems. METHODS: The SPIDER (Sample, Phenomenon of Interest, Design, Evaluation, and Research type) framework was used to develop the following review question: What makes digital mental health interventions with a synchronous component work on people with mental health problems, including depression, anxiety, or stress, based on implementation, economic, quantitative, qualitative, and mixed methods studies? The MEDLINE, EBM Reviews, PsycINFO, EMBASE, SCOPUS, CINAHL Complete, and Web of Science databases were searched from January 1, 2015, to September 2020 with no language restriction. A Measurement Tool to Assess Systematic Reviews-2 (AMSTAR-2) was used to assess the risk of bias and Confidence in Evidence from Reviews of Qualitative Research (CERQual) was used to assess the confidence in cumulative evidence. Realist synthesis analysis allowed for developing a framework on the implementation of synchronous digital mental health using a grounded-theory approach with an emergent approach. RESULTS: A total of 21 systematic reviews were included in the study. Among these, 90% (n=19) presented a critically low confidence level as assessed with AMSTAR-2. The realist synthesis allowed for the development of three hypotheses to identify the context and mechanisms in which these interventions achieve these outcomes: (1) these interventions reach populations otherwise unable to have access because they do not require the physical presence of the therapist nor the patient, thereby tackling geographic barriers posed by in-person therapy; (2) these interventions reach populations otherwise unable to have access because they can be successfully delivered by nonspecialists, which makes them more cost-effective to implement in health services; and (3) these interventions are acceptable and show good results in satisfaction because they require less need of disclosure and provide more privacy, comfortability, and participation, enabling the establishment of rapport with the therapist. CONCLUSIONS: We developed a framework with three hypotheses that explain what makes digital mental health interventions with a synchronous component work on people with mental health problems. Each hypothesis represents essential outcomes in the implementation process. TRIAL REGISTRATION: PROSPERO International Prospective Register of Systematic Reviews CRD42020203811; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020203811. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.12688/f1000research.27150.2.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.003 | 0.000 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.005 | 0.001 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".