Evaluating the Digital Frontier: A Mixed-Methods Exploration of the Implementation of Digital Mental Health Interventions
Bibliographic record
Abstract
Background: Digital mental health interventions (DMHI) have been increasingly integrated into routine service provision. As we move past the height of the COVID-19 pandemic, an opportunity has arisen to systematically investigate the short- and long-term viability of these interventions. Objectives: This thesis has three main objectives: i. Evaluate the current state of implementing DMHI, including digitally delivered trauma-focused psychotherapies, through an implementation science lens. ii. Identify strengths and weaknesses of currently implemented DMHI. iii. Clarify whether these DMHI are appropriately addressing the needs of clients, clinicians, and community partners. Methods: This dissertation explored DMHI using a range of methodologies, including a scoping review, mixed methods studies, and qualitative approached as described briefly below. A scoping review, informed by the Alberta Quality Matrix of Health, systematically mapped existing peer-reviewed research on synchronous, therapist-delivered web-based psychotherapy for individuals with a mental illness. A pilot mixed-methods study investigated perceptions of digitally delivered psychotherapies utilized for trauma affected populations, as reported by Canadian military members, Veterans, and Public Safety Personnel who had undergone these interventions, and a mixed methods study identified strengths and weaknesses of digitally delivered psychotherapies utilized for trauma affected populations based on the perceptions of Canadian mental health clinicians who had provided these interventions. An additional mixed methods study investigated and identified factors that may affect the current and future implementation of DMHI in mental health care systems and ascertain current micro, meso, and macro level factors related to the use of DMHI. A randomized control trial (RCT) was conducted to investigated whether web-based, synchronous clinician-delivered eye movement desensitization and reprocessing (EMDR), primarily targeting experiences, beliefs, or affective states associated with suicidal thinking, would aid in reducing suicidal ideation (SI) compared to treatment as usual. In addition, a qualitative study explored the experiences of civilian adult mental health outpatients who received web-based, therapist-delivered EMDR targeting suicidal state related content during the Randomized Controlled Trial Investigating Virtual Eye Movement Desensitization and Reprocessing for Adults with Suicidal Ideation. Results: The review revealed that most studies measured treatment effectiveness and acceptability health quality dimensions. Important aspects of health care quality (accessibility, appropriateness, efficiency, and safety) had received little scientific examination, underscoring a need to address these gaps. There are also significant issues related to the generalizability of this literature, including the underrepresentation of many geographic regions, cultures, populations, clinical contexts, and psychotherapy modalities. For the study investigating perceptions of digitally delivered psychotherapies utilized for trauma affected populations, participants indicated unique advantages of DMHI, including increased accessibility of treatment, cost effectiveness, and more efficient use of resources. The subsequent mixed-methods study investigating factors that may affect the current and future implementation of DMHI reported participant support of the use of digitally delivered psychotherapies, sharing that these interventions appeared to offer similar quality of care as in-person delivery. Client and clinician participants expressed satisfaction with the implementation of DMHI. Community partner participants generally agreed, reporting that such services will play an integral role in mental health care moving forward. Community partners shared a concern that uncertainty surrounding policies and regulations related to DMHI must be addressed moving forward. The RCT results indicated that EMDR group participants exhibited decreases in median SI, depression, anxiety, and posttraumatic symptom scale scores from baseline to the four-month follow-up, while also reporting numerically fewer adverse events during study participation compared to treatment as usual group participants. These results provide promising preliminary evidence that web-based EMDR may be a viable delivery approach to addressing SI. Qualitative study participants reported benefits from receiving web-based EMDR focused on SI, while also reporting that the treatment was intensely emotional. Thematic analysis revealed five main themes: (1) systemic obstacles to recovery, (2) relational attunement creating safety, (3) moving past the stuckness of suicidal states, (4) post-traumatic growth and resilience, and (5) unique needs and preferences. Discussion: This work revealed that participants generally supported the continued use of DMHI, citing several key advantages of DMHI over in-person care, such as increased accessibility of treatment. Participants reported feeling that DMHI typically offered good treatment effectiveness, safety, and overall quality of care, although their perceived appropriateness varied amongst individuals. The results of this dissertation may be used to inform DMHI-specific policies, practices, and training opportunities in the future.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.231 | 0.212 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.003 | 0.004 |
| Bibliometrics | 0.008 | 0.007 |
| Science and technology studies | 0.004 | 0.004 |
| Scholarly communication | 0.010 | 0.007 |
| Open science | 0.004 | 0.008 |
| Research integrity | 0.002 | 0.003 |
| Insufficient payload (model declined to judge) | 0.005 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".