Evaluating the sector-wide implementation of virtual child and youth mental health services in response to the COVID-19 pandemic: Perspectives from service providers, agency leaders and clients
Bibliographic record
Abstract
Background: The COVID-19 pandemic prompted an abrupt shift in the delivery of community-based child and youth mental health services as virtual care was rapidly adopted. The objective of this study was to evaluate the sector-wide transition to virtual care across Ontario, with a focus on implementation facilitators and barriers. Methods: We used a multi-level mixed-methods design where agency leaders, service providers, and clients shared their experiences planning, implementing, and accessing virtual care. In total, 97 agency leaders, and 192 youth and family members responded to the surveys; 13 agency leaders, and 11 service providers participated in interviews or focus groups. Results: Most agencies undertook a similar journey to implement virtual care. Stakeholders described common facilitators such as staff engagement, leadership support, and training activities. Barriers included internet connection issues, lack of resources, and privacy concerns. Service providers innovated as they implemented by partnering with agencies to meet clients' needs, using multiple platforms to engage clients, and altering session duration to reduce fatigue. Clients found virtual care easy to use, felt confident using it, and intend to continue accessing virtual care. Conclusion: Implementation of virtual care during the pandemic was complex and the evaluation involved obtaining perspectives at multiple levels. This research provides a blueprint for evaluations of the implementation of virtual mental health services, particularly in a child/youth context. Virtual care is a viable way to deliver mental health services, however, equity, accessibility, and appropriateness need to be addressed to ensure services are effective for children, youth, and their families. Plain language abstract: Academic literature suggests that using technology to deliver child and youth mental health services is a promising way to enhance access to care and improve engagement for many children and youth. Despite this, the provision of virtual child and youth mental health services in Ontario prior to the COVID-19 pandemic was limited. Efforts that did exist were largely focused on providing care to those in rural and remote areas. The COVID-19 pandemic prompted a rapid shift to virtual care, as most in-person mental health services were suspended. This paper presents new insight into how virtual mental health services were quickly established and used across Ontario from the perspectives of senior leaders, service providers, and clients. Results from this evaluation showed that agencies followed similar steps to prepare to use virtual services. Staff engagement, support from leadership, and opportunities for staff training supported the implementation of virtual care while internet connections issues, lack of resources (like computers or phones), and privacy and safety concerns hindered the implementation. Most youth and family members found virtual services easy to use and intend to continue using them. Most agencies intend to continue to offer virtual services post-pandemic but noted that it was not appropriate or accessible for all clients. This study provides a foundation for additional research to examine situations and conditions that are most conducive to virtual care delivery to address child and youth mental health concerns. These results may encourage agencies to rely more confidently on virtual services as another means to meet clients' needs and preferences.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.026 | 0.030 |
| Meta-epidemiology (narrow) | 0.000 | 0.001 |
| Meta-epidemiology (broad) | 0.000 | 0.001 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.007 | 0.004 |
| Scholarly communication | 0.005 | 0.003 |
| Open science | 0.002 | 0.006 |
| Research integrity | 0.001 | 0.002 |
| Insufficient payload (model declined to judge) | 0.002 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".