Assessing the Usability, Appeal, and Impact of a Web-Based Training for Adults Responding to Concerning Posts on Social Media: Pilot Suicide Prevention Study
Bibliographic record
Abstract
BACKGROUND: Suicide prevention remains challenging among youth, as many do not disclose suicidal ideation. Nearly one-third of American Indian and Alaska Native (AI and AN, tribal, or native) youth see concerning messages on social media at least weekly. OBJECTIVE: To prepare adults to support AI and AN youth who post or view concerning messages, our team designed an hour-long training: Responding to Concerning Posts on Social Media. This study tested the usability, appeal, and impact of the training. METHODS: A purposive sample of 70 adults was recruited to participate in the pilot, which included 2 study arms. Arm 1 participants completed a 30-min training video and reviewed accompanying handouts, including the Viewer Care Plan (VCP). The VCP provided a 3-step planning and response tool: (1) Start the Conversation, (2) Listen, Gather Information, and Assess Viewer Experience, and (3) Plan and Act. The intent of the VCP was to support and connect AI and AN youth who either view or post concerning messages on social media to life-saving resources. Those enrolled in arm 2 participated in an additional interactive role-play scenario with a coach that took place after the training, via text message. Participants provided qualitative and quantitative feedback on the training's relevance, appeal, and utility. Paired t tests were used to assess confidence in addressing concerning posts between pre- and postsurveys. Content analysis of the role-play transcripts was used to assess the quality and completion of the coached role-plays, in relation to the recommended VCP. RESULTS: Altogether, 35 participants finished the training and completed pre- and postsurveys; 22 participants completed the 6-month follow-up survey. Pre-post analyses of differences in means found significant improvement across several efficacy measures, including confidence starting a conversation about social media (P=.003), confidence contacting the person who posted something concerning (P<.001), and confidence recommending support services to youth who view (P=.001) or youth who post concerning messages (P<.001). Similarly, pre- to 6-month analyses found significant positive improvement across multiple measures, including confidence contacting the youth who posted (P<.001), confidence starting a conversation about social media with youth (P=.003), and an increase in the number of experiences recommending resources for youth who viewed concerning social media posts (P=.02). Of the 3 steps of the VCP, the least followed step in coached role-plays was sharing tools and resources, which is a part of the third Plan and Act step. CONCLUSIONS: Findings indicate that the Responding to Concerning Posts on Social Media training is a promising tool to prepare adults to intervene and complete the VCP. Additional evaluation with a larger cohort of participants is needed to determine the unique impact of the role-play scenario and changes in mental health referral rates, behaviors, and skills.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.008 | 0.017 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.001 | 0.000 |
| Science and technology studies | 0.001 | 0.001 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.004 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".