Preliminary analysis of validation evidence for two new scales assessing teachers’ confidence and worries related to delivering mental health content in the classroom
Bibliographic record
Abstract
BACKGROUND: While mental health challenges in the classroom have increased over the past several years, existing research suggests that many educators feel unprepared to broach the topics of mental health and mental illness with their students. This paper outlines the development and gathering of preliminary evidence of validity for two new scales designed to assess teachers' confidence and worries related to delivering mental health content in the classroom. METHODS: Content evidence was collected through the use of two methods: a focus group held with members of the Elementary Teachers' Federation of Ontario, and a consensus survey conducted among a sample of educational experts recruited from an Ontario university. Internal structure evidence was derived from the initial intake survey of an evaluation of a new online guide designed to give elementary school teachers the tools and knowledge to develop lesson plans related to mental health. Internal consistency reliability of test scores was estimated with Cronbach's alpha. RESULTS: Both scales loaded on a single dimension with all items loading strongly (factor loadings greater than .60). Cronbach's alpha coefficients of .96 for scores on the Teacher Confidence Scale and .93 for scores on the What Worries Me Scale estimated strong internal consistency reliability. CONCLUSIONS: We identified two unidimensional scales measuring concerns educators may have about discussing the topic of mental health in a classroom setting. The Teacher Confidence Scale for Delivering Mental Health Content contains 12 items measuring educators' confidence in delivering mental health related materials in the classroom. The What Worries Me Scale contains 11 items. These scales may be useful for evaluating programs, educational workshops, and other initiatives aimed at improving teachers' abilities to provide mental health content in the classroom.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.084 | 0.157 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.002 |
| Bibliometrics | 0.003 | 0.003 |
| Science and technology studies | 0.001 | 0.003 |
| Scholarly communication | 0.002 | 0.002 |
| Open science | 0.002 | 0.002 |
| Research integrity | 0.001 | 0.002 |
| Insufficient payload (model declined to judge) | 0.003 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".