MétaCan
Menu
Back to cohort

Psychometric validation of the pictorial ecological momentary well-being instrument

2025· article· en· W4413581527 on OpenAlexafffundabout
Marie Buzzi, Grégory Moullec, Yan Kestens, Lætitia Minary, Jennifer O’Loughlin, Benoît Lalloué, Nelly Agrinier, Jonathan Epstein

Bibliographic record

VenueJournal of Clinical Epidemiology · 2025
Typearticle
Languageen
FieldPsychology
TopicMental Health Research Topics
Canadian institutionsUniversité de MontréalInstitut National de Santé Publique du Québec
FundersPublic Health Agency of Canada
KeywordsPsychometricsEcologyPsychologyBiologyClinical psychology

Abstract

fetched live from OpenAlex

OBJECTIVES: With the growing interest in Ecological Momentary Assessment (EMA) in mental health research, the need for precise and reliable measurement tools has become a pressing issue. However, few candidate instruments have been validated in intensive longitudinal data collection contexts. The present study provides an example of the psychometric validation of measurement instruments designed for EMA, by assessing the psychometric properties of Ecological Momentary Well-being Instrument (EMoWI), the first scale specifically designed to measure momentary well-being. STUDY DESIGN AND SETTING: Participants from the COvid-19 HEalth and Social InteractiOn in Neighborhoods (COHESION) cohort, a general population sample of Canadian adults, who participated in the September 2022 EMA wave, were included. Prompts including the 8 EMoWI items were sent to participants three times a day, over 10 consecutive days. Based on recent recommendations, we combined Classical Test and Item Response theories to assess content, structural, and construct validity, as well as reliability of EMoWI in an intensive longitudinal data collection context. RESULTS: Two Hundred Ninety adults aged between 19 and 80 were included, representing a total of 7974 prompts over 10 days. Variance decomposition analysis confirmed significant variability in momentary well-being at both the participant and day levels. Multilevel confirmatory factor analysis supported a single factor hypothesis (root mean square error of approximation = 0.074). Internal consistency was high, both at the within- and between-variance level (MacDonald's ω = 0.814 and 0.938, respectively) and we demonstrated longitudinal measurement invariance over time. Variations in mean momentary well-being across subgroups were consistent with our predefined hypotheses, supporting construct validity of EMoWI. CONCLUSION: We demonstrated the validity and reliability of EMoWI to measure momentary well-being in intensive longitudinal studies. These results will enhance the accuracy of findings related to well-being in EMA studies and inform the development of evidence-based mental health ecological momentary interventions.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.011
metaresearch head score (Gemma)0.025
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Methods · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.989
Threshold uncertainty score0.061

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0110.025
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.001
Bibliometrics0.0010.001
Science and technology studies0.0010.001
Scholarly communication0.0010.001
Open science0.0010.002
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0020.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.353
GPT teacher head0.589
Teacher spread0.236 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designObservational
DomainMethods
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2025
Admission routes3
Has abstractyes

Explore more

Same venueJournal of Clinical EpidemiologySame topicMental Health Research TopicsFrench-language works237,207