Understanding Longitudinal Ecological Momentary Assessment Completion: Results From 12 Months of Burst Sampling in the TIME Study
Bibliographic record
Abstract
BACKGROUND: Ecological momentary assessment (EMA) is a valuable method for capturing real-time data on behaviors and experiences in naturalistic settings. However, maintaining participant engagement in longitudinal (ie, multiburst) EMA studies remains challenging, particularly when collecting intensive data over extended periods. Understanding factors affecting completion rates is essential for designing more effective EMA protocols and interpreting results accurately. OBJECTIVE: This study investigated factors influencing EMA completion rates in a 12-month intensive longitudinal study among young adults in the United States, examining both time-varying factors and stable individual characteristics. METHODS: Young adults (N=246, ages 18-29 years) participated in the Temporal Influences on Movement and Exercise (TIME) study, responding to smartphone-based EMA prompts during biweekly measurement bursts (4-day periods of intensive sampling), with continuous passive data collection via smartwatches. Each burst included signal-contingent prompts delivered approximately once per hour during waking hours, resulting in an average of 12.1 (SD 1.3) prompts per day. Multilevel logistic regression models examined the effects of time-varying temporal factors (time of day, day of week, season, and time in study), contextual factors (phone screen status, phone usage, and location), behavioral factors (sleep duration, physical activity levels, and travel status), and psychological factors (momentary affect and stress) on prompt completion. Models also included time-invariant demographic characteristics (sex, race, ethnicity, education, and employment) and tested interactions between time in study and other predictors. RESULTS: Mean completion rate was 77% (SD 13%). Hispanic participants showed lower odds of completion compared to non-Hispanic participants (odds ratio [OR] 0.79, 95% CI 0.63-0.99; P=.04) and employed participants were less likely to complete prompts than unemployed participants (OR 0.75, 95% CI 0.61-0.92; P<.01). Having the phone screen on at prompt delivery substantially increased completion odds (OR 3.39, 95% CI 2.81-4.09; P<.001), while being away from home reduced completion likelihood, with particularly low odds when at sports facilities (OR 0.58, 95% CI 0.47-0.74; P<.001) or restaurants and shops (OR 0.61, 95% CI 0.51-0.72; P<.001). Short sleep duration the previous night (OR 0.92, 95% CI 0.87-0.99; P=.02) and traveling status (OR 0.78, 95% CI 0.75-0.82; P<.001) were associated with lower completion odds. Higher momentary stress levels predicted lower completion of subsequent prompts (OR 0.85, 95% CI 0.78-0.93; P<.001). Completion odds declined over the 12-month study (OR 0.95, 95% CI 0.94-0.96; P<.001), with significant interactions between time in study and various predictors, indicating changing patterns of engagement over time. CONCLUSIONS: Findings highlight the dynamic nature of EMA engagement in longitudinal multiburst studies and underscore the importance of considering time-varying and time-invariant factors in study design and analysis. This study provides valuable insights for researchers designing intensive longitudinal studies in behavioral science and digital health. Potential strategies for optimizing EMA protocols could include tailoring prompt schedules to individual contexts and developing adaptive sampling techniques.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.041 | 0.092 |
| Meta-epidemiology (narrow) | 0.000 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.001 | 0.002 |
| Science and technology studies | 0.001 | 0.001 |
| Scholarly communication | 0.002 | 0.002 |
| Open science | 0.001 | 0.003 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".