Smartphone App–Based Noncontact Ecological Momentary Assessment With Experienced and Naïve Older Participants: Feasibility Study
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
BACKGROUND: Smartphone app-based ecological momentary assessment (EMA) without face-to-face contact between researcher and participant (app-based noncontact EMA) potentially provides a valuable data collection tool when geographic, time, and situational factors (eg, COVID-19 restrictions) place constraints on in-person research. Nevertheless, little is known about the feasibility of this method, particularly in older and naïve EMA participants. OBJECTIVE: This study aims to assess the feasibility of app-based noncontact EMA as a function of previous EMA experience, by recruiting and comparing a group of participants who had never participated in EMA before against a group of participants who had been part of an earlier in-person EMA study, and age, by recruiting middle-aged to older adults. METHODS: Overall, 151 potential participants were invited via email; 46.4% (70/151) enrolled in the study by completing the baseline questionnaire set and were emailed instructions for the EMA phase. Of these participants, 67% (47/70) downloaded an EMA app and ran the survey sequence for 1 week. In total, 5 daytime surveys and 1 evening survey, each day, assessed participants' listening environment, social activity, and conversational engagement. A semistructured exit telephone interview probed the acceptability of the method. As markers of feasibility, we assessed the enrollment rate, study completion rate, reason for noncompletion, EMA survey response rate, and likelihood of reporting an issue with survey alerts and requested assistance from researchers, family, or friends. RESULTS: Enrollment rates among invitees (63.3% vs 38.2%; P=.004) and completion rates among enrollees (83.9% vs 53.8%; P<.001) were higher in the experienced than in the naïve EMA group. On average, experienced participants responded to 64.1% (SD 30.2%) of the daytime EMA surveys, and naïve participants responded to 54.3% (SD 29.5%) of the daytime EMA surveys (P=.27). Among participants who retrospectively reported issues with survey alerts, only 19% (3/16) requested researcher assistance during data collection. Older participants were more likely to report not being alerted to EMA surveys (P=.008), but age was unrelated to all other markers of feasibility. Post hoc analyses of the effect of the phone operating system on markers of feasibility revealed that response rates were higher among iOS users (mean 74.8%, SD 20.25%) than among Android users (mean 48.5%, SD 31.35%; P=.002). CONCLUSIONS: Smartphone app-based noncontact EMA appears to be feasible, although participants with previous EMA experience, younger participants, and iOS users performed better on certain markers of feasibility. Measures to increase feasibility may include extensive testing of the app with different phone types, encouraging participants to seek timely assistance for any issues experienced, and recruiting participants who have some previous EMA experience where possible. The limitations of this study include participants' varying levels of existing relationship with the researcher and the implications of collecting data during the COVID-19 social restrictions.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.003 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.001 | 0.001 |
| Scholarly communication | 0.000 | 0.001 |
| Open science | 0.000 | 0.001 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.004 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it