Improving Predictability and Effectiveness in Preventive Digital Health Interventions: Scoping Review
Bibliographic record
Abstract
BACKGROUND: Lifestyle-related diseases caused by inadequate diet and physical activity cause premature death, loss of healthy life years, and increased health care costs. Randomized controlled trial (RCT) studies indicate that preventive digital health interventions (P-DHIs) can be effective in preventing these health problems, but the results of these studies are mixed. Adoption studies have identified multiple factors related to individuals and the context in which they live that complicate the transfer of positive results from RCT studies to practical use. Implementation studies have revealed barriers to the large-scale implementation of mobile health (mHealth) solutions in general. Consequently, there is no clear path to delivering predictable outcomes from P-DHIs and achieving effectiveness when scaling up interventions to reduce health problems in society. OBJECTIVE: This research aimed to expand our understanding of how to increase the outcome predictability of P-DHIs by focusing on physical activity and diet behaviors and amplify our understanding of how to improve effectiveness in large-scale implementations. METHODS: The research objective was pursued through a multidisciplinary scoping review. This scoping review used the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) as a guide. A comprehensive search of Web of Science and PubMed limited to English-language journal articles published before January 2022 was conducted. Google Scholar was used for hand searches. Information systems theory was used to identify key constructs influencing outcomes of IT in general. Public health and mHealth literature were used to identify factors influencing the adoption of, outcomes from, and implementation of P-DHIs. Finally, the P-DHI investment model was developed based on information systems constructs and factors from the public health and mHealth literature. RESULTS: In total, 203 articles met the eligibility criteria. The included studies used a variety of methodologies, including literature reviews, interviews, surveys, and RCT studies. The P-DHI investment model suggests which constructs and related factors should be emphasized to increase the predictability of P-DHI outcomes and improve the effectiveness of large-scale implementations. CONCLUSIONS: The research suggests that outcome predictability could be improved by including descriptions of the constructs and factors in the P-DHI investment model when reporting from empirical studies. Doing so would increase our understanding of when and why P-DHIs succeed or fail. The effectiveness of large-scale implementations may be improved by using the P-DHI investment model to evaluate potential difficulties and possibilities in implementing P-DHIs to create better environments for their use before investing in them and when designing and implementing them. The cost-effectiveness of large-scale implementations is unknown; implementations are far more complicated than just downloading and using apps, and there is uncertainty accompanying implementations given the lack of coordinated control over the constructs and factors that influence the outcome.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.047 | 0.046 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.004 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; both teacher heads agree on what is shown here.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".