MétaCan
Menu
Back to cohort
Record W4402384985 · doi:10.1177/01632787241281745

The Use of Contribution Analysis in Evaluating Health Interventions: A Scoping Review

2024· review· en· W4402384985 on OpenAlexafffund
David Buetti, M. Fitzgerald, Cassandra Barber, Patrick Labelle, Isabelle Bourgeois, Tim Aubry, Erin Cameron, Claire Kendall

Bibliographic record

VenueEvaluation & the Health Professions · 2024
Typereview
Languageen
FieldHealth Professions
TopicHealth Policy Implementation Science
Canadian institutionsUniversity of OttawaBruyèreNOSM UniversityUniversité de Montréal
FundersCanadian Institutes of Health Research
KeywordsPsychological interventionStakeholderHealth promotionStakeholder engagementPsychologyManagement scienceMedicineMedical educationApplied psychologyPublic healthPublic relationsNursingPolitical scienceEngineering

Abstract

fetched live from OpenAlex

Contribution Analysis (CA) is a promising theory-based evaluation approach for complex interventions, yet its application in health interventions remains largely unexplored. To bridge this gap, we conducted a scoping review to examine the extent of such applications and the methodologies, strengths, and limitations of this approach in health programming. Our comprehensive search strategy was developed and used in 15 databases to identify peer-reviewed articles from 1999 to 2023 that focused on using CA to evaluate health interventions. We then implemented rigorous double- and triple-screening processes for abstracts and full-text papers, respectively. Data were extracted and narratively summarized. Our review found seven relevant studies, which showed that CA has been employed in health promotion programs, health policies, and targeted health issues such as nutrition, cardiovascular disease, substance misuse, and suicide prevention. The studies identified strengths of using CA, including its flexible impact evaluation approach, capacity to inform decision-making, and potential to enhance understanding of health programs and policies. However, challenges such as how to determine suitable evidence levels and how to best manage resource intensity were also identified. The limited number of studies indicates that CA is still a novel approach, whereas the variation in the reporting of the studies suggests that this approach could benefit from more standardized methods and detailed stakeholder engagement strategies.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.329
metaresearch head score (Gemma)0.542
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Evaluation · Consensus signal: none
Study designCandidate signal: Systematic review · Consensus signal: Systematic review
GenreCandidate signal: Review · Consensus signal: Review
Teacher disagreement score0.671
Threshold uncertainty score0.827

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.3290.542
Meta-epidemiology (narrow)0.0040.004
Meta-epidemiology (broad)0.0140.015
Bibliometrics0.0590.045
Science and technology studies0.0040.005
Scholarly communication0.0130.014
Open science0.0060.009
Research integrity0.0050.004
Insufficient payload (model declined to judge)0.0060.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.952
GPT teacher head0.831
Teacher spread0.121 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designSystematic review
DomainEvaluation
GenreReview

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations3
Published2024
Admission routes2
Has abstractyes

Explore more

Same venueEvaluation & the Health ProfessionsSame topicHealth Policy Implementation ScienceFrench-language works237,207