Research partnership and knowledge transfer in the development of a generic evaluation toolkit for health promotion interventions in primary care.
Bibliographic record
Abstract
IntroductionEvaluation research is fundamental to generating evidence to inform the development of policy, services and practice in health promotion. At a national and international level, rigorous evaluation is central to advancing knowledge and practice. At a local level evaluation can measure the effectiveness and efficiency of health promotion interventions. This evidence can be used to inform decision making about budget allocations and recurrent funding, service provision and methods for meeting local health needs.The speed at which health promotion practice and knowledge is advancing is potentially stalled by a number of complexities associated with the process of evaluating health promotion. These complexities are well reported and are related to the individual nature of health (1,2), the wide range of activities and actions considered under the term health promotion (3-6), the lack of a universal definition of evaluation, and a lack of clear guidelines as to what constitutes good evaluation (3,7).Health promotion is a complex concept; this is partly due to the fact that health promotion draws from many different disciplines and ideologies and as a result there is no universally accepted definition or concept of the field of practice (8).Health promotion, in its broadest terms, aims to have a health enhancing effect (3). The Ottawa Charter for Health Promotion indicates that the activities of health promotion are extremely broad ranging from operating at an individual level (through developing personal skills) to targeting health indirectly at a population level through policy changes, making adjustments to the physical environment or re-orientating health service provision (5). Not only does health promotion encompass many different activities and draw from many disciplines, but to be effective, a combination of health promotion activities is recommended (8,9).Therefore, the challenge of evaluation is not only to capture the effects of a health promotion activity but also to capture the likely interaction between activities, and their combined effect on health, either directly or indirectly. Without clear parameters or rules about what constitutes good evaluation practice it then becomes difficult to know what to evaluate and what we understand as evidence of effectiveness (3,7,10). This adds another layer of complexity to the process, and another degree of ambiguity.Evaluation, in its simplest form is the comparison of an object of interest against a standard of acceptability (11). Evaluation of health promotion, in its most concise form, has three foci; the process of implementing the activity being evaluated, and the short and long term achievement of an intervention objectives (12). As discussed, a health promoting intervention's objectives may be far reaching, and directly concerned with achieving a health gain, or they may be concerned with indirectly targeting health through health behaviours, service provision, addressing structural disadvantage or changing a policy.Currently, there are inconsistencies in how the evaluation of health promoting interventions is conducted, and how the findings are interpreted and reported (10, 13). This lack of standardisation of evaluation has been identified at an international level and recent international research collaborations have contributed to progress in this area (3, 14). This has led to some progress towards standardisation, with Glasgow and colleagues (15,16), Steckler and Linnan (13) and Baranowski and Stables (17) making recommendations for the core components of process evaluation, and Nutbeam (18), Bauer and colleagues (19) and Spencer and colleagues (20) presenting models for the classification of health outcomes (20). However, as discussed earlier, health promotion is a complex process, and to capture this, there is a real need for an integrated evaluation framework which builds on existing knowledge and identifies the relationship and connections between process, impact and outcome evaluation data. …
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.096 | 0.002 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.001 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".