MétaCan
Menu
Back to cohort
Record W2102797756 · doi:10.1093/ije/dyp373

Commentary: Assessing population (baseline) risk is a cornerstone of population health planning—looking forward to address new challenges

2010· letter· en· W2102797756 on OpenAlexafffund
Douglas G. Manuel, Laura C. Rosella

Bibliographic record

VenueInternational Journal of Epidemiology · 2010
Typeletter
Languageen
FieldSocial Sciences
TopicHealth disparities and outcomes
Canadian institutionsInstitute for Clinical Evaluative Sciences
FundersPublic Health AgencyPublic Health Agency of Canada
KeywordsCornerstoneBaseline (sea)PopulationPopulation healthRelevance (law)MedicineIntervention (counseling)Risk assessmentEnvironmental healthPolitical scienceEconomicsManagementPsychiatryGeographyLaw

Abstract

fetched live from OpenAlex

McLaren et al.1 review two developments in critical thinking about the continued relevance of Rose’s seminal population health strategy and concluded that Rose’s original ideas, now over 25 years old, hold firm. Our commentary will focus on their critique of the suggestion to more widely use multivariate risk algorithms in the population setting.2 We also draw connections between the use of risk algorithms and the authors’ central concerns about the role of social inequalities in relation to intervention or policy coverage. We argue that understanding a population’s baseline risk is a cornerstone of population health planning as articulated by Rose, and therefore it is inexcusable not to use improved methods of baseline risk assessment. Rather than be complacent with Rose’s original method of assessing population risk, we should look forward and further develop multivariate risk algorithms in the population setting. A problem with terminology may be contributing to this debate. Despite the distinctions offered by McLaren et al. and Frohlich and Potvin,5 the concept of high- or low-baseline risk should not be equated with individual risk factors or associated only with medical or behavioural risk factors. Indeed, strength of multivariate risk algorithms is their recognition that baseline risk results from multiple contributions such as socio-economic position, biologic, demographic and other factors including those that may even begin at or before birth. High-baseline risk populations share similarities with ‘vulnerable populations’, with the additional concept that vulnerable people may have lower coverage (or ‘uptake’ or ‘response’) to interventions or policies. Reducing health inequity is a function of two critical components: baseline risk and intervention coverage. Although McLaren et al. and Frohlich and Potvin rightly focus on the role of coverage in addressing health inequities, improved risk assessment also contributes in two ways. First, discriminating methods (multivariate risk algorithms) of assessing baseline risk allow us to quantify important differences between social groups. With non-discriminating methods (used by Rose), the potential for health inequalities will falsely appear small or non-existent. Secondly, baseline risk is essential to assessing the potential for policies or interventions to reduce inequities. When we can tease apart the elements of a policy and see how they each contribute to community effectiveness (using an approach such as the ‘equity effectiveness loop’), we can see which components need to be addressed to reduce inequities.6 For example, baseline risk differences can be so large that health inequities can be reduced even when there are inequities in coverage.7 Similarly, when there are large differences in baseline risk, interventions with a low relative benefit will make a small impact in reducing inequities, even if they are ‘radical’ in their focus on upstream prevention or cover the population completely. The main advantage of multivariate risk prediction algorithms over older methods of baseline risk assessement is their improved ability to discriminate risk. Discrimination is defined as the ability to differentiate between those who are high risk and those who are low risk—or in other words distinguishing who will and will not experience the outcome. An algorithm with high discrimination does well at rank-ordering subjects in terms of likelihood of experiencing the event. Calibration or accuracy is another property of a risk algorithm that describes how well the predicted probability of disease closely agrees with the observed outcome. Risk discrimination and risk prediction are intimately related to the description of risk diffusion (Rose’s term) in populations. Take a hypothetical example of a community of 100 000 people where 1000 people will die of heart disease over the next 10 years. In an ideal setting, we would have a perfect ability to discriminate risk and can predict exactly which 1000 people will die. Because population risk is not at all diffused, we could then target only these 1000 people with preventive interventions, resulting in an extremely efficient and effective health strategy. Targeting the remaining 99 000 people with an intervention, even if it was radical, would have no preventive benefit. In public health, we rarely have such a clear knowledge of risk, though our tools are improving. Twenty-five years ago, we had poor risk prediction tools and so heart disease appeared diffused. To achieve a reduction in heart disease, it appeared that programmes needed to target most of the population. Today, risk prediction tools using multiple risk factors (such as the Framingham algorithm) can identify over a 100-fold difference in heart disease risk between individuals in developed countries.2,7 Population risk for heart disease is much less diffused than previously believed, meaning there are large inequities. Since the inequities are so large for heart disease in many populations, it may be that focused prevention and treatment could be more effective and efficient for reducing inequities than radical interventions that cover the entire population. For maximum benefit, however, health inequities in heart disease and elsewhere are usually best addressed using multiple interventions that include both high-risk and population strategies. The use of predictive risk algorithms in population settings is fairly new, and several methodological challenges may contribute to their limited use. To encourage forward thinking and debate about how best to estimate population risk, we briefly discuss three of these issues here. Simple predictive measures such as age and self-reported weight and smoking have been shown to have discriminating power equal to that of detailed clinical data, often with improved accuracy.8,9 To improve the practical use of algorithms, we need to further develop and validate them using only population data such as routinely collected health administrative data or population health surveys.10 Clinicians are chiefly concerned about the discriminating property of a predictive risk tool, but predictive accuracy has proven to be equally important in our collaboration with population health planners. The challenge, as Diamond outlined, is that discrimination and accuracy (or calibration) mathematically compete with each other.11 In population health, we need to better understand what the right balance is and how best to measure and report discrimination and accuracy. Another desirable application of population risk algorithms is to assess the contribution of individual risk factors (including behavioural or social risks) to predictive risk. Risk algorithms are ideal for re-estimating baseline risk under scenarios where individual risk factors are modified. However, there are important interpretive cautions to consider and it is challenging to combine aetiognostic and prognostic research methods. McLaren et al. acknowledge that multivariate risk algorithms are a more discriminating and accurate risk assessment approach than was available in Rose’s day, but they discount their use by wrongly associating them with only high-risk populations and the health benefits of medical treatment. To the contrary, multivariate risk algorithms can be used to more accurately discriminate risk in any population, including low-risk groups, and can help describe the benefits of all preventive health strategies, including those that are radical or upstream. A high-baseline risk strategy does not mean it focuses on downstream or medical treatment. Even when population risk is concentrated in high-risk groups, population prevention can be used to address underlying causes of disease as well as health inequities. Indeed, upstream interventions that target high-risk groups are extremely common worldwide. An example is means-tested social programmes. The methods to assess population health strategies should not stand still. Multivariate risk algorithms support Rose’s attention to population risk assessment and can improve the description of risk diffusion and other concepts that are central to population health planning. The single largest challenge is to move beyond the clinical setting to develop and validate risk algorithms especially for population health planning. D.G.M. holds a Chair in Applied Public Health from the Canadian Institute for Health Research and the Public Health Agency of Canada. The opinions, results and conclusions reported in this article are those of the author and are independent from the funding or employment sources. Conflict of interest: None declared.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.016
metaresearch head score (Gemma)0.113
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Commentary · Consensus signal: Commentary
Teacher disagreement score0.076
Threshold uncertainty score0.082

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0160.113
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0030.002
Bibliometrics0.0010.002
Science and technology studies0.0060.007
Scholarly communication0.0040.010
Open science0.0060.003
Research integrity0.0760.082
Insufficient payload (model declined to judge)0.0070.010

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.140
GPT teacher head0.476
Teacher spread0.335 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designNot applicable
Domainnot available
GenreCommentary

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations38
Published2010
Admission routes2
Has abstractyes

Explore more

Same venueInternational Journal of EpidemiologySame topicHealth disparities and outcomesFrench-language works237,207