Cardiovascular risk estimation: can a risk prediction model derived in one country be used in another?
Notice bibliographique
Résumé
This editorial refers to ‘External validation and comparison of six cardiovascular risk prediction models in the Prospective Urban Rural Epidemiology (PURE)-Colombia study’, by J.P. Lopez-Lopez et al., https://doi.org/10.1093/eurjpc/zwae242. In this issue, Lopez-Lopez and colleagues1 explore an important issue in preventive cardiology, namely the extent to which the results of a cardiovascular risk prediction system derived in one country or region can be applied to a different population. The occurrence of atherosclerotic cardiovascular disease (ASCVD) in apparently healthy persons is usually the result of the combined effects of a number of risk factors. The clinical estimation of these combined effects is generally unreliable and for this reason guidelines on prevention recommend the use of a cardiovascular risk estimation system, six of which are assessed in the present paper-SCORE2, the AHA/ACC Pooled Cohort Equation, WHO, Globorisk Latin America, the Framingham Risk Score, and the non-laboratory INTERHEART Risk Score. Current systems for risk estimation generally use cohort studies starting at around age 40 to estimate the 10-year risk of a first ASCVD event. Regression techniques are used to define beta-coefficients, which are essentially multipliers used to express the independent effects of the risk factors under consideration. Core variables are age (exposure time rather than a risk factor per se), gender, smoking, blood lipids, and blood pressure. Other relevant variables that may be included are body weight, exercise, diabetes, ethnicity, and social deprivation. Some limitations of current approaches are considered later in this editorial. Strictly speaking, the results of a cohort-based risk estimation system apply only to the population from which it was derived, or to populations with closely similar characteristics. But if they cannot be used more widely, the whole exercise is pointless, which is why the current publication is of relevance, not just to Columbia but more generally. This issue had to be addressed in developing and re-calibrating the SCORE2 risk model for four different risk regions of Europe.2 Conventional approaches to recalibration require up-to date risk factor, mortality and non-fatal event data.3 Of these, non-fatal events are most challenging in view of variations in data quality and ascertainment methods. These issues may have posed challenges for both the Globorisk and WHO risk models. The current paper describes an interesting contrasting approach to recalibration, as will be seen. Lopez-Lopez and colleagues reviewed the current literature on the evaluation of existing risk models for use in Columbia and found appreciable limitations. They therefore examined the ability of the six cardiovascular risk prediction models to estimate risk in 3802 subjects without ASCVD at baseline of the 7552 subjects in Prospective Urban Rural Epidemiology (PURE)-Colombia study. Most exclusion related to missing values, especially lipids. Those with diabetes or who were taking statins were excluded, but a further examination indicated the inclusion of these would have had a very small influence on the results. Subjects with a systolic blood pressure of >200 or <90 mmHg were excluded, as were those with an LDL cholesterol of >342 or <115 mg/dL (9 and 3 mmol/L, respectively). The performance of the models was assessed by means of conventional methods—discrimination (the ability of the model to correctly classify a positive or negative event, in this case using the C-statistic as a summary of the integrated area under the Receiver Operating curve) and calibration (the degree of similarity between the observed and predicted results). While widely used, the C-statistic has limitations. It is essentially an expression of the tradeoff between sensitivity and specificity; management decisions will be obvious at the extremes of risk whereas guidance is needed close to thresholds at which an intervention is being considered. One possible solution is to use the Net Reclassification Index.4 This was not employed in the current paper and indeed has been criticized.5 All six prediction models were reported to show similar discrimination. With regards to calibration, all models over-estimated risk, least with SCORE2 and most in Globorisk-LAC, WHO and the AHA/ACC PCE. In view of the generally similar and acceptable discrimination, it was felt appropriate to recalibrate each of the prediction models using a contrasting technique to that used in SCORE2, namely an Integrated Calibration Index,6 resulting in individual correction factors for each model. Recalibration factors varied from 0.75 (SCORE2, Women) to 0.27 (Framingham Risk Score, Men). A reasonable question is whether the use of risk estimation models, in Columbia or elsewhere, logical though it may be, results in improved patient outcomes. This would require a randomized control trial comparing usual care with risk-prediction driven care and it is unlikely that such a trial will be undertaken-the last trial of a total risk approach to care was MRFIT7 20 years ago and undertaken at a time that ASCVD mortality was falling and few effective drug treatments were available. What of the future? Whatever risk estimation system may be adopted in Columbia, there is a need to incorporate measures of social deprivation, inflammation, and probably LPa. Imaging such as CAC can improve risk prediction as a diagnostic test for asymptomatic disease rather than a risk factor per se. Its use may stimulate more intensive risk factor management. Present methods may have gone as far as they can. A move from 10-year risk to a cumulative exposure time model integrated with Mendelian Randomization and utilizing artificial intelligence to explore interaction effects may be the future, with the hope of allowing more precise personalized risk estimates from earlier in life than is presently possible.8,9
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction machine sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Le volet Gemma est une étiquette directe du modèle pour chaque travail de la base, lue sur la notice réduite au titre. Le volet Codex est un classifieur appris des 10 348 étiquettes directes de Codex et calibré sur les taux pondérés de l'échantillon; les champs sans appui suffisant ne portent aucun appel Codex. Le mode candidate est l'union des deux volets; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont pas des étiquettes humaines.
Scores du classifieur distillé par catégorie (deux têtes)
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,016 | 0,120 |
| Méta-épidémiologie (sens strict) | 0,001 | 0,001 |
| Méta-épidémiologie (sens large) | 0,003 | 0,002 |
| Bibliométrie | 0,001 | 0,001 |
| Études des sciences et des technologies | 0,001 | 0,001 |
| Communication savante | 0,003 | 0,003 |
| Science ouverte | 0,002 | 0,001 |
| Intégrité de la recherche | 0,012 | 0,016 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,002 | 0,003 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; un appel candidat d’une seule source (Gemma direct ou Codex distillé), pas un consensus.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».