Predicting Outcomes Following Carotid Artery Stenting Using Machine Learning
Bibliographic record
Abstract
BACKGROUND: Carotid artery stenting (CAS) carries important perioperative risks. Outcome prediction tools may help guide clinical decision-making but remain limited. We developed machine learning (ML) algorithms that predict 30-day outcomes following transfemoral CAS. METHODS: The National Surgical Quality Improvement Program (NSQIP) targeted vascular database was used to identify patients who underwent transfemoral CAS between 2011 and 2021. Input features included 36 preoperative demographic/clinical variables. The primary outcome was a 30-day major adverse cardiovascular event (MACE; composite of stroke, myocardial infarction [MI], or death). The secondary outcomes were 30-day stroke, MI, death, carotid-related morbidity, other morbidity, non-home discharge, and unplanned readmission. Our data were split into training (70%) and test (30%) sets. Using 10-fold cross-validation, we trained six ML models using preoperative features with logistic regression as the baseline comparator. The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). Model robustness was evaluated with calibration plot and Brier score. Variable importance scores were calculated to determine the top 10 predictive features. Performance was assessed on subgroups based on age, sex, race, ethnicity, symptom status, stent type, and urgency. RESULTS: Overall, 2093 patients underwent CAS during the study period. Thirty-day MACE occurred in 130 (6.2%) patients. The best-performing prediction model for 30-day MACE was XGBoost, achieving an AUROC (95% CI) of 0.93 (0.92-0.94). In comparison, logistic regression had an AUROC (95% CI) of 0.67 (0.65-0.68), and existing tools in the literature demonstrate AUROCs ranging from 0.58 to 0.74. For secondary outcomes, XGBoost achieved AUROCs between 0.86 and 0.97. The calibration plot showed good agreement between predicted and observed event probabilities with a Brier score of 0.02. The top three predictive features in our algorithm were (1) symptomatic carotid stenosis, (2) age, and (3) American Society of Anesthesiologists classification. Model performance remained robust on all subgroup analyses of specific demographic and clinical populations. CONCLUSIONS: Our ML models accurately predict 30-day outcomes following transfemoral CAS using preoperative data. They have the potential for important utility in guiding risk-mitigation strategies for patients being considered for CAS to improve outcomes.Clinical ImpactTransfemoral carotid artery stenting (CAS) carries important perioperative risks. Outcome prediction tools may help guide clinical decision-making but remain limited. Using data from the National Surgical Quality Improvement Program (NSQIP) targeted vascular database, we developed machine learning (ML) models that accurately predict 30-day outcomes following transfemoral CAS using preoperative data, outperforming logistic regression and existing tools in the literature. The models were well-calibrated and remained robust across demographic and clinical subpopulations. These ML algorithms have the potential for important utility in guiding risk-mitigation strategies for patients being considered for transfemoral CAS to improve outcomes.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.002 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".