Abstract 15435: Evaluating Sex-Disparities in Machine Learning Decision Support Tools for Acute Coronary Syndrome Classification in the Emergency Department
Bibliographic record
Abstract
Introduction: Women are less likely than men to be promptly diagnosed with acute coronary syndrome (ACS) and have worse post-ACS outcomes. These diagnostic failures are partially due to ACS findings on surface ECG manifesting differently in women, which may result in unnecessary delays in treatment. To narrow health disparities, we aim to investigate the sex-specific signatures of ACS as they appear on ECGs. Methods: This was a prospective observational cohort study of chest-pain patients evaluated for suspected ACS at 3 UPMC-affiliated tertiary care hospitals. After featurization, all ECG data were separately fed into 7 machine learning classifiers to predict ACS. We examined the results by sex. We also investigated two other methods: (1) building two independent models based respectively on the female and male subgroups and (2) building a model based on the initial total sample supplemented by the patients’ sex. We used Shapley values to explain the decision-making criteria of the models. We report the results for random forest, the best performing classifier. Results: Our sample consisted of 4132 patients (Age 59 ± 16; 47% female; 15% ACS). Machine learning models continue to disproportionately underperform in females across all classifiers evaluated. The sensitivity, specificity and false negative rate in the global model blinded to sex were 82.89%, 76.22% and 17.11% for men, and 67.39%, 74.16% and 32.61% for women (p<0.0001). This statistically significant gap could not be alleviated by building sex-specific models or feeding sex to the input of the model. Indeed, the rate of false negatives in sex-specific models and global models with sex as input were 14.67% and 18.42% for men, and 34.04% and 32.61% for women (p<0.0001). The explainability analysis of the sex-specific models revealed that STT configuration in lateral leads is most informative in women, whereas STT configuration in all leads and particularly in anterolateral leads most informative in men. Conclusions: Machine learning models display crucial sex differences in the ACS signatures on the ECG that consistently put women in a detrimental situation. The alternative methods investigated here are not adequate solutions for this disparity. Thus, further investigations should be conducted.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.004 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".