MétaCan
Menu
Back to cohort
Record W4376113111 · doi:10.1001/jamacardio.2023.0968

Automated Assessment of Cardiac Systolic Function From Coronary Angiograms With Video-Based Artificial Intelligence Algorithms

2023· article· en· W4376113111 on OpenAlexaffabout
Robert Avram, Joshua Barrios, Sean Abreau, Cheng Yee Goh, Zeeshan Ahmed, Kevin C. Chung, Derek So, Jeffrey E. Olgin, Geoffrey H. Tison

Bibliographic record

VenueJAMA Cardiology · 2023
Typearticle
Languageen
FieldMedicine
TopicCardiovascular Function and Risk Factors
Canadian institutionsUniversité de MontréalMontreal Heart InstituteUniversity of Ottawa
FundersNational Heart, Lung, and Blood Institute
KeywordsEjection fractionMedicineReceiver operating characteristicCardiologyCoronary artery diseaseInternal medicineOdds ratioAlgorithmHeart failureComputer science

Abstract

fetched live from OpenAlex

Importance: Understanding left ventricular ejection fraction (LVEF) during coronary angiography can assist in disease management. Objective: To develop an automated approach to predict LVEF from left coronary angiograms. Design, Setting, and Participants: This was a cross-sectional study with external validation using patient data from December 12, 2012, to December 31, 2019, from the University of California, San Francisco (UCSF). Data were randomly split into training, development, and test data sets. External validation data were obtained from the University of Ottawa Heart Institute. Included in the analysis were all patients 18 years or older who received a coronary angiogram and transthoracic echocardiogram (TTE) within 3 months before or 1 month after the angiogram. Exposure: A video-based deep neural network (DNN) called CathEF was used to discriminate (binary) reduced LVEF (≤40%) and to predict (continuous) LVEF percentage from standard angiogram videos of the left coronary artery. Guided class-discriminative gradient class activation mapping (GradCAM) was applied to visualize pixels in angiograms that contributed most to DNN LVEF prediction. Results: A total of 4042 adult angiograms with corresponding TTE LVEF from 3679 UCSF patients were included in the analysis. Mean (SD) patient age was 64.3 (13.3) years, and 2212 patients were male (65%). In the UCSF test data set (n = 813), the video-based DNN discriminated (binary) reduced LVEF (≤40%) with an area under the receiver operating characteristic curve (AUROC) of 0.911 (95% CI, 0.887-0.934); diagnostic odds ratio for reduced LVEF was 22.7 (95% CI, 14.0-37.0). DNN-predicted continuous LVEF had a mean absolute error (MAE) of 8.5% (95% CI, 8.1%-9.0%) compared with TTE LVEF. Although DNN-predicted continuous LVEF differed 5% or less compared with TTE LVEF in 38.0% (309 of 813) of test data set studies, differences greater than 15% were observed in 15.2% (124 of 813). In external validation (n = 776), video-based DNN discriminated (binary) reduced LVEF (≤40%) with an AUROC of 0.906 (95% CI, 0.881-0.931), and DNN-predicted continuous LVEF had an MAE of 7.0% (95% CI, 6.6%-7.4%). Video-based DNN tended to overestimate low LVEFs and underestimate high LVEFs. Video-based DNN performance was consistent across sex, body mass index, low estimated glomerular filtration rate (≤45), presence of acute coronary syndromes, obstructive coronary artery disease, and left ventricular hypertrophy. Conclusion and relevance: This cross-sectional study represents an early demonstration of estimating LVEF from standard angiogram videos of the left coronary artery using video-based DNNs. Further research can improve accuracy and reduce the variability of DNNs to maximize their clinical utility.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.305
Threshold uncertainty score0.718

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0000.001
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.025
GPT teacher head0.292
Teacher spread0.267 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations26
Published2023
Admission routes2
Has abstractyes

Explore more

Same venueJAMA CardiologySame topicCardiovascular Function and Risk FactorsFrench-language works237,207