MétaCan
Menu
Back to cohort
Record W4400296949 · doi:10.1093/humrep/deae108.025

O-025 An artificial intelligence (AI) model non-invasively evaluates endometrial receptivity from ultrasound images, surpassing endometrial thickness (EMT) in predicting implantation

2024· article· en· W4400296949 on OpenAlexaff
J Fjeldstad, Qi Wu, N Siddique, N Mercuri, A Krivoi, Dan Nayot

Bibliographic record

VenueHuman Reproduction · 2024
Typearticle
Languageen
FieldImmunology and Microbiology
TopicReproductive System and Pregnancy
Canadian institutionsCReATe Fertility Centre
Fundersnot available
KeywordsUltrasoundEndometriumMedicineGynecologyObstetricsRadiology

Abstract

fetched live from OpenAlex

Abstract Study question Can an AI image-based model be trained to predict whether an endometrium, prior to progesterone, is receptive for successful embryo implantation from ultrasound images? Summary answer An endometrial receptivity AI model, utilizing ultrasound images and clinical features, is predictive of successful implantation and outperforms endometrial thickness as a predictor of implantation. What is known already Despite its importance in successful embryo implantation and subsequent live birth, endometrial receptivity is difficult to measure. The standard of care at some clinics is to cancel an embryo transfer if EMT is measuring less than 7 mm on ultrasound assessment – however, achieving an EMT threshold does not guarantee success, even with euploid blastocysts. Currently available receptivity tests (e.g. endometrial receptivity assays) are unreliable and have not shown significant improvements in reproductive outcomes, necessitating the development of new evaluation methods for endometrial receptivity. AI can potentially address this gap in clinical care and understanding, aiming to increase patient success. Study design, size, duration 79,602 ultrasound images (40,910 patients) of the endometrium, on the day of progesterone start according to patient’s frozen embryo transfer cycle, were retrospectively collected from 4 clinic networks including 70 clinic locations. PGT-A outcomes and blastocyst quality were available for 15,466 and 36,070 blastocysts respectively, with 14,538 having labels for both. Different image samples (based on embryo quality) were selected to train and test several AI models, with implantation (positive beta-hCG) as a binary outcome. Participants/materials, setting, methods Three criteria for negative (implantation) class sample selection were tested for receptivity model development: 1) high- or medium-quality and/or euploid blastocysts; 2) high-quality blastocysts; 3) all blastocysts. Models were ensembles consisting of an image-based deep learning (DL)-model and a feature-based machine learning (ML)-model. Model performance was measured by Area-under-the-curve (AUC), sensitivity, and specificity. Feature importance from the ML model was assessed, while receptivity model performance was compared to the power of EMT to predict implantation. Main results and the role of chance A receptivity model trained on scenario 1) (n = 27,424) achieved AUC 0.613, sensitivity 0.716, and specificity 0.439 on a test set of 9197 samples, in predicting implantation. Another receptivity model trained on scenario 2) (n = 25,625) achieved AUC 0.627, sensitivity 0.637, and specificity 0.543 on a test set of 8642. Whereas a third receptivity model trained on scenario 3) (n = 31,238) was selected for further analysis as it attained the best performance with AUC 0.631, sensitivity 0.628, and specificity 0.556 on a test set of 10,422. The ensemble model also utilizes relevant clinical features, which were ranked by importance to model predictions: EMT; progesterone blood test value; age at transfer; previous total embryo transfers; days between ultrasound date and transfer date; age at retrieval; and oocyte origin. EMT was assessed for its ability to predict implantation at thresholds between 5–20 mm. The threshold that best separates positive and negative implantation was determined by evaluating AUC on a validation set of 5682. A threshold of 8.8 mm achieved an AUC 0.576, sensitivity 0.694, and specificity 0.455 in predicting implantation on a test set of 5686. However, the receptivity model AUC (0.631) was significantly higher (p < 0.001; DeLong test for differences in AUC), outperforming EMT predictability. Limitations, reasons for caution The endometrial receptivity model was built and tested on retrospective frozen embryo transfer data. Results should be corroborated in prospective and non-selection studies, as well as in multiple geographical locations (all clinics included reside in the United States). The dataset requires greater diversification, with a greater representation of EMT (<7mm). Wider implications of the findings This study indicates that an AI model can be built to predict implantation from ultrasound images and clinical features, surpassing current standards - EMT alone. Further experimentation, with additional clinical features, may improve performance to facilitate development of a model that can accurately predict the gold-standard of live birth. Trial registration number Not applicable

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.004
metaresearch head score (Gemma)0.002
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMeta-epidemiology (narrow)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Bench or experimental · Consensus signal: Bench or experimental
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.035
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0040.002
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0010.001
Science and technology studies0.0010.000
Scholarly communication0.0000.001
Open science0.0000.000
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.073
GPT teacher head0.339
Teacher spread0.266 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designBench or experimental
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations5
Published2024
Admission routes1
Has abstractyes

Explore more

Same venueHuman ReproductionSame topicReproductive System and PregnancyFrench-language works237,207