MétaCan
Menu
← Back to cohort
Record W4406702897 · doi:10.1093/ecco-jcc/jjae190.0438

P0264 Using a machine learning model to grade clip-level endoscopic inflammation reveals the heterogeneity of mucosal inflammation in ulcerative colitis

2025· article· en· W4406702897 on OpenAlexaboutno aff
Alexander George, Klaus Gottlieb, Shrujal S. Baxi, William Eastman, D Colucci, Chakib Battioui, Yingmei Wang, Josh Lehrer, Pavel Brodskiy, Mohammad Haft‐Javaherian, David T. Rubin

Bibliographic record

VenueJournal of Crohn s and Colitis · 2025
Typearticle
Languageen
FieldBiochemistry, Genetics and Molecular Biology
TopicInflammatory Bowel Disease
Canadian institutionsnot available
Fundersnot available
KeywordsMedicineUlcerative colitisInflammationMucosal inflammationColitisGastroenterologyInternal medicineDisease

Abstract

fetched live from OpenAlex

Abstract Background Endoscopic assessment of inflammation in ulcerative colitis (UC) is a therapeutic endpoint in clinical trials1 but can be limited by inter- and intra-observer variability2 and lack of sensitivity to detect the degree of inflammation throughout the colon3. We used a machine learning (ML) model to grade inflammation of full-length endoscopy videos at the clip-level (a series of smaller segments of video) in order to evaluate the uniformity of mucosal inflammation. Methods We used a previously developed ML model that predicts the endoscopy subscore4, a component of the modified Mayo Score, and applied it to 49 full-length endoscopy videos randomly selected and stratified by endoscopic severity from the Phase 3 induction trial for mirikizumab in UC (NCT03518086). A human reviewer identified the point of maximal extent and the end of the procedure to isolate the withdrawal portion of the video which was then divided into 15, 30, or 60 second clips, and the model generated an endoscopy subscore for each clip (clip-level endoscopy subscore) and for the entire video (video-level endoscopy subscore). Variability of inflammation between clips were calculated. Results Assessment of the endoscopy subscore on individual video clips during withdrawal demonstrated a patchy distribution of inflammation severity, and this was consistent regardless of the video-level endoscopic severity (Fig. 1). Notably, the segment with the most severe inflammation did not always occur proximally (Fig. 1). The variability of inflammation was greater in 15-second (Fig. 1A) than 30-second (Fig. 1B) or 60-second (Fig. 1C) clips. Video-level endoscopy subscores of 1-3 did contain the spectrum of clip-level endoscopy subscore grades of 0-3, but the greatest proportion of clips correlated with the video-level endoscopy subscore (Fig. 2). Conclusion Using a novel ML model to determine video-level and clip-level endoscopy subscores using colonoscopy videos in patients with moderate-to-severe UC, we identify heterogeneity of inflammatory activity, and this was best observed with clips at 15-second intervals. These findings provide insight into inter- and intra-rater variability of endoscopy subscore assessments by human readers and highlight relevant data that are not captured by a single video-level score. Further study is needed to optimize assessment of inflammation in this setting. References Food and Drug Administration. Ulcerative Colitis: Developing Drugs for Treatment [Internet]. 2022 [cited 2024 Oct 17]. Available from: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/ulcerative-colitis-developing-drugs-treatment Hashash, J. G., Yu Ci Ng, F., Farraye, F. A., Wang, Y., Colucci, D. R., Baxi, S., . . . & Melmed, G. Y. (2024). Inter-and intraobserver variability on endoscopic scoring systems in crohn’s disease and ulcerative colitis: A systematic review and meta-analysis. Inflammatory Bowel Diseases, izae051. Vuyyuru, S. K., Ma, C., Nguyen, T. M., Zou, G., Peyrin-Biroulet, L., Danese, S., . . . & Jairath, V. (2024). Differential efficacy of medical therapies for ulcerative colitis according to disease extent: Patient-level analysis from multiple randomized controlled trials. EClinicalMedicine, 72. Rubin, D. T., Gottlieb, K., Colombel, J. F., Schott, J. P., Erisson, L., Prucka, B., . . . & McGill, J. (2023). Development of a novel ulcerative colitis endoscopic mayo score prediction model using machine learning. Gastro Hep Advances, 2(7), 935-942.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.003
metaresearch head score (Gemma)0.006
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Simulation or modeling · Consensus signal: Simulation or modeling
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.006
Threshold uncertainty score0.016

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0030.006
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0010.000
Science and technology studies0.0000.000
Scholarly communication0.0010.001
Open science0.0010.000
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0030.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.021
GPT teacher head0.291
Teacher spread0.270 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designSimulation or modeling
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2025
Admission routes1
Has abstractyes

Explore more

Same venueJournal of Crohn s and Colitis→Same topicInflammatory Bowel Disease→French-language works237,207→