MétaCan
Menu
← Back to cohort

S833 Gradient Boosted Decision Tree to Model Ustekinumab Trough Levels in Crohn’s Disease

2022· article· en· W4316077523 on OpenAlexaboutno aff
Adam A. Saleh, Natalia Miroballi, Rachel Stading, Kerri Glassner, Bincy Abraham

Bibliographic record

VenueThe American Journal of Gastroenterology · 2022
Typearticle
Languageen
FieldBiochemistry, Genetics and Molecular Biology
TopicInflammatory Bowel Disease
Canadian institutionsnot available
Fundersnot available
KeywordsMedicineUnivariate analysisInternal medicineUnivariateCohortInfliximabFaecal calprotectinDiseaseMultivariate analysisMultivariate statisticsCalprotectinInflammatory bowel diseaseMachine learning

Abstract

fetched live from OpenAlex

Introduction: Strategies for predicting ustekinumab (UST) trough levels with machine learning techniques can improve personalized care and aid in decision making for UST initiation or scheduling. The aim of this study was to identify variables capable of predicting an adequate UST response through a gradient boosted decision trees (GBDT) model. Methods: A retrospective cohort of Crohn’s disease (CD) patients from our quaternary referral center being treated with UST were reviewed for variables including age, gender, ethnicity, BMI, dosing schedule, time passed since starting UST, previously used biologics, disease duration, age of diagnosis, disease location, disease behavior, and measurements of inflammation. Measurements of inflammation included albumin, CRP, ESR, lactoferrin, calprotectin, Harvey Bradshaw index (HBI), SES-CD, Rutgeerts, and intestinal ultrasound results. Null values were replaced with the mean of the rest of the feature. As part of feature selection, a univariate analysis was conducted to determine which features significantly correlated with UST trough levels. These features were then used to train a multivariate GBDT model, which was then evaluated using a nested cross-validation framework. The gini importance of the features included in each model was then ranked and then averaged across the different models. Results: 155 CD patients were identified in our cohort with UST trough levels obtained. Univariate analysis determined the following variables to be significant predictors: female gender, dosing schedule, time on UST, ESR, CRP, failed adalimumab, failed infliximab, failed certolizumab, and the Montreal classifications B1, B3, L1, L3. Results of various input variable combinations are outlined in Figure. The gini importance of features in each model is included in Table. Of the generated GBDT models, core variables only, and core variables with previous biologic exposure and CD characteristics were the best performing models with mean AUC of 0.72 ± 0.10 and 0.71 ± 0.09 respectively. Conclusion: Within our study, this proof-of-concept study demonstrates how predictive models can be used to understand predictive variables for UST response, and when additional doses of UST might be necessary to achieve therapeutic levels. Our proof-of-concept models seem to illustrate that the most predictive variables for UST trough levels were time passed since starting UST, dosing schedule, ileocolonic disease, and previously failed anti-tumor necrosis factor agents.Figure 1.: Impact of variable combinations on Gradient Boosted Decision Tree (GBDT) model’s area under the receiver operating characteristic curve (AUC). Graphs show mean (standard deviation) receiver operating characteristic (ROC) curves and AUCs for GBDT models with A) All variables B) Core variables (CV) plus previous biologic exposure and Crohn’s disease characteristics, C) CV plus Crohn’s Disease characteristics D) CV plus previous biologic exposure, E) CV plus inflammatory markers, and F) only CV. Core variables consist of gender, dosing schedule, and time on UST. Inflammatory markers consist of, erythrocyte sedimentation rate (ESR), and C-reactive protein (CRP). Previous biologic exposure includes adalimumab, infliximab, and certolizumab. Crohn’s disease characteristics includes disease location, and disease behavior (stricturing vs fistulizing). Table 1. - Gini importance ranking of variables from different models Variable All CV + previous biologic exposure + CD characteristics CV + CD Characteristics CV + previous biologic exposure CV + Inflammatory Markers CV Average Core Variables (CV) Gender 9 4 4 6 5 3 4 Dosing Schedule 5 2 3 3 4 2 2 Time on UST 1 1 1 1 1 1 1 Previous Biologic Exposures Failed Adalimumab 6 7 - 4 - - 6 Failed Infliximab 10 6 - 2 - - 5 Failed Certolizumab 7 8 - 5 - - 7 CD Characteristics Non-stricturing, non-penetrating 12 10 6 - - - 11 Penetrating 11 5 5 - - - 10 Ileal Disease 8 9 7 - - - 12 Ileocolonic Disease 4 3 2 - - - 3 Inflammatory Markers CRP 2 - - - 2 - 8 ESR 3 - - - 3 - 9 Final column averages the gini importance from each model combination before ranking them in order of importance.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.002
metaresearch head score (Gemma)0.003
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Simulation or modeling · Consensus signal: Simulation or modeling
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.012
Threshold uncertainty score0.025

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0020.003
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0010.001
Science and technology studies0.0000.000
Scholarly communication0.0010.000
Open science0.0010.000
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0020.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.011
GPT teacher head0.251
Teacher spread0.241 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designSimulation or modeling
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2022
Admission routes1
Has abstractyes

Explore more

Same venueThe American Journal of Gastroenterology→Same topicInflammatory Bowel Disease→French-language works237,207→