MétaCan
Menu
Back to cohort
Record W4395052875 · doi:10.1055/s-0044-1783005

Variability in Computer-Aided Detection effect on Adenoma Detection Rate in randomized controlled trials: a meta-regression analysis

2024· article· en· W4395052875 on OpenAlexaff
Marco Spadaccini, M. Yuichi, Cesare Hassan, F. Antonio, Tommy Rizkala, Davide Massimi, M. Roberta, Harsh K. Patel, K. Kareem, Daryl Ramai, R. Emanuele, Franco Radaelli, Alessandro Fugazza, Matteo Colombo, D. M. Alessandro, Gianluca Franchellucci, DK Rex, Mohamed Abdelrahim, S. Prateek, Alessandro Repici

Bibliographic record

VenueEndoscopy · 2024
Typearticle
Languageen
FieldComputer Science
TopicAI in cancer detection
Canadian institutionsSt. Michael's Hospital
Fundersnot available
KeywordsMedicineMeta-analysisMeta-regressionRandomized controlled trialArtificial intelligenceAdenomaRegressionRegression analysisStatisticsInternal medicineMachine learningComputer science

Abstract

fetched live from OpenAlex

Aims The assistance of computer-aided detection (CADe) systems during colonoscopy may increase adenoma detection rate (ADR), theoretically reducing the risk of post-colonoscopy colorectal cancer (PCCRC). Although the promising results in different randomized trials, both the variability of the magnitude of relative effect of CADe systems across the previous studies, and the contradicting results in the first real-life experiences, highlighted a clear gap of knowledge when looking for those factors possibly explaining these fluctuating results. The aim of our analysis was to investigate the different variables possibly affecting the impact of CADe-assisted colonoscopy and its effect on ADR. Methods We searched MEDLINE, EMBASE, and Scopus databases until July 2023 for RCTs reporting diagnostic accuracy of CADe systems in the detection of colorectal neoplasia (PROSPERO: CRD42023462438). The main outcome was pooled adenoma detection rate (ADR). We calculated risk ratios (RRs), and performed meta-regression analysis to explore thesources of heterogeneity. The variables examined included factors with an impact on expected prevalence of adenomas across the study populations, such as gender, age and colonoscopy indication. We also included both key (ADR), and minor (Withdrawal time) performance measures considered as quality indicators for colonoscopy. Results Twenty-three randomized controlled trials (RCTs) on 19,077 patients were include. ADR was higher in the CADe group than in the standard colonoscopy group (45.83% versus 38.28%; RR 1.22 [95% CI 1.14-1.29]) with substantial level of heterogeneity (I 2 =67.69%). In univariable meta-regression analysis, patient age, ADR in control arms, and withdrawal time were the strongest predictors of CADe effect on ADR (P<.001), whereas FIT as an indication for colonoscopy was only suggestively associated with the outcome (P=0.098), and was included in the multivariable analysis. The proportion of male patients was not apparently associated with the CADe effect on ADR. In multivariable meta-regression, ADR in control arms, and withdrawal time were simultaneous significant predictors of the proportion of the CADe effect on ADR. Conclusions In conclusion, the substantial level of heterogeneity found appeared to be associated with variability in colonoscopy quality performances across the studies. As a matter of fact, across all the studies in which the CADe system showed no relative effect, the baseline ADR was higher than 60% suggesting a possible “ceiling effect” with little room left for improvement in the intervention group. On the other hand, endoscopists with lower quality performances are going to benefit the most from the use of CADe systems during colonoscopy, irrespectively from the expected adenoma prevalence across different populations. Thus, the implementation of CADe-assisted colonoscopy is supposed to help in reducing the gap in term of detection performances between high- and low- detectors. Publication History Article published online: 15 April 2024 © 2024. European Society of Gastrointestinal Endoscopy. All rights reserved. Georg Thieme Verlag KG Rüdigerstraße 14, 70469 Stuttgart, Germany

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.071
metaresearch head score (Gemma)0.130
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Meta-epidemiology (broad)
Consensus categoriesnone
DomainCandidate signal: Methods · Consensus signal: none
Study designCandidate signal: Meta-analysis · Consensus signal: Meta-analysis
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.987
Threshold uncertainty score0.375

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0710.130
Meta-epidemiology (narrow)0.0020.001
Meta-epidemiology (broad)0.0130.046
Bibliometrics0.0030.003
Science and technology studies0.0010.001
Scholarly communication0.0040.002
Open science0.0030.001
Research integrity0.0030.004
Insufficient payload (model declined to judge)0.0040.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.025
GPT teacher head0.321
Teacher spread0.296 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designMeta-analysis
DomainMethods
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2024
Admission routes1
Has abstractyes

Explore more

Same venueEndoscopySame topicAI in cancer detectionFrench-language works237,207