Abstract B029: Confident Filtering in the context of primary Gleason pattern classification
Bibliographic record
Abstract
Abstract Objective: Advancements in deep neural network-based models (deep AI) can be used to provide clinical assessments of Gleason patterns in digital prostate pathology slides. We cover the variability in clinical assessments which provides challenges in training a deep neural model with small glandular regions with limited sample sizes. Method: A convolutional neural network (CNN) model with transfer learning was used to train on pathology images with smaller patches that provide representation of a section with multiple glands of similar glandular architecture (primary Gleason pattern) level data (300x300 pixel or 40-140 micron patches). We assembled a cohort of Hematoxylin Eosin (H&E) stained sections with patches (3311 GS3 and 2909 GS4 patches) extracted from whole slide images from a cohort of 58 patients. We used calibrated confidence on the clinical scoring of the pathological slides at the pre-training phase. We conducted seven experiments splitting the data randomly, but with the constraint that all patches in holdout sets were not part of training (at patient biopsy whole slide level). For each experiment the training data was further split into 5 training-validation folds, that results in 35 models for each ablation study. We compare our findings to a naïve baseline. The baseline used in this study comprises: a VGG16 network with all CNN layers (5 stage) but with a smaller 2-stage fully-connected output classification layer (as implemented for all models), trained with an AdamW optimizer (with default TensorFlow settings), original ground-truth labels (no label flipping or removal of training samples), and no confidence filtering. Additionally, the optimal case (averaged over 5 folds) is compared to unoptimized case without ensembling. In both the unoptimized and optimized cases, all models were trained for ∼600 epochs, and the models with lowest validation loss were saved. Results: We found optimized AI models were able to improve classification of the primary score at the patch level (Gleason 3 vs 4) using ensembles, training-label reassignment and ambiguous sample elimination, and most dramatically by filtering on the highest confidence samples. We achieved a mean accuracy of 0.74, F 1 of 0.72 and AUC of 0.79 estimated using holdout sets classifying small patches with Gleason 3 and 4 patterns. Average performance on all metrics were improved by roughly 20%, when accounting for all optimizations Citation Format: Ryan Fogarty, Dmitry Goldgof, Laerence Hall, Jasreman Dhillon, Vaibhav Chumbalkar, Yoganand Balagurunathan. Confident Filtering in the context of primary Gleason pattern classification [abstract]. In: Proceedings of the AACR Special Conference in Cancer Research: Artificial Intelligence and Machine Learning; 2025 Jul 10-12; Montreal, QC, Canada. Philadelphia (PA): AACR; Clin Cancer Res 2025;31(13_Suppl):Abstract nr B029.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.002 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".