Use of the ISUP e-learning module improves interrater reliability in prostate cancer grading
Bibliographic record
Abstract
AIMS: Prostate cancer (PCa) grading is an important prognostic parameter, but is subject to considerable observer variation. Previous studies have shown that interobserver variability decreases after participants were trained using an e-learning module. However, since the publication of these studies, grading of PCa has been enhanced by adopting the International Society of Urological Pathology (ISUP) 2014 grading classification. This study investigates the effect of training on interobserver variability of PCa grading, using the ISUP Education web e-learning on Gleason grading. METHODS: The ISUP Education Prostate Test B Module was distributed among Dutch pathologists. The module uses images graded by the ISUP consensus panel consisting of 24 expert uropathologists. Participants graded the same 10 images before and after e-learning. We included those who completed the tests before and after training. We evaluated variation in PCa grading in a fully crossed study design, using linearly weighted kappa values for each pathologist, comparing them to other pathologists and to the ISUP consensus panel. We analysed the improvement in median weighted kappas before and after training, using Wilcoxon's signed rank-test. RESULTS: We included 42 pathologists. Inter-rater reliability between pathologists improved from 0.70 before training to 0.74 after training (p=0.01). When compared with the ISUP consensus panel, five pathologists improved significantly, whereas the kappa of one pathologist was significantly lower after training. All pathologists who improved significantly, graded with less than substantial agreement before training. CONCLUSIONS: ISUP Prostate Test B e-learning reduces variability in PCa grading. E-learning is a cost-effective method for standardisation of pathology.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.034 | 0.096 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.000 | 0.001 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.001 | 0.003 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.003 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".