P0238 Reliability of magnetic resonance imaging indices for evaluating perianal fistulizing disease activity in paediatric Crohn’s disease
Bibliographic record
Abstract
Abstract Background Progress in clinical trials and drug development for paediatric perianal fistulising CD (pfCD) depends upon accurate, reproducible imaging to assess disease activity and measure treatment response. We evaluated the inter- and intra-rater reliability of existing radiologic disease activity indices and anatomical classification systems previously identified as appropriate for assessment of paediatric pfCD.1 Methods A retrospective cohort (N=50) of magnetic resonance imaging (MRI) exams representing a full spectrum of paediatric (<18 years) perianal CD severity was selected by a single expert paediatric radiologist. Methods described by Zou2 were used to estimate sample size. Three separate radiologists (2 paediatric) blinded to clinical information assessed pfCD in the exams using the Magnetic Resonance Novel Index for Fistula Imaging in CD (MAGNIFI-CD), Van Assche Index (VAI), modified VAI (mVAI), Paediatric MRI based Perianal Crohn’s disease (PEMPAC) index, a visual analogue scale (VAS) of overall pfCD disease severity (range, 0-100 mm), as well as with the Park’s and St. James University Hospital anatomic classification systems. Two radiologists read all exams twice, separated by 2 weeks, and 1 radiologist read the exams once (250 total reads). Intra- and inter-rater reliability was evaluated using intraclass correlation coefficients (ICC; equivalent to weighted kappa). Precision of the ICC estimates was quantified with 95% confidence intervals (CIs) obtained using clustered bootstrapping. Degree of reliability was interpreted with benchmarks proposed by Landis and Koch3. Results Median age of children was 13.5 years (IQR 11.4-16.1), and 64% were male. Median Paediatric Crohn’s Disease Activity Index score at time of imaging was 17.5 (IQR 10-32.5). Substantial (ICC>0.61) inter-rater reliability was observed for MAGNIFI-CD, VAI, and mVAI (Table 1), with the highest ICCs observed for the mVAI (0.72 [0.6 to 0.79]). Moderate (ICC>0.41) inter-rater reliability was observed for PEMPAC, St. James University Hospital classification, and the VAS, and fair (ICC>0.21) inter-rater reliability was observed for Parks classification. Intra-rater reliability was nearly perfect (ICC>0.81) for the VAS, and substantial for all indices except for Parks classification, which had moderate (0.60 [0.44 to 0.75]) intra-rater reliability (Table 1). Conclusion Most existing multi-item MRI-based disease activity indices and the St. James Hospital classification were reliable for the assessment of paediatric pfCD in our cohort. Our preliminary results suggest that the disease activity indices may have utility to measure treatment effect in paediatric pfCD clinical trials. References 1.Crowley E, Ma C, Guizzetti L, Zou G, Lewindon PJ, Gee MS, et al. Recommendations for Standardizing MRI-based Evaluation of Perianal Fistulizing Disease Activity in Pediatric Crohn's Disease Clinical Trials. Inflamm Bowel Dis. 2024;30(3):357-69. 2.Zou GY. Sample size formulas for estimating intraclass correlation coefficients with precision and assurance. Statistics in Medicine. 2012;31(29):3972-398 3.Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159-74.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.027 | 0.087 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.002 | 0.001 |
| Science and technology studies | 0.000 | 0.001 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.001 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".