Spondyloarthritis Research Consortium of Canada sacroiliac joint inflammation and structural scores: change score reliability and recalibration utility in children
Bibliographic record
Abstract
BACKGROUND: The SPARCC sacroiliac joint inflammation (SIS) and structural (SSS) scores are reliable measures to quantify abnormalities in the pediatric sacroiliac joint. We aimed to evaluate the utility of online calibration modules for the SIS and SSS and the reliability of their component change scores. METHODS: Change score reliability of 6 raters was assessed by overall and pairwise intraclass correlation coefficients (ICCs) before and after the use of real-time iterative calibration (RETIC) modules for both the SIS and SSS comprised of 20 adult cases. Acceptable ICC for change scores was > 0.7 for SIS and > 0.5 for all SSS components. Sensitivity to change was assessed by the standardized response mean (SRM). RESULTS: In scoring exercise 1, the SIS had acceptable reliability with a change score ICC of 0.80 and sclerosis was the only SSS lesion that met the acceptability threshold with a change score ICC of 0.52. After RETIC calibration, the SIS overall (ICC = 0.83) and mean pairwise (ICC = 0.83) change scores remained reliable with a large SRM (0.90). All SSS components except sclerosis met the overall and mean pairwise change score ICC acceptability thresholds-backfill: overall = 0.54, mean pairwise = 0.50; fat metaplasia: overall = 0.65, mean pairwise = 0.57; erosion: overall = 0.60, mean pairwise = 0.58; and ankylosis: overall = 0.96, mean pairwise = 0.96. The SSS RETIC module augmented the number of SSS components surpassing the acceptability threshold from 1 to 4. Sensitivity to change, as measured by the SRM, was large for erosion (0.96), moderate for backfill (0.55) and sclerosis (0.70), and small for fat metaplasia (0.36) and ankylosis (0.28). CONCLUSION: RETIC modules improved the overall reliability of SPARCC SIS and SSS change scores for previously calibrated raters. SIS recalibration was not as helpful to the most experienced raters who achieved high levels of agreement before recalibration. The SPARCC SIS and all SSS components except sclerosis are reliable measures to quantify change over time in children. A pediatric-specific RETIC tool should be developed to enhance the calibration of readers.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.001 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.001 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".