Development of a Scoring Tool for Chronic Nonbacterial Osteomyelitis Magnetic Resonance Imaging and Evaluation of its Interrater Reliability
Bibliographic record
Abstract
OBJECTIVE: Serial magnetic resonance imaging (MRI) examinations are often needed in chronic nonbacterial osteomyelitis (CNO) to determine the objective response to treatment. Our objectives in this study were (1) to develop a consensus-based MRI scoring tool for clinical and research use in CNO; and (2) to evaluate interrater reliability and agreement using whole-body (WB)-MRI from children with CNO. METHODS: Eleven pediatric radiologists discussed definitions and grading of signal intensity, size of signal abnormality within bone marrow, and associated features on MRI through monthly conference calls and a consensus meeting, using a nominal group technique in July 2017. WB-MRI scans from children with CNO were deidentified for training reading and an interrater reliability study. The reading by each radiologist was conducted in a randomized order. Interrater reliability for abnormal signal and severity were assessed using free-marginal κ statistics. RESULTS: Radiologists reached a consensus on grading CNO-specific MRI findings and on describing bone units based on anatomy. A total of 45 sets of WB-MRI scans, including 4 sets of non-CNO MRI examinations, were selected for the final reading. The mean κ of each category of bones was > 0.7 with majority > 0.9 demonstrating substantial/almost perfect interrater reliability of readings among radiologists. The agreement on signal intensity and the size of signal abnormality within the most commonly affected bones (femur and tibia) were lower than those of other bones. CONCLUSION: The chronic nonbacterial osteomyelitis magnetic resonance imaging scoring (CROMRIS) tool is a comprehensive standardized scoring tool for MRI in children with CNO. Our interrater study demonstrated good interrater reliability and agreement of readings.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".