Inter-rater and Intrarater Reliabilities of the Identification of a “Gothic Arch” in the Acetabulum of Children With Cerebral Palsy
Bibliographic record
Abstract
BACKGROUND: Progressive hip displacement in children with cerebral palsy (CP) is monitored by measuring migration percentage (MP) on anteroposterior (AP) pelvis radiographs. Accurate measurement of MP requires the lateral margin of the ossified acetabulum to be identified for the placement of Perkin's line. It has been suggested that when there is an erosion of the acetabular rim, described as a gothic arch, the midpoint of the arch be used for the placement of Perkin's line. However, this requires that there be agreement on what constitutes a gothic arch. The purpose of this study was to evaluate the inter-rater and intrarater reliabilities of identifying a gothic arch on pelvis radiographs. METHODS: An online survey with 100 AP pelvis images (200 hips) of children with CP was sent to international experts. Participants were asked to identify which hip(s) had a gothic arch (left, right, both, and neither). The Fleiss κ statistic for inter-rater reliability was calculated. Eight weeks later, the images were shuffled and redistributed to calculate intrarater reliability. RESULTS: The initial survey was completed by 10 participants with 9 participants completing the second survey. The average inter-rater κ value was 0.18 [95% confidence interval (CI), 0.14-0.23] and 0.19 (95% CI, 0.14-0.24) for the 2 surveys, respectively. Among the pediatric orthopaedic surgeons subgroup, the κ values were 0.06 (95% CI, 0.02-0.1) and 0.08 (95% CI, 0.03-0.13). The average intrarater reliability κ value was 0.61 (95% CI, 0.2-1), ranging from 0.32 to 0.86. CONCLUSIONS: There were poor inter-rater and moderate intrarater reliabilities in identifying a gothic arch on AP pelvis radiographs in children with CP. Further characterization and clarification of what constitutes a gothic arch are required. The lack of agreement on the identification of a gothic arch may negatively impact the measurement of MP and referrals to a pediatric orthopaedic surgeon.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".