MétaCan
Menu
Back to cohort
Record W2799433785 · doi:10.1097/bpo.0000000000001179

A Systematic Review and Meta-analysis on the Reproducibility of Ultrasound-based Metrics for Assessing Developmental Dysplasia of the Hip

2018· review· en· W2799433785 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueJournal of Pediatric Orthopaedics · 2018
Typereview
Languageen
FieldMedicine
TopicHip disorders and treatments
Canadian institutionsUniversity of British ColumbiaBC Children's Hospital
Fundersnot available
KeywordsMedicineMeta-analysisReproducibilityMedical physicsPathologyStatistics

Abstract

fetched live from OpenAlex

BACKGROUND: The purposes of this study were to (1) perform a systematic review of articles that reported agreement or reproducibility in repeated diagnosis of developmental dysplasia of the hip (DDH) using ultrasound imaging, (2) estimate the reproducibility in the available dysplasia metrics, and (3) compare reproducibility of the available dysplasia metrics. METHODS: A systematic review of the Medline and Embase databases was performed by using a search strategy formulated from our research question: "For infants at risk of DDH, are US imaging-based diagnoses reproducible?" Two reviewers independently identified articles for inclusion in the systematic review, and then assessed the quality of the included studies using the Guidelines for Reporting Reliability and Agreement Studies guideline. Variability and agreement-related statistics in the included studies were extracted and included in a meta-analysis for summarizing the available statistics. The reproducibility of the available dysplasia metrics was compared, with a Bonferroni correction made to adjust for multiple comparisons. RESULTS: Twenty eight studies were included in the systematic review. Overall, the quality of the included studies was moderate (average, 10.7/15; range, 6 to 12). Graf's alpha angle had the lowest interexamination variability of the metrics assessed, followed by Graf's beta angle (the variability of the alpha angle was 10% lower than the variability of the beta angle, P<0.05). However, despite Graf's angles having lower variability compared with other dysplasia metrics, their actual variability was still problematically high. This finding was supported by the low intraclass correlation and Kappa coefficient values reported in the included studies. There was also evidence to suggest that the reproducibility in DDH diagnosis has potentially worsened over time. CONCLUSIONS: Overall, we found high variability and low agreement in all reported dysplasia metrics. Furthermore, in the last 3 decades, the repeatability of dysplasia metrics has not markedly improved and may even have declined, indicating a genuine need for improving repeatability and reliability of ultrasound-based DDH diagnosis. LEVEL OF EVIDENCE: Level III-systematic review of level III studies.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.010
metaresearch head score (Gemma)0.018
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Meta-analysis · Consensus signal: none
GenreCandidate signal: Review · Consensus signal: Review
Teacher disagreement score0.868
Threshold uncertainty score0.991

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0100.018
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0070.006
Bibliometrics0.0010.003
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.102
GPT teacher head0.368
Teacher spread0.265 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it