Internal and external validation of an updated ICD-10-CA to AIS-2005 update 2008 algorithm
Bibliographic record
Abstract
BACKGROUND: Administrative data are a powerful tool for population-level trauma research but lack the trauma-specific diagnostic and injury severity codes needed for risk-adjusted comparative analyses. The objective of this study was to validate an algorithm to derive Abbreviated Injury Scale (AIS-2005 update 2008) severity scores from Canadian International Classification of Diseases (ICD-10-CA) diagnostic codes in administrative data. METHODS: This was a retrospective cohort study using data from the 2009 to 2017 Ontario Trauma Registry for the internal validation of the algorithm. This registry includes all patients treated at a trauma center who sustained a moderate or severe injury or were assessed by a trauma team. It contains both ICD-10-CA codes and injury scores assigned by expert abstractors. We used Cohen's kappa (𝜅) coefficient to compare AIS-2005 Update 2008 scores assigned by expert abstractors to those derived using the algorithm and the intraclass correlation coefficient to compare assigned and derived Injury Severity Scores. Sensitivity and specificity for detection of a severe injury (AIS score, ≥ 3) were then calculated. For the external validation of the algorithm, we used administration data to identify adults who either died in an emergency department or were admitted to hospital in Ontario secondary to a traumatic injury (2009-2017). Logistic regression was used to evaluate the discriminative ability and calibration of the algorithm. RESULTS: Of 41,869 patients in the Ontario Trauma Registry, 41,793 (99.8%) had at least one diagnosis matched to the algorithm. Evaluation of AIS scores assigned by expert abstractors and those derived using the algorithm demonstrated a high degree of agreement in identification of patients with at least one severe injury (𝜅 = 0.75; 95% confidence interval [CI], 0.74-0.76). Likewise, algorithm-derived scores had a strong ability to rule in or out injury with AIS ≥ 3 (specificity, 78.5%; 95% CI, 77.7-79.4; sensitivity, 95.1; 95% CI, 94.8-95.3). There was strong correlation between expert abstractor-assigned and crosswalk-derived Injury Severity Score (intraclass correlation coefficient, 0.80; 95% CI, 0.80-0.81). Among the 130,542 patients identified using administrative data, the algorithm retained its discriminative properties. CONCLUSION: Our ICD-10-CA to AIS-2005 update 2008 algorithm produces reliable estimates of injury severity and retains its discriminative properties with administrative data. Our findings suggest that this algorithm can be used for risk adjustment of injury outcomes when using population-based administrative data. LEVEL OF EVIDENCE: Diagnostic Tests/Criteria; Level II.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.055 | 0.165 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.004 | 0.003 |
| Science and technology studies | 0.001 | 0.001 |
| Scholarly communication | 0.003 | 0.001 |
| Open science | 0.003 | 0.002 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.002 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".