Validation of billing code combinations to identify cardiovascular magnetic resonance imaging scans in Ontario, Canada: a retrospective cohort study
Bibliographic record
Abstract
OBJECTIVES: Cardiovascular magnetic resonance (CMR) imaging is the gold-standard test for the assessment of heart function. Despite its importance, many jurisdictions lack specific billing codes that can be used to identify patient receipt of CMR in administrative databases, limiting the ability to perform 'big data' CMR studies. Our objective was to identify the optimal billing code combination to identify patients who underwent CMR using administrative data in Ontario. DESIGN: Retrospective cohort study. SETTING: Quaternary care academic referral centre in Ontario, Canada. PARTICIPANTS: We tested all billing code combinations in order to identify the optimal one to determine receipt of CMR. The reference gold standard was a list of all cardiothoracic magnetic resonance scans performed at Sunnybrook Health Sciences Centre between 1 January 2014 and 31 December 2016, verified by chart audit. We assessed the diagnostic performance (accuracy, sensitivity, specificity, positive predictive value and negative predictive value) for all code combinations. RESULTS: Our gold-standard cohort consisted of 2339 thoracic MRIs that were performed at Sunnybrook Health Sciences Centre from 1 January 2014 to 31 December 2016. Of these, 2139 (91.5%) were CMRs and 200 (8.5%) were chest MRIs. We identified the most accurate billing combination for the determination of patient receipt of CMR. This combination resulted in an accuracy of 95.3% (95% CI 94.4% to 96.2%), sensitivity of 97.4% (95% CI 96.6% to 98.1%), specificity of 86.4% (95% CI 83.1% to 89.6%), positive predictive value of 96.9% (95% CI 96.1% to 97.6%) and negative predictive value of 88.4% (95% CI 85.4% to 91.5%). CONCLUSIONS: Our study is the first to verify the ability to accurately identify patient receipt of CMR using administrative data, facilitating more robust population-based CMR studies in the future.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.004 | 0.017 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.002 | 0.004 |
| Science and technology studies | 0.003 | 0.002 |
| Scholarly communication | 0.002 | 0.001 |
| Open science | 0.002 | 0.002 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".