Validation of 5 key colonoscopy-related data elements from Ontario health administrative databases compared to the clinical record: a cross-sectional study
Bibliographic record
Abstract
BACKGROUND: Colonoscopy is used widely, but its quality is highly variable, which may adversely affect patients. Research and quality-improvement initiatives in a variety of jurisdictions have sought to address this issue, often supported by the use of health administrative data. As these data are generally not collected for these purposes, it is critical to measure their validity before use. The aim of this study was to validate health administrative data definitions for 5 key colonoscopy elements through comparison to the clinical record. METHODS: In a cross-sectional study, we randomly sampled 1968 colonoscopy and noncolonoscopy procedures performed at 23 hospitals and 5 nonhospital endoscopy clinics between April 2008 and March 2009 in Ontario. We compared definitions for 5 key colonoscopy elements (colonoscopy case, colonoscopy setting, colonoscopy completeness, anesthesiologist assistance and polypectomy) derived from the health administrative data to the clinical record. We calculated weighted and unweighted sensitivity, specificity and positive predictive value, adjusted for clustering of patients within physicians, for each definition relative to the reference standard. RESULTS: We abstracted 1845 records; in 1282 cases (69.5%), colonoscopy was intended or performed. The weighted sensitivity and specificity of colonoscopy case, nonhospital colonoscopy setting and anesthesiologist assistance exceeded 95%. The weighted sensitivity for colonoscopy completeness and polypectomy exceeded 95%, but specificity was less than 90%. INTERPRETATION: Ontario health administrative data definitions for 5 key colonoscopy data elements performed well, with sensitivity and specificity values acceptable for use in research and quality-improvement initiatives. In jurisdictions where health administrative data are similarly used for research or quality improvement, similar studies could be considered.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.002 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".