Assessment of 3 standards-based clinical decision support (CDS) tools in an academic electronic health record using Clinical Quality Language, CDS Hooks, and Fast Healthcare Interoperability Resources: a retrospective evaluation
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
Abstract Objectives To evaluate clinical decision support (CDS) of varying complexities and care settings represented using Health Information Technology (HIT) standards—Clinical Quality Language (CQL) for representing clinical logic and Fast Healthcare Interoperability Resources (FHIR) for health information exchange. Materials and Methods This Institutional Review Board-approved, retrospective study was performed at an academic medical center (January 1, 2023-December 31, 2023). Recommendations extracted from patient-centered outcomes guidelines were translated into standardized syntax (SNOMED CT) and representations (CQL, FHIR). Clinical decision support Hooks applications were developed for: CDS1—provides education for emergency department (ED) patients with venous thromboembolism; CDS2—recommends CT pulmonary angiogram in ED patients with suspected pulmonary embolism (PE) and uses FHIR Questionnaire resources for representing interactive content; CDS3—recommends mammography/breast magnetic resonance imaging surveillance in outpatients with breast cancer history. We randomly selected 50 ED patients with suspected PE and 50 outpatients undergoing breast imaging surveillance. We compared outcomes of false-positive alerts and the accuracy of CDS1, the more complex CDS2, and CDS3 for outpatients. Results Clinical decision support Hooks applications used CQL logic for trigger expressions and logic files and provided recommendations to ED and outpatient providers. CDS1 had a false-positive alert and accuracy of 11.1% and 98%, respectively, not significantly different from CDS2 (0.0% false-positive alerts, P = .33 and 96% accuracy, P = .56) or from CDS3 (0.0% false-positive alerts, P = .15 and 100% accuracy, P = .31). Discussion Health Information Technology standards can represent recommendations of varying complexities in various care settings. Conclusion The potential to represent CDS using standardized syntax and formats can help facilitate the dissemination of CDS-consumable artifacts.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.115 | 0.007 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.002 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.001 | 0.000 |
| Scholarly communication | 0.000 | 0.001 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.001 | 0.005 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it