Identifying diagnostic errors in the emergency department using trigger-based strategies
Bibliographic record
Abstract
IMPORTANCE: Diagnostic errors represent a major patient safety concern, with the potential to significantly impact patient outcomes. To address this, various trigger-based strategies have been developed to identify diagnostic errors, aiming to enhance clinical decision-making and improve patient safety. OBJECTIVE: To evaluate the performance of three pre-established triggers (T) in the emergency department (ED) setting and assess their effectiveness in detecting diagnostic errors. DESIGN: Consecutive cohort, retrospective observational design. SETTING: Academic ED with 80 000 annual visits. PARTICIPANTS: Adults and children presenting to a single ED in the USA between 1 May 2018 and 1 January 2020. INTERVENTION/OUTCOMES: Electronic health records (EHRs) were retrieved and categorised into trigger-positive and trigger-negative cases using the following criteria: T1-unscheduled returnvisits to the ED with admission within 7-10 days of theinitial visit; T2-care escalation from the inpatient unitto the intensive care unit (ICU) within 6, 12 or 24 hoursof ED admission; and T3-all deaths in the ED or within24 hours of ED admission, excluding palliative care. A random sample of trigger-positive cases was reviewed using the SaferDx tool to determine the presence or absence of a diagnostic error. RESULTS: A total of 5791 trigger-positive and 118262 trigger-negative cases were identified. Among trigger-positive cases, 4159 (72%) were associated with T1, 1415 (24%) with T2, and 217 (4%) with T3. A preliminary chart review of 462 trigger-positive and 251 trigger-negative cases showed most were error-negative (279 and 217, respectively). Detailed reviews found 32 diagnostic errors among 183 trigger-positive cases, yielding PPVs of 5.4% (T1), 8.9% (T2), and 6.9% (T3). No errors were found in 34 reviewed trigger-negative cases, resulting in a 100% NPV. Sepsis was the most common diagnosis among error-positive cases (n=11, 34.4%). Those with non-specific chief complaints like altered mental status or shortness of breath had higher diagnostic error risk. CONCLUSION AND RELEVANCE: While previously proposed EHR-based triggers can identify some diagnostic errors, they are insufficient for detecting all cases. To improve error detection performance, we recommend exploring data-driven strategies, such as machine learning techniques, to more effectively identify underlying contributing factors to diagnostic errors and enhance detection accuracy in the ED.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.007 | 0.035 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.001 |
| Bibliometrics | 0.006 | 0.003 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.001 | 0.002 |
| Research integrity | 0.001 | 0.000 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".