Improving Safety Recommendations Before Implementation: A Simulation-Based Event Analysis to Optimize Interventions Designed to Prevent Recurrence of Adverse Events
Bibliographic record
Abstract
Introduction Pediatric inpatients are at high risk of adverse events (AE). Traditionally, root cause analysis was used to analyze AEs and identify recommendations for change. Simulation-based event analysis (SBEA) is a protocol that systematically reviews AEs by recreating them using in situ simulated patients, to understand clinician decision making, improve error discovery, and, through guided sequential debriefing, recommend interventions for error prevention. Studies suggest that these interventions are rarely tested before dissemination. This study investigates the use of simulation to optimize recommendations generated from SBEA before implementation. Methods Recommendations and interventions developed through SBEA of 2 hospital-based AEs (event A: error of commission; event B: error of detection) were tested using in situ simulation. Each scenario was repeated 8 times. Interventions were modified based on participant feedback until the error stopped occurring and data saturation was reached. Results Data saturation was reached after 6 simulations for both scenarios. For scenario A, a critical error was repeated during the first 2 scenarios using the initial interventions. After modifications, errors were corrected or mitigated in the remaining 6 scenarios. For scenario B, 1 intervention, the nursing checklist, had the highest impact, decreasing average time to error detection to 6 minutes. Based on feedback from participants, changes were made to all but one of the original proposed interventions. Conclusions Even interventions developed through improved analysis techniques, like SBEA, require testing and modification. Simulation optimizes interventions and provides opportunity to assess efficacy in real-life settings with clinicians before widespread implementation.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.006 | 0.003 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.001 | 0.004 |
| Science and technology studies | 0.001 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".