Evaluation of the Effectiveness of Advanced Technology Clinical Simulation Manikins in Improving the Capability of Australian Paramedics to Deliver High-Quality Cardiopulmonary Resuscitation: Pre- and Postintervention Study
Bibliographic record
Abstract
Background: Emergency medical services attend out-of-hospital cardiac arrests all across Australia. Resuscitation by emergency medical services is attempted in nearly half of all cases. However, resuscitation skills can degrade over time without adequate exposure, which negatively impacts patient survival. Consequently, for paramedics working in areas with low out-of-hospital cardiac arrest case volumes, ambulance services and professional bodies recognize the importance of alternative ways to maintain resuscitation skills. Simulation-based training via resuscitation manikins offers a potential solution for maintaining paramedic clinical practice skills. Objective: The aim of the study is to examine the effectiveness of advanced technology clinical simulation manikins and accompanying simulation resources (targeted clinical scenarios and debriefing tools) in improving the demonstrable capability of paramedics to deliver high-quality patient care, as measured by external cardiac compression (ECC) performance. Methods: A pre- and postintervention study design without a control group was used. Data were collected at the start of the manikin training forum (baseline), immediately following the training forum (time 2), and 6 to 11 months after the training forum (time 3). The study was conducted with paramedics from 95 NSW Ambulance locations (75 regional locations and 20 metropolitan locations). Eligible participants were paramedics who were employed by NSW Ambulance (N=106; 100% consent rate). As part of the intervention, paramedics attended a training session on the use of advanced technology simulation manikins. Manikins were then deployed to locations for further use. The main outcome measure was an overall compression score that was automatically recorded and calculated by the simulator manikin in 2-minute cycles. This score was derived from compressions that were fully released and with the correct hand position, adequate depth, and adequate rate. Results: A total of 106 (100% consent rate) paramedics participated, primarily representing regional ambulance locations (n= 75, 78.9%). ECC compression scores were on average 95% or above at all time points, suggesting high performance. No significant differences over time (P>.05) were identified for the overall ECC performance score, compressions fully released, compressions with adequate depth, or compressions with the correct hand position. However, paramedics had significantly lower odds (odds ratio 0.30, 95% CI 0.12-0.78) of achieving compressions with adequate rate at time 3 compared to time 2 (P=.01). Compressions were of a slower rate, with an average difference of 2.1 fewer compressions every minute. Conclusions: Despite this difference in compression rate over time, this did not cause significant detriment to overall ECC performance. Training and deployment of simulator manikins did not significantly change paramedics' overall ECC performance. The high baseline performance (ceiling effect) of paramedics in this sample may have prevented the potential increase in skills and performance.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.011 | 0.002 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".