MétaCan
Menu
Back to cohort

Assessing the electronic Bedside Paediatric Early Warning System: A simulation study on decision-making and usability

2019· article· en· W2972906190 on OpenAlexafffund
Jessica Tomasi, Megan V. Hamilton, Mark Fan, Sonia Pinkney, Kristen Middaugh, Christopher S. Parshuram, Patricia Trbovich

Bibliographic record

VenueInternational Journal of Medical Informatics · 2019
Typearticle
Languageen
FieldMedicine
TopicSepsis Diagnosis and Treatment
Canadian institutionsHospital for Sick ChildrenUniversity of TorontoSickKids FoundationNorth York General Hospital
FundersOntario Centres of Excellence
KeywordsUsabilityEarly warning scoreDocumentationClinical decision support systemMedicineIntervention (counseling)Electronic health recordWarning systemMedical emergencyHealth careElectronic data captureMEDLINEDecision support systemNursingComputer scienceAlternative medicineArtificial intelligence

Abstract

fetched live from OpenAlex

BACKGROUND: The Bedside Paediatric Early Warning System (BedsidePEWS) is a clinical decision support tool designed to augment clinician expertise, objectively identify children at risk for clinical deterioration, and standardize and prioritize care to improve outcomes in community settings. Although the paper-based BedsidePEWS documentation record has been shown to improve clinicians' perception of their ability to detect deterioration and follow care recommendations, research is needed to asses this impact empirically. Furthermore, as hospitals progressively move toward electronic clinical systems, knowledge regarding the impact of BedsidePEWS' novel electronic interface on clinicians' performance and user experience is required. OBJECTIVES: The primary objectives of this study were (1) to compare adherence to evidence-based care recommendations using a) electronic health record software, b) paper BedsidePEWS, and c) a novel electronic BedsidePEWS interface, and (2) to describe end-users' experiences of usability and opportunities for improvement of both paper and electronic BedsidePEWS. METHODS: Paediatric nurses participated in a repeated measures simulation study. Participants assessed simulated patients, documented patient data, and responded to a series of questions regarding follow-up care for each patient. Three patient types (i.e., stable, mild deterioration, severe deterioration) were assessed in each of three intervention conditions (i.e., electronic health record, paper BedsidePEWS, electronic BedsidePEWS). Following simulation scenarios, participants provided comments regarding the usability of the paper and electronic tools. RESULTS: Participants made 12.7% and 18.0% more appropriate care decisions with paper and electronic BedsidePEWS, respectively, than with the electronic health record intervention (p < 0.001). Accurate BedsidePEWS severity of illness score calculation was related to better adherence to evidence-based care recommendations (65%), compared to inaccurate calculation (55%), and electronic BedsidePEWS was associated with 15.7% fewer calculation errors than paper (p < 0.005). Electronic BedsidePEWS demonstrated usability benefits over its paper predecessor, including automatic score calculation and data plotting, and the potential to eliminate double charting, and participants expressed a preference for electronic BedsidePEWS in all aspects of the debrief questionnaire (p < 0.001). CONCLUSIONS: BedsidePEWS in both paper and electronic formats significantly improved participants' ability to detect deterioration and follow care recommendations compared to electronic health record software. Furthermore, results suggest that electronic BedsidePEWS would afford improved patient care in excess of the paper-based original and further contribute to the standardization, prioritization, and improvement of care in community settings.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.002
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.203
Threshold uncertainty score0.231

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0020.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.044
GPT teacher head0.421
Teacher spread0.377 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations11
Published2019
Admission routes2
Has abstractyes

Explore more

Same venueInternational Journal of Medical InformaticsSame topicSepsis Diagnosis and TreatmentFrench-language works237,207