MétaCan
Menu
Back to cohort
Record W2900730820 · doi:10.2196/10666

A Real-Time Autonomous Dashboard for the Emergency Department: 5-Year Case Study

2018· article· en· W2900730820 on OpenAlexvenueno aff
Junsang Yoo, Kwang Yul Jung, Taerim Kim, Tae Rim Lee, Sung Yeon Hwang, Hee Yoon, Tae Gun Shin, Min Seob Sim, Ik Joon Jo, Hansol Paeng, Jong Soo Choi, Won Chul

Bibliographic record

VenueJMIR mhealth and uhealth · 2018
Typearticle
Languageen
FieldHealth Professions
TopicElectronic Health Records Systems
Canadian institutionsnot available
Fundersnot available
KeywordsDashboardUsabilityWorkflowEmergency departmentComputer scienceSystem usability scaleWorld Wide WebMedicineMedical emergencyWeb usabilityData scienceNursingHuman–computer interactionDatabase

Abstract

fetched live from OpenAlex

BACKGROUND: The task of monitoring and managing the entire emergency department (ED) is becoming more important due to increasing pressure on the ED. Recently, dashboards have received the spotlight as health information technology to support these tasks. OBJECTIVE: This study aimed to describe the development of a real-time autonomous dashboard for the ED and to evaluate perspectives of clinical staff on its usability. METHODS: We developed a dashboard based on three principles-"anytime, anywhere, at a glance;" "minimal interruption to workflow;" and "protect patient privacy"-and 3 design features-"geographical layout," "patient-level alert," and "real-time summary data." Items to evaluate the dashboard were selected based on the throughput factor of the conceptual model of ED crowding. Moreover, ED physicians and nurses were surveyed using the system usability scale (SUS) and situation awareness index as well as a questionnaire we created on the basis of the construct of the Situation Awareness Rating Technique. RESULTS: The first version of the ED dashboard was successfully launched in 2013, and it has undergone 3 major revisions since then because of geographical changes in ED and modifications to improve usability. A total of 52 ED staff members participated in the survey. The average SUS score of the dashboard was 67.6 points, which indicates "OK-to-Good" usability. The participants also reported that the dashboard provided efficient "concentration support" (4.15 points), "complexity representation" (4.02 points), "variability representation" (3.96 points), "information quality" (3.94 points), and "familiarity" (3.94 points). However, the "division of attention" was rated at 2.25 points. CONCLUSIONS: We developed a real-time autonomous ED dashboard and successfully used it for 5 years with good evaluation from users.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.005
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMeta-epidemiology (narrow), Science and technology studies
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.197
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0050.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0000.000
Science and technology studies0.0060.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0010.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.099
GPT teacher head0.487
Teacher spread0.388 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designNot applicable
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations46
Published2018
Admission routes1
Has abstractyes

Explore more

Same venueJMIR mhealth and uhealthSame topicElectronic Health Records SystemsFrench-language works237,207