An Analysis of the New York University Emergency Department Algorithm’s Suitability for Use in Gauging Changes in ED Usage Patterns
Bibliographic record
Abstract
BACKGROUND: The Emergency Department Algorithm (EDA) developed at New York University uses administrative discharge data to distill hundreds of International Classification of Diseases-9 codes for emergency department (ED) visits into 4 categories, making it attractive to researchers and policy makers. The EDA has been used to analyze patterns of ED visits in a wide variety of locations and populations. However, there are concerns regarding the validity and use of the EDA for research and policy. OBJECTIVE: To explain the findings of previous EDA users that it appears to lack sensitivity in detecting changes in ED utilization patterns. STUDY DESIGN: Mathematical simulation was used to analyze and explain the performance of the EDA in detecting differences in utilization patterns across hypothetical ED populations. Sensitivity analysis was used to illustrate the magnitude of changes in EDA outputs relative to changes in ED populations using a national sample of actual ED patients. RESULTS: The vast majority of possible EDA outputs are clustered so tightly as to show no significant change in outputs between different hypothetical populations. Sensitivity analysis shows that changes in EDA outputs are not nearly as great as the magnitude of the input differences across real-world populations. CONCLUSIONS: The EDA categorizes a very large variety of ED visits into a relatively small group of outputs. Its operating characteristics suggest that the EDA is insufficiently sensitive to changes in ED utilization patterns to be useful in assessing interventions to change them. This finding should caution potential users to consider the EDA's limitations before using it.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".