Derivation and validation of a point-based forecasting tool for SARS-CoV-2 critical care occupancy: a population-based modeling study
Bibliographic record
Abstract
Background: The requirement for critical care in even a modest fraction of SARS-CoV-2-infected individuals made critical care resources a key societal chokepoint during the COVID-19 pandemic. We previously developed a simple regression-based point score to forecast critical care occupancy in Ontario, Canada, using case numbers, mean age of cases, and testing volume. In this study, we aimed to validate and update this forecasting model to account for evolving population immunity, including the effects of widespread vaccination. Methods: We obtained complete provincial SARS-CoV-2 case, testing, and vaccination data from March 2020 to September 2022, subdividing the pandemic into six waves. Our initial model was fitted using data from the first two waves; an updated model included wave 3, which was dominated by N501Y+ variants. We validated the models by comparing projections to waves not used for fitting. Predictive validity was assessed using Spearman's rho. Counterfactual scenarios without vaccination were modeled to estimate vaccine-attributable reductions in critical care admissions. Findings: The initial model (waves 1-2) was well calibrated (rho = 0.85) but had modest predictive validity (rho = 0.46). Predictive validity improved with models fitted to waves 1-3, both without (rho = 0.60) and with vaccination (rho = 0.68); model fit improved significantly with vaccination (p = 0.013). Averted admissions attributable to vaccination were estimated at 144% (22,017 expected vs. 9020 observed). Interpretation: Simple regression-based forecasting tools remain valuable for predicting SARS-CoV-2 critical care occupancy. However, models developed early in the pandemic should be recalibrated to account for evolving immunity, including widespread vaccination. Funding: Canadian Institutes of Health Research (OV4-170360); R. Howard Webster Foundation (via the University of Toronto Institute for Pandemics).
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.006 | 0.014 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.001 | 0.000 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.002 | 0.001 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".