Derivation and Validation of a Point-based Forecasting Tool for SARS-CoV-2 Critical Care Occupancy
Bibliographic record
Abstract
Background The requirement for critical care in even a modest fraction of SARS-CoV-2 infected individuals made ICU resources an important societal chokepoint during the recent pandemic. We developed a simple regression-based point score in 2020 based on an objective of forecasting critical care occupancy in the Canadian province of Ontario based on mean age of cases, case numbers, and testing volume. Evolution of the pandemic (variants of concern, vaccination) led us to re-assess and re-calibrate our earlier work, with inclusion of information vaccination which became widespread in 2021. Methods We obtained complete provincial SARS-CoV-2 case, testing, and vaccination data for the period from March 2020 to September 2022, with data subdivided into 6 major “waves”, following the approach applied by other Canadian investigators. Our initial model was fit only using the first two “wild type” SARS-CoV-2 waves; an updated model included wave 3 (N501Y+ variants). Our model was validated by comparing model projections to waves not used for model fitting; validation model fits were evaluated with Spearman’s rho; counterfactuals without vaccination were modeled to impute fraction of critical care admissions prevented with vaccination. Costing was based on published economic estimates. Results Our initial model (fit to waves 1 and 2) was well calibrated (rho 0.85) but predictive validity was modest (rho 0.46). Predictive validity improved in models fit to the first 3 pandemic waves without vaccination (rho 0.60) or with vaccination (rho 0.68) (P for inclusion of vaccination 0.013 by Likelihood Ratio Test). Prevented fraction of ICU admissions attributable to vaccination was 144% (22017 admissions expected vs. 9020 observed); based on published estimates of ICU admission cost for SARS-CoV-2 the 12977 admissions averted $2.9 (CDN) billion in economic costs, in contrast to the $3 billion total cost of the vaccination program. Conclusions Simple time series regression incorporating case and testing characteristics continues to be useful as a tool for forecasting critical care occupancy due to SARS-CoV-2 but early pandemic models need to be updated to capture the preventive effects of widespread vaccination. The economic benefit of vaccination for prevention of critical care resource consumption during the pandemic is substantial, achieving near cost neutrality with the province’s entire vaccination program.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.006 | 0.031 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.002 | 0.002 |
| Science and technology studies | 0.001 | 0.000 |
| Scholarly communication | 0.002 | 0.001 |
| Open science | 0.002 | 0.001 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.002 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".