MétaCan
Menu
Back to cohort
Record W4289261700 · doi:10.1038/s41597-022-01517-w

The United States COVID-19 Forecast Hub dataset

2022· article· en· W4289261700 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.
fundA Canadian funder is recorded on the work.

Bibliographic record

VenueScientific Data · 2022
Typearticle
Languageen
FieldMathematics
TopicCOVID-19 epidemiological studies
Canadian institutionsDalhousie UniversityUniversity of British ColumbiaUniversity of VictoriaTRIUMF
FundersOak Ridge National LaboratoryNatural Sciences and Engineering Research Council of CanadaQuest for Intelligence, Massachusetts Institute of TechnologyPlant Sciences Institute, Iowa State UniversityNational Institutes of HealthCenters for Disease Control and PreventionKlaus Tschira StiftungCenter for Emerging Infectious Diseases, University of IowaIowa State UniversityNorth Carolina State UniversityBundesministerium für Bildung und ForschungCouncil of State and Territorial EpidemiologistsInstitute for Health Metrics and EvaluationNational Institute of General Medical SciencesUniversity of Massachusetts AmherstJohns Hopkins Bloomberg School of Public HealthWellcome TrustU.S. Department of EnergyNational Institute of Diabetes and Digestive and Kidney DiseasesCalifornia Institute of TechnologyEunice Kennedy Shriver National Institute of Child Health and Human DevelopmentBill and Melinda Gates FoundationLos Alamos National LaboratoryJohns Hopkins UniversityGordon and Betty Moore FoundationIndiana University-Purdue University IndianapolisU.S. Department of Homeland SecurityNational Nuclear Security AdministrationLaboratory Directed Research and DevelopmentNational Science Foundation
KeywordsLeverage (statistics)DownloadCoronavirus disease 2019 (COVID-19)Government (linguistics)PandemicScale (ratio)Disease controlComputer scienceData scienceEconometricsBusinessGeographyInfectious disease (medical specialty)EconomicsWorld Wide WebEnvironmental healthMedicineMachine learning

Abstract

fetched live from OpenAlex

Academic researchers, government agencies, industry groups, and individuals have produced forecasts at an unprecedented scale during the COVID-19 pandemic. To leverage these forecasts, the United States Centers for Disease Control and Prevention (CDC) partnered with an academic research lab at the University of Massachusetts Amherst to create the US COVID-19 Forecast Hub. Launched in April 2020, the Forecast Hub is a dataset with point and probabilistic forecasts of incident cases, incident hospitalizations, incident deaths, and cumulative deaths due to COVID-19 at county, state, and national, levels in the United States. Included forecasts represent a variety of modeling approaches, data sources, and assumptions regarding the spread of COVID-19. The goal of this dataset is to establish a standardized and comparable set of short-term forecasts from modeling teams. These data can be used to develop ensemble models, communicate forecasts to the public, create visualizations, compare models, and inform policies regarding COVID-19 mitigation. These open-source data are available via download from GitHub, through an online API, and through R packages.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.011
metaresearch head score (Gemma)0.026
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Science and technology studies, Open science, Insufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Dataset · Consensus signal: Dataset
Teacher disagreement score0.114
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0110.026
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.001
Science and technology studies0.0050.001
Scholarly communication0.0000.000
Open science0.0040.011
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.595
GPT teacher head0.495
Teacher spread0.099 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it