MétaCan
Menu
Back to cohort
Record W4400921190 · doi:10.2196/49871

Spatiotemporal Cluster Detection for COVID-19 Outbreak Surveillance: Descriptive Analysis Study

2024· article· en· W4400921190 on OpenAlexvenueno aff
Rachel Martonik, Caitlin Oleson, Ellyn Marder

Bibliographic record

VenueJMIR Public Health and Surveillance · 2024
Typearticle
Languageen
FieldMedicine
TopicData-Driven Disease Surveillance
Canadian institutionsnot available
Fundersnot available
KeywordsCluster (spacecraft)Coronavirus disease 2019 (COVID-19)OutbreakSevere acute respiratory syndrome coronavirus 2 (SARS-CoV-2)2019-20 coronavirus outbreakPandemicDisease surveillanceEnvironmental healthGeographyPublic healthVirologyMedicineComputer scienceInfectious disease (medical specialty)Disease

Abstract

fetched live from OpenAlex

BACKGROUND: During the peak of the winter 2020-2021 surge, the number of weekly reported COVID-19 outbreaks in Washington State was 231; the majority occurred in high-priority settings such as workplaces, community settings, and schools. The Washington State Department of Health used automated address matching to identify clusters at health care facilities. No other systematic, statewide outbreak detection methods were in place. This was a gap given the high volume of cases, which delayed investigations and decreased data completeness, potentially leading to undetected outbreaks. We initiated statewide cluster detection using SaTScan, implementing a space-time permutation model to identify COVID-19 clusters for investigation. OBJECTIVE: To improve outbreak detection, the Washington State Department of Health initiated a systematic cluster detection model to identify timely and actionable COVID-19 clusters for local health jurisdiction (LHJ) investigation and resource prioritization. This report details the model's implementation and the assessment of the tool's effectiveness. METHODS: In total, 6 LHJs participated in a pilot to test model parameters including analysis type, geographic aggregation, cluster radius, and data lag. Parameters were determined through heuristic criteria to detect clusters early when they are smaller, making interventions more feasible. This study reviews all clusters detected after statewide implementation from July 17 to December 17, 2021. The clusters were analyzed by LHJ population and disease incidence. Clusters were compared with reported outbreaks. RESULTS: A weekly, LHJ-specific retrospective space-time permutation model identified 2874 new clusters during this period. While the weekly analysis included case data from the prior 3 weeks, 58.25% (n=1674) of all clusters identified were timely-having occurred within 1 week of the analysis and early enough for intervention to prevent further transmission. There were 2874 reported outbreaks during this same period. Of those, 363 (12.63%) matched to at least one SaTScan cluster. The most frequent settings among reported and matched outbreaks were schools and youth programs (n=825, 28.71% and n=108, 29.8%), workplaces (n=617, 21.46% and n=56, 15%), and long-term care facilities (n=541, 18.82% and n=99, 27.3%). Settings with the highest percentage of clusters that matched outbreaks were community settings (16/72, 22%) and congregate housing (44/212, 20.8%). The model identified approximately one-third (119/363, 32.8%) of matched outbreaks before cases were associated with the outbreak event in our surveillance system. CONCLUSIONS: Our goal was to routinely and systematically identify timely and actionable COVID-19 clusters statewide. Regardless of population or incidence, the model identified reasonably sized, timely clusters statewide, meeting the objective. Among some high-priority settings subject to public health interventions throughout the pandemic, such as schools and community settings, the model identified clusters that were matched to reported outbreaks. In workplaces, another high-priority setting, results suggest the model might be able to identify outbreaks sooner than existing outbreak detection methods.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.004
metaresearch head score (Gemma)0.002
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMeta-epidemiology (narrow)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.315
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0040.002
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0010.002
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.052
GPT teacher head0.369
Teacher spread0.317 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations4
Published2024
Admission routes1
Has abstractyes

Explore more

Same venueJMIR Public Health and SurveillanceSame topicData-Driven Disease SurveillanceFrench-language works237,207