A “Pandemic-Proof” Methodology for Outbreak Detection Adapted From COVID-19’s Impact on Notifications of Infectious Diseases in the Netherlands: Surveillance Study
Bibliographic record
Abstract
Background: Reporting of notifiable infectious diseases was overall impacted by the COVID-19 pandemic. This could affect disease surveillance and thus, outbreak detection, as it is based on historical data. For effective outbreak detection, it is crucial that communicable disease control professionals can rely on accurate and valuable alarm thresholds to ensure timely and adequate response to potential outbreaks. Objective: In this study, we take the first steps in the development of a methodology that adjusts for the impact of the COVID-19 pandemic on the number of notifications of notifiable infectious diseases and provides corrected alarm thresholds for outbreak detection. We identify which infectious diseases were affected by the COVID-19 pandemic, assess the duration of these effects, and explore potential correction methods to improve outbreak detection. Methods: We analyzed cases of 25 notifiable infectious diseases reported from 2015-2023 in the Netherlands. Negative binomial regression was used to calculate the incidence rate ratios for each period: pre-COVID-19 pandemic, COVID 2020, COVID 2021, COVID 2022, and post-COVID-19 pandemic. To address the decrease in notifications during the COVID-19 pandemic, we tested 3 correction methods: (1) recoding COVID-19 years as missing; (2) imputing with the last pre-COVID-19 pandemic observation; and (3) imputing the historical moving average. Results: Between 2015-2023, a total of 74,990 notifications were reported in the Netherlands, of which 9,836 notifications (13%) occurred during the COVID-19 pandemic. Malaria, typhoid fever, hepatitis A, meningococcal infection, paratyphoid fever, Q-fever, shigellosis, measles, mumps, and pertussis had significantly lower notifications during the COVID-19 pandemic, but the duration and magnitude of the effect differed among the infections. The effect of the COVID-19 pandemic on the notifications of malaria (incidence rate ratio [IRR] 0.17, 95% CI 0.08-0.36) and typhoid fever (IRR 0.12, 95% CI 0.02-0.55) was only seen in 2020, while the notifications for measles (IRR 0.34, 95% CI 0.15-0.75) and pertussis (IRR 0.34, 95% CI 0.20-0.60) were still significantly lower in the post-COVID-19 pandemic period. In addition, the newly calculated alarm thresholds showed a noticeable difference compared with the original unadjusted alarm thresholds. However, the variation among the 3 different corrected alarm thresholds was not substantial. Conclusions: During the COVID-19 pandemic, notifications of 10 infectious diseases declined significantly. The duration of this decline varied among infections, highlighting the need for pattern-specific adjustments. Our study demonstrates that accounting for the reduced notifications impacts alarm threshold calculations for outbreak detection. We therefore recommend amending the alarm thresholds to account for this impact to ensure reliable outbreak detection, so that communicable disease control professionals can act in a timely and data-driven manner. The next step in the development of the "pandemic-proof" methodology is to determine which correction method is most suitable. Further validation by communicable disease control professionals is essential to assess the applicability of the adjusted alarm thresholds for outbreak detection.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.041 | 0.105 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.002 |
| Bibliometrics | 0.002 | 0.002 |
| Science and technology studies | 0.001 | 0.001 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.002 | 0.002 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.002 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".