Cross-Validation of Generic Risk Assessment Tools for Animal Disease Incursion Based on a Case Study for African Swine Fever
Bibliographic record
Abstract
In recent years, several generic risk assessment (RA) tools have been developed that can be applied to assess the incursion risk of multiple infectious animal diseases allowing for a rapid response to a variety of newly emerging or re-emerging diseases. Although these tools were originally developed for different purposes, they can be used to answer similar or even identical risk questions. To explore the opportunities for cross-validation, seven generic RA tools were used to assess the incursion risk of African swine fever (ASF) to the Netherlands and Finland for the 2017 situation and for two hypothetical scenarios in which ASF cases were reported in wild boar and/or domestic pigs in Germany. The generic tools ranged from qualitative risk assessment tools to stochastic spatial risk models but were all parameterized using the same global databases for disease occurrence and trade in live animals and animal products. A comparison of absolute results was not possible, because output parameters represented different endpoints, varied from qualitative probability levels to quantitative numbers, and were expressed in different units. Therefore, relative risks across countries and scenarios were calculated for each tool, for the three pathways most in common (trade in live animals, trade in animal products, and wild boar movements) and compared. For the 2017 situation, all tools evaluated the risk to the Netherlands to be higher than Finland for the live animal trade pathway, the risk to Finland the same or higher as the Netherlands for the wild boar pathway, while the tools were inconclusive on the animal products pathway. All tools agreed that the hypothetical presence of ASF in Germany increased the risk to the Netherlands, but not to Finland. The ultimate aim of generic RA tools is to provide risk-based evidence to support risk managers in making informed decisions to mitigate the incursion risk of infectious animal diseases. The case study illustrated that conclusions on the ASF risk were similar across the generic RA tools, despite differences observed in calculated risks. Hence, it was concluded that the cross-validation contributed to the credibility of their results.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.001 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".