Canada-wide Modelling – Analysis of Model Accuracy to Drive Appropriate Use and Risk Reduction Program Development
Bibliographic record
Abstract
In many countries, continental and global scale flood hazard modelling methodologies are employed to provide an understanding of flood hazard over large geographical areas and at multiple return periods, flood generating mechanisms, and future climate change scenarios.  These models are commonly used for estimating flood hazard in areas where high resolution flood mapping is unavailable, and for estimating portfolio risk for insurers and the financial sector. However, these products are generally lower accuracy and precision than local (e.g. regulatory, engineering-level) maps, and therefore the limitations and appropriate use cases of continental and global scale mapping should be understood when using these products to understand flood hazard and flood risk.   Public Safety Canada (PS) has the mandate to keep Canadians safe from a range of risks and is working towards several soon-to-be launched flood resilience policy programs that depend upon a consistent, Canada-wide characterization of flood risk, and has accordingly procured multiple flood hazard models. PS bridges policy work to data science and engineering practices by conducting quantitative risk analysis, using Canada-wide flood hazard models, robust exposure data, and damage estimation methodologies.  PS has done extensive testing of Canada-wide flood hazard models, including quality control and evaluation, to better understand their limitations and uses, and to support quantitative risk analysis for PS and other federal departments and agencies. This presentation will describe the results of PS’s evaluation and use of global models, including performance assessment against a set of comparable regulatory-quality flood maps across Canada and recommendations for appropriate use cases. These findings will contribute to a future partnership between PS and an academic research consortium to develop a made-in-Canada, open source, Canada-wide flood hazard model that will leverage data and expertise developed across government and other sectors.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.003 | 0.003 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.002 | 0.002 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.001 | 0.000 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".