Understanding sources of Northern Hemisphere uncertainty and forecast error in a medium‐range coupled ensemble sea‐ice prediction system
Bibliographic record
Abstract
Abstract The Global Ensemble Prediction System (GEPS) of Environment and Climate Change Canada was recently upgraded to a coupled atmosphere, ocean, and sea‐ice version from an uncoupled atmosphere‐only system. This has been operational since July 2019, with over a year of forecasts now available to evaluate the system throughout all seasons. Using metrics that score the forecast error in ice‐edge position, the spatial probability score and the integrated ice‐edge error, we investigate the spread–error relationship in probabilistic Arctic sea‐ice forecasts from the system and compare this with the skill of the system relative to persistence and a companion Global Deterministic Prediction System (GDPS). Within this ensemble framework, we explore the advantages of having a probabilistic forecast and probe its usefulness in addressing the errors in the system. Both the ensemble GEPS and the deterministic GDPS systems show enhanced sea‐ice prediction over persistence in all months except May and June, when significant biases exist in the systems in shallow‐sea and shelf regions. We attribute a significant portion of these biases to problems modelling landfast ice, but other sources of bias, including significant uncertainties in initializing and verifying sea‐ice analysis, also contribute. The lowest errors in the systems are found during September and continue at reasonably low levels through much of the boreal winter. The minimum and maximum extent periods, along with the early freeze‐up period, are shown to be periods for which the ensemble system offers enhanced benefits over a single deterministic forecast. For these periods, the errors are low and strongly correlated spatially with the ensemble spread. Nevertheless, we find that the ensemble system would likely still benefit from further improvement of the spread/error relationship in the system, currently hampered due to ensemble perturbations that are produced solely in the atmospheric component.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.003 | 0.008 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.000 | 0.001 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".