Exploratory analysis of statistical post‐processing methods for hydrological ensemble forecasts
Bibliographic record
Abstract
Abstract Despite many recent improvements, ensemble forecast systems for streamflow often produce under‐dispersed predictive distributions. This situation is problematic for their operational use in water resources management. Many options exist for post‐processing of raw forecasts. However, most of these have been developed using meteorological variables such as temperature, which displays characteristics very different from streamflow. In addition, streamflow data series are often very short or contain numerous gaps, thus compromising the estimation of post‐processing statistical parameters. For operational use, a post‐processing method has to be effective while remaining as simple as possible. We compared existing post‐processing methods using normally distributed and gamma‐distributed synthetic datasets. To reflect situations encountered with ensemble forecasts of daily streamflow, four normal distribution parameterizations and six gamma distribution parameterizations were used. Three kernel‐based approaches were tested, namely, the ‘best member’ method and two improvements thereof, and one regression‐based approach. Additional tests were performed to assess the ability of post‐processing methods to cope with short calibration series, missing values or small numbers of ensemble members. We thus found that over‐dispersion is best corrected by the regression method, while under‐dispersion is best corrected by kernel‐based methods. This work also shows key limitations associated with short data series, missing values, asymmetry and bias. One of the improved best member methods required longer series for the estimation of post‐processing parameters, but if provided with adequate information, yielded the best improvement of the continuous ranked probability score. These results suggest guidelines for future studies involving real operational datasets. Copyright © 2014 John Wiley & Sons, Ltd.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.002 | 0.003 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.002 |
| Science and technology studies | 0.000 | 0.001 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.002 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".