Large-scale snow data assimilation using a spatialized particle filter: recovering the spatial structure of the particles
Bibliographic record
Abstract
Abstract. The use of particle filters for data assimilation is increasingly popular because of its minimal assumptions. Nevertheless, implementing a particle filter over domains of large spatial dimensions remains challenging, as the number of required particles rises exponentially as domain size increases. A common solution to overcome this issue is to localize the particle filter and consider a collection of local applications rather than a single regional one. Although this solution can solve the dimensionality limit, it can also create some spatial discontinuity inside the particles. This issue can become even more problematic when additional data is assimilated. The purpose of this study is to test the possibility of remedying the spatial discontinuities of the particles by locally reordering the particles. We implement a spatialized particle filter to estimate the snow water equivalent (SWE) over a large territory in eastern Canada by assimilating local manual snow survey observations. We apply two reordering strategies based on 1) a simple ascending order sorting and 2) the Schaake Shuffle and evaluate their ability to maintain the spatial structure of the particles. To increase the amount of assimilated data, we investigate the inclusion of a second data set, in which SWE is indirectly estimated from snow depth. The two reordering solutions maintain the spatial structure of the individual particles throughout the winter season, which significantly reduces the random noise in the distribution of the particles and decreases the uncertainty associated with the estimation. The Schaake Shuffle proves to be a better tool for maintaining a realistic spatial structure for all particles, although we also found that sorting provides a simpler and satisfactory solution. The assimilation of the secondary data set improved SWE estimates in ungauged sites when compared with the open-loop model, but we noted no significant improvement when both snow courses and the SR50 data were assimilated.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.001 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.001 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".