A practical assimilation approach to extract smaller‐scale information from observations with spatially correlated errors: An idealized study
Bibliographic record
Abstract
Abstract It is still common to neglect the spatial error correlations of assimilated observations in numerical weather prediction systems because no practical approach is available to account for them when the number of observations with correlated error is large or when these observations are non‐uniformly distributed. Instead, it is common practice to inflate observation error variances to avoid overfitting large scales and spatially thin observations to reduce error correlations between remaining observations, although both methods generally sacrifice small‐scale information. Inspired by previous work on assimilating the difference between adjacent observations (so‐called spatial difference observations), this study aims at combining direct observations with spatial difference observations in the assimilation to extract both large‐ and smaller‐scale information from observations with spatially correlated errors, while still neglecting these error correlations. Experiments performed in a simplified 1D context over a periodic domain show that the combined approach is numerically equivalent to directly assimilating observations available at every grid point using non‐diagonal observation error covariances based on a first‐order autoregressive correlation function. In a case where observation error correlations have a different structure (e.g. Gaussian), the true observation error correlations are not perfectly taken into account by the combined approach, but it still efficiently extracts information to correct the scales that have the most errors. Combining direct observations with spatial difference observations proves complementary and experimental results show lower analysis errors for both large and intermediate scales. More specifically, while neglecting spatial observation error correlations, the combined approach provides results with lower analysis error than the direct approach, especially when spatial error correlations are large and when direct observations are spatially thinned.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.001 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".