Rare event simulation for diffusion processes via two-stage importance sampling
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
Abstract. We consider the problem of estimating expected values of functionals of real-valued diffusions over regions in path space that have very small probability. We propose a two-stage importance sampling procedure that first converts the problem into one involving standard Brownian motion and then addresses the rare event problem in this simpler setting. In order to identify an effective yet practical importance measure we propose using a time-dependent deterministic drift that minimizes the relative entropy between the corresponding importance measure and the conditional law of the standard Brownian motion, given that its trajectory lies in the region of interest. We provide numerical evidence that (i) our entropy-based criteria performs favourably with an alternative, but less general and less practical, criteria based on large deviations and (ii) our two-stage procedure performs admirably in cases where the region of interest is so rare that crude estimators fail completely.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.004 | 0.002 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.001 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it