Comparing Flow-R, Rockyfor3D and RAMMS to Rockfalls from the Mel de la Niva Mountain: A Benchmarking Exercise
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
Rockfall simulations are often performed at various levels of detail depending on the required safety margins of rockfall-hazard-related assessments. As a pseudo benchmark, the simulation results from different models can be put side-by-side and compared with reconstructed rockfall trajectories, and mapped deposited block fragments from real events. This allows for assessing the objectivity, predictability, and sensitivity of the models. For this exercise, mapped data of past events from the Mel de la Niva site are used in this paper for a qualitative comparison with simulation results obtained from early calibration stages of the Flow-R 2.0.9, Rockyfor3D 5.2.15 and RAMMS::ROCKFALL 1.6.70 software. The large block fragments, reaching hundreds of megajoules during their fall, greatly exceed the rockfall energies of the empirical databases used for the development of most rockfall models. The comparison for this challenging site shows that the models could be improved and that combining the use of software programs with different behaviors could be a workaround in the interim. The findings also highlight the inconvenient importance of calibrating the simulations on a per-site basis from onsite observations. To complement this process, a back calculation tool is briefly described and provided. This work also emphasizes the need to better understand rockfall dynamics to help improve rebound models.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.001 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.001 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it