MétaCan
Menu
Back to cohort
Record W3123679449 · doi:10.1145/3429336

Green Simulation with Database Monte Carlo

2021· article· en· W3123679449 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.
fundA Canadian funder is recorded on the work.

Bibliographic record

VenueACM Transactions on Modeling and Computer Simulation · 2021
Typearticle
Languageen
FieldDecision Sciences
TopicProbabilistic and Robust Engineering Design
Canadian institutionsUniversity of Waterloo
FundersNatural Sciences and Engineering Research Council of Canada
KeywordsControl variatesVariance reductionComputer scienceMonte Carlo methodVariance (accounting)Convergence (economics)Reduction (mathematics)IdleDatabaseMathematical optimizationSimulationStatisticsMathematicsMonte Carlo molecular modeling

Abstract

fetched live from OpenAlex

In a setting in which experiments are performed repeatedly with the same simulation model, green simulation means reusing outputs from previous experiments to answer the question currently being asked of the model. In this article, we address the setting in which experiments are run to answer questions quickly, with a time limit providing a fixed computational budget, and then idle time is available for further experimentation before the next question is asked. The general strategy is database Monte Carlo for green simulation: the output of experiments is stored in a database and used to improve the computational efficiency of future experiments. In this article, the database provides a quasi-control variate, which reduces the variance of the estimated mean response in a future experiment that has a fixed computational budget. We propose a particular green simulation procedure using quasi-control variates, addressing practical issues such as experiment design, and analyze its theoretical properties. We show that, under some conditions, the variance of the estimated mean response in an experiment with a fixed computational budget drops to zero over a sequence of repeated experiments, as more and more idle time is invested in creating databases. Our numerical experiments on the procedure show that using idle time to create databases of simulation output provides variance reduction immediately, and that the variance reduction grows over time in a way that is consistent with the convergence analysis.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Simulation or modeling · Consensus signal: Simulation or modeling
GenreCandidate signal: Methods · Consensus signal: none
Teacher disagreement score0.870
Threshold uncertainty score0.461

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0000.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.112
GPT teacher head0.327
Teacher spread0.215 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it