Multiresponse Metamodeling in Simulation-Based Design Applications
Bibliographic record
Abstract
The optimal design of complex systems in engineering requires the availability of mathematical models of system’s behavior as a function of a set of design variables; such models allow the designer to search for the best solution to the design problem. However, system models (e.g., computational fluid dynamics (CFD) analysis, physical prototypes) are usually time-consuming and expensive to evaluate, and thus unsuited for systematic use during design. Approximate models of system behavior based on limited data, also known as metamodels, allow significant savings by reducing the resources devoted to modeling during the design process. In this work in engineering design based on multiple performance criteria, we propose the use of multi-response Bayesian surrogate models (MR-BSM) to model several aspects of system behavior jointly, instead of modeling each individually. To this end, we formulated a family of multiresponse correlation functions, suitable for prediction of several response variables that are observed simultaneously from the same computer simulation. Using a set of test functions with varying degrees of correlation, we compared the performance of MR-BSM against metamodels built individually for each response. Our results indicate that MR-BSM outperforms individual metamodels in 53% to 75% of the test cases, though the relative performance depends on the sample size, sampling scheme and the actual correlation among the observed response values. In addition, the relative performance of MR-BSM versus individual metamodels was contingent upon the ability to select an appropriate covariance/correlation function for each application, a task for which a modified version of Akaike’s Information Criterion was observed to be inadequate.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.005 | 0.008 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.002 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.000 | 0.001 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.002 | 0.002 |
| Insufficient payload (model declined to judge) | 0.002 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".