Is my model fit for purpose? Validating a population model for predicting freshwater fish responses to flow management
Bibliographic record
Abstract
Abstract Models based on ecological processes (process‐explicit models) are often used to predict ecosystem responses to environmental changes or management scenarios. However, models are imperfect and need to be validated, ideally by testing their assumptions and outputs against independent empirical data sets. Examples of validation of process‐explicit models are rare. Recently, stochastic population models have been developed to predict the likely responses (over 10–120 years) of a riverine fish (golden perch, Macquaria ambigua ) to flow management in the Murray–Darling Basin (MDB) in eastern Australia, one of the world's most regulated river basins. Declines in golden perch (and other species) are a direct consequence of altered hydrology, and managers require information to predict how fish will respond to possible future hydrological conditions to guide substantial investments in flow management. Here, we use two independent field data sets to validate our population model. We compared model predictions to observed trends to ask: (1) How do predicted population sizes and growth rates compare with observed data? (2) Does the correlation between predicted and observed population sizes and growth rates vary among populations? (3) Does the correlation between predicted and observed population sizes and growth rates vary across observed hydrological conditions? (4) How do modeled and observed fish movement rates compare? We found reasonable correlations between fish population sizes and growth rates as predicted by the model and observed in independent data sets for several populations (Aim 1), but the strength of these correlations varied among populations (Aim 2) and hydrological conditions (Aim 3). Predicted and observed fish movement rates were strongly correlated (Aim 4). Population models are frequently used in conservation decision‐making but are rarely validated. We demonstrate that: (1) validation can identify model strengths and weaknesses; (2) observed data sets often have inherent limitations that can preclude robust validations; (3) validation is likely to be more common if appropriate observed data sets are available; and (4) validation should consider the purpose of modeling. Wider consideration of these messages would contribute to more critical examinations of models, so they can be most appropriately used in conservation decision‐making.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".