Rapid and responsive water quality risk assessment using a hybrid machine learning integrated quantitative microbial risk assessment model
Bibliographic record
Abstract
Unprecedented global population displacement in recent years has increased the burden of waterborne illnesses in refugee and internally displaced person (IDP) settlements. Unlike contexts where water is piped directly to the home, in urban-scale refugee and IDP settlements, water users manually collect water from public tapstands and transport it to their dwellings where they store and use it over several hours. This creates the potential for recontamination, increasing waterborne illness risk. Humanitarian responders need to optimize water treatment to minimize waterborne illness risk at the household. Quantitative microbial risk assessment (QMRA) has been used to assess health risk from drinking water in a variety of contexts. However, conventional QMRA approaches rely on pathogen enumeration data, which is too slow, expensive, and logistically challenging to respond to rapid fluctuations in water quality (WQ) in humanitarian contexts.We propose a novel hybrid machine learning (ML)-QMRA approach that links operational WQ data to QMRA using probabilistic ML models for responsive risk assessments. The ML-QMRA model uses a two-stage probabilistic ML approach: first we forecast WQ from tapstand to household via a deep composite quantile regression neural network (DCQRNN) and then we link household WQ to E.coli data using a support vector quantile regression (SVQR) model. This predicted E. coli becomes an input to an QMRA model designed based on WHO QMRA guidelines.We tested this ML-QMRA modelling approach using operational WQ data from the Kyaka II refugee settlement in Uganda to assess daily probabilities of infection for pathogenic E. coli and rotavirus. The ML-QMRA model forecasted a mean infection risk for pathogenic E. coli ranged of 4.5x10-2 and 0.19x10-4 for rotavirus. The ML-QMRA model also determined that to keep the risk of infection from pathogenic E. coli within 5% of the minimum daily risk of infection, 0.8 mg/L of FRC was needed at the tapstand at a turbidity of 1 NTU. The FRC requirement increased with turbidity, up to 1.25 mg/L at a turbidity of 20 NTU. This water quality was also sufficient to manage rotavirus infection risk.Our study shows how hybridizing process-based QMRA health risk assessment with probabilistic ML models can enable integration of operational data for more rapid risk assessment than conventional approaches using pathogen data. The ML-QMRA model also enables us to set multi-parameter water quality targets for routine monitoring data that are based on health-risk, not arbitrary guidelines. The ML-QMRA approach has applications in a range of contexts outside of humanitarian contexts in urban water management to make QMRA more responsive to rapid WQ fluctuations.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.005 | 0.001 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.001 | 0.001 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.008 |
| Research integrity | 0.000 | 0.004 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".