Accuracy of an AI-based automated plate reading mobile application for the identification of clinical mastitis-causing pathogens in chromogenic culture media
Bibliographic record
Abstract
Using on-farm microbiological culture (OFC), based on chromogenic culture media, enables the identification of mastitis causing pathogens in about 24 h, allows rapid decision making on selective treatment and control management measures of cows with clinical mastitis (CM). However, accurate interpretation of OFC results requires trained and experienced operators, which could be a limitation for the use of OFC in dairy farms. Our hypothesis was that AI-based automated plate reading mobile application can analyze images of microorganisms' colonies in chromogenic culture media with similar diagnostic performance as a trained specialist evaluator. Therefore, the aim of the present study was to evaluate the diagnostic accuracy of an AI-based application (Rumi; OnFarm, Piracicaba, São Paulo, Brazil) for interpreting images of mastitis causing microorganism colonies grown in chromogenic culture media. For this study two trials were organized to compare the results obtained using an AI-based application Rumi with the interpretation of: (1) a trained specialist, using MALDI-TOF MS as the gold standard; (2) farm personnel users (FPU). In trial 1, a total of 476 CM milk samples, from 11 farms located in São Paulo (n = 7) and Minas Gerais (n = 4), southeast Brazil, were inoculated in chromogenic culture media plates (Smartcolor 2, OnFarm, Piracicaba, São Paulo, Brazil) by specialists under lab conditions, and digital images were recorded 24 h after incubation at 37 °C. After that, all the 476 digital images were analyzed by the Rumi and by another specialist (who only had access to the digital images) and the diagnostic accuracy indicators sensitivity (Se) and specificity (Sp) were calculated using MALDI-TOF MS microbiological identification of the isolates as the reference. In Trial 2, a total of 208 CM milk samples, from 150 farms from Brazil, were inoculated in chromogenic culture media plates by FPU, and the results of microbiological growth were visually interpreted by FPU under on-farm conditions. After visual interpretation, results were recorded using an OnFarmApp application (herd manage application for mastitis by OnFarm, Piracicaba, São Paulo, Brazil), and the images of the chromogenic culture plates were captured by the OnFarmApp to be evaluated by Rumi and Bayesian Latent Class Models were performed to compare Rumi and the FPU. In Trial 1, Rumi presented high and intermediate accuracy results, with the only exception of the low Enterococcus spp.'s Se. In comparison with the specialist, Rumi performed similarly in Se and Sp for most groups of pathogens, with the only exception of non-aureus staphylococci where Se results were lower. Both Rumi and the specialist achieved Sp results > 0.96. In Trial 2, Rumi had similar results as the FPU in the Bayesian Latent Class Model analysis. In conclusion, the use of the AI-based automated plate reading mobile application can be an alternative for visual interpretation of OFC results, simplifying the procedures for selective treatment decisions for CM based on OFC.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.003 | 0.006 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.001 | 0.000 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.001 | 0.000 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".