Accuracy of an AI-based automated plate reading mobile application for the identification of clinical mastitis-causing pathogens in chromogenic culture media
Notice bibliographique
Résumé
Using on-farm microbiological culture (OFC), based on chromogenic culture media, enables the identification of mastitis causing pathogens in about 24 h, allows rapid decision making on selective treatment and control management measures of cows with clinical mastitis (CM). However, accurate interpretation of OFC results requires trained and experienced operators, which could be a limitation for the use of OFC in dairy farms. Our hypothesis was that AI-based automated plate reading mobile application can analyze images of microorganisms' colonies in chromogenic culture media with similar diagnostic performance as a trained specialist evaluator. Therefore, the aim of the present study was to evaluate the diagnostic accuracy of an AI-based application (Rumi; OnFarm, Piracicaba, São Paulo, Brazil) for interpreting images of mastitis causing microorganism colonies grown in chromogenic culture media. For this study two trials were organized to compare the results obtained using an AI-based application Rumi with the interpretation of: (1) a trained specialist, using MALDI-TOF MS as the gold standard; (2) farm personnel users (FPU). In trial 1, a total of 476 CM milk samples, from 11 farms located in São Paulo (n = 7) and Minas Gerais (n = 4), southeast Brazil, were inoculated in chromogenic culture media plates (Smartcolor 2, OnFarm, Piracicaba, São Paulo, Brazil) by specialists under lab conditions, and digital images were recorded 24 h after incubation at 37 °C. After that, all the 476 digital images were analyzed by the Rumi and by another specialist (who only had access to the digital images) and the diagnostic accuracy indicators sensitivity (Se) and specificity (Sp) were calculated using MALDI-TOF MS microbiological identification of the isolates as the reference. In Trial 2, a total of 208 CM milk samples, from 150 farms from Brazil, were inoculated in chromogenic culture media plates by FPU, and the results of microbiological growth were visually interpreted by FPU under on-farm conditions. After visual interpretation, results were recorded using an OnFarmApp application (herd manage application for mastitis by OnFarm, Piracicaba, São Paulo, Brazil), and the images of the chromogenic culture plates were captured by the OnFarmApp to be evaluated by Rumi and Bayesian Latent Class Models were performed to compare Rumi and the FPU. In Trial 1, Rumi presented high and intermediate accuracy results, with the only exception of the low Enterococcus spp.'s Se. In comparison with the specialist, Rumi performed similarly in Se and Sp for most groups of pathogens, with the only exception of non-aureus staphylococci where Se results were lower. Both Rumi and the specialist achieved Sp results > 0.96. In Trial 2, Rumi had similar results as the FPU in the Bayesian Latent Class Model analysis. In conclusion, the use of the AI-based automated plate reading mobile application can be an alternative for visual interpretation of OFC results, simplifying the procedures for selective treatment decisions for CM based on OFC.
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction machine sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Le volet Gemma est une étiquette directe du modèle pour chaque travail de la base, lue sur la notice réduite au titre. Le volet Codex est un classifieur appris des 10 348 étiquettes directes de Codex et calibré sur les taux pondérés de l'échantillon; les champs sans appui suffisant ne portent aucun appel Codex. Le mode candidate est l'union des deux volets; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont pas des étiquettes humaines.
Scores du classifieur distillé par catégorie (deux têtes)
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,003 | 0,006 |
| Méta-épidémiologie (sens strict) | 0,001 | 0,000 |
| Méta-épidémiologie (sens large) | 0,000 | 0,000 |
| Bibliométrie | 0,001 | 0,001 |
| Études des sciences et des technologies | 0,000 | 0,000 |
| Communication savante | 0,001 | 0,000 |
| Science ouverte | 0,001 | 0,001 |
| Intégrité de la recherche | 0,001 | 0,000 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,001 | 0,000 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; un appel candidat d’une seule source (Gemma direct ou Codex distillé), pas un consensus.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».