MétaCan
Menu
Retour à la cohorte
Enregistrement W3216468336 · doi:10.1016/s2589-7500(21)00234-x

Bias and privacy in AI's cough-based COVID-19 recognition

2021· letter· en· W3216468336 sur OpenAlexaboutno aff
Humberto Pérez-Espinosa, Eva Timonet‐Andreu, Javier Andreu-Pérez

Notice bibliographique

RevueThe Lancet Digital Health · 2021
Typeletter
Langueen
DomaineMedicine
ThématiqueCOVID-19 diagnosis using AI
Établissements canadiensnon disponible
Organismes subventionnairesnon disponible
Mots-clésScopusCoronavirus disease 2019 (COVID-19)Test (biology)MedicineSevere acute respiratory syndrome coronavirus 2 (SARS-CoV-2)Artificial intelligenceFamily medicineLibrary sciencePsychologyMEDLINEPolitical scienceComputer scienceInternal medicineLaw

Résumé

récupéré en direct d'OpenAlex

We read with interest the Comment by Coppock and colleagues,1Coppock H Jones L Kiskin I Schuller B COVID-19 detection from audio: seven grains of salt.Lancet Digit Health. 2021; 3: e537-38Summary Full Text Full Text PDF PubMed Scopus (21) Google Scholar in which the authors express their thoughtful opinion about several simultaneous works by independent research groups worldwide (eg, Massachusetts Institute of Technology, National Research Council of Canada, University of Cambridge, and Swiss Federal Institute of Technology Lausanne). One of these works was our own; a pioneering, multicentre, international study2Andreu-Perez J Perez-Espinosa H Timonet E et al.A generic deep learning based cough analysis system from clinically validated samples for point-of-need COVID-19 test and severity levels.IEEE Trans Serv Comput. 2021; (published online Feb 23.)https://doi.org/10.1109/TSC.2021.3061402Crossref Scopus (42) Google Scholar with a clinically validated dataset of forced coughs alongside quantitative RT-PCR from participants who physically attended a test centre. Participant control was performed on site by health personnel at the partner health centres that contributed to this study.2Andreu-Perez J Perez-Espinosa H Timonet E et al.A generic deep learning based cough analysis system from clinically validated samples for point-of-need COVID-19 test and severity levels.IEEE Trans Serv Comput. 2021; (published online Feb 23.)https://doi.org/10.1109/TSC.2021.3061402Crossref Scopus (42) Google Scholar The Comment1Coppock H Jones L Kiskin I Schuller B COVID-19 detection from audio: seven grains of salt.Lancet Digit Health. 2021; 3: e537-38Summary Full Text Full Text PDF PubMed Scopus (21) Google Scholar focuses on human audio biometrics in general, albeit eight out of ten referenced works made use of coughs as their audio source. The use of cough sounds to detect respiratory system abnormalities had been investigated for at least 3 years before the COVID-19 pandemic.3Botha GHR Theron G Warren RM et al.Detection of tuberculosis by automatic cough sound analysis.Physiol Meas. 2018; 39045005Crossref PubMed Scopus (57) Google Scholar Cough analysis is a particular form of audio biometrics, and other forms of audio biometrics cannot be discussed interchangeably. Although person authentication via speech has been achieved to some degree; to date, recognising an individual with ease in a large database solely by the sound of their cough is inconclusive. The same applies to inferring emotional traits. The prospect of re-identifying patients from cough sounds raises several concerns. Will participants whose data is used in developing these pre-screening systems be able to benefit from it in the future in an unbiased manner? Additionally, how can personal biometric data be made public, ensuring that it always remains non-identifiable? On the basis of the current health context, official calls have been made not to trivialise the privacy and protection of patient data.4WHOJoint statement on data protection and privacy in the COVID-19 response.https://www.who.int/news/item/19-11-2020-joint-statement-on-data-protection-and-privacy-in-the-covid-19-responseDate: Nov 19, 2020Date accessed: August 2, 2021Google Scholar, 5Pierucci A Walter J-P Joint Statement on the right to data protection in the context of the COVID-19 pandemic.https://www.coe.int/en/web/kyiv/-/joint-statement-on-the-right-to-data-protection-in-the-context-of-the-covid-19-pandemicDate: May 14, 2020Date accessed: August 2, 2021Google Scholar Subsequent research initiatives from public bodies must now help to enable inclusive research clusters and secure collaborative infrastructures in the domain of audio biometrics. Our training, development (validation), and holdout (test) sets do not contain data from the same participant (ie, they are participant-independent) to avoid spurious discerning patterns that could compromise classification scores.2Andreu-Perez J Perez-Espinosa H Timonet E et al.A generic deep learning based cough analysis system from clinically validated samples for point-of-need COVID-19 test and severity levels.IEEE Trans Serv Comput. 2021; (published online Feb 23.)https://doi.org/10.1109/TSC.2021.3061402Crossref Scopus (42) Google Scholar However, a general assumption is that a competent biometrics classifier should maximise the distinction between divergent patterns within participants, while minimising that of different participants within the same class. The inclusion of divergent observations (negative and positive) from the same participant, in the training set only, could help to satisfy this assumption; however, this effect requires further study. To conclude, there is hope that rapid, point-of-need pre-screening for COVID-19 via forced cough sounds captured from smartphones or portable devices could be feasible in the short term. Online interventional studies are now necessary to explore the potential of this novel technology and to evaluate its real-life performance, health impact assessment, end-user utility, and acceptability. We declare no competing interests. COVID-19 detection from audio: seven grains of saltDigital mass testing for COVID-19 via a mobile phone application could be made possible through machine learning and its ability to identify patterns in data. COVID-19 appears to confer unique features in the audio produced by infected individuals,1 and machine learning COVID-19 detection from breath, cough, and speech audio recordings has yielded promising results.2–4 In this critique, we present seven major issues with this research and argue that further investigation is needed before conclusions about the detectability of COVID-19 from audio can be made. Full-Text PDF Open AccessBias and privacy in AI's cough-based COVID-19 recognition – Authors' replyWe thank Humberto Perez-Espinosa and colleagues for their constructive points regarding our Comment,1 which raised concerns over the work on COVID-19 detection from bioacoustic recordings. We take this opportunity to note that the study by Perez-Espinosa and colleagues2 represented one of the superior COVID-19 audio datasets that were collected. Although the study was not completely free from the "seven grains of salt" detailed in our Comment,1 it was large scale, validated by quantitative RT-PCR, and the participants were blinded. Full-Text PDF Open Access

Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.

Comment cette classification a été obtenuedéplier

Prédiction distillée sur la base complète

Imitation des enseignants

Ni prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.

score de la tête « metaresearch » (Codex)0,001
score de la tête « metaresearch » (Gemma)0,002
Version: codex-gemma-dda1882f352aStatut de validation: machine_predicted_unvalidated
Catégories candidatesMéta-épidémiologie (sens strict)
Catégories consensuellesaucune
DomaineSignal candidat: aucune · Signal consensuel: aucune
Devis d'étudeSignal candidat: Sans objet · Signal consensuel: Sans objet
GenreSignal candidat: Commentaire · Signal consensuel: Commentaire
Score de désaccord entre enseignants0,012
Score d'incertitude au seuil1,000

Scores Codex et Gemma par catégorie

CatégorieCodexGemma
Métarecherche0,0010,002
Méta-épidémiologie (sens strict)0,0000,000
Méta-épidémiologie (sens large)0,0010,000
Bibliométrie0,0000,000
Études des sciences et des technologies0,0000,000
Communication savante0,0000,000
Science ouverte0,0000,000
Intégrité de la recherche0,0000,002
Charge utile insuffisante (le modèle a refusé de juger)0,0000,000

Scores machine (provisoires)

Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.

Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.

Tête enseignante Opus0,189
Tête enseignante GPT0,399
Écart entre enseignants0,209 · la distance entre les deux têtes enseignantes sur ce seul travail
Statut de validationscore_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découle

Classification

machine, non validée

Prédiction automatique; un appel candidat d’une seule tête enseignante, pas un consensus.

Devis d'étudeSans objet
Domainenon disponible
GenreCommentaire

Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».

En bref

Citations0
Publié2021
Routes d'admission1
Résumé présentoui

Explorer davantage

Même revueThe Lancet Digital HealthMême sujetCOVID-19 diagnosis using AITravaux en français237 207