MétaCan
Menu
Retour à la cohorte
Enregistrement W2733427969 · doi:10.1097/ede.0000000000000706

Re

2017· letter· war· W2733427969 sur OpenAlex
Michael A. McIsaac

Pourquoi ce travail est dans la base

Une base qui oublie comment elle a trouvé un travail ne peut pas être vérifiée. Voici les voies qui ont admis celui-ci.

affAu moins un auteur déclare une institution canadienne dans l'instantané OpenAlex épinglé.
aboutLe titre ou le résumé porte un signal canadien du lexique géographique.

Notice bibliographique

RevueEpidemiology · 2017
Typeletter
Languewar
DomaineComputer Science
ThématiqueBayesian Modeling and Causal Inference
Établissements canadiensQueen's University
Organismes subventionnairesnon disponible
Mots-clésPropositionBayes' theoremBelief revisionMistakeEpistemologySet (abstract data type)Point (geometry)Mathematical economicsComputer sciencePsychologyMathematicsPhilosophyArtificial intelligenceBayesian probabilityLawPolitical science

Résumé

récupéré en direct d'OpenAlex

To the Editor: In their letter, Cole et al1 set out to prove that a dogmatist (one whose beliefs cannot be influenced by observations) cannot learn (which they define as “having your beliefs influenced by observations”). Disregarding that this proposition is true by definition, the authors provided an amusing exploration into this idea using Bayes’ theorem. However, the authors made an important error in their calculations. This error does not change the authors’ point about dogmatists being unable to learn, but it does lead to the incorrect conclusion that it is good practice to allow any piece of information to sway your opinion, regardless of the quality of that information; this seems like a major oversight in this era of “fake news”2 and “alternative facts!”3,4 Cole et al1 consider an encrypted question that has two possible answers; we will denote these as or . The authors suppose that 12 people answer the question of interest and examine how prior belief in the correct answer is updated by these observations. The authors remind us of Bayes’ theorem, which says that belief in an answer after observing data [the posterior probability ] is a function of both prior belief and the likelihood of the observed data if the answer is . They define a dogmatic belief as one that is certain a priori [e.g., ] and observe that data do not influence this dogmatic belief . However, in their calculations, Cole et al1 conflated their answer to the question of interest with the probability that each person actually gave the right answer. In the remainder of this letter, I will correct the calculations and demonstrate the important finding that learning from bad information can be worse than not learning at all. As in reference (1), suppose that in absence of evidence, a nondogmatist believes the two possible answers to be equally likely . Cole et al1 wish to calculate the nondogmatist’s belief that after learning that five people think and seven think . That is, the goal is to find the posterior probability. The key point missed by Cole et al1 is that is a function of the probability (call it ) that each of these independent and exchangeable people gave the right answer. In their example with deterministic Q, If the observations came from 12 individuals who were each fairly likely to get the right answer, say = 2/3, then the posterior probabilities would be and , and as reported by Cole et al,1 a nondogmatist should be swayed to believe that the correct answer is . However, if the 12 “experts” were answering completely randomly (so = 1/2), then we can see that their information truly should not influence beliefs: and . Most importantly, if the information came from 12 people who were unlikely to give the right answer, say = 1/3, then beliefs should actually be influenced in the opposite direction: and . Without knowing the quality of the data, it is impossible to properly learn from it. If presented with bad data, the nondogmatist could easily be swayed to posterior beliefs that are further from the truth than the ones established a priori! In this light, I propose an addendum to the proposition by Cole et al1: it is true that dogmatists cannot learn, but learning may actually be detrimental to those who cannot separate truth from “alternative facts.” Michael A. McIsaac Department of Public Health Sciences Queen’s University Kingston, ON, Canada [email protected]

Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.

Prédiction distillée sur la base complète

Imitation des enseignants

Ni prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.

score de la tête « metaresearch » (Codex)0,005
score de la tête « metaresearch » (Gemma)0,006
Version: codex-gemma-dda1882f352aStatut de validation: machine_predicted_unvalidated
Catégories candidatesMéta-épidémiologie (sens strict), Science ouverte, Intégrité de la recherche, Charge utile insuffisante (le modèle a refusé de juger)
Catégories consensuellesIntégrité de la recherche
DomaineSignal candidat: aucune · Signal consensuel: aucune
Devis d'étudeSignal candidat: Sans objet · Signal consensuel: Sans objet
GenreSignal candidat: Commentaire · Signal consensuel: Commentaire
Score de désaccord entre enseignants0,375
Score d'incertitude au seuil0,999

Scores Codex et Gemma par catégorie

CatégorieCodexGemma
Métarecherche0,0050,006
Méta-épidémiologie (sens strict)0,0010,001
Méta-épidémiologie (sens large)0,0020,001
Bibliométrie0,0000,000
Études des sciences et des technologies0,0010,001
Communication savante0,0000,000
Science ouverte0,0060,001
Intégrité de la recherche0,0030,004
Charge utile insuffisante (le modèle a refusé de juger)0,0000,005

Scores machine (provisoires)

Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.

Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.

Tête enseignante Opus0,197
Tête enseignante GPT0,379
Écart entre enseignants0,182 · la distance entre les deux têtes enseignantes sur ce seul travail
Statut de validationscore_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découle