MétaCan
Menu
Back to cohort
Record W6906298117 · doi:10.17605/osf.io/5ypfj

A scoping review protocol for cognitive bias in US and Canadian medical diagnosis: Current prevalence and management through education and policy

2023· other· en· W6906298117 on OpenAlexaboutno aff

Bibliographic record

VenueOpen Science Framework · 2023
Typeother
Languageen
Field
Topic
Canadian institutionsnot available
Fundersnot available
KeywordsJudgementProtocol (science)Cognitive biasCognitionPublicationMedical diagnosisPsychological interventionMedical literature

Abstract

fetched live from OpenAlex

In 2002, psychologist Daniel Kahneman’s received the Nobel Prize for his work on errors in judgement and decision-making. Kahneman’s and Amos Tversky’s collaboration, dating back to the 1990’s, with Canadian physician Donald Redelmeier, advanced work on cognitive biases in medical decision-making. In 2005, US and Canadian physicians began to publish regularly on cognitive bias in medical diagnosis. The literature through 2017 suggests missed or delayed diagnoses were implicated in 10-15% of cases, 17% of adverse events and 10% of deaths. Research also suggested cognitive bias was associated with 74% of missed or delayed diagnoses, regardless of whether a condition was rare or common or of the degree of confidence in the incorrect diagnosis. Given the well-documented importance of reducing cognitive bias in order to promote medical diagnostic accuracy, the current scoping review will integrate the English language reviews and literature 2005 through 2020 based on vignettes, case-studies, surveys, and medical record searches as well as policy and theory. It is anticipated the scoping review will document prevalent and overlooked biases; include theory and findings about circumstances that promote bias; and align policy recommendations with interventions that have more or less robust evidence for their efficacy. Given the history of the field, the review concentrates on medical diagnosticians and their patients in the USA and Canada.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.173
metaresearch head score (Gemma)0.225
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Protocol · Consensus signal: Protocol
Teacher disagreement score0.971
Threshold uncertainty score0.916

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.1730.225
Meta-epidemiology (narrow)0.0060.007
Meta-epidemiology (broad)0.0120.013
Bibliometrics0.0330.030
Science and technology studies0.0090.007
Scholarly communication0.0120.009
Open science0.0060.009
Research integrity0.0090.009
Insufficient payload (model declined to judge)0.0860.017

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.119
GPT teacher head0.516
Teacher spread0.397 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designNot applicable
Domainnot available
GenreProtocol

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2023
Admission routes1
Has abstractyes

Explore more

Same venueOpen Science FrameworkFrench-language works237,207