MétaCan
Menu
Back to cohort
Record W2928924896 · doi:10.1136/bmjebm-2018-111070.82

82 Defining overdiagnosis of mental health disorders: secondary analysis of an overdiagnosis scoping review

2018· article· en· W2928924896 on OpenAlexaff
Kimberly A. Turner, Ian Shrier, Brett D. Thombs

Bibliographic record

VenueOral Presentations · 2018
Typearticle
Languageen
FieldEconomics, Econometrics and Finance
TopicHealth Systems, Economic Evaluations, Quality of Life
Canadian institutionsJewish General HospitalMcGill University
Fundersnot available
KeywordsOverdiagnosisPsychological interventionOperationalizationMental healthNeurocognitiveMedicineAsymptomaticPsychologyPsychiatryCognitionPathologyEpistemology

Abstract

fetched live from OpenAlex

Objectives The term ‘overdiagnosis’ was first used as early as 1924, when J. D. Adamson used it to describe negative implications of attempts to achieve early diagnosis of pulmonary tuberculosis (CMAJ, 1924). Since then, the term has been used most frequently to describe negative outcomes from screening for early-stage asymptomatic cancers. Typical definitions describe overdiagnosis as detection of early-stage asymptomatic conditions that would never have led to morbidity or mortality. In other areas, including mental health, overdiagnosis can occur among people who experience symptoms but whose symptoms do not reflect disorders and may not be amenable to healthcare interventions. Thus, more recent alternative definitions have focused on diagnosis among people who would not be expected to experience net benefit. The degree to which such definitions have been adopted is not clear. Our objective was to describe how the term overdiagnosis has been defined explicitly or operationalized implicitly in mental health. Method A scoping review of overdiagnosis across medical disciplines searched PubMed in August 2017 for published articles that used keywords related to overdiagnosis. Articles from the scoping review were eligible for the present analysis if they were classified in the scoping review as related to mental health, excluding neurocognitive disorders, and if they used the term overdiagnosis in the text of the article and not just in the title. We extracted basic information about the article and whether it included an explicit or implicit definition of overdiagnosis. Explicit definitions were extracted. If the definition was implicit, the reviewer provided an explanation of how overdiagnosis was operationalized in the study or article. Data were extracted by one reviewer with validation by a second reviewer, and any disagreements resolved by consensus. Explicit and implicit definitions were grouped into categories by one investigator and verified by a second investigator. Results 148 articles were included. Of the 14 articles that explicitly defined overdiagnosis, 9 defined it as a false positive diagnosis, 2 as misdiagnosis (diagnosing people with one disorder rather than another), 1 as diagnosis of an individual who would not be expected to benefit from treatment, and 2 had vague descriptions. In the other 134 articles, implicit definitions fit into 4 categories; 68 articles implicitly defined overdiagnosis as diagnosis of people who do not meet diagnostic criteria, 59 as misdiagnosis, 13 as diagnosis resulting from overly broad or changed diagnostic criteria; and 2 as no net benefit from diagnosis. There were 13 with unclear or difficult to classify definitions. There was overlap of definitions with several articles fitting into more than one category. The most significant overlap involved 13 articles that were classified as both misdiagnosis and diagnosis of people who do not meet diagnostic criteria. Conclusions Definitions of overdiagnosis commonly used in the context of screening for asymptomatic early-stage disease are not generally applicable in mental health where diagnoses are not made in the absence of symptoms. There is not, however, an agreed upon definition of overdiagnosis in mental health. Results from the present review indicate that the term is used most commonly in the field to describe potential drivers of overdiagnosis, including diagnosing individuals who do not meet diagnostic criteria and overly broad diagnostic criteria, as well as misdiagnosis, which may not always reflect overdiagnosis. Some articles define overdiagnosis in mental health as occurring when there is no net benefit from diagnosis; that is, when individuals are diagnosed, but expected benefits from the diagnosis would not be expected to exceed harms. Agreement on an approach to defining overdiagnosis in mental health is needed so that evidence of overdiagnosis can be more readily evaluated.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.112
metaresearch head score (Gemma)0.334
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Methods · Consensus signal: none
Study designCandidate signal: Systematic review · Consensus signal: Systematic review
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.888
Threshold uncertainty score0.593

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.1120.334
Meta-epidemiology (narrow)0.0020.002
Meta-epidemiology (broad)0.0080.016
Bibliometrics0.0510.048
Science and technology studies0.0020.002
Scholarly communication0.0060.004
Open science0.0030.007
Research integrity0.0020.002
Insufficient payload (model declined to judge)0.0090.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.285
GPT teacher head0.508
Teacher spread0.222 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designSystematic review
DomainMethods
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2018
Admission routes1
Has abstractyes

Explore more

Same venueOral PresentationsSame topicHealth Systems, Economic Evaluations, Quality of LifeFrench-language works237,207