MétaCan
Menu
Back to cohort
Record W3176725870 · doi:10.1093/ije/dyab118

Response to the Opinion paper ‘Why do we disagree?’

2021· article· en· W3176725870 on OpenAlexaff
Shira Kramer, Colin L. Soskolne

Bibliographic record

VenueInternational Journal of Epidemiology · 2021
Typearticle
Languageen
FieldHealth Professions
TopicHealthcare cost, quality, practices
Canadian institutionsUniversity of Alberta
Fundersnot available
KeywordsPublic opinionMEDLINEMedicinePsychologyPolitical scienceLawPolitics

Abstract

fetched live from OpenAlex

In the Opinion piece by Woodward et al. (2020),1 we appreciate their explanations and proposals to resolve disagreement among epidemiologists. However, one glaring omission in their framework relates to the funding source as a major reason for uncompromising disagreement in the profession. The funding source, broadly interpreted, includes not only money, but also professional ambition tied to professional security. The scope and impact of this problem are deep and, as shown by Kramer and Soskolne (2017) in Figure 1, have grown steeply since about 2000.2 The funding source impacts not only the choice of research topic, but also the design, analysis and interpretation of studies over which disagreement often results.3–5 The funding source also results in influences that foment uncertainty and cast doubt,6–9 resulting in disagreement. With the increasing dependence of academic institutions on corporate funding, as well as the influence of politics on federal research priorities and funding, the problem is further exacerbated. Funding results in conflicted interests with entrenched stakes at play, so the question becomes one of, in the context of conflict, whether an honest conversation between epidemiologists about the design, analysis and interpretation of a study could take place. In the context of conflicting interests, would bringing social and behavioural scientists into a panel discussion change anyone’s position if it threatens their funding support and/or career? Based on the body of evidence, it would not. Indeed, it would be magical thinking to anticipate anything different. An adversarial role is taken by otherwise well-meaning epidemiologists in the presence of vested interests, especially when money is involved. Long overdue for broad consensus, and a topic that we speculate would help to minimize the likelihood of disagreement of the type proposed by Woodward et al. (2020),1 is the need for a more formal requirement that familiarity with ethics guidelines10 be required in epidemiology training programmes, as well as in mentoring programmes. Ethics guidelines have been put forward for the profession since the 1990s. However, their uptake, determined from ad hoc surveys at professional meetings, as well the small number of times they are cited in publications, has been poor. The International Society for Environmental Epidemiology),10,11 as well as the American College of Epidemiology,12 were leaders in approving their ethics guidelines. The guidelines, formally adopted by these prominent professional epidemiology organizations, provide normative standards for epidemiological practice and behaviour based on expressed core values and ethical principles. In so doing, a framework is provided for constructive argument regarding actions that need to be taken for advancing knowledge. The guidelines also provide detailed mechanisms for community engagement, including oversight bodies that determine the relevance of the very question being addressed epidemiologically, to its interpretation and dissemination, impacting on its effective translation into policy. We are left wondering whether the concerns expressed by Woodward et al.1 would exist had adequate attention over the past 20 years been given to integrating ethics training into the curriculum, and into mentorship programmes. Shoring up, in any way we can, the integrity of our discipline is needed if the public interest is to be protected.13 The purpose behind ethics-guideline development is to be proactive in providing a transparent framework for assessing normative ethical options anchored in transparent professional values. Guidelines facilitate discourse, including constructive disagreement, among well-intentioned people. However, when conflicted interests arise through financial interests, we submit that agreement is nigh on impossible among parties with entrenched positions. None declared.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Direct model labels (unvalidated)

Per-model category and study-design labels from the labeling rounds. They are machine output, unvalidated, and the disagreement between models ships as data. No study design here is MEDLINE-validated yet.

Model armCategoriesStudy designConfidence
gemmano category
Domain: not available · Genre: Commentary
About the Canadian research system: no · About a Canadian topic: no
Not applicablelow
gptno category
Domain: not available · Genre: Commentary
About the Canadian research system: no · About a Canadian topic: no
Not applicablelow
models agreeAgreement compares identical category sets and study designs across arms.

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.012
metaresearch head score (Gemma)0.095
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Commentary · Consensus signal: Commentary
Teacher disagreement score0.072
Threshold uncertainty score0.063

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0120.095
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0030.003
Bibliometrics0.0010.001
Science and technology studies0.0060.004
Scholarly communication0.0070.005
Open science0.0040.004
Research integrity0.0720.066
Insufficient payload (model declined to judge)0.0170.013

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.690
GPT teacher head0.635
Teacher spread0.055 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Labeled directly by 2 models reading the full record.

The models applied no category: nothing in the taxonomy fit this work.
Study designNot applicable
Domainnot available
GenreCommentary

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2021
Admission routes1
Has abstractno

Explore more

Same venueInternational Journal of EpidemiologySame topicHealthcare cost, quality, practicesFrench-language works237,207