MétaCan
Menu
Back to cohort
Record W2780757550 · doi:10.1139/facets-2017-0087

Keeping science’s seat at the decision-making table: Mechanisms to motivate policy-makers to keep using scientific information in the age of disinformation

2017· article· en· W2780757550 on OpenAlexafffundvenueabout
Justin N. Marleau, Kimberly Girling

Bibliographic record

VenueFACETS · 2017
Typearticle
Languageen
FieldMedicine
TopicHIV, Drug Use, Sexual Risk
Canadian institutionsMcGill UniversityMitacs
FundersNatural Resources CanadaNational Research Council CanadaAgriculture and Agri-Food CanadaCanadian Space AgencyHealth CanadaEnvironment and Climate Change CanadaFisheries and Oceans CanadaCanadian Food Inspection AgencyMitacsPublic Health AgencyCanadian Nuclear Safety CommissionPublic Health Agency of Canada
KeywordsDisinformationPublic relationsScientific evidenceGovernment (linguistics)OutreachWork (physics)Political sciencePosition (finance)Process (computing)Public policyPublic administrationBusinessComputer scienceEngineeringLawSocial media

Abstract

fetched live from OpenAlex

Policy-makers are confronted with complex problems that require evaluating multiple streams of evidence and weighing competing interests to develop and implement solutions. However, the policy interventions available to resolve these problems have different levels of supporting scientific evidence. Decision-makers, who are not necessarily scientifically trained, may favour policies with limited scientific backing to obtain public support. We illustrate these tensions with two case studies where the scientific consensus went up against the governing parties’ chosen policy. What mechanisms exist to keep the weight of scientific evidence at the forefront of decision-making at the highest levels of government? In this paper, we propose that Canada create “Departmental Chief Science Advisors” (DCSAs), based on a program in the UK, to help complement and extend the reach of the newly created Chief Science Advisor position. DCSAs would provide advice to ministers and senior civil servants, critically evaluate scientific work in their host department, and provide public outreach for the department’s science. We show how the DCSAs could be integrated into their departments and illustrate their potential benefits to the policy making process and the scientific community.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.173
metaresearch head score (Gemma)0.266
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Evaluation · Consensus signal: none
Study designCandidate signal: Theoretical or conceptual · Consensus signal: Theoretical or conceptual
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.827
Threshold uncertainty score0.917

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.1730.266
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0060.004
Science and technology studies0.0200.044
Scholarly communication0.0310.018
Open science0.0050.021
Research integrity0.0220.018
Insufficient payload (model declined to judge)0.0120.002

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.050
GPT teacher head0.380
Teacher spread0.329 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designTheoretical or conceptual
DomainEvaluation
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations7
Published2017
Admission routes4
Has abstractyes

Explore more

Same venueFACETSSame topicHIV, Drug Use, Sexual RiskFrench-language works237,207