MétaCan
Menu
Back to cohort
Record W2974190242 · doi:10.1057/s41599-019-0318-6

A collaboratively derived international research agenda on legislative science advice

2019· article· en· W2974190242 on OpenAlexaff
Karen Akerlof, Chris Tyler, Sarah Foxen, Erin Heath, Marga Gual Soler, Alessandro Allegra, Emily Cloyd, John Hird, Selena Nelson, Christina T. Nguyen, Cameryn J. Gonnella, Liam A. Berigan, C. R. Abeledo, Tamara Al-Yakoub, Harris Andoh, Laura dos Santos Boeira, Pieter van Boheemen, Paul Cairney, Robert Cook‐Deegan, Gavin Costigan, Meghnath Dhimal, Martín Hernán Di Marco, Donatus Dube, Abiodun Egbetokun, Jauad El Kharraz, Liliana Estrada Galindo, Mark W. J. Ferguson, José Luis Franco, Zach Graves, Emily Hayter, Alma Cristal Hernández‐Mondragón, Abbi Hobbs, Kerry Holden, Carel IJsselmuiden, Ayodele Samuel Jegede, Snežana Krstić, Jean-Marie Mbonyintwali, Sisay Derso Mengesha, Tomáš Michalek, Hiroshi Nagano, Michael Nentwich, Ali Nouri, Peter Dithan Ntale, Olusegun Michael Ogundele, J. Tochukwu Omenma, L. F. Pau, Jon M. Peha, Elizabeth M. Prescott, Irene Ramos-Vielba, Raimundo Roberts, Paul A. Sandifer, Marc Saner, Edmond Sanganyado, Maruf Sanni, Orlando Santillán, Deborah D. Stine, Miron L. Straf, Peter Tangney, Carla-Leanne Washbourne, Wim Winderickx, Masaru Yarime

Bibliographic record

VenuePalgrave Communications · 2019
Typearticle
Languageen
FieldSocial Sciences
TopicJudicial and Constitutional Studies
Canadian institutionsUniversity of Ottawa
FundersEconomic and Social Research CouncilNational Science Foundation
KeywordsAdvice (programming)LegislaturePolitical sciencePublic relationsSociologyEngineering ethicsComputer scienceLawEngineering

Abstract

fetched live from OpenAlex

Abstract The quantity and complexity of scientific and technological information provided to policymakers have been on the rise for decades. Yet little is known about how to provide science advice to legislatures, even though scientific information is widely acknowledged as valuable for decision-making in many policy domains. We asked academics, science advisers, and policymakers from both developed and developing nations to identify, review and refine, and then rank the most pressing research questions on legislative science advice (LSA). Experts generally agree that the state of evidence is poor, especially regarding developing and lower-middle income countries. Many fundamental questions about science advice processes remain unanswered and are of great interest: whether legislative use of scientific evidence improves the implementation and outcome of social programs and policies; under what conditions legislators and staff seek out scientific information or use what is presented to them; and how different communication channels affect informational trust and use. Environment and health are the highest priority policy domains for the field. The context-specific nature of many of the submitted questions—whether to policy issues, institutions, or locations—suggests one of the significant challenges is aggregating generalizable evidence on LSA practices. Understanding these research needs represents a first step in advancing a global agenda for LSA research.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.288
metaresearch head score (Gemma)0.314
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Evaluation · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.712
Threshold uncertainty score0.878

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.2880.314
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0020.002
Bibliometrics0.0110.015
Science and technology studies0.0160.040
Scholarly communication0.0410.043
Open science0.0060.026
Research integrity0.0340.031
Insufficient payload (model declined to judge)0.0230.003

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.183
GPT teacher head0.462
Teacher spread0.279 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designQualitative
DomainEvaluation
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations30
Published2019
Admission routes1
Has abstractyes

Explore more

Same venuePalgrave CommunicationsSame topicJudicial and Constitutional StudiesFrench-language works237,207