MétaCan
Menu
← Back to cohort
Record W6950438233 · doi:10.5683/sp3/hwg5fc

Public consultation in the evaluation of animal research protocols

2022· dataset· en· W6950438233 on OpenAlexaff

Bibliographic record

VenueBorealis · 2022
Typedataset
Languageen
Field
Topic
Canadian institutionsUniversity of British Columbia
Fundersnot available
KeywordsThematic analysisTransparency (behavior)Protocol (science)Public involvementAmbivalenceResearch ethicsQualitative researchData collectionScale (ratio)

Abstract

fetched live from OpenAlex

In this study we invited public responses to five different research projects, using non-technical summaries intended for lay audiences. Our aim was to assess the potential for this type of public consultation in protocol review, and a secondary aim was to better understand what types of animal research people are willing to accept and why. US participants (n = 1521) were asked (via an online survey) “Do you support the use of these (insert species) for this research”, and responded using a seven-point scale (1 = “No”, 4 = “Neutral”, and 7 = “Yes”). Participants were asked to explain the reasons for their choice; open-ended text responses were subjected to thematic analysis. Most participants (89.7%) provided clear comments, showing the potential of an online forum to elicit feedback. Four themes were prevalent in participant reasoning regarding their support for the proposed research: 1) impact on animals, 2) impact on humans, 3) scientific merit, and 4) availability of alternatives. Participant support for the proposed research varied but on average was close to neutral (mean ± SD: 4.5 ± 2.19) suggesting some ambivalence to this animal use. The protocol describing Parkinson’s research (on monkeys) was least supported (3.9 ± 2.17) and the transplant research (on pigs) was most supported (4.9 ± 2.02). These results indicate that public participants are sensitive to specifics of a protocol. We conclude that an online forum can provide meaningful public input on proposed animal research, offering research institutions the opportunity for improved transparency and the chance to reduce the risk that they engage in studies that are out of step with community values.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.788
metaresearch head score (Gemma)0.745
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Evaluation · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Dataset · Consensus signal: none
Teacher disagreement score0.212
Threshold uncertainty score0.261

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.7880.745
Meta-epidemiology (narrow)0.0020.003
Meta-epidemiology (broad)0.0020.002
Bibliometrics0.0070.005
Science and technology studies0.0110.016
Scholarly communication0.0110.016
Open science0.0060.022
Research integrity0.0100.010
Insufficient payload (model declined to judge)0.0100.003

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.506
GPT teacher head0.526
Teacher spread0.020 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designNot applicable
DomainEvaluation
GenreDataset

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2022
Admission routes1
Has abstractyes

Explore more

Same venueBorealis→French-language works237,207→