MétaCan
Menu
Back to cohort
Record W4405540378 · doi:10.18438/eblip30665

Evidence Summary Theme: Open Access

2024· article· en· W4405540378 on OpenAlex
H. Robson MacDonald

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.
venuePublished in a venue whose home country is Canada.
aboutThe title or abstract carries a Canadian signal from the geographic lexicon.

Bibliographic record

VenueEvidence Based Library and Information Practice · 2024
Typearticle
Languageen
FieldDecision Sciences
Topicscientometrics and bibliometrics research
Canadian institutionsCarleton University
Fundersnot available
KeywordsTheme (computing)Computer scienceWorld Wide WebData scienceLibrary science

Abstract

fetched live from OpenAlex

Open access is the focus of the evidence summaries in this issue.The benefits of open access are familiar to many librarians.Making publicly funded research openly accessible serves a common good by advancing discovery and innovation, enhancing public welfare, providing an evidence base for sound policy, as well as many other societal benefits (Canadian Association of Research Libraries, 2013).We have a short list of summaries this issue.The first article summarized investigates librarians' perspectives on their role in promoting open access and the barriers and requirements for successful promotion.Next is a summary of an article that explores faculty perspectives on and experiences with open access and sharing of unpublished open content.The final evidence summary looks at an article that showcases techniques for archiving open access articles in an institutional repository.We hope these summaries provide useful to librarians involved in, or simply interested in, open access endeavors.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Direct model labels (unvalidated)

Per-model category and study-design labels from the labeling rounds. They are machine output, unvalidated, and the disagreement between models ships as data. No study design here is MEDLINE-validated yet.

Model armCategoriesStudy designConfidence
gemmaScholarly communicationOpen science
Domain: not available · Genre: Review
About the Canadian research system: no · About a Canadian topic: no
Not applicablemedium
gptScholarly communication
Domain: not available · Genre: Review
About the Canadian research system: no · About a Canadian topic: no
Other designlow
models splitAgreement compares identical category sets and study designs across arms.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.021
metaresearch head score (Gemma)0.118
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Bibliometrics, Scholarly communication, Open science, Insufficient payload (model declined to judge)
Consensus categoriesBibliometrics, Scholarly communication, Insufficient payload (model declined to judge)
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Commentary · Consensus signal: none
Teacher disagreement score0.697
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0210.118
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0170.086
Science and technology studies0.0000.000
Scholarly communication0.0950.782
Open science0.0060.004
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0030.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.582
GPT teacher head0.592
Teacher spread0.010 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it