MétaCan
Menu
Back to cohort
Record W4394582036 · doi:10.22584/nr55.2024.014

Tag the Scientists!

2024· article· en· W4394582036 on OpenAlexaffvenueabout
Amanda Graham

Bibliographic record

VenueThe Northern Review · 2024
Typearticle
Languageen
FieldSocial Sciences
TopicHistorical Geography and Geographical Thought
Canadian institutionsYukon University
FundersAreva
KeywordsComputer science

Abstract

fetched live from OpenAlex

Extract from Introduction...Northern research. A big topic. An important one. Scholars, academics, practitioners, and community people are thinking about it a lot: how and why it’s done. We’re talking about how to repatriate it, about how to fund it, about how to ensure that inquiries are relevant and methods valid, that people are involved in research in good ways, and that the research benefits widely.This is the place where “Tag the Scientists” comes from. Deep in the boreal forest, CritterLab, with its moose PI, fox and porcupine grad students, and bunny undergrads, undertakes an observational study of southern scientists who conduct research in and about the North, to uncover the complex lives of their subjects through remote sensing. It’s a riff on ACCESS, an idea facetiously floated by Aron Senkpiel and Norm Easton in the Northern Review’s first issue, recounting a time they’d been talking about “the problem of the South.” They had joked around with the idea of a northern Association of Canadian Colleges Engaged in Southern Studies. It would hold annual Southern Studies conferences in the North, and establish scholarships for students to come north to study southern Canada. The Association would set up field stations in the Near, Middle, and Far South to enable researchers to spend a month or two down south in the winter. “That reminded us,” they breathlessly conclude, “that we would have to give some thought to developing a code of ethics to which members engaged in southern research would have to subscribe.”(1) The tables would be comprehensively turned!

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.004
metaresearch head score (Gemma)0.042
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesScience and technology studies, Insufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.998
Threshold uncertainty score0.186

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0040.042
Meta-epidemiology (narrow)0.0020.001
Meta-epidemiology (broad)0.0020.002
Bibliometrics0.0080.010
Science and technology studies0.0020.001
Scholarly communication0.0120.009
Open science0.0030.006
Research integrity0.0050.004
Insufficient payload (model declined to judge)0.8690.869

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.022
GPT teacher head0.330
Teacher spread0.308 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designNot applicable
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2024
Admission routes3
Has abstractyes

Explore more

Same venueThe Northern ReviewSame topicHistorical Geography and Geographical ThoughtFrench-language works237,207