MétaCan
Menu
← Back to cohort
Record W4226288816 · doi:10.29173/jchla29409

Developing a code of practice for literature searching in health sciences: a project description

2022· article· en· W4226288816 on OpenAlexaffvenueabout
Brooke Ballantyne Scott

Bibliographic record

VenueJournal of the Canadian Health Libraries Association / Journal de l Association de bilbiothèques de la santé du Canada · 2022
Typearticle
Languageen
FieldHealth Professions
TopicHealth Literacy and Information Accessibility
Canadian institutionsFraser Health
Fundersnot available
KeywordsComputer scienceCLARITYTerminologyVocabularyGlossaryCard sortingCode (set theory)DelphiInformation retrievalBest practiceWorld Wide WebPolitical science

Abstract

fetched live from OpenAlex

Introduction: Libraries have provided mediated search services for more than forty years without a practice standard to guide the execution of searches, training of searchers, or evaluation of search performance. A pan-Canadian group of librarians completed a study of the literature on mediated search practices from 2014-2017 as a first step in addressing this deficit. Methods: We used a three-phase, six-part content analysis process to examine and analyze published guidance on literature searching. Card sorting, Delphi methods, and an online questionnaire were then used to validate our findings and build a code of practice. Results: Our code of practice for mediated searching lists eighty-five search tasks arranged in performance order, within five progressive levels of search complexity. A glossary of 150 search terms supports the code of practice. Discussion: The research literature on mediated search methods is sparse and fragmented, lacking currency and a shared vocabulary. A code of practice for mediated searching will provide clarity in terminology, approach, and methods. This code of practice will provide a unified and convenient reference for training a new hire, upholding standards of search service delivery, or educating the next wave of health library professionals.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.168
metaresearch head score (Gemma)0.219
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Scholarly communication
Consensus categoriesnone
DomainCandidate signal: Methods · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Protocol · Consensus signal: none
Teacher disagreement score0.991
Threshold uncertainty score0.888

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.1680.219
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0080.007
Science and technology studies0.0090.011
Scholarly communication0.0090.006
Open science0.0040.014
Research integrity0.0030.004
Insufficient payload (model declined to judge)0.0040.003

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.031
GPT teacher head0.395
Teacher spread0.364 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designNot applicable
DomainMethods
GenreProtocol

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations2
Published2022
Admission routes3
Has abstractyes

Explore more

Same venueJournal of the Canadian Health Libraries Association / Journal de l Association de bilbiothèques de la santé du Canada→Same topicHealth Literacy and Information Accessibility→French-language works237,207→