MétaCan
Menu
Back to cohort
Record W2995846175 · doi:10.33211/jnhpr.9

Favouring Responsible Publishing: A Protocol for Creating a Database of Researchers and Surveying their Knowledge, Attitudes and Opinions towards Open Access Publishing and a New Field-Specific Journal

2019· article· en· W2995846175 on OpenAlexafffund
Jeremy Y. Ng, Halton Quach, Fredrick D. Ashbury, Kieran Cooley, Pierre S. Haddad

Bibliographic record

VenueJournal of Natural Health Product Research · 2019
Typearticle
Languageen
FieldDecision Sciences
TopicMeta-analysis and systematic reviews
Canadian institutionsUniversité de MontréalHamilton Health SciencesUniversity of TorontoMcMaster UniversityCanadian College of Naturopathic MedicineImpact
FundersGovernment of CanadaAustralian Government
KeywordsPublishingProtocol (science)Field (mathematics)Process (computing)Product (mathematics)Open access publishingComputer scienceScholarly communicationWorld Wide WebPublic relationsData sciencePolitical scienceMedicineAlternative medicine

Abstract

fetched live from OpenAlex

Background: As a new publication, the Journal of Natural Health Product Research (JNHPR) sought to develop a two-step protocol that (1) creates an international database of natural health product (NHP) researchers and (2) surveys their perceptions, needs, and preferences for a legitimate, broad-based, open access scientific journal in their field. This protocol could be useful to other researchers and publishers and can be adapted to establish similarly legitimate journals within their academic discipline.Methods: The database will initially be created using publicly available information online. A keyword-based, systematized search will identify the majority of NHP researchers, with referrals completing the process. Key research and publication characteristics of each person will be recorded. Subsequently, a survey will be developed and administered to all identified individuals to capture their attitudes and opinions on both open access in general, as well as the JNHPR. Construction of our NHP researcher database began in early-2018 and the development of our survey began in mid-2019. The survey is slated to be administered in early 2020.Conclusion: This protocol provides a process for constructing an international researcher database and a survey that aims to understand the community of NHP researchers’ interests and needs regarding open access publishing and a new field-specific journal. This process can be modified and replicated for the purpose of establishing other legitimate journals in any scientific research discipline.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.214
metaresearch head score (Gemma)0.246
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Open science
Consensus categoriesMetaresearch
DomainCandidate signal: Incentives · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Protocol · Consensus signal: Protocol
Teacher disagreement score0.995
Threshold uncertainty score0.969

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.2140.246
Meta-epidemiology (narrow)0.0020.004
Meta-epidemiology (broad)0.0040.003
Bibliometrics0.0080.010
Science and technology studies0.0100.005
Scholarly communication0.0070.011
Open science0.0050.009
Research integrity0.0080.009
Insufficient payload (model declined to judge)0.1010.048

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.951
GPT teacher head0.725
Teacher spread0.225 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designNot applicable
DomainIncentives
GenreProtocol

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations2
Published2019
Admission routes2
Has abstractyes

Explore more

Same venueJournal of Natural Health Product ResearchSame topicMeta-analysis and systematic reviewsFrench-language works237,207