MétaCan
Menu
Back to cohort
Record W2171209354 · doi:10.1142/9789814299701_0003

Bibliometric Analyses on Repository Contents for the Evaluation of Research at Wageningen UR

2010· article· en· W2171209354 on OpenAlexaboutno aff
M.G.P. van Veller, W. Gerritsma, P.L. van der Togt, Charles D. Leon, Corrie M. van Zeist

Bibliographic record

VenueQualitative and Quantitative Methods in Libraries · 2010
Typearticle
Languageen
FieldComputer Science
TopicWeb visibility and informetrics
Canadian institutionsnot available
Fundersnot available
KeywordsComputer scienceLibrary science

Abstract

fetched live from OpenAlex

Since the last two decennia, Wageningen UR Library has been involved in bibliometric analyses for the evaluation of scientific output of staff, chair groups and research institutes of Wageningen UR. In these advanced bibliometric analyses several indicator scores, such as the number of publications, number of citations and citation impacts, are calculated. For a fair comparison of scientific output from staff, chair groups or research institutes (that each work in a different scientific discipline with specific publication and citation habits) scores of the measured bibliometric indicators are normalized against average trend (or baseline) scores per research field. For the collection of scientific output that is subjected to the bibliometric analyses the repository Wageningen Yield (WaY) is used. This repository is filled from the research registration system Metis in which meta data for scientific output is registered by the secretaries of the research groups of Wageningen UR. By the application of a connection between the meta data of publications in WaY and citation scores in Thomson Reuters¿ Web of Science, custom-made analyses on the scientific output and citation impact of specific entities from Wageningen UR can be performed fast and efficiently. Moreover, a timely registration of new scientific output is stimulated (to ensure their inclusion in future bibliometric analyses) and the quality of meta data in WaY is checked by the library staff and by the research staff from the research entities under investigation, thus promoting communication between the library and customers

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.033
metaresearch head score (Gemma)0.035
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Bibliometrics
Consensus categoriesMetaresearch, Bibliometrics
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Theoretical or conceptual · Consensus signal: Theoretical or conceptual
GenreCandidate signal: Methods · Consensus signal: Methods
Teacher disagreement score0.481
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0330.035
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0110.030
Science and technology studies0.0000.001
Scholarly communication0.0000.001
Open science0.0010.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.741
GPT teacher head0.652
Teacher spread0.088 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; both teacher heads agree on what is shown here.

Study designTheoretical or conceptual
Domainnot available
GenreMethods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations8
Published2010
Admission routes1
Has abstractyes

Explore more

Same venueQualitative and Quantitative Methods in LibrariesSame topicWeb visibility and informetricsFrench-language works237,207