Bibliographic record
Abstract
There have been several studies on the distributions of index terms, title terms, authors and other elements used in searching bibliographic databases. What is needed is to relate this information of the actual usage of terms in searching. This study uses data from monitoring the actual usage of terms in an online catalog at the School of Library and Information Science at the University of Western Ontario. Every time a term was used in a search expression, a count in the dictionary file was updated. If a word was not in the dictionary it was added. In this way we can see which words are in the catalog and not searched and also those which were searched but not in the dictionary. As a check on other studies the rank distribution of terms used in searching was checked and found to be of a general Zipf type. The main interest was to check if high frequency terms in the catalog were used frequently in searching. Several measures of this were tried. First the regular scatterplot of frequency of use in the catalog versus the frequency in searching was checked and Pearson’s correlation coefficient was calculated. The correlation was reasonably high at 0.74. Since the total number of terms and frequencies was much larger in the catalog, a plot of the rank of the terms in the catalog was plotted against the rank of the term in searching. This provided a very scattered plot with less clustering at the origin as in the original plot of frequencies. The Spearman rank correlation coefficient was moderate at 0.58. Some studies have suggested that removing high frequency and very low frequency terms from the search vocabulary will improve retrieval performance. This data shows that many general users actually use these terms in searching. Currently a sample of search words are being analyzed for factors which affect the correlation, such as errors in both the catalog and searching, the effect of truncations, and the effect of stemming (which was done on both the catalog vocabulary and the search terms).
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.008 | 0.100 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.010 | 0.019 |
| Science and technology studies | 0.000 | 0.001 |
| Scholarly communication | 0.003 | 0.002 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.005 | 0.002 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".