Methods for determining the quality and efficiency of libraries functioning in the context of iso and arl normative documents
Bibliographic record
Abstract
The article deals with the study of methods for measuring the quality and performance of libraries that are being developed and implemented by the Association of Research Libraries of the USA and Canada (ARL) and the methods of measuring the effectiveness offered by international ISO standards. The paper focuses on the method of measuring the quality and efficiency of LibQual, which has received widespread recognition in many countries around the world. The indicators of efficiency of library activities offered by ISO international standards are analyzed. The aim of this study is to introduce and analyze the methodology for evaluating the quality and effectiveness of Library Activity LibQUAL, which is used by the Association of Scientific Libraries of the United States and Canada (ARL), in comparison with international ISO standards. The study of the experience of applying the LibQUAL methodology for assessing the quality and performance of libraries, which introduced ARLs for 124 research libraries in Canada and the United States, shows that this technique is an effective tool and has several benefits. The analysis of survey data allows us to assess the relevance of library services to users’ expectations and to reengineering production processes to radically improve the key performance indicators of libraries. The analysis of the LibQUAL method showed that this method does not allow to assess the social long-term impact of libraries, the methods of measurement of which are proposed by the new international standard DSTU ISO 16439: 2016 «Methods and procedures for assessing the impact of libraries. Information and documentation». The economic and organizational effectiveness is not taken into account, the measurement procedures of which are described by the standard DSTU ISO 11620: 2016 «Library performance indicators. Information and docu mentation» and DSTU ISO 2789: 2016 «Information and documentation. International Library Statistics». The study proposes to combine LibQUAL technology with the methods of assessing the impact and effectiveness of libraries described by international ISO standards in order to comprehensively measure the quality and efficiency of libraries.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.047 | 0.119 |
| Meta-epidemiology (narrow) | 0.002 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.017 | 0.016 |
| Science and technology studies | 0.002 | 0.003 |
| Scholarly communication | 0.008 | 0.006 |
| Open science | 0.003 | 0.004 |
| Research integrity | 0.002 | 0.002 |
| Insufficient payload (model declined to judge) | 0.007 | 0.003 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".