MétaCan
Menu
Back to cohort
Record W4389795166 · doi:10.18438/eblip30416

User Experience Research Techniques Facilitate Improvements for Access and Discovery Tools Managed by Technical Services Librarians

2023· article· en· W4389795166 on OpenAlex
Abbey Lewis

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

venuePublished in a venue whose home country is Canada.
no affNo Canadian affiliation: this work is invisible to an affiliation-only frame.
No Canadian affiliation. An affiliation-only frame, the usual design, would never have seen this work. It is one of the works that make the case for inverting the frame.

Bibliographic record

VenueEvidence Based Library and Information Practice · 2023
Typearticle
Languageen
FieldComputer Science
TopicWeb and Library Services
Canadian institutionsnot available
Fundersnot available
KeywordsUsabilityWorkflowComputer scienceWorld Wide WebSubject (documents)User interfaceInterface (matter)DatabaseHuman–computer interaction

Abstract

fetched live from OpenAlex

A Review of: Hill, K. (2020). Usability beyond the home page: Bringing usability into the technical services workflow. The Serials Librarian, 78 (1–4), 173–180. https://doi.org/10.1080/0361526X.2020.1702857 Objective – To demonstrate how user experience research techniques can be incorporated into technical services work. As proof of this concept, the author describes a case wherein a team of librarians, including one in a technical services role, deployed a user experience study to determine if students were able to successfully use LibGuides and the A-Z Database List to find subject-specific resources. The study also aimed to gauge the potential for several A-Z Database List interface redesign options. Design – A case study of user experience techniques applied to technical services projects, including a classic usability test of existing tools and an A/B/C comparison of potential interface redesigns. Setting – The library at the University of North Carolina Greensboro (UNCG), a public R2 university (doctoral university with high research activity). Subjects – Eleven student participants recruited through convenience sampling. Methods – The research team recruited study participants who were in the library at the time of the study, deselecting students from UNCG’s library school and those who were not currently affiliated with the university through an initial questionnaire. Eleven student participants were ultimately selected and led through a series of tasks related to finding subject-specific databases using the A-Z Database List and LibGuides. After the tasks for the A-Z Database List were completed, students were asked for their impression of two additional database list interfaces. Students were recorded throughout the tasks using the “talk aloud” method to provide researchers with insights on their thought processes and preferences. Following the study, researchers listened to the recordings, coding them as successful or incomplete and noting their observations for use in generalized findings. Main Results – Eight of eleven participants used the library’s main search box to locate a general resource for their major on the library’s homepage. When shown the A-Z Database List, ten out of eleven participants used the list to find a database for their major, while one used the link to “Research guides by subject” from that page. Comparisons of three A-Z Database List interfaces showed that most students preferred the Springshare Content Management System that allowed for filtering by subject area. When asked to find a research guide for their subject or major from the library’s homepage, nine out of eleven students clicked on the link labeled “Research guides by subject.” Starting from their subject guide, ten out of eleven could find a tab listing article databases. Nine participants noted that the number of databases listed on the guides was daunting. Conclusion – Results from the user experience study were used to support a redesign of the A-Z Database List using the Springshare Content Management System. The author regarded the experience as a whole as demonstrating how technical services librarians can become involved in user experience work and incorporate findings from usability studies into their management and design of tools that promote access and discoverability.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesScholarly communication
Consensus categoriesScholarly communication
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Commentary · Consensus signal: none
Teacher disagreement score0.903
Threshold uncertainty score0.993

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.001
Science and technology studies0.0010.000
Scholarly communication0.0080.654
Open science0.0010.001
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.055
GPT teacher head0.341
Teacher spread0.285 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it