The "Just-in-Time" (JIT) information librarian consultation service
Bibliographic record
Abstract
Background: This thesis is based on the “Just-in-Time information” (JIT) librarian consultation service project. The project was designed to test if a library-related service could be used to address an information gap in primary healthcare by assisting clinicians in answering their questions. The project specifically tested whether or not a librarian consultation service could have a positive impact in two delivery methods for primary care practice in Ontario, Canada. Design: Randomized controlled trial (RCT) with additional qualitative and quantitative evaluation. The literature review section includes two systematic reviews. Methods: The primary method of this thesis is RCT of clinical questions posed by primary care professionals who participated in the JIT librarian consultation service. The thesis also discusses the project’s service delivery model and its implementation, which was developed to support the RCT. Other elements broader than the RCT, such as a librarian survey, have also been developed and included to explore factors contributing to the success or failure of the librarian consultation service. It evaluates potential positive impacts in terms of costs (saving time, workload issues), patient care decision-making, and improved access to information by using such a service. Results: The JIT service was implemented and run for one year prior to the RCT phase of the project with 88 individuals who participated in the RCT. The primary outcome was time to receive a response; whether time for JIT librarians to locate information to provide a response to a question, or a participant’s time to search for the information. Librarians provided their responses to clinical questions in less than fifteen minutes. This time was quicker than the response time of the participants. Of the responses provided to intervention questions, participants rated 63% as having a highly positive impact. Of the responses provided to control questions, participants rated 24.8% as having no impact, and 44.9% as having a negative impact on decision-making. Most participants rated their level of satisfaction with the service as having a positive impact (86%) on the care they provided to their patients and 83% assessed the service as providing relevant information to their questions in an appropriate time frame. Most participants would consider using a similar service, and most participants preferred this service to be delivered by a hand-held wireless device or web interface. Discussion and conclusions: This thesis demonstrates the development and implementation of a cost-effective and user-friendly librarian consultation service that provided primary care professionals with information to assist them in answering their questions arising from patient visits. Using a librarian to respond to clinical questions may allow primary care professionals to have more time in their day, thus potentially increasing patient access to care. Participation in this RCT decreased the use of consultations with other practice physicians, return patient visits, referrals, and other actions in the control group; reductions in these areas decrease costs. The application of the RCT design by combining librarianship with health services research is unusual. The use of the response to a clinical question as the unit of randomization and allocation is also innovative.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.017 | 0.046 |
| Meta-epidemiology (narrow) | 0.000 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.001 | 0.003 |
| Science and technology studies | 0.005 | 0.004 |
| Scholarly communication | 0.005 | 0.004 |
| Open science | 0.003 | 0.009 |
| Research integrity | 0.002 | 0.002 |
| Insufficient payload (model declined to judge) | 0.039 | 0.008 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".