Students are Confident Using Federated Search Tools as much as Single Databases
Bibliographic record
Abstract
Objective – To measure students’ perceptions of the ease-of-use and efficacy of a federated search tool versus a single multidisciplinary database. Design – An evaluation worksheet, employing a combination of quantitative and qualitative questions. Setting – A required, first-year English composition course taught at the University of Illinois at Chicago (UIC). Subjects – Thirty-one undergraduate students completed and submitted the worksheet. Methods – Students attended two library instruction sessions. The first session introduced participants to basic Boolean searching (using AND only), selecting appropriate keywords and searching for books in the library catalogue. In the second library session, students were handed an evaluation worksheet and, with no introduction to the process of searching article databases, were asked to find relevant articles on a research topic of their own choosing using both a federated search tool and a single multidisciplinary database. The evaluation worksheet was divided into four sections: step-by-step instructions for accessing the single multidisciplinary database and the federated search tool; space to record search strings in both resources; space to record the titles of up to five relevant articles; and a series of quantitative and qualitative questions regarding ease-of-use, relevancy of results, overall preference (if any) between the two resources, likeliness of future use and other preferred research tools. Half of the participants received a worksheet with instructions to search the federated search tool before the single database; the order was reversed for the other half of the students. The evaluation worksheet was designed to be completed in one hour. Participant responses to qualitative questions were analyzed, codified and grouped into thematic categories. If a student mentioned more than one factor in responding to a question, their response was recorded in multiple categories. Main Results – Participants indicated a slight preference for using a federated search tool over a single multidisciplinary database. Of the 31 students who completed the evaluation worksheet, 16 (51.6%) found that their search results were more relevant in the federated search tool; 10 (32.3%) students reported that the articles they found were more relevant in the single database. Three students stated that both search tools produced equally relevant results and two students responded that neither resource produced relevant results on their topic. When asked to state which resource they would be likely to use in the future, 22 students (71%) indicated that they would use the federated search tool and 21 (67.7%) students answered that they would use the single multidisciplinary database. Of the participants who expressed potential use of the single database to look for articles in the future, 43% referred to the ease of use or efficiency of the search tool in their responses. Similarly, more than half of the students who stated that they would use the federated search tool in the future (54.5%) also cited ease of use or efficiency in their answers. In total, 11 students (35.5%) stated that they would be unlikely to use the federated search tool for future research. In their responses, students referred to the inefficiency or complexity of the research tool. Of the 12 participants (38.7%) who stated that they would be unlikely to use the single multidisciplinary database, 50% cited a lack of relevant results and 42% referred to the overall complexity and inefficiency of the database. Conclusions – The results of this study do not support a significant preference among undergraduate students for either search tool. Though some participants struggled with terminology or various features of each resource, more students expressed confidence and satisfaction with the search process no matter which tool they opted to use. Given student confidence and comfort level in both research environments, the author suggests that librarians should place equal weight on both types of resources in library instruction.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.014 | 0.102 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.002 | 0.001 |
| Science and technology studies | 0.001 | 0.002 |
| Scholarly communication | 0.011 | 0.006 |
| Open science | 0.001 | 0.003 |
| Research integrity | 0.002 | 0.002 |
| Insufficient payload (model declined to judge) | 0.008 | 0.003 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".