MétaCan
Menu
Back to cohort
Record W1551875820 · doi:10.18438/b8sw5r

Students are Confident Using Federated Search Tools as much as Single Databases

2011· article· en· W1551875820 on OpenAlexaffvenue
Deena Yanofsky

Bibliographic record

VenueEvidence Based Library and Information Practice · 2011
Typearticle
Languageen
FieldSocial Sciences
TopicLibrary Science and Information Literacy
Canadian institutionsMcGill University
Fundersnot available
KeywordsWorksheetComputer scienceSession (web analytics)Information retrievalSpace (punctuation)Library instructionMultidisciplinary approachWorld Wide WebDatabaseMathematics educationPsychologyInformation literacy

Abstract

fetched live from OpenAlex

Objective – To measure students’ perceptions of the ease-of-use and efficacy of a federated search tool versus a single multidisciplinary database. 
 
 Design – An evaluation worksheet, employing a combination of quantitative and qualitative questions.
 
 Setting – A required, first-year English composition course taught at the University of Illinois at Chicago (UIC). 
 
 Subjects – Thirty-one undergraduate students completed and submitted the worksheet. 
 
 Methods – Students attended two library instruction sessions. The first session introduced participants to basic Boolean searching (using AND only), selecting appropriate keywords and searching for books in the library catalogue. In the second library session, students were handed an evaluation worksheet and, with no introduction to the process of searching article databases, were asked to find relevant articles on a research topic of their own choosing using both a federated search tool and a single multidisciplinary database. 
 
 The evaluation worksheet was divided into four sections: step-by-step instructions for accessing the single multidisciplinary database and the federated search tool; space to record search strings in both resources; space to record the titles of up to five relevant articles; and a series of quantitative and qualitative questions regarding ease-of-use, relevancy of results, overall preference (if any) between the two resources, likeliness of future use and other preferred research tools. Half of the participants received a worksheet with instructions to search the federated search tool before the single database; the order was reversed for the other half of the students. The evaluation worksheet was designed to be completed in one hour. 
 
 Participant responses to qualitative questions were analyzed, codified and grouped into thematic categories. If a student mentioned more than one factor in responding to a question, their response was recorded in multiple categories. 
 
 Main Results – Participants indicated a slight preference for using a federated search tool over a single multidisciplinary database. Of the 31 students who completed the evaluation worksheet, 16 (51.6%) found that their search results were more relevant in the federated search tool; 10 (32.3%) students reported that the articles they found were more relevant in the single database. Three students stated that both search tools produced equally relevant results and two students responded that neither resource produced relevant results on their topic.
 
 When asked to state which resource they would be likely to use in the future, 22 students (71%) indicated that they would use the federated search tool and 21 (67.7%) students answered that they would use the single multidisciplinary database. Of the participants who expressed potential use of the single database to look for articles in the future, 43% referred to the ease of use or efficiency of the search tool in their responses. Similarly, more than half of the students who stated that they would use the federated search tool in the future (54.5%) also cited ease of use or efficiency in their answers.
 
 In total, 11 students (35.5%) stated that they would be unlikely to use the federated search tool for future research. In their responses, students referred to the inefficiency or complexity of the research tool. Of the 12 participants (38.7%) who stated that they would be unlikely to use the single multidisciplinary database, 50% cited a lack of relevant results and 42% referred to the overall complexity and inefficiency of the database.
 
 Conclusions – The results of this study do not support a significant preference among undergraduate students for either search tool. Though some participants struggled with terminology or various features of each resource, more students expressed confidence and satisfaction with the search process no matter which tool they opted to use. 
 
 Given student confidence and comfort level in both research environments, the author suggests that librarians should place equal weight on both types of resources in library instruction.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.003
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesScholarly communication, Insufficient payload (model declined to judge)
Consensus categoriesScholarly communication
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.922
Threshold uncertainty score0.998

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.003
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.001
Science and technology studies0.0010.000
Scholarly communication0.0030.765
Open science0.0010.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0040.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.129
GPT teacher head0.371
Teacher spread0.241 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; both teacher heads agree on what is shown here.

Study designNot applicable
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations1
Published2011
Admission routes2
Has abstractyes

Explore more

Same venueEvidence Based Library and Information PracticeSame topicLibrary Science and Information LiteracyFrench-language works237,207