Completion of an Online Library Module Improves Engineering Student Performance on Information Literacy Skills Tests
Bibliographic record
Abstract
A Review of: Zhang, Q., Goodman, M., & Xie, S. (2015). Integrating library instruction into the Course Management System for a first-year engineering class: An evidence-based study measuring the effectiveness of blended learning on students’ information literacy levels. College & Research Libraries, 76(7), 934-958. http://dx.doi.org/10.5860/crl.76.7.934 Objective – To assess the efficacy of an online library module and of blended learning methods on students’ information literacy skills. Design – Multi-modal, pre- and posttests, survey questionnaire, and focus groups. Setting – Public research university in London, Ontario, Canada. Subjects – First-year engineering students. Methods – Of 413 students enrolled in Engineering Science (ES) 1050, 252 volunteered to participate in the study. Participants were asked to complete the online module, a pretest, a posttest, an online follow-up survey, and to take part in a focus group. Researchers generated a pretest and a posttest, each comprised of 15 questions:; multiple choice, true or false, and matching questions which tested students’ general and engineering-specific information literacy skills. The pretest and posttest had different, but similarly challenging, questions to ensure that students involved in the study would not have an advantage over those who had opted out. While all components of the study were voluntary, the posttest was a graded course assignment. In-person tutorials were offered on 4 occasions, with only 15 students participating. Both tutorial and module content were designed to cover all questions and competencies tested in the pretest and the posttest, including Boolean operators, peer review, identifying plagiarism, engineering standards, engineering handbooks, search strategies, patents, article citations, identifying reliable sources, and how to read journal articles. The posttest survey was delivered in the CMS immediately after the posttest was completed. It measured self-reported student behaviours and preferences concerning the online modules. Two focus groups were convened after all posttest surveys were completed to gather qualitative data about student preferences. Main Results – Of the 252 volunteers, 239 students (57.9% of enrolled students) completed both the pretest and the posttest, 89 filled out the follow-up survey, and 7 students participated in a focus group. Students used the online module content differently; accordingly those numbers were not reported. Researchers compared pretest and posttest scores to find that the posttest scores were significantly higher than the pretest scores (p < 0.001). Of 239 pretest and posttest pairs evaluated, the mean pretest score was 10.456 and the mean posttest score was 13.843. A t-test survey and focus group data evaluated student perceptions of the module. Students reported a slight preference for online instruction. Conclusion – After completing an online library module, students’ performance on information literacy skills tests improved from the pretest to the posttest. Focus group and survey data indicate a slight student preference for online tutorials over in-person instruction. Although intended as a blended approach to library instruction, the voluntary in-person instruction was not well attended and has subsequently been changed to mandatory in-class instruction. The authors recommend further research to evaluate how the medium and format of instruction impacts student learning outcomes.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.001 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.001 | 0.833 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".