MétaCan
Menu
Back to cohort
Record W2298928029 · doi:10.18438/b89k8f

The Collision of Two Lexicons: Librarians, Composition Instructors and the Vocabulary of Source Evaluation

2016· article· en· W2298928029 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

venuePublished in a venue whose home country is Canada.
no affNo Canadian affiliation: this work is invisible to an affiliation-only frame.
No Canadian affiliation. An affiliation-only frame, the usual design, would never have seen this work. It is one of the works that make the case for inverting the frame.

Bibliographic record

VenueEvidence Based Library and Information Practice · 2016
Typearticle
Languageen
FieldPsychology
TopicEducational Strategies and Epistemologies
Canadian institutionsnot available
Fundersnot available
KeywordsComposition (language)RhetoricRhetorical questionJargonDictionVocabularyComputer scienceLiteracyWriting assessmentInformation literacyMathematics educationClass (philosophy)Literal and figurative languageComparabilityLinguisticsPsychologyPedagogyArtificial intelligenceWorld Wide Web

Abstract

fetched live from OpenAlex

Abstract
 
 Objective – The study has two aims. The first is to identify words and phrases from information literacy and rhetoric and composition that students used to justify the comparability of two sources. The second is to interpret the effectiveness of students’ application of these evaluative vocabularies and explore the implications for librarians and first-year composition instructors’ collaborations. 
 
 Methods – A librarian and a first-year composition instructor taught a class on source evaluation using the language of information literacy, composition, and rhetorical analysis (i.e., classical, Aristotelian, rhetorical appeals). Students applied the information learned from the instruction session to help them locate and select two sources of comparable genre and rigor for the purpose of an essay assignment. The authors assessed this writing assignment for students’ evaluative diction to identify how they could improve their understanding of each other’s discourse.
 
 Results – The authors’ analysis of the student writing sample exposes struggles in how students understand, apply, and integrate the jargon of information literacy and rhetoric and composition. Assessment shows that students chose the language of rhetoric and composition rather than the language of information literacy, they selected the broadest and/or vaguest terms to evaluate their sources, and they applied circular reasoning when justifying their choices. When introduced to analogous concepts or terms between the two discourses, students cherry-picked the terms that allowed for the easiest, albeit, least-meaningful evaluations.
 
 Conclusion – The authors found that their unfamiliarity with each other’s discourse revealed itself in both the class and the student writing. They discovered that these miscommunications affected students’ language use in their written source evaluations. In fact, the authors conclude that this oversight in addressing the subtle differences between the two vocabularies was detrimental to student learning. To improve communication and students’ source evaluation, the authors consider developing a common vocabulary for more consistency between the two lexicons.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesScholarly communication
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Theoretical or conceptual · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.913
Threshold uncertainty score0.978

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.036
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.025
GPT teacher head0.316
Teacher spread0.292 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it