MétaCan
Menu
Back to cohort
Record W4387116134 · doi:10.1111/jvim.16857

Evaluating the readability of recruitment materials in veterinary clinical research

2023· article· en· W4387116134 on OpenAlexaff
Charly McKenna, Mindy Quigley, Tracy L. Webb

Bibliographic record

VenueJournal of Veterinary Internal Medicine · 2023
Typearticle
Languageen
FieldHealth Professions
TopicHealth Literacy and Information Accessibility
Canadian institutionsUniversity of Guelph
Fundersnot available
KeywordsReadabilityMedicineGrade levelHealth literacyComprehensionPrivate practiceClinical trialReferralMedical educationFamily medicineVeterinary medicinePathologyHealth carePsychologyMathematics education

Abstract

fetched live from OpenAlex

BACKGROUND: Owner comprehension is vital to recruitment and study success, but limited information exists regarding the readability of public-facing veterinary clinical trial descriptions. OBJECTIVES: The current study sought to evaluate the readability of public-facing online veterinary clinical trial descriptions from academic institutions and private referral practices. ANIMALS: None. METHODS: This prospective study assessed readability in a convenience sample of veterinary clinical trial study descriptions using 3 common methods: the Flesch-Kincaid Grade Level (F-K), Flesch Reading Ease Score (FRES), and online Automatic Readability Checker (ARC). Results were compared across specialties and between academic and private institutions. RESULTS: Grade level and readability consensus scores (RCSs) were obtained for 61 online clinical trial descriptions at universities (n = 49) and private practices (n = 12). Average grade-level RCS for study descriptions was 14.13 (range, 9-21). Using Microsoft Word, the FRES score was higher in descriptions from universities compared to private practices (P = .03), and F-K scores were lower in university compared to private practice descriptions (P = .03). FRES (P = .07), F-K (P = .12), and readability consensus (P = .17) scores obtained from ARC were not different between institution types. Forty-eight studies (79%) had RCSs over 12, equivalent to reading material at college or graduate school levels. CONCLUSIONS AND CLINICAL IMPORTANCE: Similar to other areas in veterinary communication, the evaluated veterinary clinical trial descriptions used for advertising and recruitment far exceeded the recommended 6th-grade reading level for medical information. Readability assessments are straightforward to conduct, and ensuring health literacy should be a customary best practice in veterinary medicine and clinical research.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.075
metaresearch head score (Gemma)0.245
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Methods · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.925
Threshold uncertainty score0.399

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0750.245
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0040.002
Science and technology studies0.0010.001
Scholarly communication0.0020.002
Open science0.0010.002
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0040.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.845
GPT teacher head0.744
Teacher spread0.101 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designObservational
DomainMethods
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations7
Published2023
Admission routes1
Has abstractyes

Explore more

Same venueJournal of Veterinary Internal MedicineSame topicHealth Literacy and Information AccessibilityFrench-language works237,207