MétaCan
Menu
Back to cohort
Record W3013532894 · doi:10.2196/14504

Evaluation of an Educational Health Website on Infections and Antibiotics in England: Mixed Methods, User-Centered Approach

2020· article· en· W3013532894 on OpenAlexvenueno aff
Rosalie Allison, Catherine Hayes, Vicki L. Young, Cliodna McNulty

Bibliographic record

VenueJMIR Formative Research · 2020
Typearticle
Languageen
FieldHealth Professions
TopicHealth Literacy and Information Accessibility
Canadian institutionsnot available
Fundersnot available
KeywordsHyperlinkInteractivityLearnabilityComputer scienceTask (project management)CurriculumResistance (ecology)World Wide WebMedical educationMedicinePsychologyEngineeringWeb page

Abstract

fetched live from OpenAlex

BACKGROUND: e-Bug, an educational health website for teachers and students, aims to help control antibiotic resistance by educating young people about microbes, hygiene, and antibiotic resistance, reducing the incidence of infection and, therefore, the need for antibiotics. The teachers' section of the e-Bug website has not been evaluated since it was launched in 2009, and worldwide page views have been steadily decreasing since 2013. OBJECTIVE: This study aimed to apply GoodWeb, a comprehensive framework utilizing methodologies and attributes that are relevant to the digital era, to evaluate and suggest improvements to the e-Bug website. METHODS: Electronic questionnaires and face-to-face completion of task scenarios were used to assess content, ease of use, interactivity, technical adequacy, appearance, effectiveness, efficiency, and learnability of the teachers' section of the e-Bug website. RESULTS: A total of 106 teachers evaluated the e-Bug website; 97.1% (103/106) of them reported that they would use e-Bug, and 98.1% (104/106) of them reported that they would recommend it to others. Participants thought that there was a niche for e-Bug because of the way the resources fit into the national curriculum. Suggestions for improvements included changing the menu indication by highlighting the current page or deactivating links, improving home page indication, and providing a preview of resources when hovering the mouse over hyperlinks. Additional features requested by users included a search function and access to training opportunities. CONCLUSIONS: This paper reports that the GoodWeb framework was successfully applied to evaluate the e-Bug website, and therefore, it could be used to guide future website evaluations in other fields. Results from this study will be used to appraise the current quality and inform any future changes, modifications, and additions to e-Bug.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.051
metaresearch head score (Gemma)0.057
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.051
Threshold uncertainty score0.271

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0510.057
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0020.002
Bibliometrics0.0020.001
Science and technology studies0.0020.001
Scholarly communication0.0030.003
Open science0.0010.003
Research integrity0.0020.001
Insufficient payload (model declined to judge)0.0040.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.323
GPT teacher head0.632
Teacher spread0.309 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designQualitative
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations6
Published2020
Admission routes1
Has abstractyes

Explore more

Same venueJMIR Formative ResearchSame topicHealth Literacy and Information AccessibilityFrench-language works237,207