MétaCan
Menu
Back to cohort
Record W4414879404 · doi:10.31234/osf.io/a28sq_v1

Assessing Media and Science Literacy in Adults: A Scoping Review of Existing Assessment Tools

2025· article· en· W4414879404 on OpenAlexfundno aff
Vincent Gosselin Boucher, Frédérique Deslauriers, Camille Léger, Florence Coulombe-Raymond, Noémie Tremblay, Ariane Bélanger‐Gravel

Bibliographic record

Venuenot available
Typearticle
Languageen
FieldSocial Sciences
TopicGender and Technology in Education
Canadian institutionsnot available
FundersFonds de Recherche du Québec - Santé
KeywordsMisinformationContext (archaeology)Public awareness of scienceDigital literacyInclusion (mineral)Scientific literacyMedia literacyDigital mediaInformation literacy

Abstract

fetched live from OpenAlex

Individual’s capacity to navigate today’s complex information landscape has become a critical issue, particularly in the context of public health, where misinformation poses significant risks. This scoping review aimed to identify and describe existing tools for assessing media and science literacies, including their definitions, conceptual frameworks, psychometric properties, and target populations. A comprehensive search of English and French publications was conducted up to July 11, 2023, across PUBMED, Embase (Ovid), PsycINFO, Cochrane Databases of Systematic Reviews, and Scopus. Of 5,910 unique references, 32 articles met the final inclusion criteria: 16 on media literacy and 16 on science literacy. Fifteen media literacy tools were identified, focusing on traditional and digital media. Most used Likert-scale items, with some incorporating open-ended responses. These tools assessed skills such as critical thinking, digital proficiency, and awareness of the socio-political context of media content. Twelve tools assessed science literacy, covering general knowledge, environmental health, and specific scientific domains. They measured cognitive, behavioural, and attitudinal dimensions using various formats, including Likert scales, multiple-choice, and open-ended items. This review highlights diverse approaches to media and science literacy assessment and calls for interdisciplinary, digitally responsive tools co-developed with educators, experts, and underrepresented communities.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.031
metaresearch head score (Gemma)0.112
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Methods · Consensus signal: none
Study designCandidate signal: Systematic review · Consensus signal: Systematic review
GenreCandidate signal: Review · Consensus signal: Review
Teacher disagreement score0.969
Threshold uncertainty score0.163

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0310.112
Meta-epidemiology (narrow)0.0020.001
Meta-epidemiology (broad)0.0050.006
Bibliometrics0.0340.024
Science and technology studies0.0010.002
Scholarly communication0.0050.006
Open science0.0020.003
Research integrity0.0020.002
Insufficient payload (model declined to judge)0.0040.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.096
GPT teacher head0.508
Teacher spread0.412 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designSystematic review
DomainMethods
GenreReview

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2025
Admission routes1
Has abstractyes

Explore more

Same topicGender and Technology in EducationFrench-language works237,207