MétaCan
Menu
Back to cohort
Record W4407484887 · doi:10.30935/jdet/15963

Primary school pupils’ ability to detect fake science news following a news media literacy intervention: Exploration of their success rate, evaluation strategies, self-efficacy beliefs, and views of science news

2025· article· en· W4407484887 on OpenAlexafffund
Geneviève Allaire‐Duquette, Abdelkrim Hasni, Josée Nadia Drouin, Audrey Groleau, Mohamed Amine Mahhou, Alexis Legault, Akbar Khayat, Marie-Ève Carignan, Jean‐Philippe Ayotte‐Beaudet

Bibliographic record

VenueJournal of Digital Educational Technology · 2025
Typearticle
Languageen
FieldSocial Sciences
TopicMisinformation and Its Impacts
Canadian institutionsUniversité du Québec à MontréalUniversité du Québec à Trois-RivièresAgence Science PresseUniversité de SherbrookeUniversité du Québec en Outaouais
FundersSocial Sciences and Humanities Research Council of Canada
KeywordsMedia literacyIntervention (counseling)LiteracyScientific literacyPsychologyFake newsMedical educationMathematics educationPedagogyComputer scienceInternet privacyScience educationMedicine

Abstract

fetched live from OpenAlex

Widespread belief in scientific misinformation circulating online is a critical challenge for democracies. While research to date has focused on psychological, sociodemographic, and political antecedents to this phenomenon, fewer studies have explored the role of media literacy educational efforts, especially with children. Recent findings indicate that children are unprepared for critically evaluating scientific information online and that literacy instruction should address this gap. The aim of this study is to examine the ability to detect fake science news and the evaluation strategies employed by pupils after a news media literacy intervention. In addition, we explore the impact of the news media literacy intervention on their self-efficacy beliefs for detecting fake science news, and on their views of science news. A one-group experimental design was employed with a sample of 74 primary school pupils. A few weeks following a 2-hour media literacy intervention, pupils ranked ten Twitter posts on various scientific topics and were invited to justify their ranking in an open-ended question to unveil their evaluation strategies. Participants also completed one pre-test and one post-test designed to elicit their confidence in their ability to detect fake science news and their views of science news. We averaged pupils’ judgement accuracy, categorized student’s evaluation strategies, and compared self-efficacy beliefs before and after the intervention. On average, pupils’ accuracy when asked to detect fake science news was 68%. This performance is higher than success rates reported in previous studies where no news media literacy intervention was tested. Pupils relied mostly on knowledge in news media literacy to detect fake science news, but also in great proportion on prior scientific knowledge and intuitive reasoning. Fake news self-efficacy beliefs increased significantly after the intervention, but views of science news were not impacted by the intervention. Findings indicate that primary school pupils are capable of careful examination of the credibility of scientific news. Children are regularly exposed to misinformation, and knowledge on how to critically engage with scientific information should be taught as soon as this exposure begins. Our findings suggest that news media literacy training can be successfully facilitated with primary school pupils and could be effective in fighting scientific misinformation from a young age.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.003
metaresearch head score (Gemma)0.010
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Non-randomized trial · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.003
Threshold uncertainty score0.014

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0030.010
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0010.000
Science and technology studies0.0010.001
Scholarly communication0.0010.001
Open science0.0000.001
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0030.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.041
GPT teacher head0.396
Teacher spread0.354 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designNon-randomized trial
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations2
Published2025
Admission routes2
Has abstractyes

Explore more

Same venueJournal of Digital Educational TechnologySame topicMisinformation and Its ImpactsFrench-language works237,207