Evaluating AI-Generated Podcasts Versus Traditional Reading for Learning From Medical Articles: Protocol for a Mixed-Design Study Among Resident Physicians
Notice bibliographique
Résumé
BACKGROUND: Podcasts have emerged as a popular medium in medical education over the past decade. Audio learning allows flexibility and may help residents engage with content in new ways. Reading scientific literature is a core skill for residents, yet many residents struggle to comprehend complex research articles. Advances in artificial intelligence (AI) have enabled the automatic generation of podcast-style summaries of documents. It remains unclear whether listening to AI-generated podcast summaries can match the educational value of reading the full text of medical papers, and whether this depends on the complexity of the article. OBJECTIVE: This study aims to compare comprehension of medical research papers when learning via an AI-generated audio podcast versus traditional reading. We will examine whether article complexity (narrative vs technical) moderates any difference. We hypothesize an interaction: for a highly complex article, residents who read the full text should achieve a better understanding than those who listen to a summary, whereas for an easier article, the difference between modalities should be smaller. METHODS: We designed a 2×2 mixed factorial study with 60 resident physicians preparing for the board certification in internal medicine or cardiology. All participants will engage with 2 peer-reviewed cardiology articles differing in complexity: a narrative case report on eosinophilic myocarditis and a technical research article on quantifying the vena contracta area using 3-dimensional echocardiography. Each participant will read 1 article and listen to an AI-generated podcast summary of the other, with the order and assignment counterbalanced to control for order effects. The podcasts are created using Google NotebookLM's experimental audio overview feature. Participants will complete a multiple-choice knowledge test for each article. The primary outcomes are comprehension scores for each modality. The secondary outcomes include intrinsic motivation, perceived learning gains, and cognitive load for each condition. Data will be analyzed using a mixed ANOVA to test the main effects of modality and article complexity, as well as their interaction. RESULTS: Data collection is expected to be completed by early 2026. We will report the trial results according to the CONSORT (Consolidated Standards of Reporting Trials) guidelines, and any deviations from this protocol will be documented and justified. No results are available at the time of publication of this protocol. CONCLUSIONS: This randomized trial will offer evidence on the effectiveness of AI-generated podcast summaries as a learning tool for medical literature. If listening to an AI-generated podcast yields comprehension comparable to or superior to reading the full article, it could validate an innovative, time-saving approach for busy medical trainees. Conversely, if significant deficits are observed in the podcast group (especially for complex content), the findings will highlight the limitations of AI summaries and the continued importance of traditional reading for thorough understanding. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/78505.
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction machine sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Le volet Gemma est une étiquette directe du modèle pour chaque travail de la base, lue sur la notice réduite au titre. Le volet Codex est un classifieur appris des 10 348 étiquettes directes de Codex et calibré sur les taux pondérés de l'échantillon; les champs sans appui suffisant ne portent aucun appel Codex. Le mode candidate est l'union des deux volets; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont pas des étiquettes humaines.
Scores du classifieur distillé par catégorie (deux têtes)
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,060 | 0,070 |
| Méta-épidémiologie (sens strict) | 0,005 | 0,003 |
| Méta-épidémiologie (sens large) | 0,007 | 0,005 |
| Bibliométrie | 0,003 | 0,003 |
| Études des sciences et des technologies | 0,004 | 0,003 |
| Communication savante | 0,004 | 0,003 |
| Science ouverte | 0,004 | 0,003 |
| Intégrité de la recherche | 0,008 | 0,007 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,033 | 0,006 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; un appel candidat d’une seule source (Gemma direct ou Codex distillé), pas un consensus.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».