A Novel Virtual OSCE Preparation Tool to Enhance Medical Education: Development and Usability Study (Preprint)
Notice bibliographique
Résumé
BACKGROUND A significant component of Canadian medical education is learning how to approach the Objective Structured Clinical Examination (OSCE). The OSCE assesses skills imperative to good clinical practice, such as patient communication, clinical decision-making and medical knowledge. Despite the widespread implementation of this examination across all academic settings, very few preparatory resources currently exist that cater specifically to Canadian medical students. The MonkeyJacket is a novel, open-access online application built with the goal of providing medical students in Canada with an accessible and representative learning tool for the OSCE. OBJECTIVE The goal of this research study was to analyze the utility of this novel platform, with the intention of releasing an open-access version for all medical students in the near future. METHODS MonkeyJacket was developed to allow Canadian medical students the opportunity to practice their clinical examination skills with their peers using one centralized platform. The OSCE cases included in the application were developed using the Medical Council of Canada (MCC) guidelines to ensure their applicability to a Canadian setting. There are currently 75 cases covering five specialties, including cardiology, respirology, gastroenterology, neurology, and psychiatry. RESULTS The MonkeyJacket application is an online platform that allows medical students to practice clinical decision-making skills in real time with their peers by simply sharing a link. Through this application, students can practice patient interviewing, clinical reasoning, developing different diagnoses, formulating a management plan, and can receive both qualitative and quantitative feedback. Each clinical case is associated with an ‘assessment checklist’ and incorporates audio and video recording that is accessible to students after practice sessions to promote personal improvement through self-reflection. CONCLUSIONS The development of the MonkeyJacket application will transform the ways in which Canadian medical students practice for OSCEs. Currently, limited resources exist that are accessible in cost, remote in nature, and specific to MCC. By providing students with relevant clinical cases, assessment checklists, and the ability to review their own performance, MonkeyJacket fills the aforementioned gaps in medical education by introducing a unique and innovative way for medical learners to develop their patient interviewing and clinical reasoning skills. The widespread implementation of this application will promote a more competent medical workforce which will benefit the most important stakeholder in medicine - the patient.
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction machine sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Le volet Gemma est une étiquette directe du modèle pour chaque travail de la base, lue sur la notice réduite au titre. Le volet Codex est un classifieur appris des 10 348 étiquettes directes de Codex et calibré sur les taux pondérés de l'échantillon; les champs sans appui suffisant ne portent aucun appel Codex. Le mode candidate est l'union des deux volets; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont pas des étiquettes humaines.
Scores du classifieur distillé par catégorie (deux têtes)
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,010 | 0,029 |
| Méta-épidémiologie (sens strict) | 0,001 | 0,000 |
| Méta-épidémiologie (sens large) | 0,001 | 0,001 |
| Bibliométrie | 0,002 | 0,001 |
| Études des sciences et des technologies | 0,001 | 0,001 |
| Communication savante | 0,002 | 0,001 |
| Science ouverte | 0,001 | 0,001 |
| Intégrité de la recherche | 0,001 | 0,001 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,004 | 0,001 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; un appel candidat d’une seule source (Gemma direct ou Codex distillé), pas un consensus.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».