THE MINI MILESTONES ASSESSMENT (MINI-MAS), A DIRECT OBSERVATIONAL TOOL TO ASSESS CLINICAL MILESTONES IN THE ERA OF COMPETENCY-BASED EDUCATION
Notice bibliographique
Résumé
Background: Competency based medical education will move training programs away from a time based standard to a model of competence and milestones. Assessment, observation and feedback are key ingredients to successful implementation. Work based assessment tools will be an important part of a multi-modal programmatic assessment for learners. Purpose: The purpose of the study was: 1) to facilitate the development and implement a pilot competency-based curriculum into the general pediatric component of the PGY 1 year at McMaster University, pediatric residency program, 2) to develop a tool, the Mini Milestones Assessment (Mini-MAS) to assess six medical competencies and progression through milestones using the Dreyfus Developmental Model and to pilot the tool in the general pediatric rotations for the PGY 1 and 4 residents and 3) to test the reliability, validity, acceptability and feasibility of the Mini-MAS tool. Method: Twelve PGY 1 residents at McMaster Children’s Hospital were required to complete 40 observations (10 history taking, 10 physical exam, 5 clinical reasoning, 5 communication with families, 5 communication with staff and 5 collaboration) during their general pediatric component of the 2013-2014 academic year. These same competencies were also observed for 9 PGY 4 residents over the same competencies over the same time period although this group was required to complete only 15-20 encounters. Following the study period, a survey was administered to the residents and faculty to assess acceptability and feasibility of the Mini-MAS tool. Kane’s validity framework, which is divided into four components (scoring, generalization, extrapolation and decision), was used to evaluate the Mini-MAS tool. Results: PGY 1 and PGY 4 residents had an average of 36 and 16 observations completed, respectively, across a wide variety of settings and clinical problems with multiple assessors. The scale of the Mini-MAS tool was used appropriately. The tool was able to differentiate between the PGY 1 and PGY 4 learners and showed progress of the PGY 1 learners through the academic year. The G coefficient overall for the Mini-MAS tool was 0.8 for the PGY1 residents and 0.5 for the PGY 4 residents. Correlation between the six competencies assessed was low, achieved by only one competency being observed and having grounded anchors. Learners and faculty were satisfied with the tool. The tool allowed learners to be observed more frequently and receive timely valuable feedback. Conclusion: A pilot competency based curriculum for PGY 1 residents was successfully implemented. The Mini-MAS tool added, as a formative assessment mode to a multi-modal assessment program will benefit the trainee, by increasing their observations and providing residents with valuable feedback. The assessment will inform residents where they stand with respect to their level of training, what competencies they can improve on and how they can make such improvements.
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction distillée sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.
Scores Codex et Gemma par catégorie
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,002 | 0,001 |
| Méta-épidémiologie (sens strict) | 0,000 | 0,000 |
| Méta-épidémiologie (sens large) | 0,001 | 0,000 |
| Bibliométrie | 0,000 | 0,002 |
| Études des sciences et des technologies | 0,000 | 0,000 |
| Communication savante | 0,000 | 0,000 |
| Science ouverte | 0,001 | 0,000 |
| Intégrité de la recherche | 0,000 | 0,001 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,002 | 0,000 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; un appel candidat d’une seule tête enseignante, pas un consensus.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».