MétaCan
Menu
Back to cohort
Record W3161833518 · doi:10.36834/cmej.70943

Exploring resident perceptions of initial competency based medical education implementation

2021· article· en· W3161833518 on OpenAlexafffundvenue
Shivani Upadhyaya, Marghalara Rashid, Andrea Dávila Cervantes, Anna Oswald

Bibliographic record

VenueCanadian Medical Education Journal · 2021
Typearticle
Languageen
FieldMedicine
TopicInnovations in Medical Education
Canadian institutionsUniversity of Alberta
FundersUniversity of Alberta
KeywordsThematic analysisCompetence (human resources)PerceptionCore competencyMedical educationMedicinePsychologyQualitative researchManagement

Abstract

fetched live from OpenAlex

BACKGROUND: Competence by design (CBD) is a nationally developed hybrid competency based medical education (CBME) curricular model that focuses on residents' abilities to promote successful practice and better meet societal needs. CBD is based on a commonly used framework of five core components of CBME: outcome competencies, sequenced progression, tailored learning experiences, competency-focused instruction and programmatic assessment. There is limited literature concerning residents' perceptions of implementation of CBME. OBJECTIVE: We explored resident perceptions of this transformation and their views as they relate to the intended framework. METHODS: We recruited residents enrolled in current CBME implementation between August 2018 and January 2019. We interviewed residents representing eight disciplines from the initial two CBME implementation cohorts. Inductive thematic analysis was used to analyse the data through iterative consensus building until saturation. RESULTS: We identified five themes: 1) Value of feedback for residents; 2) Resident strategies for successful Entrustable Professional Activity observation completion; 3) Residents experience challenges; 4) Resident concerns regarding CBME; and 5) Resident recommendations to improve existing challenges. We found that while there was clear alignment with residents' perceptions of the programmatic assessment core CBME component, alignment was not as clear for other components. CONCLUSIONS: Residents perceived aspects of this transformation as helpful but overall had mixed perceptions and variable understanding of the intended underlying framework. Understanding and disseminating successes and challenges from the resident lens may assist programs at different stages of CBME implementation.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.029
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Insufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Other design · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.712
Threshold uncertainty score0.979

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.029
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0010.001
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.1630.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.050
GPT teacher head0.418
Teacher spread0.368 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designOther design
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations13
Published2021
Admission routes3
Has abstractyes

Explore more

Same venueCanadian Medical Education JournalSame topicInnovations in Medical EducationFrench-language works237,207