Gender Differences in Clinical Performance Assessment of Internal Medicine Residents: A Longitudinal Analysis of the Influence of Faculty and Trainee Gender
Bibliographic record
Abstract
PURPOSE: Competency-based medical education relies on equitable assessment. This study examined the influence of faculty and trainee gender on assessments of internal medicine (IM) resident performance over time. METHOD: A longitudinal analysis of clinical performance assessments from 7 U.S. IM residency programs (July 2014-June 2019) was conducted. Core competency scores (patient care [PC], medical knowledge [MK], practice-based learning and improvement [PBLI], systems-based practice [SBP], professionalism [PROF], and interpersonal and communication skills [ICS]) were standardized across programs. Cross-classified mixed-effects linear regression evaluated the relationship between gender and standardized competency scores within training programs, while adjusting for multiple variables including IM In Training Examination percentile rank. RESULTS: Data included 9,346 evaluations by 1,011 faculty (552 [55%] men, 459 [45%] women) for 664 residents (358 [54%] men, 306 [46%] women). Initially, women residents' scores were significantly lower than men's in PC (estimated difference [standard error], -0.097 [0.033]; P = .004), MK (-0.145 [0.034], P < .001), and PBLI (-0.090 [0.040], P = .022). PC, MK, PBLI, and SBP scores increased more over time for women residents than men (PC: 0.050 [0.015], P = .001; MK: 0.052 [0.015], P = .001; PBLI: 0.036 [0.018], P = .048; SBP: 0.036 [0.016], P = .027). PROF and ICS scores were comparable across gender. There was a significant interaction between faculty gender and postgraduate year (PGY) across all competencies but none between resident gender, faculty gender, and PGY, indicating that men and women faculty rated residents differently over time but were consistent in how they rated men and women residents. CONCLUSIONS: Gender-based assessment differences were variable across competencies and time. Women residents had lower scores initially but greater gains in "hard skill" (MK, PC, and PBLI) than in "soft skill" (ICS and PROF) competencies, suggesting assessment inequities. Efforts to ensure equitable assessment are needed.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.005 | 0.012 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.000 | 0.001 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".