Student Affairs Officers Should Not Oversee Preparation of the Medical Student Performance Evaluation
Bibliographic record
Abstract
During the 2010 AAMC annual meeting, the Group on Student Affairs hosted a “Hot Topic” session related to who should write the medical student performance evaluation (MSPE), also known as the “dean's letter.” This session was stimulated because of my concerns as cosecretary of the Liaison Committee on Medical Education (LCME) that a student might be inhibited from seeking access to sensitive health services made available through student affairs if the dean for student affairs writes the MSPE. The various perspectives were presented by a five-person panel; each panelist was given three minutes to present his or her point, leaving ample time for audience participation. I sat on the dais listening to the lively, sometimes passionate audience comments, including those of a long line of student affairs deans who came to the microphone to defend their right to write the MSPE. At first, I was assured that by raising the question, this dedicated group of faculty would find ways to make sure that students would not be blocked or inhibited from seeking help for health issues. But as I listened more closely I realized that their statements were contradictory. Describing the MSPE as an objective evaluative document and, in the same sentence, arguing that it was best written by a student advocate was disconcerting. The danger that this advocacy could be expressed in the MSPE in an unconscious or conscious manner, thus undermining the desired objectivity of the MSPE, is more than a little worrisome. This called to mind the recent study by Kiefer et al1 reporting that students who were rated “good” in the MSPE were invariably below average. I would understand that a student in the bottom half of a medical school accredited by the LCME would still most likely be a “good” student. However, the intent of the Kiefer report was not so forgiving and implied a kind of cover-up of the facts. If we are to continue the progress in the direction of making the MSPE more objective and useful to residency directors that began with the 1989 AAMC publication guidelines for the dean's letter,2 then we must reconsider who creates it. Our colleagues in Canada, to a school, believe that while the student affairs office should be the office of support and advocacy, student affairs officers should never be the writers of the Canadian version of the MSPE, the medical student performance report (MSPR). While there are differences across the border in the overall structure of the deans' offices, it is notable that all 17 Canadian schools depend on the academic side of the dean's office to create the MSPR. The Canadian deans are surprised when they learn about the U.S. situation. The calls in the literature for improvements in objectivity continue,3 and I believe it is now time to review who should write this evaluation. If we examine all potentials for bias, then we would need to conclude that, with the pressures on each medical school to “have a good match,” perhaps no one in the dean's office should write the MSPE and that perhaps it should be left to a group that is knowledgeable but independent of the dean's office. While reassured that schools will work on systems to ensure access to sensitive health issues, I walked away from that Hot Topic session convinced that the writer should not be a member of the group whose charge it is to be the student's advocate. Funding/Support: None. Other disclosures: None. Ethical approval: Not applicable.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.095 | 0.271 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.002 | 0.002 |
| Science and technology studies | 0.009 | 0.004 |
| Scholarly communication | 0.014 | 0.008 |
| Open science | 0.003 | 0.007 |
| Research integrity | 0.011 | 0.021 |
| Insufficient payload (model declined to judge) | 0.052 | 0.081 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".