MétaCan
Menu
Back to cohort

A RIME Perspective on the Quality and Relevance of Current and Future Medical Education Research

2004· article· en· W2023973805 on OpenAlexaff
Judy A. Shea, Louise Arnold, Karen Mann

Bibliographic record

VenueAcademic Medicine · 2004
Typearticle
Languageen
FieldMedicine
TopicInnovations in Medical Education
Canadian institutionsDalhousie University
Fundersnot available
KeywordsRelevance (law)TimelineScope (computer science)CurriculumQuality (philosophy)Engineering ethicsMedical educationSituatedWork (physics)Empirical researchCreativityPerspective (graphical)PsychologyMedicinePedagogyComputer sciencePolitical scienceEngineering

Abstract

fetched live from OpenAlex

In this article, the authors consider the quality and relevance of current and future medical education research by (1) presenting a framework for medical education research and reviewing basic principles of "good" empirical work, (2) extending the discussion of principles to "best practices," (3) considering the distinctive features of medical education that present challenges to the researcher, and (4) discussing opportunities for expanding the scope and influence of medical education research. Their audience is intended to be clinicians involved in education, deans and associate deans who create and direct educational curricula and processes, and those from offices critical to the educational mission such as admissions, student services and financial aid, as well as medical education researchers. The authors argue that the quality and relevance of current work can be enhanced when research is situated within a general framework and questions are asked that are based on literature and theory and push the field toward new knowledge. Obviously methods and designs must be appropriate and well-executed and sufficient data must be gathered. Multiple studies are highlighted that showcase the rigor and creativity associated with excellent quality work. However, good research is not without its challenges, most notably short timelines and the need to work within an ever-changing real-life educational environment. Most important, the field of medical education research has many opportunities to increase its impact and advance its quest to study important learners' behaviors and patients' outcomes. Programs to train and collaborate with clinical and administrative colleagues, as well as researchers in other fields, have great potential to improve the quality of research in the field.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.520
metaresearch head score (Gemma)0.601
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Evaluation · Consensus signal: none
Study designCandidate signal: Theoretical or conceptual · Consensus signal: Theoretical or conceptual
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.480
Threshold uncertainty score0.592

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.5200.601
Meta-epidemiology (narrow)0.0010.002
Meta-epidemiology (broad)0.0050.003
Bibliometrics0.0180.012
Science and technology studies0.0110.108
Scholarly communication0.0520.055
Open science0.0080.021
Research integrity0.0230.031
Insufficient payload (model declined to judge)0.0060.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.114
GPT teacher head0.543
Teacher spread0.429 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designTheoretical or conceptual
DomainEvaluation
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations69
Published2004
Admission routes1
Has abstractyes

Explore more

Same venueAcademic MedicineSame topicInnovations in Medical EducationFrench-language works237,207