MétaCan
Menu
Back to cohort

Variation in Case Exposure During Internal Medicine Residency

2024· article· en· W4405514999 on OpenAlexaffabout
Andrew C. L. Lam, Brandon Tang, Chang Liu, Marwa Ismail, Surain B. Roberts, Matthew Wankiewicz, Anushka Lalwani, Daniel J. Schumacher, Benjamin Kinnear, Amol A. Verma, Fahad Razak, Brian M. Wong, Shiphra Ginsburg

Bibliographic record

VenueJAMA Network Open · 2024
Typearticle
Languageen
FieldMedicine
TopicHospital Admissions and Outcomes
Canadian institutionsHealth Sciences CentreMount Sinai HospitalSunnybrook Health Science CentreWestern UniversityUniversity of Toronto
Fundersnot available
KeywordsMedicineQuartileLogistic regressionCohortMedical diagnosisFamily medicineAcute careEmergency medicineHealth careDemographyConfidence intervalInternal medicine

Abstract

fetched live from OpenAlex

Importance: Variation in residency case exposure affects resident learning and readiness for future practice. Accurate reporting of case exposure for internal medicine (IM) residents is challenging because feasible and reliable methods for linking patient care to residents are lacking. Objective: To develop an integrated education-clinical database to characterize and measure case exposure variability among IM residents. Design, Setting, and Participants: In this cohort study, an integrated educational-clinical database was developed by linking patients admitted during overnight IM in-hospital call shifts at 5 teaching hospitals to senior on-call residents. The senior resident, who directly cares for all overnight IM admissions, was linked to their patients by the admission date, time, and hospital. The database included IM residents enrolled between July 1, 2010, and December 31, 2019, in 1 Canadian IM residency. Analysis occurred between August 1, 2023, and June 30, 2024. Main Outcomes and Measures: Case exposure was defined by patient demographic characteristics, discharge diagnoses, volumes, acuity (eg, critical care transfer), medical complexity (eg, Charlson Comorbidity Index), and social determinants of health (eg, from long-term care). Residents were grouped into quartiles for each exposure measure, and the top and bottom quartiles were compared using standardized mean difference (SMD). Variation between hospitals was evaluated by calculating the SMD between the hospitals with the highest and lowest proportions for each measure. Variation over time was assessed using linear and logistic regression. Results: The integrated educational-clinical database included 143 632 admissions (median [IQR] age, 71 [55-83] years; 71 340 [49.7%] female) linked to 793 residents (median [IQR] admissions per shift, 8 [6-12]). At the resident level, there was substantial variation in case exposure for demographic characteristics, diagnoses, volumes, acuity, complexity, and social determinants. For example, residents in the highest quartile had nearly 4 times more admissions requiring critical care transfer compared with the lowest quartile (3071 of 30 228 [10.2%] vs 684 of 25 578 [2.7%]; SMD, 0.31). Hospital-level variation was also significant, particularly in patient volumes (busier hospital vs less busy hospital: median [IQR] admissions per shift, 10 [8-12] vs 7 [5-9]; SMD, 0.96). Over time, residents saw more median (IQR) admissions per shift (2010 vs 2019: 7.6 [6.6-8.4] vs 9.0 [7.6-10.0]; P = .04) and more complex patients (2010 vs 2019: Charlson Comorbidity Index ≥2, 3851 of 13 762 [28.0%] vs 2862 of 8188 [35.0%]; P = .03), while working similar shifts per year (median [IQR], 11 [8-14]). Conclusions: In this cohort study of IM residents in a Canadian residency program, significant variation in case exposure was found between residents, across sites, and over time.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesInsufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.250
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.019
GPT teacher head0.321
Teacher spread0.301 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations5
Published2024
Admission routes2
Has abstractyes

Explore more

Same venueJAMA Network OpenSame topicHospital Admissions and OutcomesFrench-language works237,207