Predictive Validity of the Global Assessment Form Used in a Final‐year Undergraduate Rotation in Emergency Medicine
Bibliographic record
Abstract
Abstract Objectives:To determine whether the predictive validity of Global Assessment Form (GAF) knowledge subdomain marks exceeds that of the overall GAF marks with respect to written examination marks for an undergraduate rotation in emergency medicine, and to determine the interdependence between subdomain marks on the GAF.Methods:Final‐year clinical clerks completing a four‐week rotation through the emergency departments of a university teaching center were evaluated using both a ten‐subdomain GAF for clinical performance and an independent written examination. The GAF and examination marks were prospectively obtained for clinical clerks over a two‐year period. Pearson correlations were calculated between examination marks and both the GAF knowledge subdomain and the GAF overall mark. Olkin's Z score was calculated to determine the significance of the difference between correlations. Interdependencies between subdomains of the GAF were calculated using an alpha coefficient and inter‐item correlations.Results:Data sets were reviewed for 347 clinical clerks. Nine sets of data were excluded (incomplete evaluations); 338 sets were analyzed. Means for overall clinical mark and examination mark were 80.11% (SD = 4.375) and 81 (SD = 7.66). Among subdomains, knowledge had the highest correlation with the examination mark (0.19). Overall clinical marks had lower correlation with the examination marks (0.169); the difference was not significant (Olkin's Z = 0.40). The correlation of the examination marks with the average marks of all subdomains excluding knowledge was even lower (0.12). The tenitem alpha for the GAF was 0.92.Conclusions:Clinical GAF assessments of knowledge, as measured by written examination, do not appear to be any more predictive than overall clinical impression. There is substantial consistency between subdomain scores, suggesting that assessors are not effectively discriminating between them when assigning marks.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.004 | 0.031 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.001 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.000 | 0.001 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.002 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".