Validity testing of the APDVS Medical Student Curriculum eBook demonstrates increased knowledge and self-perceived competence among medical students
Bibliographic record
Abstract
No standard curricular recommendations exist for undergraduate medical education learners on vascular surgery rotations. Vascular surgery educators in the United States and abroad recognize the need for a more accessible, comprehensive, and uniform undergraduate medical education vascular surgery curriculum. To address this need, the Association of Program Directors in Vascular Surgery is prioritizing the creation of a standardized, distance-learning curriculum in the form of an eBook. The eBook was studied through design-based research methodology comprising cycles of designing, testing, evaluating, and reflecting. The evaluation phase involved a quasi-experimental, convergent mixed-methods design including pre-post testing and virtual, semistructured, one-on-one interviews. Students were recruited via faculty partners, snowball sampling, and open calls on social media. Descriptive statistics and Fischer's exact tests were conducted for discrete variables. Paired t tests were performed for continuous variables. Qualitative descriptive analysis was performed to help explain the factual conclusions of the quantitative results. Fifteen students enrolled and thirteen completed the study. Students communicated significant increases in self-reported confidence in general carotid artery stenosis (CAS) knowledge ( P = .012), the ability to diagnose CAS ( P = .001), the ability to create a CAS management plan ( P ≤ .001), and the ability to teach a peer about CAS ( P ≤ .001). Students demonstrated a significant increase in CAS knowledge scores (mean increase = 17.9%; t (12) = 3.54; P = .004). Qualitative descriptive analysis provided three insights to explain the quantitative results: (1) eBook self-study required an appropriate amount of mental effort, (2) the eBook helped to prepare students for clinical interactions, and (3) vascular surgery interest is cemented before clinical experiences and eBook use. According to measurable outcomes and lived experiences, student eBook use during clinical rotations led to increased CAS knowledge and self-reported competence in general CAS knowledge, the ability to diagnose and create a management plan for uncomplicated CAS, and the ability to teach peers about CAS. Students value the Association of Program Directors in Vascular Surgery Medical Student Curriculum eBook as a level-appropriate and efficient learning resource. Future studies are warranted to evaluate the validity of chapters beyond the minimal viable product and of the eBook for other learners.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.002 | 0.004 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.001 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".