Meeting the Shared Goals of a Student-Selected Component: Pilot Evaluation of a Collaborative Systematic Review
Bibliographic record
Abstract
BACKGROUND: Research methodology is insufficiently featured in undergraduate medical curricula. Student-selected components are designed to offer some research opportunities but frequently fail to meet student or supervisor expectations, such as completion or publication. We hypothesized that a collaborative, educational approach to a systematic review (SR), whereby medical students worked together, may improve student experience and increase success. OBJECTIVE: This study aimed to establish whether offering a small team of students the opportunity to take part in the screening phase of SRs led by an experienced postgraduate team could enhance the learning experience of students, overcome the barriers to successful research engagement, and deliver published output. METHODS: Postgraduate researchers from the University of Cambridge led a team of 14 medical students to work on 2 neurosurgical SRs. One student was appointed as the lead for each SR. All students were provided with training on SR methodology and participated in title and abstract screening using Rayyan software. Students completed prepilot, midscreening, and postscreening questionnaires on their research background, perceptions, knowledge, confidence, and experience. Questions were scored on a Likert scale of 1 (strongly disagree) to 10 (strongly agree). RESULTS: Of the 14 students involved, 29% (n=4) reported that they had received sufficient training in research methodology at medical school. Positive trends in student knowledge, confidence, and experience of SR methodology were noted across the 3 questionnaire time points. Mean responses to "I am satisfied with the level of guidance I am receiving," "I am enjoying being involved in the SR process," and "I could not gain this understanding of research from passive learning e.g., textbook or lecture" were greater than 8.0 at all time points. Students reported "being involved in this research has made me more likely to do research in the future" (mean 8.57, SD 1.50) and that "this collaborative SR improved my research experience" (mean 8.50, SD 1.56). CONCLUSIONS: This collaborative approach appears to be a potentially useful method of providing students with research experience; however, it requires further evaluation.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.206 | 0.248 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.003 | 0.000 |
| Bibliometrics | 0.000 | 0.007 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.002 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.005 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; both teacher heads agree on what is shown here.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".