MétaCan
Menu
Back to cohort
Record W4385953764 · doi:10.3399/bjgpo.2023.0044

Evaluating the UK’s first national prescribing assessment for GPs in training using an online survey

2023· article· en· W4385953764 on OpenAlexaff
Richard Knox, Brian Bell, Nde-Eshimuni Salema, Kim Emerson, Susan Bodgener, Jonathan Rial, Gill Gookey, Glen Swanwick, Anna Charly, Anthony Avery

Bibliographic record

VenueBJGP Open · 2023
Typearticle
Languageen
FieldMedicine
TopicInnovations in Medical Education
Canadian institutionsWorkplace Health, Safety and Compensation Commission
FundersPatient Safety Translational Research CentreDepartment of Health and Social CareNational Institute for Health and Care ResearchRoyal College of General Practitioners
KeywordsTrainerMedical prescriptionMedicineFamily medicineEthnic groupComputer-assisted web interviewingDisadvantageMedical educationNursing

Abstract

fetched live from OpenAlex

Background GP trainees may not have experienced a systematic and comprehensive education in safe prescribing. Therefore, a self-assessment prescribing review was developed. Aim To determine whether the assessment was feasible, had face validity, and did not disadvantage particular groups of participants. Design & setting An online survey that evaluates the opinions of GPs in training of a prescribing assessment in the UK. All full-time UK trainees who started their final year of GP training in August 2019 undertook the prescribing assessment along with their trainers, after which they completed an online anonymous feedback questionnaire. Method The questionnaire completed by trainees sought their opinions of the assessment, and collected ethnicity and disability data. The trainer questionnaire was similar but did not include any demographic information. Results The questionnaire was completed by 1741 trainees and 1576 trainers. There was no evidence that ethnic group and disability were related to aspects of the review. Most of the trainees (76.4%, n = 1330) and trainers (82.0%, n = 1293) agreed or strongly agreed that the prescribing review was helpful for assessing and learning about the trainee’s prescribing. However, most participants (63.2%, n = 1092) took >4 hours to review their prescriptions. A majority of trainees (90.2%, n = 1571) reported that completing the assessment had resulted in a change in their prescribing practice. Conclusion The majority of trainers and trainees reported that the prescribing assessment was helpful. The study was not able to assess whether there had been an actual change in practice that resulted in an error reduction.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.009
metaresearch head score (Gemma)0.006
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.430
Threshold uncertainty score0.703

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0090.006
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.001
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.726
GPT teacher head0.602
Teacher spread0.124 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2023
Admission routes1
Has abstractyes

Explore more

Same venueBJGP OpenSame topicInnovations in Medical EducationFrench-language works237,207