MétaCan
Menu
Back to cohort
Record W4378347451 · doi:10.1111/ans.18513

Building a bright future: discussing the weighting of academic research in standardized curriculum vitae for Australian Medical and Surgical Specialty Training College entrance

2023· article· en· W4378347451 on OpenAlexaboutno aff
Thomas Muecke, Stephen Bacchi, Robert J. Casson, Weng Onn Chan

Bibliographic record

VenueANZ Journal of Surgery · 2023
Typearticle
Languageen
FieldMedicine
TopicHealth and Medical Research Impacts
Canadian institutionsnot available
Fundersnot available
KeywordsMedicineSpecialtyCurriculumMedical educationWeightingTraining (meteorology)Family medicineRadiologyPedagogy

Abstract

fetched live from OpenAlex

Entrance into specialist medical and surgical training programmes in Australia is a challenging prospect for trainee medical officers (TMO). Whilst entrance requirements differ between each training program,1 acquisition of certain clinical skills, research publications, higher degrees and regional exposure are often paramount. These criteria are typically reflected in the curriculum vitae (CV), which provides the assessor an initial snapshot of the applicant's professional career. As the number of medical school graduates continues to grow without the equivalent expansion of postgraduate positions, a competitive CV is often required for successful entry into vocational training.1, 2 Standardized criteria are utilized by certain training programmes and provide a quantification of the weighting of different aspects of a given CV. Accordingly, applicants may direct their time and activities towards activities that are endorsed by these CV criteria. Clinical research (including publications, presentations, and higher degrees) is a vital component of advancing the care of our patients. Including research as a component in specialty training program entrance criteria may facilitate selection of individuals who are likely to continue contributing academically. The extent to which research is weighted in CV criteria may vary between specialty training programmes. In this article, we present the proportion of specialty training programmes that have publicly available explicit criteria point allocations regarding CV content (a standardized CV), as well as the percentage of points in the available standardized CVs dedicated to research. Clinical research is one of other vocations that reflects a TMO's involvement in evidence-based medicine,2 and as such, often is a key criterion for specialty college training program applications.3 The desire for TMO's to partake in clinical research, which may be motivated by specialty college CV requirements, is described in several studies.2, 4-6 O'Sullivan et al. reports that TMO's target research publications to improve their CV.5 Furthermore, Funston et al. reported that 96.6% of 1625 medical students from 38 countries reported they would want to be involved in research after graduation.6 Similarly, previous studies of TMO's have found that 98.4% were interested in doing research in the future, with two of the three main motivators being a perceived CV improvement and pre-requisite for specialty training.4 The weightings of research in standardized CVs, however, differ between Australian and New Zealand specialty colleges. McGrail et al. reports that 60% of 11 263 Australian TMO's believe that clinical research is important to either progress their training or career.2 Within this group, 91% of metropolitan and 87% of rural surgical TMOs share this belief when compared to 74% metropolitan and 63% rural internal medicine TMOs. A higher agreeance on the importance of research may reflect their desired college having more competitive research entry criteria and expectations.2 We found that 14/47 (29.8%) specialty medical and surgical training programmes in Australia and New Zealand publish publicly available standardized CVs, and of these 14/14 (100%) allocate points towards research, with a mean point weighting towards research of 42.5% (median: 45.5%; range: 5%–61.9%). Allocation of points dedicated to research are presented in Table A1 and the breakdown of point allocation for research and higher degrees is described in Table A2. Our findings demonstrate that, evidently for the 14 specialty training programmes with publicly available standardized CVs, involvement in research is a valuable and desired attribute of training program applicants. Standardized CVs are more common in surgical specialties, (e.g., RACS, RANZCO, and RANZCOG) which constitutes 12/14 (85.7%) specialty training programmes identified with publicly available standardized CVs. Comparatively, for physician training programmes (RACP), 1/26 (3.85%) published a publicly available standardized CV. Interestingly, 10/14 (71.4%) specialty training programmes awarded greater weighting to research than for clinical experience in that specialty. This finding, however, may reflect the structure of the specialty training program, as for surgical specialties, surgical skills and techniques and typically learnt during vocational training. A standardized CV allows for applicants to be evaluated and compared in a standardized and transparent manner. Incentivizing and highlighting the importance of research in this manner may facilitate the generation of new knowledge to improve medical practice. However, heavily weighting research as a CV criterion may have limitations. While applicants strive towards obtaining a competitive application, some individuals may approach acquiring research points with a ‘box-ticking’ mentality. Conversely, availability of and involvement in research projects is not uniform for medical students and TMOs, including those in rural positions or outside of academic centres, disadvantaging some groups of future specialty training applicants. Research opportunities may be increased through equal opportunity for placements at academic hospitals, or through compulsory research involvement within an undergraduate medical degree. Furthermore, research mentors and supervisors may be incentivized to undertake research projects with diverse teams of varying experience. The presented findings are observational in nature. The effect of including research as a component in standardized CVs on the continued participation of registrars and specialty trained doctors in clinical research has not been demonstrated. It should also be noted that standardized CVs, including the weighting of research, change over time. Individuals may be negatively impacted after criteria shift from and misalign with an individual's prior efforts towards building a competitive CV. Future work could obtain qualitative insights into the process of producing and updating standardized CVs. Additionally, the effect of disparate research availability and opportunities for Australian medical student and TMO's, as well as the impact of research mentorship, on an applicant's admission into their desired specialty training program, could be explored. The evaluation of the future impact of the research cited in CVs may also be valuable. Additionally, selection guidelines during later sections of the selection process, including interviews and situational judgement tests, are not publicly available to applicants. The effects of potential conflicts of interest during this phase, manifesting as applicant selection bias, remain largely unknown. Thomas Muecke: Data curation; writing – original draft; writing – review and editing. Stephen Bacchi: Conceptualization; supervision; writing – review and editing. Robert Casson: Supervision; writing – review and editing. Weng Onn Chan: Conceptualization; supervision; writing – review and editing. Indigenous identity: 7 points Regional origin and experience: 7 points Academic awards and excellence: 7 points Qualifications: 7 points Continuing professional development and courses: 4 points Relevant personal experiences: 7 points Indigenous identity: 10 points Regional clinical exposure: 5 points Within O&G: 12 points Within O&G in a rural location: 3 points Outside of O&G: 3 points Academic (excellence and awards): 8 points Professional qualifications and courses: 5 points Outstanding leadership and altruism: 11 points Research and higher degrees: 4 points Presentations/posters: 1 point Grants and scholarships: 1 point Academic performance: 2 points Other attributes (scholarships, sporting representations, music and art achievements, charity involvements): 4 points Neurology elective year: 2 points Neurology residency experience (any): 1 point Completing medical degree: 2 points Internship + 3 years of general medical training: 4 points Passed both components of the FRACP exam: 4 points B Med Sci or other post grad degree: 2 points Significant involvement in hospital committees, resident association: 2 points Significant teaching achievements: 2 points Non–medical activities that show leadership, application, determination, personal sacrifice, or voluntary activities for common good: 2 points One or more prize during medical course or training: 1 point Publications: 10 points Presentations: 10 points Cardiothoracics experience: 6 points Surgical experience other than cardiothoracics: 3 points Non–surgical rotations: 3 points Skills courses: 5 points Medical awards/achievements: 2 points Publications: 5 points Presentations: 3 points Prizes/awards for excellence: 2 points Scholarships and teaching: 3 points Qualifications: 4 points Publications: 2 points Presentations: 1 point Neurosurgery experience: 4 points ICU experience: 1 point Presentations: 2 points Publications: 4 points Orthopaedics experience: 3 points Clinical experience other than orthopaedics: 1 point Publications: 5 points Presentations: 3 points Otolaryngology head and neck experience: 4 points Surgical experience other than otolaryngology head and neck: 2 points Publications: 3 points Presentations: 2 points Courses and scientific meetings: 2 points Awards and scholarships: 2 points Special achievements and leadership: 2 points Professional development activities (medical/technical): 15 points Professional development activities (non–medical/non–technical): 10 points Prizes, awards, and leadership: 15 points Publications: 8 points Presentations: 8 points RACS skills courses: currently suspended due to covid Teaching: 2 points Professional development: 10 points Achievements, leadership, and management: 5 points Cultural competence and cultural safety: 3 points Article or textbook chapter: 2 points Opinion/non–research publication: 0.5 Competition and presentation of audit: 1 point Full time research position: 2 points per year Part time research position: 1 point per year Development of a substantial education resource: 2 points Co–investigator in a clinical trial: 2 points One publication: 1 point Two or more publications: 2 points JIF>4: 2 points JIF<4: 1 point 0.25 points 0.5 maximum One publication, first author: 0.5 points Two or more publications, as first author: 0.75 points 0.75 maximum 1 presentation / poster: 0.5 point 2 presentations / posters: 0.75 point 3 or more presentations / posters: 1.0 points 1 presentation / poster: 0.25 point 2 presentations / posters: 0.38 point 3 or more presentations / posters: 0.5 point International, or Australasian society, or association meeting Presentation: 2 point Poster: 1 point, maximum of 2 points National meetings of professional societies Presentation: 1 point, 3 points maximum Poster: 1 point, maximum 1 point Presentation at State meetings of professional societies: 1 point, maximum 2 points Poster: N/P Master's in a surgical field: 2 points Masters in a non–surgical field: 1 point Presentation: 1 point Poster: 0.5 point Technique article, first author: 1 point Doctoral degree, excluding a primary medical qualification: 2 points Bachelor's honours degree: 1 point Presentation at national AOA or RACS meeting: 2 points International equivalent national orthopaedic association meeting: 2 points Presentation at AOA regional meeting: 1 point (maximum of 1 point) OA national sub–specialty society meeting: 1 point (maximum of 1 point) Presentation: 1 point Poster: 0.25 point Presentation: 0.5 point Poster: 0.25 PhD relevant to medicine: 4 points PhD not relevant to medicine: 2 points By research and thesis, relevant to medicine: 2 points By coursework, relevant to medicine: 0.5 point Presentation: 2 points Poster: 0.5 points OMS Regional meeting: 1 point ANZAOMS or college convocation: 1.5 point Completed: 4 points Incomplete: 0.5 points Completed: 2 points Incomplete: 0.5 point Second author publication: 4 points Non–first or second author publication or book chapter: 2 points Documented participation in a multi–author collaboration project/paper: 1 point presentation: 3 points conference poster: 1 point presentation: 3 points conference poster: 1 point Presentation (must be first author): 8 points Poster (must be first author): 4 points Presentation (must be first author): 8 points Poster (must be first author): 4 points Medically related PhD Completed with thesis: 40 points Completed without thesis: 20 points Incomplete: 15 points Non–medically related PhD Completed with thesis: 20 points Completed without thesis: 10 points Completed with thesis: 20 points Completed without thesis: N/P Article: 5 points Chapter in medical or surgical textbook: 4 points Article: 3 points Chapter in medical or surgical textbook: 3 points Presentations at the following urological meetings: American Urological Association, Société Internationale d’Urologie, British Association of Urological Surgeons, Canadian Urological Association, Urological Association of Asia, European Urological Association, World Congress of Endourology, International Continence Society Presentation: 4 points Poster: 2 points Unmoderated posters: 1 point Presentations at other international, national, or Australasian organisations Presentation: 2 points Poster: 1 point Unmoderated posters: 0.5 point Presentations at USANZ Sectional Meetings or Regional Surgical Specialty Meetings: Presentation: 1 point Completed: 8 points Pre–submission thesis review: 4 points Confirmation of candidature: 2 points Master of surgery (MS) or master's degree (not MS) of 2 years full time equivalent duration undertaken by thesis Completed: 4 points Pre–submission thesis review: 2 points Master of Surgery (MS) or master's degree (not MS) of 1 year of more duration completed by coursework with or without dissertation Completed: 2 points per year of full–time equivalent study International level: 5 points National level: 3 points State/section level: 1 point Doctor of medical science (DMedSc) or other post graduate doctorate in medicine or surgery Completed: 8 points Pre–submission thesis review: 4 points Confirmation of candidature: 2 points For articles < 10 authors: 1 point For articles > 10 authors: 0.5 points (maximum of 1 point) Presentation: 1 point Poster (applicant must be first author): 0.5 point Presentation: 0.5 point Poster (applicant must be first author): 0.5 point By dissertation: 3 points By coursework: 2 points

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.037
metaresearch head score (Gemma)0.028
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.734
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0370.028
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0010.001
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.002
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.278
GPT teacher head0.501
Teacher spread0.223 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; both teacher heads agree on what is shown here.

Study designNot applicable
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations10
Published2023
Admission routes1
Has abstractyes

Explore more

Same venueANZ Journal of SurgerySame topicHealth and Medical Research ImpactsFrench-language works237,207