Assessing Competence in Critical Care Echocardiography: Development and Initial Results of an Examination and Certification Processes*
Bibliographic record
Abstract
OBJECTIVES: To describe the development and initial results of an examination and certification process assessing competence in critical care echocardiography. DESIGN: A test writing committee of content experts from eight professional societies invested in critical care echocardiography was convened, with the Executive Director representing the National Board of Echocardiography. Using an examination content outline, the writing committee was assigned topics relevant to their areas of expertise. The examination items underwent extensive review, editing, and discussion in several face-to-face meetings supervised by National Board of Medical Examiners editors and psychometricians. A separate certification committee was tasked with establishing criteria required to achieve National Board of Echocardiography certification in critical care echocardiography through detailed review of required supporting material submitted by candidates seeking to fulfill these criteria. SETTING: The writing committee met twice a year in person at the National Board of Medical Examiner office in Philadelphia, PA. SUBJECTS: Physicians enrolled in the examination of Special Competence in Critical Care Electrocardiography (CCEeXAM). MEASUREMENTS AND MAIN RESULTS: A total of 524 physicians sat for the examination, and 426 (81.3%) achieved a passing score. Of the examinees, 41% were anesthesiology trained, 33.2% had pulmonary/critical care background, and the majority had graduated training within the 10 years (91.6%). Most candidates work full-time at an academic hospital (46.9%). CONCLUSIONS: The CCEeXAM is designed to assess a knowledge base that is shared with echocardiologists in addition to that which is unique to critical care. The National Board of Echocardiography certification establishes that the physician has achieved the ability to independently perform and interpret critical care echocardiography at a standard recognized by critical care professional societies encompassing a wide spectrum of backgrounds. The interest shown and the success achieved on the CCEeXAM by practitioners of critical care echocardiography support the standards set by the National Board of Echocardiography for testamur status and certification in this imaging specialty area.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.014 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.001 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".