Teaching communication skills to OTL-HNS residents: Multisource feedback and simulated scenarios
Bibliographic record
Abstract
BACKGROUND: Effective communication has been linked to a reduction in adverse events and improved patient compliance. Currently in Otolaryngology - Head and Neck Surgery (OTL-HNS) residency programs, there is limited explicit teaching of communication skills. Our objective was to implement an educational program on communication skills for residents using multisource assessment in several simulation-based contexts throughout residency. METHODS: For three consecutive years, OTL-HNS residents were recruited to participate in a total of nine simulation-based clinical scenarios in which communication skills could be honed. This educational program was designed to provide instruction and practice of challenging ethics scenarios, with communication efficacy as a secondary goal. To facilitate this goal, a multisource assessment was paired with a debriefing process that involved attending staff, observing and participating residents, standardized patients, and invited content experts. RESULTS: Seventeen residents completed the curriculum for at least two consecutive years from 2009 to 2011. The internal-consistency reliability of the scenarios ranged from 0.88 to 0.96. The intraclass correlation was 0.19, as expected in this context. There was no statistical difference in the mean ratings of performance across post-graduate year (PGY) level (p = 0.201). Results from the random-intercept regression indicated that, on average, a learner's mean rating at baseline was 3.6/5 and increased significantly by 0.25 points per year (p < 0.05) as assessed by OTL-HNS staff members and peers. No significant improvement across time was found for ratings by non-medical assessors. CONCLUSION: Implementing an educational program focused on communication skills using a multisource assessment in various contexts has shown to be potentially effective at our institution, and resulted for yearly improvement and consolidation of performance of OTL-HNS residents as judged by faculty and residents. The inclusion of a multisource assessment in the simulation curriculum is key to allow for the representation of different perspectives on communication skills, for both the assessment and the debriefing process. Future studies are needed to explore the possibility of fully integrating this educational program into residence training in order to support deliberate communication skills teaching.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.001 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.001 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".