Development of an Operative Performance Rating System for Plastic Surgery Residents
Notice bibliographique
Résumé
PURPOSE A standardized measure of operative performance is an essential component of the Patient Care Competency and is critical to the training of plastic surgery residents. The Operative Performance Rating System (OPRS) developed and validated by the Department of General Surgery at Southern Illinois University consists of procedure-specific evaluations for resident intraoperative performance. The OPRS provides an objective measure of procedure-specific resident performance that is not currently being assessed in plastic surgery training programs. The purpose of this study is to describe OPRS for plastic surgery residents and propose methodology for assessing the reliability, validity, and feasibility of this instrument. METHODS Ten procedure-specific rating instruments were developed for sentinel cases, each consisting of critical procedure-specific steps based on literature review and faculty focus group consensus. Sentinel cases were chosen based on review of the American Council of Graduate Medical Education Milestones and resident logs of the most commonly performed plastic surgery procedures, both at our institution and nationally. The degree of guidance required from the attending surgeon is recorded for each step. General operative performance competency is evaluated from validated items developed by the University of Toronto.1 All items use a 5-point Likert scale with behavioral anchors. The OPRS assessments will be incorporated into the internet-based resident management platform New Innovations. Sentinel procedures for evaluation will be identified on a weekly basis by the residency coordinator, based on resident operative assignments (postgraduate year 2–6) organized by the chief resident. OPRS assessment forms will be available electronically immediately following the procedures, with an e-mail reminder notification 24 hours later to help encourage compliance. In addition, resident self-assessment using the same OPRS will be conducted and correlated with faculty OPRS evaluations. Each OPRS assessment will be evaluated for internal consistency reliability and inter-item correlation. Inter-rater reliability will be measured by faculty assessment of videotaped sentinel procedures using the appropriate OPRS instrument. Performance variation based on resident PGY level will be analyzed using 1-way analysis of variance. Feasibility will also be determined based on attending and resident response rates and time to completion for the OPRS evaluations, as well as a short written survey to assess resident and attending satisfaction and obtain feedback following OPRS implementation. CONCLUSIONS A web-based OPRS provides timely and objective feedback to improve residents’ technical and decision-making skills, as demonstrated by the experiences of other surgical specialties.2 This instrument will provide both formative and summative resident feedback, encouraging faculty and residents to focus on demonstrated competencies and areas for improvement.3 Furthermore, resident operative performance can be monitored across time and residents, allowing program directors to have a long-term objective method of evaluating resident technical performance.3 A reliable and valid OPRS may provide a feasible method of intraoperative assessment that could be implemented across all plastic surgery training programs.
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction distillée sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.
Scores Codex et Gemma par catégorie
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,001 | 0,005 |
| Méta-épidémiologie (sens strict) | 0,000 | 0,000 |
| Méta-épidémiologie (sens large) | 0,001 | 0,000 |
| Bibliométrie | 0,000 | 0,000 |
| Études des sciences et des technologies | 0,000 | 0,000 |
| Communication savante | 0,000 | 0,001 |
| Science ouverte | 0,000 | 0,000 |
| Intégrité de la recherche | 0,000 | 0,000 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,000 | 0,000 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; un appel candidat d’une seule tête enseignante, pas un consensus.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».