A234 INTER AND INTRA RATER RELIABILITY OF PHOTO DOCUMENTATION IN COLONOSCOPY
Notice bibliographique
Résumé
Colonoscopy is one of the most powerful methods employed for early detection and prevention of colorectal cancer. Visualization of the cecum is significant as it indicates that a complete colonoscopy has been performed. Photo-documentation of the ileocecal valve has been utilized to document a complete colonoscopy. The effectiveness of this guideline as a screening tool used by endoscopists in the Saskatoon Health Region remains to be researched. To determine the inter- and intra-rater reliability amongst endoscopists in regards to colonoscopy photodocumentation. The endoscopic-photo at the moment when the endoscopist believes they have completed the colonoscopy (reached the ileocecal valve) was recorded. As well, endoscopists were instructed to get one photograph of the colon, not of the ileocecal valve but similar in appearance, for every 4 positive scopes. A total of 20 pictures were collected from 3 endoscopists and 10 pictures from 2 endoscopists. After the completion of all 80 colonoscopies, the photographs were compiled, randomized and presented to each of the 5 endoscopists. The endoscopists were required review all the 80 photographs, within a standardized time period, and grade whether the photo-documentation indicated that cecum had been reached or not. The data was recorded and a correlation coefficient was performed to analyze the intra-rater and inter-rater reliability. Overall agreement between stated image region that was taken and physician blinded review occurred in 365 of 400 reviews (91%). Among those images taken at the cecum/appendix, 297/320 reviews (93%) labeled these images as being from this region (sensitivity). Among those images not from the cecum/appendix, 68/80 reviews (85%) recognized these images as not begin from this region (specificity). As such 12/80 reviews (15%) of images taken prior to the cecum/appendix were mistakenly thought to be from the cecum/appendix (i.e. false positive). Overall positive and negative predictive values were 96% and 75% respectively. Overall agreement across multiple raters using Fleiss’s Kappa statistic = 0.69, suggesting substantial agreement beyond that occurring by chance. Of the 80 images assessed, 6 (8%) were not rated the same way when reassessed by the endoscopist who originally took the image. Three were falsely labeled as negative and three were falsely labeled as positive. Documenting colonoscopy with static images of the ileocecal valve is only partially successful as an objective measure if a total colonoscopy has been performed at the Saskatoon Health Region. Authors believe still photography of the ileocecal valve may not be convincing in all cases. A combination of photographs (involving the ileocecal valve and appendiceal orifice) or documentation of the terminal ileum could be more efficacious as an objective measure of a total colonoscopy. None
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction machine sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Le volet Gemma est une étiquette directe du modèle pour chaque travail de la base, lue sur la notice réduite au titre. Le volet Codex est un classifieur appris des 10 348 étiquettes directes de Codex et calibré sur les taux pondérés de l'échantillon; les champs sans appui suffisant ne portent aucun appel Codex. Le mode candidate est l'union des deux volets; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont pas des étiquettes humaines.
Scores du classifieur distillé par catégorie (deux têtes)
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,118 | 0,166 |
| Méta-épidémiologie (sens strict) | 0,001 | 0,001 |
| Méta-épidémiologie (sens large) | 0,001 | 0,002 |
| Bibliométrie | 0,003 | 0,002 |
| Études des sciences et des technologies | 0,001 | 0,002 |
| Communication savante | 0,002 | 0,001 |
| Science ouverte | 0,001 | 0,002 |
| Intégrité de la recherche | 0,001 | 0,001 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,002 | 0,001 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; un appel candidat d’une seule source (Gemma direct ou Codex distillé), pas un consensus.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».