MétaCan
Menu
Back to cohort
Record W2889994600 · doi:10.23889/ijpds.v3i4.1014

Experiences with Coding using ICD-11: “The Codes Paint a Clearer Picture”

2018· article· en· W2889994600 on OpenAlexaff
Catherine Eastwood, Danielle A. Southern, Alicia Boxill, Malgorzata Maciszewski, Hude Quan, Denise Cullen, Margaret Penchoff, William A. Ghali

Bibliographic record

VenueInternational Journal for Population Data Science · 2018
Typearticle
Languageen
FieldHealth Professions
TopicMedical Coding and Health Information
Canadian institutionsCanadian Institute for Health InformationToronto Metropolitan UniversityUniversity of Calgary
Fundersnot available
KeywordsCoding (social sciences)Computer scienceComprehensionPsychologyMedicineStatistics

Abstract

fetched live from OpenAlex

IntroductionA high performing health data classification system requires clear, comprehensive code descriptions and user-friendly coding tools for effective coding. Coding specialists have essential specialized knowledge to contribute to the development and functionality of the 11th version of International Classification of Diseases (ICD-11) that will be released in June of 2018.
 Objectives and ApproachThe objective was to evaluate coding specialists’ experience of coding using ICD-11 for complete inpatient hospital charts. Mixed methods were employed for a survey and interviews. As part of a large field trial, 6 certified coding specialists underwent training to use the ICD-11 Beta Draft browser and ICD-11 Coding Tool. The coding team completed multiple coding exercises and coded over 60 charts each prior to evaluation of their experience. An electronic survey was used to evaluate ICD-11 knowledge, comprehension, and application of the coding training. Interviews explored the coders’ experience of learning and using the ICD-11 classification system.
 ResultsThe coding team (3 to 10 years of experience) received 14 hours classroom training and 5-10 hours per week of coding practice over 3 months. After training, perceived confidence in coding with ICD-11 was satisfactory; moderate (n=4), high (n=1), and low (n=1). Coding short scenarios was the most useful resource (n=6) and lack of guidelines was the most frustrating. Learning ICD-11 was deemed moderately (n=2) to somewhat (n=3) difficult but each coder described satisfaction in learning the new system. From the interviews, coders expressed liking the ability to more fully describe health conditions and hospital harms with code clusters. “The codes paint a clearer picture of what happened than with ICD-10”. With practice they achieved speed with the coding tools.
 Conclusion/ImplicationsCoding specialists learned and proficiently used the Beta Version of ICD-11 coding system with moderate perceived confidence. New ICD-11 codes and clustering functions allowed for more complete description of health scenarios and enhanced coder satisfaction.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.005
metaresearch head score (Gemma)0.002
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesScience and technology studies
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Simulation or modeling · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.712
Threshold uncertainty score0.998

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0050.002
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0040.000
Scholarly communication0.0000.002
Open science0.0010.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.440
GPT teacher head0.562
Teacher spread0.123 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designSimulation or modeling
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2018
Admission routes1
Has abstractyes

Explore more

Same venueInternational Journal for Population Data ScienceSame topicMedical Coding and Health InformationFrench-language works237,207