MétaCan
Menu
Back to cohort
Record W4406091862 · doi:10.2196/preprints.70167

Developing a SNOMED CT-based value set to document symptoms and diagnoses for adverse drug events (Preprint)

2024· preprint· en· W4406091862 on OpenAlexaboutno aff
Erica Y. Lau, Linda Bird, Anthony Lau, Yau-Lam Alex Chau, Katherine Butcher, Susan Buchkowsky, Kira Gossack‐Keenan, Cheryl A Sadowski, Corinne M. Hohl

Bibliographic record

Venuenot available
Typepreprint
Languageen
FieldPharmacology, Toxicology and Pharmaceutics
TopicPharmacovigilance and Adverse Drug Reactions
Canadian institutionsnot available
Fundersnot available
KeywordsSNOMED CTPreprintMedical diagnosisMedicineValue (mathematics)Adverse effectDrugMedical physicsComputer scienceData scienceWorld Wide WebInternal medicineRadiologyPharmacologyTerminologyMachine learningLinguistics

Abstract

fetched live from OpenAlex

BACKGROUND Adverse drug events (ADE) lead to over two million emergency department visits in Canada annually, resulting in significant patient harm and over $1 billion in healthcare costs. Effective documentation and sharing of ADE information through electronic medical records (EMRs) is essential to inform subsequent care and improve safety when culprit medications can be replaced and re-exposures avoided. Yet current systems often lack standardized comprehensive ADE value sets. OBJECTIVE This study aimed to develop a SNOMED CT value set for symptoms and diagnoses to standardize ADE documentation and improve ADE data integration into EMRs. METHODS We used ADE data from ActionADE, a prospective reporting system implemented in nine hospitals in British Columbia. We extracted 5,792 reports that yielded 827 unique ADE symptom and diagnosis terms based on MedDRA preferred terms. Two independent mappers employed both automated and manual mapping approaches to match these terms to SNOMED CT concepts. Two clinical experts conducted validation, followed by a quality assurance review by a separate clinical team. Discrepancies were resolved through consensus discussions. Interrater reliability was assessed using Cohen’s kappa. RESULTS The automated mapping process identified 63.8% (528/827) semantically equivalent matches from SNOMED CT’s Clinical Finding hierarchy. Two mappers manually reviewed the automatically mapped terms and identified appropriate target concepts for the unmapped terms. After the manual mapping process, 95.3% (788/827) of the source terms were successfully mapped to SNOMED CT concepts, with 4.7% (39/827) remaining unmapped. Interrater reliability between the mappers was strong (κ = 0.87, 95% CI: 0.85-0.89). The validation phase identified and removed one irrelevant term, resulting in 98.9% (778/826) terms mapped, with 1.6% (9/826) unmapped, and a high interrater reliability (κ = 0.88, 95% CI: 0.80-0.95). During quality assurance, six terms were flagged for concerns regarding clinical relevance or safety risks and were resolved through discussions. The final value set comprised 813 SNOMED CT concepts, with 95.0% of terms classified as semantically equivalent. Thirteen additional terms remained unmapped and will be reviewed as new SNOMED CT codes are added. CONCLUSIONS This study developed a SNOMED CT-based value set to document symptoms and diagnoses for adverse drug events observed in adults in EMRs. Adopting this value set can improve the consistency, accuracy, and interoperability of ADE documentation in EMRs, helping to reduce repeat ADEs and enhance patient safety. Ongoing refinement and improved clinical usability are essential for its widespread adoption. Future research should assess the impact of integrating this value set into EMRs on ADE reporting, pharmacovigilance, and patient safety outcomes.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.009
metaresearch head score (Gemma)0.043
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Methods · Consensus signal: Methods
Teacher disagreement score0.021
Threshold uncertainty score0.045

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0090.043
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.002
Bibliometrics0.0180.008
Science and technology studies0.0010.001
Scholarly communication0.0040.003
Open science0.0020.003
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0040.002

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.099
GPT teacher head0.463
Teacher spread0.364 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designNot applicable
Domainnot available
GenreMethods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2024
Admission routes1
Has abstractyes

Explore more

Same topicPharmacovigilance and Adverse Drug ReactionsFrench-language works237,207