MétaCan
Menu
Back to cohort
Record W4404296055 · doi:10.2196/60084

Co-Designing a Consumer-Focused Digital Reporting Health Platform to Improve Adverse Medicine Event Reporting: Protocol for a Multimethod Research Project (the ReMedi Project)

2024· article· en· W4404296055 on OpenAlexvenueno aff
Eyob Alemayehu Gebreyohannes, Christopher Thornton, Myra Thiessen, Sieta T. de Vries, André Q Andrade, Lisa M. Kalisch Ellett, Oliver Frank, Phaik Yeong Cheah, Kim‐Kwang Raymond Choo, Tracey‐Lea Laba, Elizabeth E. Roughead, Indae Hwang, Geraldine Moses, Renly Lim

Bibliographic record

VenueJMIR Research Protocols · 2024
Typearticle
Languageen
FieldPharmacology, Toxicology and Pharmaceutics
TopicPharmacovigilance and Adverse Drug Reactions
Canadian institutionsnot available
FundersWellcome Trust
KeywordsPreprintProtocol (science)Digital healthEvent (particle physics)Alternative medicineMedicineMedical educationComputer scienceHealth careWorld Wide Web

Abstract

fetched live from OpenAlex

BACKGROUND: Adverse medicine events (AMEs) are unintended effects that occur following administration of medicines. Up to 70% of AMEs are not reported to, and hence remain undetected by, health care professionals and only 6% of AMEs are reported to regulators. Increased reporting by consumers, health care professionals, and pharmaceutical companies to medicine regulatory authorities is needed to increase the safety of medicines. OBJECTIVE: We describe a project that aims to co-design a digital reporting platform to improve detection and management of AMEs by consumers and health care professionals and improve reporting to regulators. METHODS: The project will be conducted in 3 phases and uses a co-design methodology that prioritizes equity in designing with stakeholders. Our project is guided by the Consolidated Framework for Implementation Research. In phase 1, we will engage with 3 stakeholder groups-consumers, health care professionals, and regulators-to define digital platform development standards. We will conduct a series of individual interviews, focus group discussions, and co-design workshops with the stakeholder groups. In phase 2, we will work with a software developer and user interaction design experts to prototype, test, and develop the digital reporting platform based on findings from phase 1. In phase 3, we will implement and trial the digital reporting platform in South Australia through general practices and pharmacies. Consumers who have recently started using medicines new to them will be recruited to use the digital reporting platform to report any apparent, suspected, or possible AMEs since starting the new medicine. Process and outcome evaluations will be conducted to assess the implementation process and to determine whether the new platform has increased AME detection and reporting. RESULTS: This project, initiated in 2023, will run until 2026. Phase 1 will result in persona profiles and user journey maps that define the standards for the user-friendly platform and interactive data visualization tool or dashboard that will be developed and further improved in phase 2. Finally, phase 3 will provide insights of the implemented platform regarding its impact on AME detection, management, and reporting. Findings will be published progressively as we complete the different phases of the project. CONCLUSIONS: This project adopts a co-design methodology to develop a new digital reporting platform for AME detection and reporting, considering the perspectives and lived experience of stakeholders and addressing their requirements throughout the entire process. The overarching goal of the project is to leverage the potential of both consumers and technology to address the existing challenges of underdetection and underreporting of AMEs to health care professionals and regulators. The project potentially will improve individual patient safety and generate new data for regulatory purposes related to medicine safety and effectiveness. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/60084.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.130
metaresearch head score (Gemma)0.138
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Protocol · Consensus signal: Protocol
Teacher disagreement score0.130
Threshold uncertainty score0.688

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.1300.138
Meta-epidemiology (narrow)0.0030.003
Meta-epidemiology (broad)0.0030.005
Bibliometrics0.0050.004
Science and technology studies0.0070.005
Scholarly communication0.0060.005
Open science0.0040.007
Research integrity0.0080.007
Insufficient payload (model declined to judge)0.0680.017

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.782
GPT teacher head0.743
Teacher spread0.039 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designNot applicable
Domainnot available
GenreProtocol

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations2
Published2024
Admission routes1
Has abstractyes

Explore more

Same venueJMIR Research ProtocolsSame topicPharmacovigilance and Adverse Drug ReactionsFrench-language works237,207