MétaCan
Menu
Back to cohort
Record W4404521810 · doi:10.1371/journal.pone.0296528

Usability of an automated medication dispensation device and adherence dashboard: A study protocol

2024· article· en· W4404521810 on OpenAlexaff
Tejal Patel, Christoph Laeer, Hamed Darabi, Maxime Lachance, Michelle Anawati, Marie‐Hélène Chomienne

Bibliographic record

VenuePLoS ONE · 2024
Typearticle
Languageen
FieldMedicine
TopicMedication Adherence and Compliance
Canadian institutionsUniversity of OttawaUniversity of TorontoInstitut du Savoir MontfortCentre for Family MedicineInstitute of AgingResearch Institute for AgingUniversity of Waterloo
Fundersnot available
KeywordsUsabilityDashboardWorkloadSystem usability scaleMedicineCognitive walkthroughProtocol (science)Computer scienceMedical emergencyHuman–computer interactionHeuristic evaluationData science

Abstract

fetched live from OpenAlex

Non-adherence to prescribed medication regimens can lead to suboptimal control of chronic health conditions and increased hospitalizations. Older adults may find it particularly challenging to self-manage medications due to physical and cognitive limitations, resulting in medication non-adherence. While automated medication dispensing technologies may offer a solution for medication self-management among older adults, these technologies must demonstrate usability before effectiveness can be investigated and products made available for widespread use. This study will aim to measure usability, workload, and unassisted task completion rates of an automated medication dispenser and medication adherence dashboard on the Medipense portal with older adults and their clinicians, respectively. This study is designed as a convergent parallel mixed-methods observational study with older adults and their clinicians. Usability will be examined with the use of the System Usability Scale (SUS) while NASA Load Index (NASA-TLX) will be utilized to assess the workload of both the device and the adherence monitoring platform. Cognitive walkthrough will be utilized prior to usability testing to identify series of steps required to use the automated dispenser and adherence dashboard. The study will assess the unassisted task completion rates to successfully operate the device. Semi-structured interviews with both types of participants will provide qualitative data with which to comprehensively gauge the automated dispenser user experience. The results of this study will allow us to examine usability of both the automated medication dispensing system and the adherence monitoring dashboard from older adult and health-care provider perspectives. The results of this study will highlight and address the challenges with usability that older adults and health-care providers may face with this device and dashboard. The results of this study will be used to optimize the usability of both the automated medication dispenser and the adherence dashboard. In clinical practice, usability of technology is important to establish prior to full-scale implementation. Products that are not user friendly, add to workload, impact workflow, or are difficult to navigate by both clinicians and population in general may not be adopted. Usability permits an evaluation of the products, to identify problems that must be addressed prior to implementation and to ensure products are useful in clinical practice.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.045
metaresearch head score (Gemma)0.027
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Protocol · Consensus signal: Protocol
Teacher disagreement score0.045
Threshold uncertainty score0.239

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0450.027
Meta-epidemiology (narrow)0.0030.004
Meta-epidemiology (broad)0.0050.004
Bibliometrics0.0030.002
Science and technology studies0.0050.003
Scholarly communication0.0030.003
Open science0.0040.003
Research integrity0.0060.007
Insufficient payload (model declined to judge)0.0370.010

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.122
GPT teacher head0.400
Teacher spread0.277 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designNot applicable
Domainnot available
GenreProtocol

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations4
Published2024
Admission routes1
Has abstractyes

Explore more

Same venuePLoS ONESame topicMedication Adherence and ComplianceFrench-language works237,207