Exploring Electronic Medical Record and Self-Administered Medication Risk Screening Tools in a Primary Care Clinic
Bibliographic record
Abstract
BACKGROUND: Electronic medical record (EMR) screening for indicators of medication risk could improve efficiency in identifying primary care clinic patients in need of clinical pharmacist care compared with patient self-reporting. OBJECTIVES: To (a) compare the performance of an EMR medication risk assessment questionnaire (MRAQ) with a self-administered (SA) MRAQ and (b) explore each tool's ability to predict indicators of health behavior, health status, and health care utilization. METHODS: A prospective cohort study was conducted with 143 adults who attended an academic family medicine center and were taking ≥ 2 medications. All participants completed the 10-item SA-MRAQ, Morisky Medication Adherence Scale, Chew's health literacy screener, Stanford Health Distress Scale, and SF-36 overall rating of health. A blinded investigator completed the EMR-MRAQ and a chart review to ascertain 6 months of health care utilization. Outcome measures included the following: (a) scores from the 5- and 10-item SA-MRAQs and 5-item EMR-MRAQ; (b) sensitivity and specificity to determine the accuracy of the 5-item EMR versus the 5-item SA risk scores; (c) correlations between risk assessments and health behavior/status scales; and (d) area under the receiver operator curve to determine how well a high-risk score predicted health care utilization. RESULTS: The 5-item SA-MRAQ, the 5-item EMR-MRAQ, and the 10-item SA-MRAQ categorized 52.9% (55/104), 69.2% (99/143), and 17.6% (18/102) of participants as high risk, respectively. For the 104 participants who completed both 5-item MRAQ tools, the EMR-MRAQ had a sensitivity of 81.8% and specificity of 49.0% in detecting a high-risk SA-MRAQ score. Both 5-item risk assessments showed weak correlations with health distress and overall health, while the 10-item SA-MRAQ additionally showed weak correlations with medication adherence. The EMR-MRAQ was most effective in predicting all-cause emergency room visits/hospitalization (c-statistic = 0.69; 95% CI=0.57-0.81) and high clinic utilization (≥ 4 visits per 6 months; c-statistic = 0.77; 95% CI = 0.69-0.85). The EMR-MRAQ had high sensitivities but low specificities for these health care utilization outcomes, respectively (82.6% and 33.3%; 88.9% and 42.7%). CONCLUSIONS: This pilot study suggests that EMR-MRAQ screening has high sensitivity but low specificity in comparison with self-reporting and was able to discriminate between those who would and would not experience health care utilization outcomes. These results justify further development and validation of an automated EMR-based tool to predict patient-important consequences of medication-related problems. DISCLOSURES: This work was funded by the Canadian Society of Hospital Pharmacists Research and Education Foundation, which had no role in the analysis or interpretation of data or the decision to submit the manuscript for publication. The authors have no conflict of interests, potential or otherwise, to report. Makowsky had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design were contributed by Makowsky and Cor. Makowsky and Wong collected the data, and data interpretation was performed by Makowsky, Cor, and Wong. The manuscript was written by Makowsky and was critically reviewed for intellectual content by Makowsky, Cor, and Wong.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.007 | 0.002 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.002 | 0.000 |
| Scholarly communication | 0.000 | 0.001 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.000 | 0.005 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".