Usability Testing and Adaptation of the Pediatric Cardiovascular Risk Reduction Clinical Decision Support Tool
Bibliographic record
Abstract
BACKGROUND: Cardiovascular disease (CVD) is 1 of the leading causes of death, years of life lost, and disability-adjusted years of life lost worldwide. CVD prevention for children and teens is needed, as CVD risk factors and behaviors beginning in youth contribute to CVD development. In 2012, the National Heart, Lung, and Blood Institute released their "Integrated Guidelines for Cardiovascular Health and Risk Reduction in Children and Adolescents" for clinicians, describing CVD risk factors they should address with patients at primary care preventative visits. However, uptake of new guidelines is slow. Clinical decision support (CDS) tools can improve guideline uptake. In this paper, we describe our process of testing and adapting a CDS tool to help clinicians evaluate patient risk, recommend behaviors to prevent development of risk, and complete complex calculations to determine appropriate interventions as recommended by the guidelines, using a user-centered design approach. OBJECTIVE: The objective of the study was to assess the usability of a pediatric CVD risk factor tool by clinicians. METHODS: The tool was tested using one-on-one in-person testing and a "think aloud" approach with 5 clinicians and by using the tool in clinical practice along with formal usability metrics with 14 pediatricians. Thematic analysis of the data from the in-person testing and clinical practice testing identified suggestions for change in 3 major areas: user experience, content refinement, and technical deployment. Descriptive statistical techniques were employed to summarize users' overall experience with the tool. RESULTS: Data from testers showed that general reactions toward the CDS tool were positive. Clinical practice testers suggested revisions to make the application more user-friendly, especially for clinicians using the application on the iPhone, and called for refining recommendations to be more succinct and better tailored to the patient. Tester feedback was incorporated into the design when feasible, including streamlining data entry during clinical visits, reducing the volume of results displayed, and highlighting critical results. CONCLUSIONS: This study found support for the usability of our pediatric CVD risk factor tool. Insights shared about this tool may be applicable for designing other mHealth applications and CDS tools. The usability of decision support tools in clinical practice depends critically on receiving (ie, through an accessible device) and adapting the tool to meet the needs of clinicians in the practice setting.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.006 | 0.005 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.001 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".