Improving computerized decision support system interventions: a qualitative study combining the theoretical domains framework with the GUIDES Checklist
Bibliographic record
Abstract
BACKGROUND: Computerized clinical decision support systems (CDSSs) can improve care by bridging knowledge to practice gaps. However, the real-world uptake of such systems in health care settings has been suboptimal. We sought to: (1) use the Theoretical Domains Framework (TDF) to identify determinants (barriers/enablers) of uptake of the Electronic Asthma Management System (eAMS) CDSS; (2) match identified TDF belief statements to elements in the Guideline Implementation with Decision Support (GUIDES) Checklist; and (3) explore the relationship between the TDF and GUIDES frameworks and the usefulness of this sequential approach for identifying opportunities to improve CDSS uptake. METHODS: In Phase 1, we conducted semistructured interviews with primary care physicians in Toronto, Canada regarding the uptake of the eAMS CDSS. Using content analysis, two coders independently analyzed interview transcripts guided by the TDF to generate themes representing barriers and enablers to CDSS uptake. In Phase 2, the same reviewers independently mapped each belief statement to a GUIDES domain and factor. We calculated the proportion of TDF belief statements that linked to each GUIDES domain and the proportion of TDF domains that linked to GUIDES factors (and vice-versa) and domains. RESULTS: We interviewed 10 participants before data saturation. In Phase 1, we identified 53 belief statements covering 12 TDF domains; 18 (34.0%) were barriers, and 35 (66.0%) were enablers. In Phase 2, 41 statements (77.4%) linked to at least one GUIDES factor, while 12 (22.6%) did not link to any specific factor. The GUIDES Context Domain was linked to the largest number of belief statements (19/53; 35.8%). Each TDF domain linked to one or more GUIDES factor, with 6 TDF domains linking to more than 1 factor and 8 TDF domains linking to more than 1 GUIDES domain. CONCLUSIONS: The TDF provides unique insights into barriers and enablers to CDSS uptake, which can then be mapped to GUIDES domains and factors to identify required changes to CDSS context, content, and system. This can be followed by conventional mapping of TDF domains to behaviour change techniques to optimize CDSS implementation. This novel step-wise approach combines two established frameworks to optimize CDSS interventions, and requires prospective validation.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.041 | 0.053 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.002 | 0.002 |
| Science and technology studies | 0.008 | 0.008 |
| Scholarly communication | 0.003 | 0.004 |
| Open science | 0.002 | 0.005 |
| Research integrity | 0.002 | 0.003 |
| Insufficient payload (model declined to judge) | 0.003 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".