Naturalistic study of guideline implementation tool use via evaluation of website access and physician survey
Bibliographic record
Abstract
BACKGROUND: Clinical guidelines support decision-making at the point-of-care but the onus is often on individual users such as physicians to implement them. Research shows that the inclusion of implementation tools in or with guidelines (GItools) is associated with guideline use. However, there is little research on which GItools best support implementation by individual physicians. The purpose of this study was to investigate naturalistic access and use of GItools produced by the American Academy of Neurology (AAN) to inform future tool development. METHODS: Website accesses over six months were summarized for eight AAN guidelines and associated GItools published between July 2012 and August 2013. Academy members were surveyed about use of tools accompanying the sport concussion guideline. Data were analyzed using summary statistics and the Chi-square test. RESULTS: The clinician summary was accessed more frequently (29.0%, p < 0.001) compared with the slide presentation (26.8%), patient summary (23.2%) or case study (20.9%), although this varied by guideline topic. For the sport concussion guideline, which was accompanied by a greater variety of GItools, the mobile phone quick reference check application was most frequently accessed, followed by the clinician summary, patient summary, and slide presentation. For the sports concussion guideline survey, most respondents (response rate 21.8%, 168/797) were aware of the guideline (88.1%) and had read the guideline (78.6%). For GItool use, respondents indicated reading the reference card (51.2%), clinician summary (45.2%), patient summary (28.0%), mobile phone application (26.2%), and coach/athletic trainer summary (20.2%). Patterns of sports concussion GItool use were similar between respondents who said they had and had not yet implemented the guideline. CONCLUSIONS: Developers faced with resource limitations may wish to prioritize the development of printable or mobile application clinician summaries, which were accessed significantly more than other types of GItools. Further research is needed to understand how to optimize the design of such GItools.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.032 | 0.135 |
| Meta-epidemiology (narrow) | 0.000 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.002 | 0.001 |
| Science and technology studies | 0.002 | 0.002 |
| Scholarly communication | 0.002 | 0.002 |
| Open science | 0.001 | 0.002 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.001 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".