A systematic review of information in decision aids
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
OBJECTIVE: We completed a systematic review of information reported as included in decision aids (DAs) for adult patients, to determine if it is complete, balanced and accurate. SEARCH STRATEGY: DAs were identified using the Cochrane Database of DAs and searches of four electronic databases using the terms: 'decision aid'; shared decision making' and 'patients'; 'multimedia or leaflets or pamphlets or videos and patients and decision making'. Additionally, publications reporting DA development and actual DAs that were reported as publicly available on the Internet were consulted. Publications were included up to May 2006. DATA EXTRACTION: Data were extracted on the following variables: external groups consulted in development of the DA, type of study used, categories of information, inclusion of probabilities, use of citation lists and inclusion of patient experiences. MAIN RESULTS: 68 treatment DAs and 30 screening DAs were identified. 17% of treatment DAs and 47% of screening DAs did not report any external consultation and, of those that did, DA producers tended to rely more heavily on medical experts than on patients' guidance. Content evaluations showed that (i) treatment DAs frequently omit describing the procedure(s) involved in treatment options and (ii) screening DAs frequently focus on false positives but not false negatives. About 1/2 treatment DAs reported probabilities with a greater emphasis on potential benefits than harms. Similarly, screening DAs were more likely to provide false-positive than false-negative rates. CONCLUSIONS: The review led us to be concerned about completeness, balance and accuracy of information included in DAs.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.005 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.004 | 0.000 |
| Bibliometrics | 0.001 | 0.002 |
| Science and technology studies | 0.001 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it