InformedTogether: Usability Evaluation of a Web-Based Decision Aid to Facilitate Shared Advance Care Planning for Severe Chronic Obstructive Pulmonary Disease
Bibliographic record
Abstract
BACKGROUND: Advance care planning may help patients receive treatments that better align with their goals for care. We developed a Web-based decision aid called InformedTogether to facilitate shared advance care planning between chronic obstructive pulmonary disease (COPD) patients and their doctors. OBJECTIVE: Our objective was to assess the usability of the InformedTogether decision aid, including whether users could interact with the decision aid to engage in tasks required for shared decision making, whether users found the decision aid acceptable, and implications for redesign. METHODS: We conducted an observational study with 15 patients and 8 doctors at two ethnically and socioeconomically diverse outpatient clinics. Data included quantitative and qualitative observations of patients and doctors using the decision aid on tablet or laptop computers and data from semistructured interviews. Patients were shown the decision aid by a researcher acting as the doctor. Pulmonary doctors were observed using the decision aid independently and asked to think aloud (ie, verbalize their thoughts). A thematic analysis was implemented to explore key issues related to decision aid usability. RESULTS: Although patients and doctors found InformedTogether acceptable and would recommend that doctors use the decision aid with COPD patients, many patients had difficulty understanding the icon arrays that were used to communicate estimated prognoses and could not articulate the definitions of the two treatment choices-Full Code and Do Not Resuscitate (DNR). Minor usability problems regarding content, links, layout, and consistency were also identified and corresponding recommendations were outlined. In particular, participants suggested including more information about potential changes in quality of life resulting from the alternative advance directives. Some doctor participants thought the decision aid was too long and some thought it may cause nervousness among patients due to the topic area. CONCLUSIONS: A decision aid for shared advance care planning for severe COPD was found acceptable to most COPD patients and their doctors. However, many patient participants did not demonstrate understanding of the treatment options or prognostic estimates. Many participants endorsed the use of the decision aid between doctors and their patients with COPD, although they desired more information about quality of life. The design must optimize comprehensibility, including revising the presentation of statistical information in the icon array, and feasibility of integration into clinical workflow, including shortening the decision aid.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.003 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.001 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".