Design and Prestudy Assessment of a Dashboard for Presenting Self-Collected Health Data of Patients With Diabetes to Clinicians: Iterative Approach and Qualitative Case Study
Bibliographic record
Abstract
BACKGROUND: Introducing self-collected health data from patients with diabetes into consultation can be beneficial for both patients and clinicians. Such an initiative can allow patients to be more proactive in their disease management and clinicians to provide more tailored medical services. Optimally, electronic health record systems (EHRs) should be able to receive self-collected health data in a standard representation of medical data such as Fast Healthcare Interoperability Resources (FHIR), from patients systems like mobile health apps and display the data directly to their users-the clinicians. However, although Norwegian EHRs are working on implementing FHIR, no solution or graphical interface is available today to display self-collected health data. OBJECTIVE: The objective of this study was to design and assess a dashboard for displaying relevant self-collected health data from patients with diabetes to clinicians. METHODS: The design relied on an iterative participatory process involving workshops with patients, clinicians, and researchers to define which information should be available and how it should be displayed. The assessment is based on a case study, presenting an instance of the dashboard populated with data collected from one patient with diabetes type 1 (in-house researcher) face-to-face by 14 clinicians. We performed a qualitative analysis based on usability, functionality, and expectation by using responses to questionnaires that were distributed to the 14 clinicians at the end of the workshops and collected before the participants left. The qualitative assessment was guided by the Standards for Reporting Qualitative Research. RESULTS: We created a dashboard permitting clinicians to assess the reliability of self-collected health data, list all collected data including medical calculations, and highlight medical situations that need to be investigated to improve the situation of the patients. The dashboard uses a combination of tables, graphs, and other visual representations to display the relevant information. Clinicians think that this type of solution will be useful during consultations every day, especially for patients living in remote areas or those who are technologically interested. CONCLUSIONS: Displaying self-collected health data during consultations is not enough for clinicians; the data reliability has to be assured and the relevant information needs to be extracted and displayed along with the data to ease the introduction during a medical encounter. The prestudy assessment showed that the system provides relevant information to meet clinicians' need and that clinicians were eager to start using it during consultations. The system has been under testing in a medical trial since November 2018, and the first results of its assessment in a real-life situation are expected in the beginning of next year (2020).
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.078 | 0.076 |
| Meta-epidemiology (narrow) | 0.002 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.003 | 0.002 |
| Science and technology studies | 0.009 | 0.009 |
| Scholarly communication | 0.006 | 0.005 |
| Open science | 0.005 | 0.010 |
| Research integrity | 0.003 | 0.003 |
| Insufficient payload (model declined to judge) | 0.003 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".