User-Oriented Requirements for Artificial Intelligence–Based Clinical Decision Support Systems in Sepsis: Protocol for a Multimethod Research Project
Bibliographic record
Abstract
BACKGROUND: Artificial intelligence (AI)-based clinical decision support systems (CDSS) have been developed for several diseases. However, despite the potential to improve the quality of care and thereby positively impact patient-relevant outcomes, the majority of AI-based CDSS have not been adopted in standard care. Possible reasons for this include barriers in the implementation and a nonuser-oriented development approach, resulting in reduced user acceptance. OBJECTIVE: This research project has 2 objectives. First, problems and corresponding solutions that hinder or support the development and implementation of AI-based CDSS are identified. Second, the research project aims to increase user acceptance by creating a user-oriented requirement profile, using the example of sepsis. METHODS: The research project is based on a multimethod approach combining (1) a scoping review, (2) focus groups with physicians and professional caregivers, and (3) semistructured interviews with relevant stakeholders. The research modules mentioned provide the basis for the development of a (4) survey, including a discrete choice experiment (DCE) with physicians. A minimum of 6667 physicians with expertise in the clinical picture of sepsis are contacted for this purpose. The survey is followed by the development of a requirement profile for AI-based CDSS and the derivation of policy recommendations for action, which are evaluated in a (5) expert roundtable discussion. RESULTS: The multimethod research project started in November 2022. It provides an overview of the barriers and corresponding solutions related to the development and implementation of AI-based CDSS. Using sepsis as an example, a user-oriented requirement profile for AI-based CDSS is developed. The scoping review has been concluded and the qualitative modules have been subjected to analysis. The start of the survey, including the DCE, was at the end of July 2024. CONCLUSIONS: The results of the research project represent the first attempt to create a comprehensive user-oriented requirement profile for the development of sepsis-specific AI-based CDSS. In addition, general recommendations are derived, in order to reduce barriers in the development and implementation of AI-based CDSS. The findings of this research project have the potential to facilitate the integration of AI-based CDSS into standard care in the long term. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/62704.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.160 | 0.128 |
| Meta-epidemiology (narrow) | 0.003 | 0.003 |
| Meta-epidemiology (broad) | 0.004 | 0.007 |
| Bibliometrics | 0.006 | 0.006 |
| Science and technology studies | 0.007 | 0.004 |
| Scholarly communication | 0.006 | 0.004 |
| Open science | 0.004 | 0.008 |
| Research integrity | 0.008 | 0.006 |
| Insufficient payload (model declined to judge) | 0.039 | 0.008 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".