Process Evaluation Alongside a Cluster-Randomized Trial of a Multicomponent Intervention Designed to Improve Patient Access to Kidney Transplantation
Bibliographic record
Abstract
Background: In a cluster-randomized trial, we learned that a novel multicomponent intervention designed to improve access to kidney transplantation did not significantly increase the rate of completed steps toward receiving a kidney transplant. Alongside the trial, we conducted a process evaluation to help interpret our findings. Objective: To determine whether the intervention addressed targeted barriers to transplant and whether the implementation occurred as planned. Design: Mixed-methods process evaluation informed by implementation science theories. Setting: Chronic kidney disease (CKD) programs in Ontario, Canada. These programs, providing care to patients with advanced CKD, participated in the trial from November 1, 2017 to December 31, 2021 (either in the intervention or usual care group). Participants: Health care providers (eg, nurses, managers) at Ontario's 27 CKD programs. Methods: We conducted surveys (n = 114/162 [70.4%]) and semi-structured interviews (n = 17/26 [65.4%]) with providers in CKD programs in Ontario, Canada. In both the intervention-group and control-group surveys, using the Theoretical Domains Framework, we assessed perceived barriers to transplant and how barriers changed throughout the trial period. In the intervention-group surveys and interviews, using the normalization process theory, we assessed the extent to which the intervention was embedded into daily routines. In the intervention-group surveys, and by completing an implementation checklist, we assessed fidelity of implementation. Results: Perceived barriers to transplant did not substantially differ between providers in the intervention and usual care groups, and both groups reported disagreeing or feeling neutral that the targeted barriers impeded transplant access. Intervention-group providers reported that intervention activities were becoming a regular part of their work and that they engaged with its components. However, they also felt the intervention was complex and described needing more resources, a better execution plan, and more buy-in from frontline staff. Fidelity was high for administrative support, quality improvement teams, delivery of educational resources, and patient peer support. The use of performance reports was low. Conclusions: We identified several possible reasons why the intervention was unsuccessful. Improving access to kidney transplantation remains a high priority for health care systems. We will continue to foster a quality improvement culture, and our results will guide future interventions. Limitations: Two of the 13 intervention-group CKD programs did not participate in this evaluation. Trial Registration: ClinicalTrials.gov Identifier: NCT03329521.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.088 | 0.106 |
| Meta-epidemiology (narrow) | 0.004 | 0.002 |
| Meta-epidemiology (broad) | 0.004 | 0.004 |
| Bibliometrics | 0.002 | 0.002 |
| Science and technology studies | 0.003 | 0.003 |
| Scholarly communication | 0.002 | 0.003 |
| Open science | 0.002 | 0.003 |
| Research integrity | 0.004 | 0.003 |
| Insufficient payload (model declined to judge) | 0.009 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".