Cochrane in CORR®: Strategies to Improve Recruitment to Randomised Trials
Bibliographic record
Abstract
Importance of the Topic Although an essential part of conducting a clinical trial, recruiting patients is challenging, time consuming, and requires planning and expertise. Trials that recruit slowly take longer to complete and therefore cost more money, leading to inefficiencies in funding and frustration for funders and investigators. Beyond cost and time issues, poor trial recruitment can lead to stopping early for feasibility reasons, leading to underpowered trials. Underpowered trials are a major source of research waste, which has been described as “unethical conduct” and a “moral issue” [3] because patients are exposed to potentially harmful interventions for little scientific benefit, and public research funds are used improperly. Framing the concept of insufficient sample size as a moral issue may sound extreme or unfair given that well-intentioned investigators sometimes encounter unanticipated problems, however, the principle that prospective trials should take steps to ensure adequate recruitment is fundamentally correct both for scientific and social reasons. The Cochrane review by Treweek and colleagues [9] aims to identify the effective methods for improving trial recruitment in randomized trials. An update to two earlier Cochrane systematic reviews, this review contains 68 studies (totaling more than 74,000 patients) of which some were real trials, and some were hypothetical trials in which patients were asked whether they would participate if the trial was real [9]. The authors placed more emphasis on the real trials where possible because patients’ answers in the hypothetical situations may be different from real situations. The authors considered 72 interventions that sought to improve recruitment in randomized trials. Of those, high-quality evidence from more than one study allowed them to draw only three conclusions: (1) Open rather than blinded, placebo controlled trials increased recruitment by a modest amount (about 10%), (2) using telephone reminders increased recruitment in trials that otherwise had low (< 10%) recruitment, but the size of this effect was small (a 6% increase), and (3) creating customized patient-information leaflets made little or no difference in recruitment. The authors’ conclusions provide very little information on which to change practice, despite there being 68 included studies. Upon Closer Inspection Although the Cochrane review does not address this issue, an issue closely related to trial recruitment is trial retention (also known as followup). Loss to followup affects trials in a similar way to ineffective recruitment; it leads to loss of power and/or increased time and cost [6, 10]. There have been two studies [6, 8] in orthopaedics of which we are aware that demonstrated comprehensive strategies to minimize loss to followup by using a combination of targeted and general strategies. Examples of general strategies include designing trials such that followup aligns with standard clinical visits, selecting outcomes that could be obtained over the phone or in person, and compensating participating sites based on the proportion of patients who are accounted for at latest followup. Targeted strategies for patients at high risk of being lost to followup include collecting multiple pieces of contact information, searching local phone books, obituaries, and death registries, and prioritizing outcome measures if patients feel overburdened by questionnaires [6, 8]. It is possible that very few useful conclusions could be drawn from the available literature because a multi-faceted intervention is required. Therefore, if more studies are conducted on trial recruitment in the future, they should evaluate more-comprehensive sets of methods to maximize recruitment. For example, a multifaceted intervention could include an open design with several reminder methods, recruitment that does not require special visits, and develop targeted strategies for patients at risk of not being recruited. Take-home Messages Some of the included studies were from surgical disciplines [1, 7], but only one was specific to orthopaedics (a vitamin D trial) [2]. The Cochrane review finding that open trials recruit better than blinded trials is of particular interest for surgical trials. Surgical trials often face challenges regarding blinding to a much-greater degree than do medical and drug trials. Surgeons often cannot be blinded, and even blinding patients can be a challenge when they see their radiographs or surgical incisions. One way to minimize the risk of bias associated with blinding in surgical trials, even when blinding patients and surgeons is impossible, is to blind other members of the study team, particularly outcome assessors and data analysts [5]. Additionally, trial investigators can prepare blinded interpretation documents to minimize the risk of interpretation bias [4]. Surgeons can use this finding to methodologically justify not blinding patients in trials where it is impossible to do so.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.381 | 0.798 |
| Meta-epidemiology (narrow) | 0.006 | 0.010 |
| Meta-epidemiology (broad) | 0.011 | 0.012 |
| Bibliometrics | 0.046 | 0.037 |
| Science and technology studies | 0.003 | 0.006 |
| Scholarly communication | 0.018 | 0.024 |
| Open science | 0.011 | 0.027 |
| Research integrity | 0.019 | 0.015 |
| Insufficient payload (model declined to judge) | 0.174 | 0.078 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".