Performance of statistical methods to address treatment non-adherence in pragmatic clinical trials with point-treatment settings: a simulation study
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
Introduction: The instrumental variable (IV)-based methods (e.g., two-stage least square [2SLS], two-stage residual inclusion [2SRI], and nonparametric causal bound [NPCB]) can be used to address non-adherence in pragmatic trials. These methods require assumptions, e.g., exclusion restriction, although they are known to handle unmeasured confounding. The inverse probability-weighted per-protocol [IPW-PP] method is useful in the same setting but requires different assumptions (no unmeasured confounding). Although all these methods aim to address the same problem, comprehensive simulations to compare their performance are absent in the literature. We performed extensive simulations when (1) confounding is present, (2) confounder is unmeasured but exclusion restriction is met, (3) exclusion restriction is violated, and (4) non-adherence is one-sided and differential.
 Method: We compared the performance in terms of bias, standard error (SE), mean squared error (MSE), and 95% confidence interval coverage probability.
 Results: For setting-1, IPW-PP outperforms IV-methods in terms of bias, SE, MSE, and coverage for <80% non-adherence but produces high bias beyond that point. IPW-PP also has high biases, but 2SLS and 2SRI work well for setting-2. For setting-3, 2SLS and 2SRI perform the worst in all scenarios; IPW-PP produces unbiased estimates when necessary confounders are measured and adjusted. For setting-4, IPW-PP has less bias, but 2SLS and 2SRI have higher SE and MSE. NPCB has wider bounds in all scenarios. We also analyze a two-arm trial to estimate the effect of vitamin A supplementation on childhood mortality after addressing non-adherence.
 Conclusion: We need to be cautious using the IPW-PP when non-adherence is very high or strong unmeasured confounding and should avoid using the IV methods when the exclusion restriction assumption is violated or high differential non-adherence. Since assumptions are different and often untestable for IPW-PP and IV methods, we suggest analyzing data using both methods for a robust conclusion.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.010 | 0.003 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it