Re-analysis of data from cluster randomised trials to explore the impact of model choice on estimates of odds ratios: study protocol
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
BACKGROUND: There are numerous approaches available to analyse data from cluster randomised trials. These include cluster-level summary methods and individual-level methods accounting for clustering, such as generalised estimating equations and generalised linear mixed models. There has been much methodological work showing that estimates of treatment effects can vary depending on the choice of approach, particularly when estimating odds ratios, essentially because the different approaches target different estimands. METHODS: In this manuscript, we describe the protocol for a planned re-analysis of data from a large number of cluster randomised trials. Our main objective is to examine empirically whether and how odds ratios estimated using different approaches (for both primary and secondary binary outcomes) vary in cluster randomised trials. We describe the methods that will be used to identify the datasets for inclusion and how they will be analysed and reported. DISCUSSION: There have been a number of small comparisons of empirical differences between the different approaches to analysis for CRTs. The systematic approach outlined in this protocol will allow a much deeper understanding of when there are important choices around the model approach and in which settings. This will be of importance given the heightened awareness of the importance of estimands and the specification of statistical analysis plans.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.022 | 0.109 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.003 | 0.001 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it