Surrogate endpoints for neonatal outcome: A rapid review
Bibliographic record
Abstract
Recent research has highlighted the increasing use of surrogate endpoints in interventional trials.1 The United States Food and Drug Administration (US FDA) defines a surrogate endpoint, or an “intermediate clinical endpoint,” as: “…a marker, such as a laboratory measurement, radiographic image, physical sign, or another measure, that is not itself a direct measurement of clinical benefit, and—(A) is known to predict clinical benefit and could be used to support traditional approval of a drug or biological product; or (B) is reasonably likely to predict clinical benefit and could be used to support the accelerated approval of a drug or biological product under section 506(c).”2 Among the “Table of Surrogate Endpoints” provided by FDA, preterm birth (PTB) is listed as a surrogate endpoint to accelerate the approval of investigational therapies for spontaneous PTB (sPTB).3 Time to sPTB from the onset of spontaneous preterm labor (sPTL) is a surrogate endpoint that may also be reasonably likely to predict neonatal morbidity/mortality. Currently, there are no FDA-approved therapies for reducing the risk of neonatal morbidity/mortality resulting from sPTB. To understand the potential for predicting neonatal outcomes in future studies, a rapid review was conducted to synthesize the quantitative evidence on the strength of surrogacy for PTB and time to delivery from sPTL diagnosis to sPTB. The Cochrane rapid review guidance4 was used to identify systematic literature reviews (SLRs), randomized controlled trials (RCTs) and observational cohort studies in Ovid MEDLINE, the Cochrane Central Register of Controlled Trials, and the Cochrane Database of Systematic Reviews. Searches were executed on February 16, 2023, and used predefined Population, Intervention, Comparators, Outcomes, Study design criteria (Appendix Table A1). Searches were restricted to English language and to articles published between 2002 and 2023. Searches for RCTs were restricted to those conducted in North America, while searches for SLRs were expanded to include any geographic region. Additional searches for observational studies conducted in North America or Europe and published between 2018 and 2023 were conducted. These latter search restrictions were applied to reflect studies following up on the retosiban program, now terminated.5, 6 This was the only late phase development program in the US known to have conducted observational studies published in the last 5 years, which were relevant to the research question; as such, observational studies sponsored by GlaxoSmithKline were eligible for consideration. Supplemental hand searches of reference lists, publicly available FDA documents, and the American College of Obstetricians and Gynecologists websites were conducted. The population of interest included individuals with a singleton and uncomplicated pregnancy, with/without a history of singleton sPTB, and reported delivery at <37 weeks' gestational age, or, reported time to delivery from sPTL diagnosis to sPTB. Interventions included preventative agent(s) for the prolongation of pregnancy; or treatment of sPTL. Outcomes included short-term neonatal outcomes (defined as the time from PTB to 28 days beyond the expected due date at 40 weeks' gestational age) including morbidity and mortality (as defined by the literature). Studies were included if either one or both surrogate endpoints of interest and, simultaneously, any one or more clinically meaningful neonatal outcomes (i.e., neonatal morbidity/mortality) were reported. For this rapid review, strength of surrogacy was defined as any empirical measures of association between the surrogate endpoints of interest and clinically meaningful outcomes of interest (morbidity, mortality); empirical measures of interest included coefficients derived from correlational analyses or using regression techniques. One reviewer screened and extracted data; a second reviewer independently verified ≥ 10% of all screenings and extractions. Strength of surrogacy was determined based on a quantitative assessment of the correlation or predictive capability between each surrogate endpoint of interest and neonatal morbidity/mortality. Risk of bias was assessed using the second version of the Cochrane risk-of-bias tool for RCTs, the adapted Newcastle-Ottawa scale for observational studies, and the second version of the Assessing the Methodological Quality of Systematic Reviews tool for SLRs. Thirty-one articles (one observational study,7 one pooled analysis of trial data,8 four RCTs,9-12 and 25 SLRs13-37) were included (Appendix Figure A1). Study periods within the identified RCTs ranged from 1999 through 2021; within the identified SLRs, they ranged from 1957 through 2017; from 2003 to 2011 for the pooled analysis of trial data8; and from 2000 to 2011 for the observational study.7 Interventions in the four RCTs9-12 included two trials9, 10 for 17-hydroxyprogesterone caproate (17-OHPC), one for progesterone gel,11 and one for vaginal progesterone compared to intramuscular 17-OHPC.12 Across the included studies, the most commonly reported neonatal morbidity outcomes were respiratory distress syndrome, necrotizing enterocolitis, bronchopulmonary dysplasia, and intraventricular hemorrhage. Neonatal mortality outcomes included perinatal loss, early infant death (defined as death after birth until 28 days of life occurring in live-born neonates delivered < 240/7 weeks' gestation), and neonatal death (defined as death < 28 days). Among the RCTs included (Figure 1)9-12 results were inconsistent and no strength of surrogacy assessment was conducted; three RCTs9-11 had low risk of bias and one RCT12 had a high risk of bias. The pooled analysis study8 compared vaginal progesterone to other procedural interventions such as cervical pessary and cerclage in three separate trials, each evaluating different treatment protocols. This study8 reported no significant differences in sPTB at <37 weeks' gestational age, neonatal morbidity, or perinatal loss; magnitudes of association were inconsistent, and considerable variability was evident for the neonatal outcomes reported. One observational study,7 rated “good quality,” illustrated lower frequency of neonatal morbidity/mortality events as weeks' gestational age at birth increased; a strength of surrogacy assessment was not conducted. Among the 25 SLRs13-37 included (Figure 2), 21 were systematic reviews of RCTs, two28, 34 included RCTs and observational studies, and two23, 27 included only observational cohort studies23 or case-control studies.27 Most SLRs assessed progesterone-based interventions, but some summarized the evidence on the use of other treatments or procedures such as tocolytic drugs,20, 34-36 cervical pessary,27, 38 cervical cerclage,28, 37 corticosteroids,23 hormones,13 and others (e.g., omega 3 fatty acids,14 probiotics,24 and ethanol25). Among the 25 SLRs13-37 included, most SLRs assessed progesterone-based interventions,16-19, 26, 29-33, 37 followed by treatments or procedures such as tocolytic drugs, cervical pessary, cervical cerclage, corticosteroids, hormones, and other agents (e.g., omega 3 fatty acids, probiotics etc.). Like the results from the RCTs in this review, the conclusions of the SLRs were inconsistent and absent any strength of surrogacy assessment; 80% of the SLRs included had low or critically low quality (Figure 2). The absence of a direct quantitative assessment, defined as any empirical measure of association between the surrogate endpoints of interest and neonatal morbidity/mortality, among the studies in this rapid literature review, which spanned the last 20 years, precludes the ability to draw conclusions on the strength of surrogacy. Such information, if available, would facilitate a deeper understanding by which these surrogate endpoints can reasonably predict neonatal morbidity/mortality. Reporting guidelines for surrogate endpoints are under development, which could improve transparency in the reporting of such endpoints, especially for clinical trials, thus facilitating the interpretation of future trial results.39, 40 Although a rapid review approach was undertaken which may have resulted in some studies or other relevant data being missed by design, this review highlights the need for empirical evidence to better support the use of these surrogate measures particularly given their role as key efficacy endpoints in investigational studies assessing therapeutic intervention for the prevention of sPTB. Shiraz El Adam: Writing—original draft; methodology; validation; visualization; writing—review and editing; project administration; supervision. Karissa Johnston: Methodology; writing—review and editing; supervision. Maanasa Venkataraman: Methodology; validation; visualization; writing—review and editing. Vanessa Perez Patel: Conceptualization; investigation; methodology; writing—review & editing; supervision. The authors would like to acknowledge Dr. Damien J. Croft, MD, (Organon, Jersey City, NJ, USA) for providing medical input during the conduct of the rapid review. This study was funded by Organon. The authors were solely responsible for the final content of the manuscript and decision to submit for publication. Shiraz El Adam, Karissa Johnston, and Maanasa Venkataraman are employees of Broadstreet HEOR and received consultancy fees from Organon. Vanessa Perez Patel is an employee of Organon. The authors had full access to all studies included in this rapid review. VPP affirms that this manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study have been explained. As only previously published data was included in this study, ethics approval was not required. Reported delivery at <37 weeks' gestational age Or Reported time to delivery from sPTL diagnosis to sPTB Preventative agent(s) for the prolongation of pregnancy; or Treatment of sPTL; or No intervention Presence of morbidity (defined by the literature) Severity of morbidity (defined by the literature) Neonatal death Phase 2 and/or Phase 3 clinical trials Databases: MEDLINE and CENTRAL Publication dates: 2002-2023 Region: North America (US, Canada) Observational cohort studies (prospective or retrospective) Databases: MEDLINE Publication dates: 2018-2023 Region: North America (US, Canada), Europe Reviews (systematic, scoping, and rapid reviews), and meta-analyses Databases: MEDLINE and CDSR Publication dates: unrestricted Region: unrestricted Languages included: English Data sharing is not applicable to this article as no data sets were generated or analyzed during the current study.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.005 | 0.001 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.003 | 0.001 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".