Opinion: The optimal use of risk factors to guide palivizumab prophylaxis against severe respiratory syncytial virus infection in moderate-to-late preterm infants
Bibliographic record
Abstract
Respiratory syncytial virus (RSV) is the predominant viral pathogen associated with lower respiratory tract infection (LRTI) in young children (<5 years), causing 3.6 million hospitalizations (RSVHs) and 101,400 deaths annually worldwide (1). Moderate-to-late preterm infants (32 to 35 weeks' gestational age; wGA) are recognized to be at greater risk of severe RSV-LRTI (2,3) and, for many countries, passive immunoprophylaxis with palivizumab remains the only preventive therapy available (4). To target palivizumab prophylaxis cost-effectively at moderate-to-late preterm infants who are at highest risk for serious RSV infection, several Risk Scoring Tools (RSTs) and predictive models have been developed incorporating social, demographic and environmental factors that determine risk for RSVH (5,6,7,8,9,10,11,12). Whilst there are several risk factors common to these RSTs and models, the number and definition of these variables and how they are scored to classify an infant's RSVH risk can vary considerably (Table 1). This leads to the question of what are the key risk factors that predict RSVH in moderate-to-late preterm infants and whether there is a preferred country-specific RST to endorse. Herein, we summarize the key attributes of an ideal RST and make the case for widespread adoption of the International RST (IRST) (5).The majority of published RSTs and predictive models have been developed from large, prospective, observational studies specifically designed to identify risk factors for RSVH in moderate-to-late preterm infants ( 15)), all of which have been used to develop country-specific RSTs (Table 1) (6,7,8,9,10). The IRST was developed using pooled data from the PICNIC, RISK and FLIP-2 studies as well as evidence from Italy (Italian Birth Cohort [n=2,210] ( 16)), the USA (REPORT [n=1,642] ( 17)), and an international study involving 23 countries predominantly from Europe but also having representation from Asia, the Middle East and Latin America (PONI [n=2,390] ( 11)) (5). In total, the dataset underpinning the IRST included risk factor data on 13,475 infants of which 484 (3.6%) had a confirmed RSVH (5). This raises the important point that any RST for predicting RSVH risk should be derived from data on moderate-to-late preterm infants with confirmed RSV infection (either through antigen or PCR testing) and should not be based on a clinical diagnosis of suspected RSV bronchiolitis. Developing an RST or predictive model using cases of presumptive RSV infection undermines the validity of an infant's predicted risk for RSVH and the overall rationale of the RST for guiding RSV prophylaxis. In addition, this strongly implies that the data used to develop the RST should exclude subjects who received RSV prophylaxis, as this would pollute the categorization of infants with and without RSVH. For the IRST, only studies where ≤15% of infants received RSV prophylaxis were included in the pooled dataset and all such recipients were excluded from analysis (5).There are several risk factors that have been significantly associated with an increased risk of RSVH in moderate-to-late preterm infants that can be selected for inclusion within an RST. In the eight RSTs/predictive models summarized in Table 1, a total of 15 distinct risk factors were used. The most common risk factor, present in all eight RSTs/predictive models, is age relative to the RSV season, which is perhaps unsurprising as it is well recognized that RSVH risk increases with decreasing chronological age. Two further risk factors, present in seven RSTs/predictive models, relate to crowding and viral spread, specifically: presence of siblings and attendance at daycare. The next most frequently included risk factors are smoking (during pregnancy and/or in the household), lack of breastfeeding, and familial atopy, all of which are part of four RSTs/predictive models.The number of risk factors that comprise the eight RSTs/predictive models ranges from three to eight, with the most predictive one, developed from the Spanish FLIP study (SFRST; 14), incorporating seven variables (6). Despite the high predictive accuracy of this RST (area under the receiver operating characteristic curve [AUROC] 0.791 (6)), it could be argued that assessing seven risk factors for a child is somewhat unwieldy, particularly when four of them are continuous (parametric) rather than simple dichotomous or categorical variables and one (breast feeding) cannot be explicitly verified. It is for this reason that the IRST was intentionally developed to include as few as possible categorical risk factors -winnowing 18 variables down to three (relating to age, smoking and siblings/daycare) -whilst maintaining a high level of predictive accuracy (AUROC 0.773) (5).A critical decision for any RST is the cut-off level or score for identifying high-risk infants, apart from categorizing those who are at low-and moderate-risk for RSVH. For the SINLAZIO score, this was accomplished by assigning high-risk to any infant with ≥3 of the eight included risk factors (12). Infants with ≥3 risk factors were found to have a 2.2 greater risk of non-specific viral bronchiolitis than those with <3 risk factors (11). For the IRST and Dutch RST (DRST; RISK-I/II), the low-risk group was set at a RSVH rate of 1%, with the moderate-and high-risk groups dichotomized by plotting the RSVH rate against the risk score and selecting a point of natural inflection (5,10). The Canadian RST (CRST) used a slightly different approach by identifying the point of highest accuracy for differentiating two populations -the low-and combined moderate-and high-risk categories -and then defining the high-risk group after review of scoring frequency (8). The average RSVH rate in the high-risk category was approximately twice as high with the CRST than the IRST (18.7% vs 9.5%, respectively), with the DRST being intermediate between the two RSTs (13%) (5,8,10).These varied approaches to defining cut-off scores have implications for the proportion of infants classified in the moderate-and high-risk groups who would ultimately be eligible for palivizumab prophylaxis. The proportion of the respective populations assigned highrisk was 11% with the DRST (10), 23.6% with the IRST (5), and 41.6% with the SINLAZIO score (12). This proportion was not reported for the CRST. However, a subsequent report comparing the CRST and IRST with a standardized population established that while a similar percentage of infants were categorized as high-risk (0.6% vs 0.7%, respectively), a far larger proportion of infants were classified as moderate-risk by the IRST (19.9% vs 9.8% by the CRST) (18). A further prospective study from Canada recently documented that 4.9% of infants were scored as high-risk, based on the IRST (19). These latter results highlight that the proportion of infants assigned to a risk category varies depending on the study design, the population being tested specifically for RSV and therefore the importance of validation exercises.In compliance with best practice, a RST should be robustly validated prior to adoption in order to lend credence to the underlying predictive model. The IRST, SFRST, DRST and Dutch-RISK RST were all internally validated using a bootstrapping approach wherein 100-1,000 copies of the source dataset were created using sampling with replacement and the average predictive accuracy (with dispersion) calculated across these datasets (Table 1; 5,6,9,10). For all four RSTs, bootstrapping confirmed the models were internally consistent and not overly optimistic (i.e. there was little or no over-fitting) (5,6,9,10). For the IRST, the mean AUROC from bootstrapping was identical to that derived from the original source data (both 0.773) (5).The true test of an RST is validation against an external database or population. The SINLAZIO score was assessed using retrospective data on Italian moderate-to-late preterm infants with (20% RSV+) and without bronchiolitis (12). The SFRST was validated against several databases of moderate-to-late preterm infants with and without confirmed RSVH, including those from Germany (6), Italy (20), France (21), and Demark (22); supporting its applicability in European populations. The DRST was originally derived from the RISK study (which was informed by the SFRST (6)) and then prospectively validated and updated by the RISK-II study (9,10); thus, demonstrating its applicability to the Dutch population. As for the CRST, this was first validated against the Spanish FLIP study before being tested prospectively in routine clinical practice in Canada (8,23). In the prospective validation, 78 (18.1% of 430) infants at moderate-and high-risk, as scored by the CRST, received palivizumab and the RSVH rate was low at 1.6% (23). This strongly supported the utility of the CRST in Canadian infant population. The IRST was first validated against the RSV Preterm Risk Estimation Measure for RSVH in Ireland (PREMI) study (5,24) before further validations were undertaken using Brazilian (25) and Colombian (26) data. Taking into consideration that the IRST was developed using data from six studies (including the multinational PONI study (11) that included data from 23 countries) the subsequent validations strongly establish its universal reproducibility and generalizability to new and different ethnic populations.Ultimately, whether an RST is worthwhile deploying in a country is dependent on its ability to guide palivizumab prophylaxis cost-effectively (versus no prophylaxis). The CRST, DRST and FLIP-2 model have all been assessed in cost-utility analyses for their respective countries, with risk factor-guided prophylaxis proving cost-effective in Canada (27,28,29) and Spain (30), but not the Netherlands (31). Perhaps unsurprisingly, RST-guided palivizumab prophylaxis was recommended in Spain (32) and certain provinces of Canada (33,34), but not the Netherlands (35).The IRST has been found to guide palivizumab prophylaxis cost-effectively in several continents and economies, including North America (Canada ( 29)), Europe (Italy (36)), Latin America (Columbia (37)) and Asia (South Korea ( 38)), and its use is recommended in International Consensus guidelines (39). A salient difference between the FLIP-2, CRST and IRST economic studies and the Dutch report is that the former modelled respiratory morbidity for 6-18 years, whereas the latter used a 1-year time horizon (27,28,29,30). It is now well-established that respiratory morbidity can persist throughout childhood (40,41) and has been reported to be a key driver of palivizumab cost-effectiveness (29,36). It would be interesting to investigate whether DRST-guided palivizumab prophylaxis achieves cost-effectiveness in the Netherlands healthcare system if respiratory morbidity was modelled for 6 years or longer.The IRST and CRST were both assessed in the Canadian healthcare system using the same cost-utility model and, while palivizumab was found highly cost-effective using both RSTs, the incremental cost-utility ratio (ICUR) was lower in the latter (CAN$29,789 vs CAN$15,833, respectively) (29). This might lead one to conclude that the CRST should be the preferred option for use in Canada. However, the IRST can be considered simpler (3 risk factors vs 7 for the CRST) and, importantly, covers more potential RSVHs (85% vs 54%) (18,29).We strongly believe that moderate-to-late preterm infants should be protected from both the shorter-and longer-term burdens of RSV infection. RSTs provide an evidenced-based approach for cost-effectively guiding palivizumab prophylaxis towards moderate-to-late preterm infants who are most at-risk for RSVH. When considering the various attributes of the published RSTs and predictive models, the IRST combines simplicity with a high level of predictive accuracy for RSVH and its cost-effectiveness has been well-demonstrated in multiple countries and economies. For those countries with no or limited use of palivizumab in moderate-to-late preterm infants, adoption of the IRST can support reimbursement following local validation and ensure, with a well-established degree of precision, that the most vulnerable of these infants receive prophylaxis.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.002 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.002 | 0.003 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".