Identification of Risk Categories from the Advanced-Stage Hodgkin International Prognostic Index (A-HIPI) Model: A Detailed Analysis from the Hodgkin Lymphoma International Study for Individual Care (HoLISTIC) Consortium
Bibliographic record
Abstract
Background: Prognostic modeling allows personalized risk prediction for individual patients (pt). The A-HIPI model in advanced stage classical Hodgkin lymphoma (AS-HL), developed and validated by the HoLISTIC Consortium (www.hodgkinconsortium.org), generates the individualized probability of a progression-free survival (PFS) event or death (OS) within the first 5 years (y) from diagnosis in pts based on continuous variables (www.qxmd.com/calculate/calculator_869/a-hipi). Clinical prognostic tools in lymphoma (eg, IPS, IPI, FLIPI, etc) typically use groupings of categorical values to define risk. Grouping a continuous value often results in loss of information, and most tools are not predictive for individual pts. However, discrete groupings have clinical utility & practicality for a) defining pt populations for clinical trials & real world studies, b) stratification within clinical trials, and c) crafting treatment guidelines. We studied potential approaches for utilizing the A-HIPI model to generate risk groups with input on strengths & limitations from the HoLISTIC modeling team & clinical experts. Methods: The A-HIPI model was developed via TRIPOD guidelines on 4,022 pts treated on 8 international clinical trials for AS-HL (Rodday. JCO 2023). External validation was performed on a dataset of 1,431 pts from 4 prospective registries. The 5y PFS (PFS5) in the A-HIPI development dataset was 77% (95% CI: 76-78); the 5y OS (OS5) was 92% (95% CI: 91-93). This represented the average outcome for a pt with AS-HL pt naïve to other clinical data at presentation. The distribution of PFS5 & OS5 predictions were heavily skewed (ie, asymmetric distribution) in both the A-HIPI discovery and validation dataset. While not unexpected due to the excellent PFS & OS in this disease setting, this presents challenges in the delineation of risk groups as depicted below . Three approaches were examined for the generation of A-HIPI risk groups. Proposed cutoffs were defined using the distribution of A-HIPI risk scores and data from the model-building cohort (ie, clinical trials). Validation was done using the A-HIPI validation cohort (ie, HL registries). Results: Approach 1: Risk groups based on clinical thresholds. Clinicians were queried what estimates of PFS5 would constitute high vs low risk. The positive, right-skewed distribution of A-HIPI risk scores limited this approach ( Figure), as cutoffs of PFS5 <70 and PFS5> 90 would only identify 15% and <1% of the population, respectively. Approach 2: Risk groups based on deviation from “average” pt. The 5-y PFS was 77% (95% CI: 76-78). We explored defining “standard risk” based on this confidence interval as well as clinical boundaries, with pts above or below this classified as decreased or increased risk, respectively. Results of a +/-5% clinical boundary are presented in the Table. Approach 3: Risk groups based on “ranking” of pts. Here we ranked the A-HIPI risk scores of the 4022 AS-HL pts in the model building cohort and used the distribution of the risk scores as a benchmark. The risk profile for a future pt is then compared to this distribution (eg, how do you rank compared to your peers). Continuous results are often presented this way (eg, tertiles or quartiles). It also allows flexibility for the user to define the size of the risk groups and/or clinical threshold of interest. Application of this approach showed good alignment between the predicted model percentiles and the observed distribution of scores in the validation cohort ( Table). This is also reflected in calibration curves presented in the primary manuscript. An online application (eg, R-Shiny) will be provided at the meeting to allow users to define their own cutoffs to aid in pt prognostication as well as identify populations for clinical trial development. Conclusions: There are challenges with defining risk groups from individual risk prediction modeling in AS-HL. Different applications and purposes, the skewed distribution of events/risk estimates, as well as varying clinical definitions of high risk, make it challenging to define consensus expert-based risk groupings for AS-HL. A flexible “rank-based” approach appeared to provide the most clinical utility & data granularity, which may be leveraged for clinical trial design and pt stratification. Further analysis and discussion of how to optimally define high-risk and low-risk populations in AS-HL will be needed as new therapeutic options emerge.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.006 | 0.014 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.002 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.001 | 0.000 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.004 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".