MétaCan
Menu
← Back to cohort
Record W4389234861 · doi:10.1182/blood-2023-175079

Identification of Risk Categories from the Advanced-Stage Hodgkin International Prognostic Index (A-HIPI) Model: A Detailed Analysis from the Hodgkin Lymphoma International Study for Individual Care (HoLISTIC) Consortium

2023· article· en· W4389234861 on OpenAlexaff
Matthew J. Maurer, Susan K. Parsons, Jenica Upshaw, Jonathan W. Friedberg, Andrea Gallamini, Massimo Federico, Eliza A. Hawkes, David Hodgson, Peter Johnson, Brian K. Link, Kerry J. Savage, Pier Luigi Zinzani, Andrew M. Evens

Bibliographic record

VenueBlood · 2023
Typearticle
Languageen
FieldMedicine
TopicLymphoma Diagnosis and Treatment
Canadian institutionsBC Cancer Agency
Fundersnot available
KeywordsMedicineInternational Prognostic IndexClinical trialInternal medicineOncologyStage (stratigraphy)LymphomaMedical physicsDiffuse large B-cell lymphoma

Abstract

fetched live from OpenAlex

Background: Prognostic modeling allows personalized risk prediction for individual patients (pt). The A-HIPI model in advanced stage classical Hodgkin lymphoma (AS-HL), developed and validated by the HoLISTIC Consortium (www.hodgkinconsortium.org), generates the individualized probability of a progression-free survival (PFS) event or death (OS) within the first 5 years (y) from diagnosis in pts based on continuous variables (www.qxmd.com/calculate/calculator_869/a-hipi). Clinical prognostic tools in lymphoma (eg, IPS, IPI, FLIPI, etc) typically use groupings of categorical values to define risk. Grouping a continuous value often results in loss of information, and most tools are not predictive for individual pts. However, discrete groupings have clinical utility & practicality for a) defining pt populations for clinical trials & real world studies, b) stratification within clinical trials, and c) crafting treatment guidelines. We studied potential approaches for utilizing the A-HIPI model to generate risk groups with input on strengths & limitations from the HoLISTIC modeling team & clinical experts. Methods: The A-HIPI model was developed via TRIPOD guidelines on 4,022 pts treated on 8 international clinical trials for AS-HL (Rodday. JCO 2023). External validation was performed on a dataset of 1,431 pts from 4 prospective registries. The 5y PFS (PFS5) in the A-HIPI development dataset was 77% (95% CI: 76-78); the 5y OS (OS5) was 92% (95% CI: 91-93). This represented the average outcome for a pt with AS-HL pt naïve to other clinical data at presentation. The distribution of PFS5 & OS5 predictions were heavily skewed (ie, asymmetric distribution) in both the A-HIPI discovery and validation dataset. While not unexpected due to the excellent PFS & OS in this disease setting, this presents challenges in the delineation of risk groups as depicted below . Three approaches were examined for the generation of A-HIPI risk groups. Proposed cutoffs were defined using the distribution of A-HIPI risk scores and data from the model-building cohort (ie, clinical trials). Validation was done using the A-HIPI validation cohort (ie, HL registries). Results: Approach 1: Risk groups based on clinical thresholds. Clinicians were queried what estimates of PFS5 would constitute high vs low risk. The positive, right-skewed distribution of A-HIPI risk scores limited this approach ( Figure), as cutoffs of PFS5 <70 and PFS5> 90 would only identify 15% and <1% of the population, respectively. Approach 2: Risk groups based on deviation from “average” pt. The 5-y PFS was 77% (95% CI: 76-78). We explored defining “standard risk” based on this confidence interval as well as clinical boundaries, with pts above or below this classified as decreased or increased risk, respectively. Results of a +/-5% clinical boundary are presented in the Table. Approach 3: Risk groups based on “ranking” of pts. Here we ranked the A-HIPI risk scores of the 4022 AS-HL pts in the model building cohort and used the distribution of the risk scores as a benchmark. The risk profile for a future pt is then compared to this distribution (eg, how do you rank compared to your peers). Continuous results are often presented this way (eg, tertiles or quartiles). It also allows flexibility for the user to define the size of the risk groups and/or clinical threshold of interest. Application of this approach showed good alignment between the predicted model percentiles and the observed distribution of scores in the validation cohort ( Table). This is also reflected in calibration curves presented in the primary manuscript. An online application (eg, R-Shiny) will be provided at the meeting to allow users to define their own cutoffs to aid in pt prognostication as well as identify populations for clinical trial development. Conclusions: There are challenges with defining risk groups from individual risk prediction modeling in AS-HL. Different applications and purposes, the skewed distribution of events/risk estimates, as well as varying clinical definitions of high risk, make it challenging to define consensus expert-based risk groupings for AS-HL. A flexible “rank-based” approach appeared to provide the most clinical utility & data granularity, which may be leveraged for clinical trial design and pt stratification. Further analysis and discussion of how to optimally define high-risk and low-risk populations in AS-HL will be needed as new therapeutic options emerge.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.006
metaresearch head score (Gemma)0.014
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.013
Threshold uncertainty score0.033

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0060.014
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0010.002
Bibliometrics0.0010.001
Science and technology studies0.0000.000
Scholarly communication0.0010.000
Open science0.0010.001
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0040.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.030
GPT teacher head0.308
Teacher spread0.279 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations1
Published2023
Admission routes1
Has abstractyes

Explore more

Same venueBlood→Same topicLymphoma Diagnosis and Treatment→French-language works237,207→