Multicenter Validation of a Personalized Model to Predict Hypomethylating Agent Response in Myelodysplastic Syndromes (MDS)
Bibliographic record
Abstract
Background While hypomethylating agents (HMAs) can improve cytopenias and even survival for MDS patients (pts), only 30-40% of pts respond to HMAs. Predicting response or resistance to therapy can improve pt outcomes, decrease cost and toxicities, and suggest alternative therapies when response is unlikely. No clinical or molecular model can reliability predict response or resistance to HMAs. We developed and validated a model to provide personalized predictions of response or resistance to HMAs during 12 weeks of treatment by monitoring changes in blood counts during therapy. Methods MDS pts treated with HMAs (azacitidine or decitabine) at Cleveland Clinic (314 pts) and the Moffit Cancer Center (100) and had their CBCs with differential monitored every 1-2 weeks in the first 12 weeks of therapy compromised the training cohort. The final model was externally validated in 80 MDS pts treated with HMAs at Sunnybrook hospital. Responses were defined per 2006 IWG criteria and pts with complete response (CR), marrow CR, partial response (PR), or hematologic improvement (HI) were considered responders. Time series analysis (analysis of serial changes in blood count parameters) using machine learning technology was used to develop the model, analogous to voice recognition algorithms such as Apple's Siri and Alexa, in which the sequence of words allows these algorithms to understand sentences. Changes in blood counts and monitoring the patterns of these changes during HMA therapy similarly can predict response/resistance to treatment. The area under the curve (AUC) was used to evaluate the performance of the final model. A feature importance algorithm was used to define the variables that most impacted the algorithm's decision for a given pt. Results For 494 included pts from all cohorts, the median age was 72 years (range: 40-94), 145 (29%) were female. Pts' IPSS-R scores at the time of treatment were: very low 4%; low 21%; intermediate 24%; high 21%; and very high 22%. Responses included: 56 (11%) complete remission (CR), 17 (3%) marrow CR, 6 (3%) partial remission (PR), and 143 (29%) hematologic improvement (HI). When trained exclusively on serial CBC values (adding other clinical or molecular values did not improve the model's performance), the model achieved an AUC of 0.82 in a cross-validated train/test schema and a similar AUC of 0.78 when it was applied to the Sunnybrook cohort. Feature importance algorithms identified improvements in hemoglobin from baseline between days 21-30 of therapy, improvement in platelets between days 51 and 60, changes in monocyte % between days 41 and 50, and changes in MCV and RDW between days 31 and 60 as predictors of response, Figure 1a. The model also can provide a personalized heatmap that summarizes the variables that impacted the response or resistance to HMAs and are specific for a given pt, Figure 1b, 1c. Conclusions We developed and externally validated a personalized prediction model that uses changes in blood counts during the initial 3 cycles of HMA therapy and can predict response or resistance to treatment with high accuracy. The model can provide personalized explanations of the variables that inform a given outcome. It can be used to develop novel clinical trial designs in which pts who are predicted not to respond within 3 cycles of HMA therapy can receive an investigational agent in addition to continuing HMA or change treatment entirely, whereas patients who are predicted to respond continue to receive HMA monotherapy. Disclosures Sallman: Agios, Bristol Myers Squibb, Celyad Oncology, Incyte, Intellia Therapeutics, Kite Pharma, Novartis, Syndax: Consultancy; Celgene, Jazz Pharma: Research Funding. Buckstein:Celgene: Research Funding; Takeda: Research Funding; Celgene: Honoraria; Astex: Honoraria; Novartis: Honoraria. Brunner:Forty Seven, Inc: Consultancy; Biogen: Consultancy; Acceleron Pharma Inc.: Consultancy; Jazz Pharma: Consultancy; Novartis: Consultancy, Research Funding; Takeda: Consultancy, Research Funding; Xcenda: Consultancy; GSK: Research Funding; Janssen: Research Funding; Astra Zeneca: Research Funding; Celgene/BMS: Consultancy, Research Funding. Mukherjee:Celgene/Acceleron: Membership on an entity's Board of Directors or advisory committees; Aplastic Anemia and MDS International Foundation: Honoraria; Celgene: Consultancy, Honoraria, Research Funding; Bristol Myers Squib: Honoraria; Partnership for Health Analytic Research, LLC (PHAR, LLC): Honoraria; Novartis: Consultancy, Membership on an entity's Board of Directors or advisory committees, Research Funding; EUSA Pharma: Consultancy. Komrokji:Abbvie: Honoraria; Agios: Speakers Bureau; BMS: Honoraria, Speakers Bureau; Jazz: Honoraria, Speakers Bureau; Incyte: Honoraria; Acceleron: Honoraria; Geron: Honoraria; Novartis: Honoraria. Maciejewski:Novartis, Roche: Consultancy, Honoraria; Alexion, BMS: Speakers Bureau. Sekeres:BMS: Consultancy; Pfizer: Consultancy; Takeda/Millenium: Consultancy. Nazha:Jazz: Research Funding; Incyte: Speakers Bureau; Novartis: Speakers Bureau; MEI: Other: Data monitoring Committee.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.008 | 0.006 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.001 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.001 | 0.000 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".