MétaCan
Menu
← Back to cohort

Abstract B003: Towards machine learning fairness in glioblastoma: An evaluation of protected attributes in publicly available clinical datasets

2025· article· en· W4412163723 on OpenAlexaboutno aff
Shreya Chappidi, Andra Krauze

Bibliographic record

VenueClinical Cancer Research · 2025
Typearticle
Languageen
FieldMedicine
TopicRadiomics and Machine Learning in Medical Imaging
Canadian institutionsnot available
Fundersnot available
KeywordsGlioblastomaComputer scienceMedicineArtificial intelligenceCancer research

Abstract

fetched live from OpenAlex

Abstract Introduction: As machine learning (ML) algorithms are increasingly developed for clinical applications, there are growing concerns over the real-world benefits of ML-assisted decision-making applications. These issues include reduced generalizability across medical institutions, lack of clinician uptake during algorithmic deployment, and observed disparate performances across various demographics, including race, gender, and socioeconomic status. Glioblastoma (GBM) is a rare brain cancer with poor outcomes and few publicly available datasets, resulting in limited opportunities for algorithmic validation and fairness evaluation. As ML research calls for improved fairness assessments and improved cross-institutional validation, we set out to characterize publicly available GBM datasets and explore fairness evaluations enabled by the protected attribute clinical data available and/or missing in these datasets. Methods: We identified and assessed 16 publicly available glioma and/or GBM clinical datasets (with non-overlapping patient cohorts) for protected attribute availability and potential issues inhibiting ML fairness methods. We also investigated patient treatment timelines and longitudinal sample pairing to assess dataset shift, cross-institutional variability, and ability to assess disease recurrence. Results and Discussion: Datasets contained an average of 343 patients (range 26-1480), with imaging (n=12) and genomic (n=11) data most commonly included, followed by histopathology (n=6) and transcriptomic (n=4) data. Treatment timelines were reported for 8 datasets, with patient treatment data spanning an average of of 9.9 years (range 2-24). Age and sex/gender variables were available across 88% of datasets (n=14), with self-reported race (56%, n=9) and ethnicity (38%, n=6) attributes less commonly available. Three datasets reported patients from multiple countries and only one dataset reported patient insurance type, indicating challenges in evaluating cross-regional generalizability and performance across socioeconomic status. Datasets with limited racial/ethnic information may result in "fairness through unawareness" evaluation approaches, which have demonstrated disparate impacts on protected groups in other ML domains. Given documented sex differences in GBM and "negative legacy" issues amongst sampling minoritized racial/ethnic groups, our results demonstrate barriers towards applying current ML bias mitigation methods. Conclusion: With increased calls for ML projects to publish and validate their algorithms on publicly available datasets, we indicate gaps between current fairness methodologies and the clinical data attribute landscape of publicly available GBM clinical data. Our results discuss how current fairness methodologies can be applied to existing datasets or may be limited by attribute availability. As clinical algorithms are increasingly developed for GBM applications, we advocate for further enrichment of publicly available datasets with socioeconomic, regional, and genetic ancestry data for improved fairness assessment. Citation Format: Shreya Chappidi, Andra V. Krauze. Towards machine learning fairness in glioblastoma: An evaluation of protected attributes in publicly available clinical datasets [abstract]. In: Proceedings of the AACR Special Conference in Cancer Research: Artificial Intelligence and Machine Learning; 2025 Jul 10-12; Montreal, QC, Canada. Philadelphia (PA): AACR; Clin Cancer Res 2025;31(13_Suppl):Abstract nr B003.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.070
metaresearch head score (Gemma)0.160
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Methods · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.930
Threshold uncertainty score0.370

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0700.160
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0010.002
Bibliometrics0.0020.002
Science and technology studies0.0020.002
Scholarly communication0.0040.003
Open science0.0020.004
Research integrity0.0020.002
Insufficient payload (model declined to judge)0.0030.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.271
GPT teacher head0.565
Teacher spread0.293 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designObservational
DomainMethods
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2025
Admission routes1
Has abstractyes

Explore more

Same venueClinical Cancer Research→Same topicRadiomics and Machine Learning in Medical Imaging→French-language works237,207→