Real-World Variability in the Prediction of Intracranial Aneurysm Wall Shear Stress: The 2015 International Aneurysm CFD Challenge
Bibliographic record
Abstract
PURPOSE: Image-based computational fluid dynamics (CFD) is widely used to predict intracranial aneurysm wall shear stress (WSS), particularly with the goal of improving rupture risk assessment. Nevertheless, concern has been expressed over the variability of predicted WSS and inconsistent associations with rupture. Previous challenges, and studies from individual groups, have focused on individual aspects of the image-based CFD pipeline. The aim of this Challenge was to quantify the total variability of the whole pipeline. METHODS: 3D rotational angiography image volumes of five middle cerebral artery aneurysms were provided to participants, who were free to choose their segmentation methods, boundary conditions, and CFD solver and settings. Participants were asked to fill out a questionnaire about their solution strategies and experience with aneurysm CFD, and provide surface distributions of WSS magnitude, from which we objectively derived a variety of hemodynamic parameters. RESULTS: A total of 28 datasets were submitted, from 26 teams with varying levels of self-assessed experience. Wide variability of segmentations, CFD model extents, and inflow rates resulted in interquartile ranges of sac average WSS up to 56%, which reduced to < 30% after normalizing by parent artery WSS. Sac-maximum WSS and low shear area were more variable, while rank-ordering of cases by low or high shear showed only modest consensus among teams. Experience was not a significant predictor of variability. CONCLUSIONS: Wide variability exists in the prediction of intracranial aneurysm WSS. While segmentation and CFD solver techniques may be difficult to standardize across groups, our findings suggest that some of the variability in image-based CFD could be reduced by establishing guidelines for model extents, inflow rates, and blood properties, and by encouraging the reporting of normalized hemodynamic parameters.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".