How Does Diagnostic Accuracy Evolve with Increased Breast MRI Experience?
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
Introduction: Our institution is part of a provincial program providing annual breast MRI screenings to high-risk women. We assessed how MRI experience, background parenchymal enhancement (BPE), and the amount of fibroglandular tissue (FGT) affect the biopsy-proven predictive value (PPV3) and accuracy for detecting suspicious MRI findings. Methods: From all high-risk screening breast MRIs conducted between 1 July 2011 and 30 June 2020, we reviewed all BI-RADS 4/5 observations with pathological tissue diagnoses. Overall and annual PPV3s were computed. Radiologists with fewer than ten observations were excluded from performance analyses. PPV3s were computed for each radiologist. We assessed how MRI experience, BPE, and FGT impacted diagnostic accuracy using logistic regression analyses, defining positive cases as malignancies alone (definition A) or malignant or high-risk lesions (definition B). Findings: There were 536 BI-RADS 4/5 observations with tissue diagnoses, including 77 malignant and 51 high-risk lesions. A total of 516 observations were included in the radiologist performance analyses. The average radiologist’s PPV3 was 16 ± 6% (definition A) and 25 ± 8% (definition B). MRI experience in years correlated significantly with positive cases (definition B, OR = 1.05, p = 0.03), independent of BPE or FGT. Diagnostic accuracy improved exponentially with increased MRI experience (definition B, OR of 1.27 and 1.61 for 5 and 10 years, respectively, p = 0.03 for both). Lower levels of BPE significantly correlated with increased odds of findings being malignant, independent of FGT and MRI experience. Summary: More extensive MRI reading experience improves radiologists’ diagnostic accuracy for high-risk or malignant lesions, even in MRI studies with increased BPE.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.001 | 0.002 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it