External Validation of O-RADS US Risk Stratification and Management System
Bibliographic record
Abstract
Background The Ovarian-Adnexal Reporting and Data System (O-RADS) US risk stratification and management system (O-RADS US) was designed to improve risk assessment and management of ovarian and adnexal lesions. Validation studies including both surgical and nonsurgical treatment as the reference standard remain lacking. Purpose To externally validate O-RADS US in women who underwent either surgical or nonsurgical treatment and to determine if incorporating acoustic shadowing as a benign finding improves diagnostic performance. Materials and Methods This retrospective study included consecutive women who underwent pelvic US between August 2015 and April 2017 at a tertiary referral oncology center. Two independent readers blinded to clinical and histologic outcome assigned an O-RADS risk category and an International Ovarian Tumor Analysis (IOTA) Assessment of Different NEoplasias in the adneXa (ADNEX) model risk of malignancy score to assessable lesions. Reference standards were surgical histopathology or 2-year imaging follow-up. Receiver operating characteristic (ROC) curve analysis was used to evaluate performance of the O-RADS US, ADNEX, and modified O-RADS models incorporating acoustic shadowing. Results In total, 227 women (mean age, 52 years ± 16 [SD]) with 262 ovarian or adnexal lesions were evaluated. Of these lesions, 187 (71%) were benign and 75 (29%) were malignant. The proportion of malignancy was 0% (0 of 100) for O-RADS 2, 3% (one of 32) for O-RADS 3, 35% (22 of 63) for O-RADS 4, and 78% (52 of 67) for O-RADS 5. The area under the ROC curve (AUC) for O-RADS and ADNEX was 0.91 (95% CI: 0.88, 0.94) and 0.95 (95% CI: 0.92, 0.97; P = .01), respectively. The addition of acoustic shadowing as a benign finding improved O-RADS AUC to 0.94 (95% CI: 0.91, 0.96; P = .01). Use of O-RADS 4 as a threshold yielded a sensitivity of 99% (74 of 75; 95% CI: 96, 100) and a specificity of 70% (131 of 187; 95% CI: 64, 77). Conclusion In a tertiary referral oncology center, the Ovarian-Adnexal Reporting and Data System US risk stratification and management system enabled accurate distinction of benign from malignant ovarian and adnexal lesions. Adding acoustic shadowing as a benign finding improved its diagnostic performance. © RSNA, 2022 See also the editorial by Levine in this issue.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".