Spinal Adverse Events Severity System, version 2 (SAVES-V2): inter- and intraobserver reliability assessment
Bibliographic record
Abstract
OBJECTIVE Reporting of adverse events (AEs) in spinal surgery uses inconsistent definitions and severity grading, making it difficult to compare results between studies. The Spinal Adverse Events Severity System, version 2 (SAVES-V2) aims to standardize the classification of spine surgery AEs; however, its inter- and intraobserver reliability are unknown. The objective of this study was to assess inter- and intraobserver reliability of the SAVES-V2 grading system for assessing AEs in spinal surgery. METHODS Two multinational, multicenter surgical study groups assessed surgical case vignettes (10 trauma and 12 degenerative cases) for AE occurrence by using SAVES-V2. Thirty-four members of the Spine Trauma Study Group (STSG) and 17 members of the Degenerative Spine Study Group (DSSG) participated in the first round of case vignettes. Six months later, the same case vignettes were randomly reorganized and presented in an otherwise identical manner. Inter- and intraobserver agreement on the presence, severity, number, and type of AE, as well as the impact of the AE on length of stay (LOS) were assessed using intraclass correlation (ICC), Cohen's kappa value, and the percentage of participants in agreement. RESULTS Agreement on the presence of AEs ranged from 97% to 100% in the 2 groups. Severity classification showed substantial interobserver (ICC = 0.75 for both groups) and intraobserver (ICC = 0.70 in DSSG, 0.71 in STSG) agreement. Judgments on the number of AEs showed high interobserver agreement and moderate intraobserver agreement in both groups. Both the STSG and DSSG had high intraobserver agreement on the type of AE; interobserver agreement for AE type was high in the STSG and fair in the DSSG. Agreement on impact of the AE on LOS was excellent in the DSSG and fair in the STSG. CONCLUSIONS There was good agreement on the presence, severity, and number of AEs in both trauma and degenerative cases in using the SAVES-V2. This grading system is a simple, reliable tool for identifying and capturing AEs in spinal surgery.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".