Paper 76: Utilization of Validated Outcome Scores in Evaluating Treatment of Osteochondral Lesions: A Comparison of Ankle Versus Knee Literature
Bibliographic record
Abstract
Objectives: Osteochondral lesions (OCLs) are commonly seen in the ankle and knee joints, and present difficult challenges for treatment. Evaluating the effectiveness of a treatment is dependent on how well constructed, content specific, reliable, and responsive the outcome measures used are. Currently, a considerable variety of outcome scores are used to assess the treatment effect of OCLs. The purpose of this study was to compare the frequency of validated outcome scores utilized in the ankle versus knee literature. Methods: A computerized search of multiple electronic databases was performed for all clinical studies from 2011 to 2020 assessing treatment outcome of ankle and knee OCLs. Eligible studies were independently screened by two reviewers. Outcome scores used in each eligible study were recorded and the overall frequency calculated. Correlation coefficients were used to determine if there was an association between use of validated outcome score with journal impact factor, publication year, or study level of evidence. Results: A total of 75 eligible ankle OCL studies were identified, with 27 different outcome scores utilized. The most frequently used scores were the American Orthopaedic Foot and Ankle Society (AOFAS) Clinical Rating Systems (47.7%), Visual Analog Scale (VAS) (34.4%), and Foot and Ankle Outcome Score (FAOS) (6.3%). Validated outcome scores were used in only 14.7% of all ankle OCL studies. There was no correlation between the use of validated outcome scores and journal impact factor (p=0.72), publication year (p=0.45), or level of evidence (p=0.66). A total of 239 eligible knee OCL studies were identified, with 34 different outcome scores utilized. The most frequently used scores were the International Knee Documentation Committee subjective knee forms (IKDC) (33.2%), Knee injury and Osteoarthritis Outcome Score (KOOS) (19.8%), and Tegner Activity Scale (TAS) (17.1%). Validated outcome scores were utilized in 87.4% of all knee OCL studies, compared to 14.7% in ankle OCL studies (p<0.001). There was no correlation between the use of validated outcome scores and journal impact factor (p=0.19), publication year (p=0.58), or level of evidence (p=0.62). Conclusions: Validated outcome scores were more frequently utilized in knee OCL studies compared to ankle OCL studies. Nearly half the ankle OCL studies utilized the AOFAS score despite the score not being shown to be valid or reliable. The extremely low frequency of validated scores used within the ankle literature may limit how well treatment effectiveness in ankle OCLs is appropriately evaluated.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.088 | 0.312 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.004 | 0.007 |
| Bibliometrics | 0.054 | 0.045 |
| Science and technology studies | 0.001 | 0.002 |
| Scholarly communication | 0.006 | 0.006 |
| Open science | 0.002 | 0.003 |
| Research integrity | 0.002 | 0.001 |
| Insufficient payload (model declined to judge) | 0.006 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".