Value-based Healthcare: Can Artificial Intelligence Provide Value in Orthopaedic Surgery?
Bibliographic record
Abstract
Artificial intelligence (AI), broadly defined as a “branch of computer science that simulates intelligent behavior in computers” [9], has expanded into the healthcare sector with the promise of enhanced predictive, diagnostic, and decision-making capabilities [11]. The accelerating allure of AI in health care has been fueled by growing datasets, algorithmic innovation, storage capacity, and the steep rise in affordable computational power [11]. But can AI-related applications provide value in orthopaedic surgery? Famed physicist, author, and cosmologist Stephen Hawking stated that AI will either be the best or worst thing to happen to humanity [3]. While we may be a long way off from a Hollywood-styled “rise of the machines,” focusing our AI efforts on value may help us to transform orthopaedic health care. We believe value-oriented AI-related applications in orthopaedics might best focus on three domains: (1) Advanced data discovery and extraction, (2) improved diagnostics and prediction, and (3) enhanced clinical and decision support. Data Discovery and Extraction Deep-learning predictive models use advanced algorithms and multi-layered artificial neural networks to recognize, learn, and improve upon patterns and correlations from massive datasets [1]. Each successive layer builds upon the output from the previous layer, and this multi-layered structure allows for powerful conclusions based on unstructured data. The complex mapping of individual linguistic elements and idiomatic phrases for natural language processing tools used for physician dictation is one example. These “neural network” models can also take raw, unorganized data from electronic health records (EHRs) and stratify patients by risk potential, or predict adverse events such as in-hospital mortality, sepsis, multi-organ failure, unplanned readmissions, or prolonged length of stay [13]. While these applications offer clinical benefits in terms of forecasting the risk of adverse events for acutely ill and surgical patients, future studies should examine whether AI can project pain, function, and health-related quality of life based on deep learning from big clinical data. Operational factors like clinical work flow, resource utilization, and costs of integrating such systems into electronic health platforms may also serve as fodder for examining the use of AI for data discovery. Diagnostics and Prediction When applied to digital-imaging data, machine and deep-learning AI approaches have demonstrated improved image acquisition and disease detection compared to conventional imaging for detecting long-bone and fragility fractures, differentiating between benign and malignant bone tumors, determining prognosis for patients with cancer [16], determining the risk of death after arthroplasty [2], and mapping disease progression for developmental dysplasia of the hip, or degenerative disease of the spine and lower extremities [1]. While many of these applications are still experimental [15], the growing evidence base for their technical and clinical efficacy suggests we are approaching a tipping point for more widespread implementation. Future studies should examine how these solutions can move the needle on process-level metrics such as minutes required for analysis and detection rate. These studies should also evaluate the impact on patient-focused outcomes and cost-effectiveness, with special consideration given to upfront costs and care delivery implications like clinical workflows and workforce utilization. Clinical Decision Support Clinicians and patients can use AI to engage in shared decision-making [14]. Clinicians can apply patient-reported outcomes (PROs), paired with demographic and clinical data, to machine-learning algorithms, which then provide patient-specific risk-benefit ratios for, as an example, the likelihood of achieving benefit following arthroplasty surgery [7, 14]. We have also seen machine-learning data applied to shared decision-making in knee osteoarthritis, ACL deficiency, and complex degenerative spinal disease [1]. Still, prospective, randomized studies will be needed to assess the impact of these advanced decision aids on decision quality, patient experience, patient limitations, and episode of care costs. AI-enabled systems are also enhancing procedural efficiency in the operating room by guiding surgical teams through orthopaedic procedures. Although these functions have the potential to reduce variation on the operating table, they may simultaneously put clinical acumen and relationship-building opportunities in jeopardy with an inherent focus on numbers rather than the individual patient [8]. For example, AI in telehealth for virtual consultations and remote diagnostic support provides clear benefits for managing patients remotely (supporting earlier discharge home), but it also decreases human contact; this may at times be detrimental given that face-to-face interaction between patient and provider offers a valuable chance to pick up nuanced verbal and non-verbal cues [5]. Ethical, Legal, Policy, and Practice Considerations A broad set of ethical, legal, policy, and practice-related aspects of AI implementation must be considered if we are to truly gauge whether this technology will deliver greater value to orthopaedic patients. Ethical Issues There are several ethical challenges to the use of AI during surgical procedures that should be identified and mitigated given the variable levels of risk to patient privacy and confidentiality, consent, and patient autonomy. For instance, how should we consent patients when performing AI-enabled robotic-assisted orthopaedic procedures? We believe that surgeons should disclose exactly how the procedure will be done, emphasizing differential risk profile potentially associated with an AI-assisted operation. There are still some unknowns associated with the potential for robots to autonomously adapt and alter the course of a procedure [10]. The current regulatory frameworks and ethical guidelines appear to be falling behind the pace of technological progress in health care [12, 17]. Market approval on devices based on predictive analytic solutions and AI rests on developing the requisite regulatory framework for integrating these tools into clinical practice. Parikh and colleagues [12] recently recommended that predictive analytic solutions include meaningful endpoints (those driving changes relevant and beneficial to clinicians and patients), appropriate benchmarks (assuring these are dynamic based on evolving sets of real-world data and performance), and longitudinal audit mechanisms (incorporating post-market surveillance of a solution inherently shifting over time as the algorithm learns) [12]. As they suggest, the true impact for these tools is observed at scale and these sweeping advancements require inter-operable solutions that are both generalizable and genuinely reflective of the populations utilized to build algorithms [12]. But first, regulatory and professional bodies should provide guidance on interventions aligned with these AI solutions [12]. Indeed, we need guidelines for clinically oriented AI tools; the need seems especially pressing in light of the number of innovations seeking market access (or achieving it; in 2018, the FDA granted premarket clearance for a machine-learning system that predicts vital-sign instability [4]). Understanding the Machine Surgeons should understand the population characteristics used to develop algorithms and work with programmers to calibrate their outputs to match the needs of the patient populations being treated. Algorithms generated using certain data may not be accurate or fully translatable to populations with different sociodemographic characteristics. A poor understanding of the data used to build the “black box” algorithms, how a given output was reached, and what the output actually “means” may generate potential legal, medical malpractice, and product-liability issues (placing proper informed consent in jeopardy). Access to the data may be challenging, since AI technology companies commonly withhold datasets as proprietary information. Surgeons should take it upon themselves to understand the nature and resolution of data inputs to the model, and monitor global validation efforts specific to the AI tool in consideration. Impact on Medical Education and Clinical Practice If an AI computer model can diagnose orthopaedic conditions more accurately and efficiently than a board-certified musculoskeletal radiologist, or if an AI-enabled robot can perform certain techniques more precisely than an orthopaedic surgeon, extensive capital investments in medical education and clinical training are avoided. How does this impact the physician workforce? AI technology may signal a need for redesign of the current medical education paradigm and the service industry orientation of health care, where future professionals spend their time interacting with and adapting to this technology for safe use in clinical settings. A key aspect of medical education would become the interaction between providers, patients, and technology. Based on the complexity of clinical care, it is likely such technologies will complement physicians rather than act as substitutes. An approach of “working with AI” will surely uncover complexities in relation to the reactions and interactions of patients and caregivers with technology. Clear boundaries will need to be set for the differential roles of machines and physicians in patient care. The Cost Perspective The functions achieved by AI technologies (data discovery, diagnostics and prediction, and clinical decision support) aim to reduce overall spending through reducing time, resource utilization, manpower, and computational power. However, these potential savings should be considered alongside the up-front investment, plus the challenges of obtaining clinical buy-in regarding the requisite culture change necessary for success. While the drive to adopt such new technologies is strong in orthopaedics and is reflected by an impressive legacy of successful innovations (advanced analysis of musculoskeletal pathology in imaging, useful pattern-seeking within the “big data” of the EHR), there are also some catastrophic failures in the portfolio—metal-on-metal joint replacement stands as a prominent example. We appear to be at point where there is a critical need for well-designed AI technologies to be tested in clinical workflows, validated in clinical decision-making processes, and evaluated for impact on patient clinical outcomes (whether patient-reported or system-level) [12]. There is also a need to demonstrate the impact of AI on value with high-quality cohort and randomized controlled trials utilizing patient-reported outcome measures, cost-effectiveness analyses, and rapid quality improvement studies compliant with evolving research standards in this arena such as the Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis [12]. This type of research needs to be conducted while working out ethical, policy, and practice guidelines. Given the expense associated with development of AI-based tools, we must focus on value: The demonstrated benefits of any new tools divided by their costs.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.012 | 0.036 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.002 | 0.002 |
| Science and technology studies | 0.002 | 0.019 |
| Scholarly communication | 0.013 | 0.020 |
| Open science | 0.002 | 0.005 |
| Research integrity | 0.008 | 0.009 |
| Insufficient payload (model declined to judge) | 0.012 | 0.003 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".