MétaCan
Menu
Back to cohort
Record W4396858270 · doi:10.1097/as9.0000000000000442

Leveraging Education Science for AI-Clinician Collaboration in the Patient Care Ecosystem

2024· article· en· W4396858270 on OpenAlex
Martin G. Tolsgaard, Aasa Feragen, Lawrence Grierson

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueAnnals of Surgery Open · 2024
Typearticle
Languageen
FieldMedicine
TopicArtificial Intelligence in Healthcare and Education
Canadian institutionsMcMaster University
Fundersnot available
KeywordsHealth careKnowledge managementSet (abstract data type)PsychologySpace (punctuation)Knowledge baseComputer scienceArtificial intelligenceMedicinePolitical science

Abstract

fetched live from OpenAlex

The discourse of artificial intelligence (AI) in the medical practice literature emphasizes its great promise for advancing healthcare by changing the ways that clinical tasks are performed.1 However, multiple studies have documented the malalignment of AI development with clinician end-user needs, thereby reducing the impact of AI on healthcare delivery.2 Here, it’s helpful to recognize the patient, AI, and physician as part of a dynamic healthcare ecosystem, in which all 3 must work together. Clinicians are not one-size-fits-all—they are individuals who are managing the proliferation of a dynamic skill set; continuous life-long learners who enter the clinical space with important personal education objectives. To date, AI for healthcare research does not typically take the science of human learning into account when conceptualizing, designing, and evaluating AI in the healthcare ecosystem.3 Yet, there are several looming education tensions that need to be addressed when it comes to introducing AI into healthcare contexts. The introduction of AI may promote the widespread degradation or loss of fundamental clinical skills. For instance, by providing a diagnosis that the physician does not need to reason first, the AI may disrupt the physician’s ability to consolidate the deep conceptual knowledge that underpins clinical decision-making. This may be particularly damaging when one considers the mounting evidence that these deep knowledge structures are essential to the way physicians innovate solutions in the face of unique healthcare challenges.4 If AI degrades the physician’s conceptual knowledge base, then it may also corrupt the ability to innovate solutions to new problems and advance the field. The absence of education theory and science in the AI for healthcare literature resembles earlier periods in history when new technology for clinicians was introduced. Indeed, technological hype in healthcare often precedes the generation of an evidence base to guide the adoption of the new technology. For example, robot-assisted surgery was implemented in the context of lacking and, at times, conflicting evidence to support its benefits for patients.5 The integration of simulation-based learning technologies for medical education also outpaced adequate consideration for learning theory, leading to frivolous spending and the influx of many simulators that do not actually elevate clinician performance.6 Fortunately, AI research in the context of general education science offers more perspective on how these systems may be employed in service of learning objectives.7 Here, the typical AI application involves systems that determine learning challenges that are customized to the learner’s current level of domain-relevant knowledge, inspiring efforts that foster the progression toward expertise in a step-based fashion.8 For example, a personalized AI would take task complexity and level of expertise into consideration when generating questions, tailoring feedback, and providing explanations. This has given way to the burgeoning field of learning analytics, which is concerned with the collection and analysis of data about learners and their contexts to optimize the outcomes of training and the environments in which it occurs.9 Research on learning analytics may offer a particularly fruitful foundation for understanding how AI systems can be constructed to ensure that the development of health professional expertise is a central consideration within the AI-clinician collaboration. In recognizing the potential of AI for education, we also recognize that AI for healthcare systems needs to better integrate learning theory to reach its full potential. However, the current education literature does not provide strong theory-based perspectives on how to do this.3 The typical personalized, step-based, AI education systems operate based on pertinent education theories such as the desirable difficulties and proximal learning frameworks, which both advocate for designs that present the learners with challenges beyond the knowledge base they have already mastered. In terms of AI-powered decision support, this translates to showing different levels of feedback and information to users at different levels of clinical skill. Importantly, evidence supporting both frameworks shows that these types of challenges increase errors and slow the rate of improvement along the way to robust, well-developed skills.10 Of course, systems that support learning through increased error and slower rates of improvement cannot be tolerated in the context of concurrent patient care. Herein we recognize the fundamental tension in meeting both the physician’s clinical and educational objectives at the same time. AI for healthcare systems must also be adaptive learning systems that improve physicians’ knowledge, skills, and behaviors. In the long run, developments that better integrate learning theory will ultimately have a larger impact on health outcomes than AI that focuses exclusively on bolstering episodic physician performance. ACKNOWLEDGMENTS The Danish Signature Project; The Pioneer Centre for Artificial Intelligence.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.002
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Other design · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.873
Threshold uncertainty score0.675

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0020.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.001
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.443
GPT teacher head0.556
Teacher spread0.113 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it