MétaCan
Menu
Retour à la cohorte
Enregistrement W4396858270 · doi:10.1097/as9.0000000000000442

Leveraging Education Science for AI-Clinician Collaboration in the Patient Care Ecosystem

2024· article· en· W4396858270 sur OpenAlexaff
Martin G. Tolsgaard, Aasa Feragen, Lawrence Grierson

Notice bibliographique

RevueAnnals of Surgery Open · 2024
Typearticle
Langueen
DomaineMedicine
ThématiqueArtificial Intelligence in Healthcare and Education
Établissements canadiensMcMaster University
Organismes subventionnairesnon disponible
Mots-clésHealth careKnowledge managementSet (abstract data type)PsychologySpace (punctuation)Knowledge baseComputer scienceArtificial intelligenceMedicinePolitical science

Résumé

récupéré en direct d'OpenAlex

The discourse of artificial intelligence (AI) in the medical practice literature emphasizes its great promise for advancing healthcare by changing the ways that clinical tasks are performed.1 However, multiple studies have documented the malalignment of AI development with clinician end-user needs, thereby reducing the impact of AI on healthcare delivery.2 Here, it’s helpful to recognize the patient, AI, and physician as part of a dynamic healthcare ecosystem, in which all 3 must work together. Clinicians are not one-size-fits-all—they are individuals who are managing the proliferation of a dynamic skill set; continuous life-long learners who enter the clinical space with important personal education objectives. To date, AI for healthcare research does not typically take the science of human learning into account when conceptualizing, designing, and evaluating AI in the healthcare ecosystem.3 Yet, there are several looming education tensions that need to be addressed when it comes to introducing AI into healthcare contexts. The introduction of AI may promote the widespread degradation or loss of fundamental clinical skills. For instance, by providing a diagnosis that the physician does not need to reason first, the AI may disrupt the physician’s ability to consolidate the deep conceptual knowledge that underpins clinical decision-making. This may be particularly damaging when one considers the mounting evidence that these deep knowledge structures are essential to the way physicians innovate solutions in the face of unique healthcare challenges.4 If AI degrades the physician’s conceptual knowledge base, then it may also corrupt the ability to innovate solutions to new problems and advance the field. The absence of education theory and science in the AI for healthcare literature resembles earlier periods in history when new technology for clinicians was introduced. Indeed, technological hype in healthcare often precedes the generation of an evidence base to guide the adoption of the new technology. For example, robot-assisted surgery was implemented in the context of lacking and, at times, conflicting evidence to support its benefits for patients.5 The integration of simulation-based learning technologies for medical education also outpaced adequate consideration for learning theory, leading to frivolous spending and the influx of many simulators that do not actually elevate clinician performance.6 Fortunately, AI research in the context of general education science offers more perspective on how these systems may be employed in service of learning objectives.7 Here, the typical AI application involves systems that determine learning challenges that are customized to the learner’s current level of domain-relevant knowledge, inspiring efforts that foster the progression toward expertise in a step-based fashion.8 For example, a personalized AI would take task complexity and level of expertise into consideration when generating questions, tailoring feedback, and providing explanations. This has given way to the burgeoning field of learning analytics, which is concerned with the collection and analysis of data about learners and their contexts to optimize the outcomes of training and the environments in which it occurs.9 Research on learning analytics may offer a particularly fruitful foundation for understanding how AI systems can be constructed to ensure that the development of health professional expertise is a central consideration within the AI-clinician collaboration. In recognizing the potential of AI for education, we also recognize that AI for healthcare systems needs to better integrate learning theory to reach its full potential. However, the current education literature does not provide strong theory-based perspectives on how to do this.3 The typical personalized, step-based, AI education systems operate based on pertinent education theories such as the desirable difficulties and proximal learning frameworks, which both advocate for designs that present the learners with challenges beyond the knowledge base they have already mastered. In terms of AI-powered decision support, this translates to showing different levels of feedback and information to users at different levels of clinical skill. Importantly, evidence supporting both frameworks shows that these types of challenges increase errors and slow the rate of improvement along the way to robust, well-developed skills.10 Of course, systems that support learning through increased error and slower rates of improvement cannot be tolerated in the context of concurrent patient care. Herein we recognize the fundamental tension in meeting both the physician’s clinical and educational objectives at the same time. AI for healthcare systems must also be adaptive learning systems that improve physicians’ knowledge, skills, and behaviors. In the long run, developments that better integrate learning theory will ultimately have a larger impact on health outcomes than AI that focuses exclusively on bolstering episodic physician performance. ACKNOWLEDGMENTS The Danish Signature Project; The Pioneer Centre for Artificial Intelligence.

Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.

Comment cette classification a été obtenuedéplier

Prédiction machine sur la base complète

Imitation des enseignants

Ni prévalence calibrée, ni vérité terrain. Validation humaine à venir. Le volet Gemma est une étiquette directe du modèle pour chaque travail de la base, lue sur la notice réduite au titre. Le volet Codex est un classifieur appris des 10 348 étiquettes directes de Codex et calibré sur les taux pondérés de l'échantillon; les champs sans appui suffisant ne portent aucun appel Codex. Le mode candidate est l'union des deux volets; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont pas des étiquettes humaines.

score de la tête « metaresearch » (Codex)0,046
score de la tête « metaresearch » (Gemma)0,070
Version: metacan-v3-hybrid-931329e0061cStatut de validation: machine_predicted_unvalidated
Catégories candidatesaucune
Catégories consensuellesaucune
DomaineSignal candidat: aucune · Signal consensuel: aucune
Devis d'étudeSignal candidat: Théorique ou conceptuel · Signal consensuel: Théorique ou conceptuel
GenreSignal candidat: Méthodes · Signal consensuel: aucune
Score de désaccord entre enseignants0,046
Score d'incertitude au seuil0,244

Scores du classifieur distillé par catégorie (deux têtes)

CatégorieCodexGemma
Métarecherche0,0460,070
Méta-épidémiologie (sens strict)0,0010,001
Méta-épidémiologie (sens large)0,0010,002
Bibliométrie0,0040,002
Études des sciences et des technologies0,0070,029
Communication savante0,0230,023
Science ouverte0,0050,031
Intégrité de la recherche0,0100,014
Charge utile insuffisante (le modèle a refusé de juger)0,0170,004

Scores machine (provisoires)

Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.

Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.

Tête enseignante Opus0,443
Tête enseignante GPT0,556
Écart entre enseignants0,113 · la distance entre les deux têtes enseignantes sur ce seul travail
Statut de validationscore_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découle

Classification

machine, non validée

Prédiction automatique; un appel candidat d’une seule source (Gemma direct ou Codex distillé), pas un consensus.

Les modèles n’ont appliqué aucune catégorie : rien dans la taxonomie ne correspondait à ce travail.
Devis d'étudeThéorique ou conceptuel
Domainenon disponible
GenreMéthodes

Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».

En bref

Citations2
Publié2024
Routes d'admission1
Résumé présentoui

Explorer davantage

Même revueAnnals of Surgery OpenMême sujetArtificial Intelligence in Healthcare and EducationTravaux en français237 207