MétaCan
Menu
← Back to cohort
Record W4402830391 · doi:10.2196/64406

Ethical Considerations in Human-Centered AI: Advancing Oncology Chatbots Through Large Language Models

2024· article· en· W4402830391 on OpenAlexafffundvenue
James C. L. Chow, Kay Li

Bibliographic record

VenueJMIR Bioinformatics and Biotechnology · 2024
Typearticle
Languageen
FieldMedicine
TopicArtificial Intelligence in Healthcare and Education
Canadian institutionsPrincess Margaret Cancer CentreUniversity of TorontoUniversity Health Network
FundersCanadian Institutes of Health Research
KeywordsPreprintEngineering ethicsPsychologyComputer scienceEngineeringWorld Wide Web

Abstract

fetched live from OpenAlex

BACKGROUND The evolution of medical chatbots underscores the pressing need for human-centered AI to address patient and family concerns more personally and precisely. This paper explores the potential ways to do so, through tracing the historical development of artificial intelligence (AI), charting the progression from neural networks to the prevalent use of Large Language Models (LLMs) like GPT-3 and 4 within the realm of human-centered AI. OBJECTIVE This review critically examines the pivotal role of LLM-based medical chatbots in fostering ethical and humanistic AI in the construction of medical chatbots. Specifically, it investigates the transition from explicit algorithms to the contemporary landscape in which LLMs emulate human speech, language, and behavior. METHODS Beginning with examining the elements of human-centred AI, pathways to build medical chatbots ethically were identified. The loopholes for potential bias in LLMs were highlighted, such as their reliance on extensive datasets and neural networks, which have revolutionized programming methodologies, whereas bias in the datasets also may result in bias in the medical chatbot’s responses. The training methodology employed in developing ChatGPT was also reviewed, finding potential bias because of the bias in the massive training data. RESULTS The study's findings centered on the potential ways to design medical chatbots with human-centered AI. It delves not only into how LLMs, particularly in their proficiency in understanding and generating human language, can significantly shape the future of AI, but also how inherent bias in the training of the LLMs may result in chatbots not for everybody. The focus extends to broader implications for AI and computer science, shedding light on transformative opportunities and ethical challenges inherent in the application of LLMs. CONCLUSIONS This review highlights the transformative potential of LLMs in shaping the next generation of medical chatbots. It underscores the imperative of infusing human-centric values and ethical considerations into AI systems, aligning with the overarching goal of creating human-centered AI. The insights presented include considerations for mitigating bias in ChatGPT and reflections on the future trajectory of LLMs, emphasizing practical applications in the development and enhancement of ethical medical chatbots. CLINICALTRIAL NA

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.044
metaresearch head score (Gemma)0.137
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.044
Threshold uncertainty score0.230

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0440.137
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0020.001
Science and technology studies0.0020.005
Scholarly communication0.0070.010
Open science0.0020.005
Research integrity0.0030.005
Insufficient payload (model declined to judge)0.0050.002

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.104
GPT teacher head0.461
Teacher spread0.356 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designNot applicable
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations64
Published2024
Admission routes3
Has abstractyes

Explore more

Same venueJMIR Bioinformatics and Biotechnology→Same topicArtificial Intelligence in Healthcare and Education→French-language works237,207→