MétaCan
Menu
Back to cohort
Record W7151631689 · doi:10.2196/86326

Stakeholder Experiences with the PCV Chatbot as a Complementary Capacity-Building Tool for Frontline Health Workers in India: a Qualitative Study (Preprint)

2025· article· en· W7151631689 on OpenAlexvenueno aff
Amanjot Kaur, Arindam Ray, Amrita Kumari, Papri Nayak, Jayanta Kumar Sukul, Dimong Padung, Tage Taka, B.N. Rajani, Syed Sirajuddin Madani, Puneet Jaitely, Amita Raut, Rhythm Hora, Seema Singh Koshal, Syed F Quadri, Rashmi Mehra, Abida Sultana, Vivek Singh, Arup Deb Roy

Bibliographic record

VenueJMIR Formative Research · 2025
Typearticle
Languageen
FieldComputer Science
TopicAI in Service Interactions
Canadian institutionsnot available
Fundersnot available
KeywordsChatbotQualitative researchStakeholderHealth careQualitative analysisFocus group

Abstract

fetched live from OpenAlex

BACKGROUND: Pneumonia remains the leading cause of mortality in individuals aged 5 years or younger globally, with India bearing a disproportionately high burden. The introduction of the pneumococcal conjugate vaccine (PCV) in India necessitated innovative approaches to support frontline health workers (FLHWs), particularly in remote settings. To address this, a customizable WhatsApp-based PCV chatbot was developed as a complementary tool to traditional training and reference materials. OBJECTIVE: This study aimed to document the opportunities, challenges, and mitigation measures encountered during the development and rollout of the PCV chatbot, and to explore its use and user experience as a capacity-building and support tool for FLHWs during new vaccine introduction. METHODS: A qualitative study was conducted across 4 Indian states-Arunachal Pradesh, Delhi, Karnataka, and West Bengal-using purposive sampling at the district and block levels. Data collection involved key informant interviews with immunization officials and chatbot developers, and focus group discussions with auxiliary nurse midwives. A Likert scale-based tool captured quantitative feedback on user satisfaction. RESULTS: Stakeholders appreciated the chatbot's accessibility, familiarity (through WhatsApp), and multilingual functionality. Most auxiliary nurse midwives found it easy to use and rated responses highly for completeness and usefulness. The chatbot enabled immediate access to information, saving time and bridging gaps, especially when traditional training was delayed or unavailable in hard-to-reach areas. Challenges included occasional technical issues, limited content related to dropout and left-out scenarios, and difficulties in typing regional languages. Recommendations included implementing predictive text, expanding scenario coverage, and strengthening user-centered design and field testing. CONCLUSIONS: The PCV chatbot demonstrated acceptability and perceived value as an on-demand knowledge tool among FLHWs. Continuous user-driven refinement, expanded content, and enhanced usability are essential for its scalability and sustained use in vaccine introduction and capacity-building efforts.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.005
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: Qualitative
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.103
Threshold uncertainty score0.713

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0050.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0010.002
Science and technology studies0.0010.000
Scholarly communication0.0000.001
Open science0.0020.001
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.160
GPT teacher head0.496
Teacher spread0.336 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designQualitative
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2025
Admission routes1
Has abstractno

Explore more

Same venueJMIR Formative ResearchSame topicAI in Service InteractionsFrench-language works237,207