Stakeholder Experiences with the PCV Chatbot as a Complementary Capacity-Building Tool for Frontline Health Workers in India: a Qualitative Study (Preprint)
Bibliographic record
Abstract
BACKGROUND: Pneumonia remains the leading cause of mortality in individuals aged 5 years or younger globally, with India bearing a disproportionately high burden. The introduction of the pneumococcal conjugate vaccine (PCV) in India necessitated innovative approaches to support frontline health workers (FLHWs), particularly in remote settings. To address this, a customizable WhatsApp-based PCV chatbot was developed as a complementary tool to traditional training and reference materials. OBJECTIVE: This study aimed to document the opportunities, challenges, and mitigation measures encountered during the development and rollout of the PCV chatbot, and to explore its use and user experience as a capacity-building and support tool for FLHWs during new vaccine introduction. METHODS: A qualitative study was conducted across 4 Indian states-Arunachal Pradesh, Delhi, Karnataka, and West Bengal-using purposive sampling at the district and block levels. Data collection involved key informant interviews with immunization officials and chatbot developers, and focus group discussions with auxiliary nurse midwives. A Likert scale-based tool captured quantitative feedback on user satisfaction. RESULTS: Stakeholders appreciated the chatbot's accessibility, familiarity (through WhatsApp), and multilingual functionality. Most auxiliary nurse midwives found it easy to use and rated responses highly for completeness and usefulness. The chatbot enabled immediate access to information, saving time and bridging gaps, especially when traditional training was delayed or unavailable in hard-to-reach areas. Challenges included occasional technical issues, limited content related to dropout and left-out scenarios, and difficulties in typing regional languages. Recommendations included implementing predictive text, expanding scenario coverage, and strengthening user-centered design and field testing. CONCLUSIONS: The PCV chatbot demonstrated acceptability and perceived value as an on-demand knowledge tool among FLHWs. Continuous user-driven refinement, expanded content, and enhanced usability are essential for its scalability and sustained use in vaccine introduction and capacity-building efforts.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.011 | 0.025 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.013 | 0.007 |
| Scholarly communication | 0.006 | 0.003 |
| Open science | 0.002 | 0.007 |
| Research integrity | 0.003 | 0.004 |
| Insufficient payload (model declined to judge) | 0.006 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".