Exploring Young Adults' Experiences and Beliefs in Asthma Medication Management: Pilot Qualitative Study Comparing Human and Multiple AI Thematic Analysis
Bibliographic record
Abstract
Background: Young adults take their asthma maintenance medication 67% of the time or less. Understanding the specific needs and behaviors of young adults with asthma is essential for developing targeted interventions to improve disease self-management. Artificial intelligence (AI) has demonstrated its utility in summarizing and identifying patterns in qualitative research and may support or augment human coding efforts. However, there is pause literature to support this assertion. Objective: The objective of this study is to begin to explore the medication management-related needs of young adults with asthma via a pilot feasibility study. We aim to understand how to best assist young adults with asthma self-management and to identify potential areas where digital health interventions can provide support. We further aimed to understand the comparative outcome of human versus multiple AI platforms in performing thematic analysis. Methods: This study purposefully sampled young adults between the ages of 18 years and 29 years who had a prescription for an inhaled corticosteroid (ICS) and were either students or staff of a large metropolitan university in the northeastern United States. Semistructured interviews lasting 40 minutes on average were conducted with 4 participants via a teleconferencing application to elicit young adults' opinions on the topic. Interviews were recorded and transcribed verbatim using Otter.ai (Otter.ai, Inc). Investigators listened to the recording to confirm the accuracy of transcriptions and to make corrections when necessary. After performing a second round of line-by-line coding, the codes were reviewed by investigators and grouped into broader, overarching themes. All investigators reviewed and discussed the final codes. Human qualitative data analyses were performed using NVivo 14 software (QSR International). After completing human analyses, the investigators performed thematic analysis with multiple AI platforms (Google Gemini, Microsoft Copilot, and OpenAI's ChatGPT) to compare the final themes with investigator-derived themes. Results: Human analysis yielded 4 themes: support from clinicians, social support, digital self-management support, and educational support. The AI-based analysis also generated similar themes with different labels. The level of overlap on the underlying concept between humans, Gemini, Copilot, and ChatGPT was high, accounting for the fact that, although the specific labels differed, they referred to the same concept. Conclusions: Findings from our pilot exploratory study offer insights into the necessity for a holistic approach in supporting young adults with asthma. Based on the health belief model, if the identified multifaceted needs are addressed, health care systems may support medication adherence and improve health outcomes for this understudied patient population. Our pilot study also offers preliminary findings that artificial intelligence may be leveraged for successful thematic analysis of qualitative data with appropriate caution.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.019 | 0.017 |
| Meta-epidemiology (narrow) | 0.000 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.002 | 0.002 |
| Science and technology studies | 0.006 | 0.005 |
| Scholarly communication | 0.003 | 0.003 |
| Open science | 0.001 | 0.004 |
| Research integrity | 0.001 | 0.002 |
| Insufficient payload (model declined to judge) | 0.003 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".