MétaCan
Menu
Back to cohort
Record W4366352196 · doi:10.2196/40277

Expressive Interviewing Agents to Support Health-Related Behavior Change: Randomized Controlled Study of COVID-19 Behaviors

2023· article· en· W4366352196 on OpenAlexaffvenue
Ian Stewart, Charles Welch, Lawrence C. An, Ken Resnicow, James W. Pennebaker, Rada Mihalcea

Bibliographic record

VenueJMIR Formative Research · 2023
Typearticle
Languageen
FieldPsychology
TopicMental Health via Writing
Canadian institutionsUniversity of Toronto
FundersNational Institute of Diabetes and Digestive and Kidney DiseasesUniversity of MichiganJohn Templeton Foundation
KeywordsMotivational interviewingInterviewTask (project management)PsychologyIntervention (counseling)Coronavirus disease 2019 (COVID-19)PandemicApplied psychologyClinical psychologyMedicinePsychiatryDisease

Abstract

fetched live from OpenAlex

BACKGROUND: Expressive writing and motivational interviewing are well-known approaches to help patients cope with stressful life events. Although these methods are often applied by human counselors, it is less well understood if an automated artificial intelligence approach can benefit patients. Providing an automated method would help expose a wider range of people to the possible benefits of motivational interviewing, with lower cost and more adaptability to sudden events like the COVID-19 pandemic. OBJECTIVE: This study presents an automated writing system and evaluates possible outcomes among participants with respect to behavior related to the COVID-19 pandemic. METHODS: We developed a rule-based dialogue system for "Expressive Interviewing" to elicit writing from participants on the subject of how COVID-19 has impacted their lives. The system prompts participants to describe their life experiences and emotions and provides topic-specific prompts in response to participants' use of topical keywords. In May 2021 and June 2021, we recruited participants (N=151) via Prolific to complete either the Expressive Interviewing task or a control task. We surveyed participants immediately before the intervention, immediately after the intervention, and again 2 weeks after the intervention. We measured participants' self-reported stress, general mental health, COVID-19-related health behavior, and social behavior. RESULTS: Participants generally wrote long responses during the task (53.3 words per response). In aggregate, task participants experienced a significant decrease in stress in the short term (~23% decrease, P<.001) and a slight difference in social activity compared with the control group (P=.03). No significant differences in short-term or long-term outcomes were detected between participant subgroups (eg, male versus female participants) except for some within-condition differences by ethnicity (eg, higher social activity among African American people participating in Expressive Interviewing vs participants of other ethnicities). For short-term effects, participants showed different outcomes based on their writing. Using more anxiety-related words was correlated with a greater short-term decrease in stress (r=-0.264, P<.001), and using more positive emotion words was correlated with a more meaningful experience (r=0.243, P=.001). As for long-term effects, writing with more lexical diversity was correlated with an increase in social activity (r=0.266, P<.001). CONCLUSIONS: Expressive Interviewing participants exhibited short-term, but not long-term, positive changes in mental health, and some linguistic metrics of writing style were correlated with positive change in behavior. Although there were no significant long-term effects observed, the positive short-term effects suggest that the Expressive Interviewing intervention could be used in cases in which a patient lacks access to traditional therapy and needs a short-term solution. TRIAL REGISTRATION: Clincaltrials.gov NCT05949840; https://www.clinicaltrials.gov/study/NCT05949840.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.019
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMeta-epidemiology (narrow), Insufficient payload (model declined to judge)
Consensus categoriesInsufficient payload (model declined to judge)
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.500
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0190.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0020.000
Bibliometrics0.0020.002
Science and technology studies0.0010.000
Scholarly communication0.0000.000
Open science0.0010.001
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0030.002

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.345
GPT teacher head0.589
Teacher spread0.244 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; both teacher heads agree on what is shown here.

Study designQualitative
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations2
Published2023
Admission routes2
Has abstractyes

Explore more

Same venueJMIR Formative ResearchSame topicMental Health via WritingFrench-language works237,207