MétaCan
Menu
Back to cohort
Record W4200393996 · doi:10.2196/33374

An Internet-Based Cognitive Behavioral Therapy Program for Anxiety and Depression (Tranquility): Adaptation Co-design and Fidelity Evaluation Study

2021· article· en· W4200393996 on OpenAlexaffvenue
Victoria C. Patterson, Meghan A. Rossi, Alissa Pencer, Lori Wozney

Bibliographic record

VenueJMIR Formative Research · 2021
Typearticle
Languageen
FieldPsychology
TopicDigital Mental Health Interventions
Canadian institutionsNova Scotia Health AuthorityDalhousie University
Fundersnot available
KeywordsUsabilityFidelityMental healthPsychological interventionAnxietyPsychologyCognitive behavioral therapyClinical psychologyCognitionApplied psychologyPsychotherapistPsychiatryComputer science

Abstract

fetched live from OpenAlex

BACKGROUND: Internet-based cognitive behavioral therapy (iCBT) is a necessary step toward increasing the accessibility of mental health services. Yet, few iCBT programs have been evaluated for their fidelity to the therapeutic principles of cognitive behavioral therapy (CBT) or usability standards. In addition, many existing iCBT programs do not include treatments targeting both anxiety and depression, which are commonly co-occurring conditions. OBJECTIVE: This study aims to evaluate the usability of Tranquility-a novel iCBT program for anxiety-and its fidelity to CBT principles. This study also aims to engage in a co-design process to adapt Tranquility to include treatment elements for depression. METHODS: CBT experts (n=6) and mental health-informed peers (n=6) reviewed the iCBT program Tranquility. CBT experts assessed Tranquility's fidelity to CBT principles and were asked to identify necessary interventions for depression by using 2 simulated client case examples. Mental health-informed peers engaged in 2 co-design focus groups to discuss adaptations to the existing anxiety program and the integration of interventions for depression. Both groups completed web-based surveys assessing the usability of Tranquility and the likelihood that they would recommend the program. RESULTS: The CBT experts' mean rating of Tranquility's fidelity to CBT principles was 91%, indicating a high fidelity to CBT. Further, 5 out of 6 CBT experts and all mental health-informed peers (all participants: 11/12, 88%) rated Tranquility as satisfactory, indicating that they may recommend Tranquility to others, and they rated its usability highly (mean 76.56, SD 14.07). Mental health-informed peers provided suggestions on how to leverage engagement with Tranquility (eg, adding incentives and notification control). CONCLUSIONS: This preliminary study demonstrated the strong fidelity of Tranquility to CBT and usability standards. The results highlight the importance of involving stakeholders in the co-design process and future opportunities to increase engagement.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.004
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Other design · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.952
Threshold uncertainty score0.516

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0040.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.001
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.336
GPT teacher head0.607
Teacher spread0.271 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designOther design
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations12
Published2021
Admission routes2
Has abstractyes

Explore more

Same venueJMIR Formative ResearchSame topicDigital Mental Health InterventionsFrench-language works237,207