MétaCan
Menu
Back to cohort
Record W3026974517 · doi:10.1093/schbul/sbaa030.412

M100. LOOSELEAF: DEVELOPING A MOBILE-BASED APPLICATION TO MONITOR DAILY CANNABIS USAGE IN YOUTH AT CLINICAL HIGH-RISK OF PSYCHOSIS: APP DEVELOPMENT AND USABILITY TESTING

2020· article· en· W3026974517 on OpenAlexaff
Olga Santesteban‐Echarri, Ga Hyung Kim, Preston Haffey, Jacky Tang, Jean Addington

Bibliographic record

VenueSchizophrenia Bulletin · 2020
Typearticle
Languageen
FieldPsychology
TopicDigital Mental Health Interventions
Canadian institutionsHotchkiss Brain InstituteUniversity of Calgary
Fundersnot available
KeywordsFocus groupCannabisUsabilityPsychologyTest (biology)Thematic analysisEffects of cannabisMobile appsFocus (optics)Computer scienceApplied psychologyMedicinePsychiatryWorld Wide WebHuman–computer interactionQualitative research

Abstract

fetched live from OpenAlex

Abstract Background Youth at clinical high risk for psychosis (CHR) often use cannabis, which can have a negative impact on their attenuated psychotic symptoms (APS). Our overall goal is to develop an app that will monitor cannabis use and its impact on APS. Objectives: (1) To describe the development of a mobile-based application named LooseLeaf (LL) to monitor daily cannabis use of individuals at CHR through participatory design; and (2) To test initial usability, discover and fix technical issues, and ensure correct data transmission of LL. Methods Two two-hour focus groups were run with CHR participants, age 12–30. Opinions of participants on (i) application content, (ii) graphic design, and (iii) user experience of the different features (i.e., home screen, inventory, questions, feedback, and calculator) were gathered from the first focus group. Based on the comments from the first focus group, a usable prototype of the application was created and was shown to the second focus group. The second focus group provided further feedback on the user experience of each feature, and finalized the application’s name and logo. The focus groups were audio recorded and transcribed verbatim for analysis. Following Braun and Clarke’s guidelines, data obtained from the focus groups was qualitatively analyzed with thematic analysis to identify patterns in responses. The application was refined accordingly. Then, six healthy controls and two CHR participants used LL for one week to test its effectiveness in monitoring cannabis use. On days that participants used cannabis they answered LL’ questions about how much cannabis they used, how they used, their subjective emotional experience, and what their social and environmental context was during and after using cannabis. When they did not use cannabis, LL asked questions about their subjective emotional experience and how they felt about not using cannabis. LL included a bug-report feature that participants were encouraged to use when they encountered problems. Qualitative data about LL was gathered through the 23-item Mobile Application Rating Scale (MARS) covering questions about engagement, functionality, aesthetics, information provided, and subjective quality of LL. Descriptive statistics were calculated for the quantitative data from MARS. Results Participants favored a minimal and neutral design, buttons with icons, and color-coding of the emotions. Participants named the application “LooseLeaf” and helped to refine its features. The final design of the application consisted of 11 questions about cannabis consumption and feelings associated with it (i.e., euphoria, anxiety, and psychosis-like experiences). Over the one-week usability testing period, LL had an 85.7% response rate. The bug-report feature was used 13 times by seven participants to flag technical issues and provide suggestions to improve user experience of LL. The App received a good overall score on the MARS. LL’s functionality, aesthetics, information, and safety rated high. Few customization options, lack of willingness to pay for applications in general, and technical issues resulted in lower engagement and subjective quality scores. LL’s perceived impact score was good. Discussion The application’s development process was based on the feedback of CHR youth. This provided important information on the design and content needed to build a user-centric mobile application. LL demonstrated initial usability, an effective bug-report feature, and some technical issues and problems with data transmission. The MARS, interviews, and bug-reports provided effective feedback for refining LL for the next phase of development.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMeta-epidemiology (narrow)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.639
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0000.001
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.045
GPT teacher head0.343
Teacher spread0.298 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations1
Published2020
Admission routes1
Has abstractyes

Explore more

Same venueSchizophrenia BulletinSame topicDigital Mental Health InterventionsFrench-language works237,207