MétaCan
Menu
← Back to cohort
Record W4389339663 · doi:10.2196/50557

Web-Based Tool Designed to Encourage Supplemental Nutrition Assistance Program Use in Urban College Students: Usability Testing Study

2023· article· en· W4389339663 on OpenAlexvenueno aff
Catherine Yan Hei Li, Charles Platkin, Jonathan Chin, Asia Khan, Jaleel Bennett, Anna Speck, Annette Nielsen, May May Leung

Bibliographic record

VenueJMIR Formative Research · 2023
Typearticle
Languageen
FieldHealth Professions
TopicFood Security and Health in Diverse Populations
Canadian institutionsnot available
Fundersnot available
KeywordsUsabilityWeb applicationSupplemental Nutrition Assistance ProgramComputer scienceMedical educationWorld Wide WebPsychologyMedicineHuman–computer interactionFood insecurityGeography

Abstract

fetched live from OpenAlex

BACKGROUND: Food insecurity continues to be a risk for college students in the United States. It is associated with numerous problems, such as chronic health conditions, increased stress and anxiety, and a lower grade point average. After COVID-19, the Supplemental Nutrition Assistance Program (SNAP) benefits were extended to college-aged students; however, there were some barriers to participation, which persisted such as lack of perceived food insecurity risk, lack of knowledge regarding the SNAP application process, the complexity of determining eligibility, and stigma associated with needing social assistance. A technology-enhanced tool was developed to address these barriers to SNAP enrollment and encourage at-risk college students to apply for SNAP. OBJECTIVE: The purpose of this study was to test the usability and acceptability of a web-based SNAP screening tool designed for college-aged students. METHODS: College students aged 18-25 years were recruited to participate in 2 rounds of usability testing during fall 2022. Participants tested the prototype of a web-based SNAP screener tool using a standardized think-aloud method. The usability and acceptability of the tool were assessed using a semistructured interview and a 10-item validated System Usability Scale questionnaire. Audio recordings and field notes were systematically reviewed by extracting and sorting feedback as positive or negative comments. System Usability Scale questionnaire data were analyzed using the Wilcoxon signed rank test and sign test. RESULTS: A total of 12 students (mean age 21.8, SD 2.8 years; n=6, 50% undergraduate; n=11, 92% female; n=7, 58% Hispanic or Black or African American; n=9, 78% low or very low food security) participated in both rounds of user testing. Round 1 testing highlighted overall positive experiences with the tool, with most participants (10/12) stating that the website fulfills its primary objective as a support tool to encourage college students to apply for SNAP. However, issues related to user interface design, navigation, and wording of some questions in the screening tool were noted. Key changes after round 1 reflected these concerns, including improved design of response buttons and tool logo and improved clarity of screening questions. The overall system usability showed slight, but not statistically significant, improvement between round 1 and round 2 (91.25 vs 92.50; P=.10, respectively). CONCLUSIONS: Overall usability findings suggest that this web-based tool was highly usable and acceptable to urban college students and could be an effective and appealing approach as a support tool to introduce college students to the SNAP application process. The findings from this study will inform further development of the tool, which could eventually be disseminated publicly among various college campuses.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.007
metaresearch head score (Gemma)0.017
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.007
Threshold uncertainty score0.037

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0070.017
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0010.001
Science and technology studies0.0010.000
Scholarly communication0.0010.001
Open science0.0010.001
Research integrity0.0010.000
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.342
GPT teacher head0.577
Teacher spread0.235 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations1
Published2023
Admission routes1
Has abstractyes

Explore more

Same venueJMIR Formative Research→Same topicFood Security and Health in Diverse Populations→French-language works237,207→