Co-design of the Transgender Health Information Resource: Web-Based Participatory Design
Bibliographic record
Abstract
BACKGROUND: There is an urgent and unmet need for accessible and credible health information within the transgender and gender-diverse (TGD) community. Currently, TGD individuals often seek and must find relevant resources by vetting social media posts. A resource that provides accessible and credible health-related resources and content via a mobile phone app may have a positive impact on and support the TGD population. OBJECTIVE: COVID-19 stay-at-home orders forced a shift in the methods used in participatory design. In this paper, we aimed to describe the web-based participatory methods used to develop the Transgender Health Information Resource. We also described and characterized the web-based engagement that occurred during a single session of the overall design process. METHODS: We planned and conducted web-based design sessions to replace the proposed in-person sessions. We used web-based collaborative tools, including Zoom (Zoom Video Communications), Mural (Mural), REDCap (Research Electronic Data Capture; Vanderbilt University), and Justinmind (Justinmind), to engage the participants in the design process. Zoom was used as an integrated platform for design activities. Mural was used to perform exercises, such as free listing, brainstorming, and grouping. REDCap allowed us to collect survey responses. Justinmind was used to create prototypes that were shared and discussed via Zoom. Recruitment was led by one of our community partners, One Colorado, who used private Facebook groups in which web-based flyers were dispersed. The design process took place in several workshops over a period of 10 months. We described and characterized engagement during a single design session by tracking the number of influential interactions among participants. We defined an influential interaction as communication, either verbal or web-based content manipulation, that advanced the design process. RESULTS: We presented data from a single design session that lasted 1 hour and 48 minutes and included 4 participants. During the session, there were 301 influential interactions, consisting of 79 verbal comments and 222 web-based content manipulations. CONCLUSIONS: Web-based participatory design can elicit input and decisions from participants to develop a health information resource, such as a mobile app user interface. Overall, participants were highly engaged. This approach maintained the benefits and fidelity of traditional in-person design sessions, mitigated deficits, and exploited the previously unconsidered benefits of web-based methods, such as enhancing the ability to participate for those who live far from academic institutions. The web-based approach to participatory design was an efficient and feasible methodological design approach.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.048 | 0.041 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.002 | 0.001 |
| Science and technology studies | 0.007 | 0.006 |
| Scholarly communication | 0.005 | 0.005 |
| Open science | 0.002 | 0.008 |
| Research integrity | 0.002 | 0.003 |
| Insufficient payload (model declined to judge) | 0.008 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".