Monitoring the Short-Term Outcomes of Community-Engaged, Project-Based User Experience Design Courses
Bibliographic record
Abstract
This paper evaluates short-term outcomes of community-engaged learning (CEL) initiatives within the field of user experience design (UXD). Qualitative data were gathered through a thematic analysis of 101 summative student reflections and 22 interview transcripts from 19 community partner organizations. Quantitative findings resulted from an analysis of 94 student surveys. Findings offer preliminary support for CEL initiatives in UXD education and reveal that CEL benefits both students and community partners. Students garnered UXD competencies, interpersonal skills, and increased empathy through participation in CEL initiatives. Community partners gained useful deliverables and an increased understanding of the discipline of UXD as part of their CEL engagement. Two primary recommendations are suggested for improving future CEL engagement: (1) designating a coordinator/point of contact to alleviate the management burden by centralizing communications; (2) providing a clear outline of the engagement deliverables and timelines up front. Este documento evalúa los resultados a corto plazo del aprendizaje a través de la participación comunitaria (CEL, por sus siglas en inglés) dentro del campo del diseño de la experiencia del usuario (UXD por sus siglas en inglés). Se recopilaron datos cualitativos a través de un análisis temático de las reflexiones de 101 estudiantes y 22 transcripciones de entrevistas a 19 organizaciones comunitarias asociadas. Los hallazgos cuantitativos se obtuvieron del análisis de encuestas realizadas a 94 estudiantes. Estos resultados ofrecen un apoyo preliminar a las iniciativas de CEL en la educación UXD y revelan que CEL beneficia tanto a los estudiantes como a los integrantes de la comunidad. Los estudiantes adquirieron habilidades UXD, mejoraron sus relaciones interpersonales y demostraron una mayor empatía a través de la participación en iniciativas CEL. Los integrantes de la comunidad obtuvieron muy buenos resultados y una mayor comprensión de la disciplina de UXD como parte de su compromiso con CEL. Se sugieren dos recomendaciones fundamentales para mejorar la participación futura de CEL: (1) designar un coordinador o punto de contacto para aliviar la carga administrativa y centralizar las comunicaciones; (2) proporcionar desde el principio un esquema claro del compromiso para las entregas de los resultados y sus correspondientes plazos.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.057 | 0.007 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.011 | 0.000 |
| Scholarly communication | 0.001 | 0.000 |
| Open science | 0.003 | 0.001 |
| Research integrity | 0.000 | 0.017 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".