Delivery and evaluation of simulations to promote authentic and meaningful engagement in childhood disability research
Bibliographic record
Abstract
BACKGROUND: In 2019, our interdisciplinary team of researchers, family members, and youth co-designed four simulation training videos and accompanying facilitation resources to prepare youth, family members, trainees, and researchers to build the knowledge and skills to engage in patient-oriented research (POR) authentically and meaningfully. Videos covered challenges in aspects of the research process including (1) forming a project team; (2) identifying project objectives and priorities; (3) agreeing on results; and (4) carrying out knowledge translation. METHODS: The purpose of the study was to deliver four simulation training videos across 2 two-hour facilitated workshops with researchers, trainees, and family partners. We evaluated whether the training videos and facilitated discussion of the simulations helped to improve knowledge and attitudes about authentic and meaningful partnership in research and self-perceived ability to engage in POR. An explanatory sequential two-phase mixed methods design was used. Phase 1 (quantitative) included two training workshops and a pre/post-training survey. Phase 2 (qualitative) included two qualitative focus groups. Results of each phase were analyzed separately and then combined during interpretation. RESULTS: Sixteen individuals (including researchers/research staff, trainees, family members, clinicians) took part in this research study. Overall, participants were highly receptive to the training, providing high scores on measures of acceptability, appropriateness, and feasibility. While the training videos and facilitated discussion of the simulations were found to increase participants' knowledge and ability to engage in authentic and meaningful POR, we found no significant change in attitude or intent. Recommendations about the simulation content and delivery were provided to inform for future use. CONCLUSIONS: The simulations were found to be a positive and impactful way for collaborative research teams to build knowledge and ability to engage in authentic and meaningful POR. Recommendations for future work include covering different content areas with varying levels of nuance; and offering the training to stakeholders in a variety of roles, such as those higher-ranked academic positions.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.065 | 0.001 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.002 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.001 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".