Core Outcome Set Use in Poststroke Aphasia Treatment Research: Examining Barriers and Facilitators to Implementation Using the Theoretical Domains Framework
Bibliographic record
Abstract
Purpose A core outcome set (COS; an agreed minimum set of outcomes) was developed to address the heterogeneous measurement of outcomes in poststroke aphasia treatment research. Successful implementation of a COS requires change in individual and collective research behavior. We used the Theoretical Domains Framework (TDF) to understand the factors influencing researchers' use and nonuse of the Research Outcome Measurement in Aphasia (ROMA) COS. Method Aphasia trialists and highly published treatment researchers were identified from the Cochrane review of speech and language therapy for aphasia following stroke and through database searches. Participants completed a theory-informed online survey that explored factors influencing COS use. Data were analyzed using descriptive statistics and qualitative content analysis. Results Sixty-four aphasia researchers from 13 countries participated. Most participants (81%) were aware of the ROMA COS, and participants identified more facilitators than barriers to its use. The TDF domain with the highest agreement (i.e., facilitator) was "knowledge" (84% agree/strongly agree). Participants had knowledge of the measures included in the ROMA COS, their associated benefits, and the existing recommendations. The TDF domains with the least agreement (i.e., barriers) were "reinforcement" (34% agree/strongly agree); "social influences" (41% agree/strongly agree); "memory, attention, and decision processes" (45% agree/strongly agree); and "behavioral regulation" (49% agree/strongly agree). Hence, participants identified a lack of external incentives, collegial encouragement, and monitoring systems as barriers to using the ROMA COS. The suitability and availability of individual measurement instruments, as well as burden associated with collecting the COS, were also identified as reasons for nonuse. Conclusions Overall, participants were aware of the benefits of using the ROMA COS and believed that its implementation would improve research quality; however, incentives for routine implementation were reported to be lacking. Findings will guide future revisions of the ROMA COS and the development of theoretically informed implementation strategies. Supplemental Material https://doi.org/10.23641/asha.16528524.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.017 | 0.008 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.001 | 0.001 |
| Scholarly communication | 0.001 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".