MétaCan
Menu
Back to cohort
Record W4289837592 · doi:10.1186/s12874-022-01682-x

Selecting implementation models, theories, and frameworks in which to integrate intersectional approaches

2022· article· en· W4289837592 on OpenAlexafffund
Justin Presseau, Danielle Kasperavicius, Isabel B. Rodrigues, Jessica Braimoh, Andrea Chambers, Cole Etherington, Lora Giangregorio, Jenna C. Gibbs, Anik Giguère, Ian D. Graham, Olena Hankivsky, Alison M. Hoens, Jayna Holroyd‐Leduc, Christine Kelly, Julia E. Moore, Matteo Ponzano, Malika Sharma, Kathryn M. Sibley, Sharon E. Straus

Bibliographic record

VenueBMC Medical Research Methodology · 2022
Typearticle
Languageen
FieldHealth Professions
TopicHealth Policy Implementation Science
Canadian institutionsGeorge & Fay Yee Centre for Healthcare InnovationUniversity of TorontoUniversity of ManitobaUniversity of CalgaryUniversity of British ColumbiaUniversité LavalUniversity of OttawaMcGill UniversityUniversity of WaterlooPublic Health OntarioYork UniversityMcMaster UniversityResearch Institute for AgingSt. Michael's HospitalOttawa Public HealthOttawa Hospital
FundersResearch Institute for Aging, University of WaterlooCanadian Institutes of Health Research
KeywordsComputer scienceUsabilityProcess (computing)Delphi methodManagement scienceArtificial intelligenceHuman–computer interaction

Abstract

fetched live from OpenAlex

BACKGROUND: Models, theories, and frameworks (MTFs) provide the foundation for a cumulative science of implementation, reflecting a shared, evolving understanding of various facets of implementation. One under-represented aspect in implementation MTFs is how intersecting social factors and systems of power and oppression can shape implementation. There is value in enhancing how MTFs in implementation research and practice account for these intersecting factors. Given the large number of MTFs, we sought to identify exemplar MTFs that represent key implementation phases within which to embed an intersectional perspective. METHODS: We used a five-step process to prioritize MTFs for enhancement with an intersectional lens. We mapped 160 MTFs to three previously prioritized phases of the Knowledge-to-Action (KTA) framework. Next, 17 implementation researchers/practitioners, MTF experts, and intersectionality experts agreed on criteria for prioritizing MTFs within each KTA phase. The experts used a modified Delphi process to agree on an exemplar MTF for each of the three prioritized KTA framework phases. Finally, we reached consensus on the final MTFs and contacted the original MTF developers to confirm MTF versions and explore additional insights. RESULTS: We agreed on three criteria when prioritizing MTFs: acceptability (mean = 3.20, SD = 0.75), applicability (mean = 3.82, SD = 0.72), and usability (median = 4.00, mean = 3.89, SD = 0.31) of the MTF. The top-rated MTFs were the Iowa Model of Evidence-Based Practice to Promote Quality Care for the 'Identify the problem' phase (mean = 4.57, SD = 2.31), the Consolidated Framework for Implementation Research for the 'Assess barriers/facilitators to knowledge use' phase (mean = 5.79, SD = 1.12), and the Behaviour Change Wheel for the 'Select, tailor, implement interventions' phase (mean = 6.36, SD = 1.08). CONCLUSIONS: Our interdisciplinary team engaged in a rigorous process to reach consensus on MTFs reflecting specific phases of the implementation process and prioritized each to serve as an exemplar in which to embed intersectional approaches. The resulting MTFs correspond with specific phases of the KTA framework, which itself may be useful for those seeking particular MTFs for particular KTA phases. This approach also provides a template for how other implementation MTFs could be similarly considered in the future. TRIAL REGISTRATION: Open Science Framework Registration: osf.io/qgh64.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.130
metaresearch head score (Gemma)0.101
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Science and technology studies, Research integrity, Insufficient payload (model declined to judge)
Consensus categoriesMetaresearch
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.454
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.1300.101
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0010.003
Science and technology studies0.0020.000
Scholarly communication0.0000.000
Open science0.0000.001
Research integrity0.0000.006
Insufficient payload (model declined to judge)0.0060.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.947
GPT teacher head0.780
Teacher spread0.167 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; both teacher heads agree on what is shown here.

Study designQualitative
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations30
Published2022
Admission routes2
Has abstractyes

Explore more

Same venueBMC Medical Research MethodologySame topicHealth Policy Implementation ScienceFrench-language works237,207