MétaCan
Menu
Back to cohort
Record W3176316077 · doi:10.1136/bmjopen-2020-042251

Identification of knowledge translation theories, models or frameworks suitable for health technology reassessment: a survey of international experts

2021· article· en· W3176316077 on OpenAlexafffundabout
Rosmin Esmail, Heather Hanson, Jayna Holroyd‐Leduc, Daniel J. Niven, Fiona Clement

Bibliographic record

VenueBMJ Open · 2021
Typearticle
Languageen
FieldHealth Professions
TopicHealth Policy Implementation Science
Canadian institutionsUniversity of CalgaryHotchkiss Brain InstituteAlberta Health Services
FundersAlberta InnovatesAlberta Innovates - Health Solutions
KeywordsMedicineKnowledge translationConsistency (knowledge bases)Identification (biology)Action planMedical educationKnowledge managementManagementComputer scienceArtificial intelligence

Abstract

fetched live from OpenAlex

OBJECTIVE: Health technology reassessment (HTR) is a field focused on managing a technology throughout its life cycle for optimal use. The process results in one of four possible recommendations: increase use, decrease use, no change or complete withdrawal of the technology. However, implementation of these recommendations has been challenging. This paper explores knowledge translation (KT) theories, models and frameworks (TMFs) and their suitability for implementation of HTR recommendations. DESIGN: Cross-sectional survey. PARTICIPANTS: Purposeful sampling of international KT and HTR experts was administered between January and March 2019. METHODS: Sixteen full-spectrum KT TMFs were rated by the experts as 'yes', 'partially yes' or 'no' on six criteria: familiarity, logical consistency/plausibility, degree of specificity, accessibility, ease of use and HTR suitability. Consensus was determined as a rating of ≥70% responding 'yes'. Descriptive statistics and manifest content analysis were conducted on open-ended comments. RESULTS: Eleven HTR and 11 KT experts from Canada, USA, UK, Australia, Germany, Spain, Italy and Sweden participated. Of the 16 KT TMFs, none received ≥70% rating. When ratings of 'yes' and 'partially yes' were combined, the Consolidated Framework for Implementation Research was considered the most suitable KT TMF by both KT and HTR experts (86%). One additional KT TMF was selected by KT experts: Knowledge to Action framework. HTR experts selected two additional KT TMFs: Co-KT framework and Plan-Do-Study-Act cycle. Experts identified three key characteristics of a KT TMF that may be important to consider: practicality, guidance on implementation and KT TMF adaptability. CONCLUSIONS: Despite not reaching an overall ≥70% rating on any of the KT TMFs, experts identified four KT TMFs suitable for HTR. Users may apply these KT TMFs in the implementation of HTR recommendations. In addition, KT TMF characteristics relevant to the field of HTR need to be explored further.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.115
metaresearch head score (Gemma)0.205
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Methods · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.885
Threshold uncertainty score0.611

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.1150.205
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0060.004
Science and technology studies0.0020.003
Scholarly communication0.0060.006
Open science0.0010.004
Research integrity0.0020.003
Insufficient payload (model declined to judge)0.0020.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.786
GPT teacher head0.739
Teacher spread0.047 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designObservational
DomainMethods
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations4
Published2021
Admission routes3
Has abstractyes

Explore more

Same venueBMJ OpenSame topicHealth Policy Implementation ScienceFrench-language works237,207