MétaCan
Menu
Back to cohort
Record W4281555489 · doi:10.1186/s12961-022-00854-x

When the messenger is more important than the message: an experimental study of evidence use in francophone Africa

2022· article· en· W4281555489 on OpenAlexaff
Amandine Fillol, Esther Mc Sween-Cadieux, Bruno Ventelou, Marie‐Pier Larose, Ulrich Boris Nguemdjo Kanguem, Kadidiatou Kadio, Christian Dagenais, Valéry Ridde

Bibliographic record

VenueHealth Research Policy and Systems · 2022
Typearticle
Languageen
FieldMedicine
TopicGlobal Health and Surgery
Canadian institutionsUniversité de SherbrookeUniversité de Montréal
FundersAgence Française de DéveloppementAgence Nationale de la Recherche
KeywordsFrenchContext (archaeology)Health services researchHealth administrationHealth policyQuality (philosophy)MedicineKnowledge translationPublic relationsPolitical sciencePublic healthNursingGeography

Abstract

fetched live from OpenAlex

BACKGROUND: Epistemic injustices are increasingly decried in global health. This study aims to investigate whether the source of knowledge influences the perception of that knowledge and the willingness to use it in francophone African health policy-making context. METHODS: The study followed a randomized experimental design in which participants were randomly assigned to one of seven policy briefs that were designed with the same scientific content but with different organizations presented as authors. Each organization was representative of financial, scientific or moral authority. For each type of authority, two organizations were proposed: one North American or European, and the other African. RESULTS: The initial models showed that there was no significant association between the type of authority or the location of the authoring organization and the two outcomes (perceived quality and reported instrumental use). Stratified analyses highlighted that policy briefs signed by the African donor organization (financial authority) were perceived to be of higher quality than policy briefs signed by the North American/European donor organization. For both perceived quality and reported instrumental use, these analyses found that policy briefs signed by the African university (scientific authority) were associated with lower scores than policy briefs signed by the North American/European university. CONCLUSIONS: The results confirm the significant influence of sources on perceived global health knowledge and the intersectionality of sources of influence. This analysis allows us to learn more about organizations in global health leadership, and to reflect on the implications for knowledge translation practices.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Direct model labels (unvalidated)

Per-model category and study-design labels from the labeling rounds. They are machine output, unvalidated, and the disagreement between models ships as data. No study design here is MEDLINE-validated yet.

Model armCategoriesStudy designConfidence
gemmano category
Domain: not available · Genre: Empirical
About the Canadian research system: no · About a Canadian topic: no
Observationallow
gptno category
Domain: not available · Genre: Empirical
About the Canadian research system: no · About a Canadian topic: no
Other designlow
models splitAgreement compares identical category sets and study designs across arms.

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.014
metaresearch head score (Gemma)0.031
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.014
Threshold uncertainty score0.076

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0140.031
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0010.001
Science and technology studies0.0060.004
Scholarly communication0.0040.002
Open science0.0010.002
Research integrity0.0020.002
Insufficient payload (model declined to judge)0.0090.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.481
GPT teacher head0.530
Teacher spread0.049 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Labeled directly by 2 models reading the full record.

The models applied no category: nothing in the taxonomy fit this work.

The models disagree on parts of this classification; every voice is preserved in the section at the end of the page.

Study designObservational · Other design
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations5
Published2022
Admission routes1
Has abstractyes

Explore more

Same venueHealth Research Policy and SystemsSame topicGlobal Health and SurgeryFrench-language works237,207