MétaCan
Menu
Back to cohort
Record W2903851980 · doi:10.1007/s00038-018-1180-9

Grounding evidence in experience to support people-centered health services

2018· article· en· W2903851980 on OpenAlexafffundabout
Anna Dion, Lawrence Joseph, Vania Jimenez, Alessandro Carini Gutierrez, Amal Ben Ameur, Émilie Robert, Neil Andersson

Bibliographic record

VenueInternational Journal of Public Health · 2018
Typearticle
Languageen
FieldDecision Sciences
TopicComplex Systems and Decision Making
Canadian institutionsCentre de Santé et de Services Sociaux de la MontagneCARE CanadaMcGill University
FundersCanadian Institutes of Health ResearchPierre Elliott Trudeau Foundation
KeywordsStakeholderExperiential knowledgePublic relationsPublic healthGrey literatureHealth equityHealth careContext (archaeology)PsychologyKnowledge managementSociologyMedicinePolitical scienceNursingMEDLINEComputer science

Abstract

fetched live from OpenAlex

Evidence-informed and equity-oriented public health policy and practice require that people’s voices, especially those less heard, be central to decision-making in public health (Serrant-Green 2011). Stakeholder engagement is particularly urgent in the context of health inequities, where perspectives of those who carry the greatest burden of inequities are often poorly reflected in published literature (Serrant-Green 2011). Decision-makers in public health need robust and locally relevant tools that take account of both biomedical and cultural understandings of health and that support people’s participation in planning, implementation and evaluation (Napier et al. 2014). Leveraging several well-established tools from participatory research, systems science and Bayesian analysis, under a critical realist philosophy, we present a novel approach to knowledge synthesis, called the Weight of Evidence. This approach pushes conventional boundaries of who (or what) constitutes health service expertise through the formal inclusion of experiential knowledge from patients and/or communities, care providers and resource decision-makers, together on even footing with epidemiological studies (Borda 1996; Midgley 2000). This method unfolds in five steps: A conventional mixed methods synthesis of the research literature summarizes what is known about an outcome of interest, representing this knowledge as a map; Independently, stakeholders generate cognitive maps that identify and weight factors they believe influence the outcome; Update the literature-based map with stakeholder knowledge using Bayesian analysis; Suggest explanations of how social, economic and organizational contexts contribute to outcomes prioritized in cognitive maps; stakeholders adjust these explanations according to their experience; and Stakeholders develop recommendations accordingly. In this publication, we outline the Weight of Evidence process, highlighting some of the key insights from our pilot work addressing inequities in perinatal health in Canada, while a full description of our methodological development results is forthcoming. Weight of Evidence proved an excellent way to engage meaningfully with divergent perspectives, creating space for multiple and complex ways of understanding health and health services. Mapping evidence Step 1 follows existing guidelines to support comprehensive mixed methods evidence syntheses, pooling effect estimates when appropriate using standard meta-analyses techniques (Pluye and Hong 2014). We converted all effect estimates to odds ratios and transformed them into a common scale (− 1 to + 1) (Andersson et al. 2017). We then summarized findings in a concept map where nodes in the map represent themes from qualitative studies or independent variables from quantitative studies, and the strength of the arcs connecting nodes describe the effect estimates (Ozesmi and Ozesmi 2004; Giles et al. 2008). In our demonstration case, we focused on unmet postpartum care needs among recent immigrant women as an important health inequity in Canada (Gagnon et al. 2013). Our concept map also included evidence from the broader literature on perinatal health outcomes and experiences of recent immigrant women in Canada, as shown in Fig. 1. Open in a separate window Fig. 1 Fuzzy cognitive map of available literature on unmet postpartum care needs among recent immigrant women in Canada. EPDS is the Edinburgh Postnatal Depression Scale. A score greater than 13 on the EPDS is interpreted as probable depression (Cox et al. 1987) (Canada, 2016)

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.185
metaresearch head score (Gemma)0.201
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.185
Threshold uncertainty score0.979

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.1850.201
Meta-epidemiology (narrow)0.0030.002
Meta-epidemiology (broad)0.0040.004
Bibliometrics0.0210.009
Science and technology studies0.0090.031
Scholarly communication0.0300.040
Open science0.0090.047
Research integrity0.0080.009
Insufficient payload (model declined to judge)0.0140.002

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.508
GPT teacher head0.552
Teacher spread0.044 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designQualitative
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations28
Published2018
Admission routes3
Has abstractyes

Explore more

Same venueInternational Journal of Public HealthSame topicComplex Systems and Decision MakingFrench-language works237,207