MétaCan
Menu
Back to cohort
Record W4382393838 · doi:10.5964/meth.10863

The logics of and strategies to enhance generalization of mixed methods research findings

2023· article· en· W4382393838 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueMethodology · 2023
Typearticle
Languageen
FieldHealth Professions
TopicHealth Policy Implementation Science
Canadian institutionsMemorial University of Newfoundland
Fundersnot available
KeywordsGeneralizationContext (archaeology)Computer scienceInterpretation (philosophy)Management scienceArtificial intelligencePsychologyEpistemologyEngineeringBiology

Abstract

fetched live from OpenAlex

Generalization of research findings is a cognizant action entailing careful examination and interpretation of findings drawn from specific samples and extrapolation of those findings to other diverse populations and settings. Approaches to generalization in qualitative and quantitative research have been discussed in the literature. However, there is limited discussion about the nature of generalization and strategies for achieving plausible generalization in mixed methods research. The purpose of this paper is to explore the logics of generalization in mixed methods and offer strategies to enhance generalization in mixed methods research. Three strategies namely, multilevel integration, comprehensive description of mixed methods and findings, and generating strong and plausible inferences and metainferences can enhance the extent to which findings of mixed methods studies can be translated outside of their own original context. These strategies may allow researchers to effectively combine qualitative and quantitative methodologies and generate findings for use in diverse contexts and settings.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Direct model labels (unvalidated)

Per-model category and study-design labels from the labeling rounds. They are machine output, unvalidated, and the disagreement between models ships as data. No study design here is MEDLINE-validated yet.

Model armCategoriesStudy designConfidence
gemmano category
Domain: not available · Genre: Methods
About the Canadian research system: no · About a Canadian topic: no
Theoretical or conceptuallow
gptMetaresearch
Domain: Methods · Genre: Methods
About the Canadian research system: no · About a Canadian topic: no
Theoretical or conceptualmedium
models splitAgreement compares identical category sets and study designs across arms.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.065
metaresearch head score (Gemma)0.029
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Bench or experimental · Consensus signal: none
GenreCandidate signal: Methods · Consensus signal: none
Teacher disagreement score0.503
Threshold uncertainty score0.980

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0650.029
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.002
Science and technology studies0.0010.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.950
GPT teacher head0.844
Teacher spread0.106 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it