MétaCan
Menu
Back to cohort
Record W4404653628 · doi:10.2196/56369

Refining Established Practices for Research Question Definition to Foster Interdisciplinary Research Skills in a Digital Age: Consensus Study With Nominal Group Technique

2024· article· en· W4404653628 on OpenAlexvenueno aff
Jana Sedláková, Mina Stanikić, Felix Gille, Jürgen Bernard, Andrea B. Horn, Markus Wolf, Christina Haag, Joël Floris, Gabriela Morgenshtern, Gerold Schneider, Aleksandra Zumbrunn Wojczyńska, Corine Mouton Dorey, Dominik A. Ettlin, Dániel Gerö, Thomas N. Friemel, Z. Lu, Kimon Papadopoulos, Sonja Schläpfer, Ning Wang, Viktor von Wyl

Bibliographic record

VenueJMIR Medical Education · 2024
Typearticle
Languageen
FieldDecision Sciences
TopicInterdisciplinary Research and Collaboration
Canadian institutionsnot available
Fundersnot available
KeywordsPreprintNominal group techniqueRefining (metallurgy)Group (periodic table)PsychologyQualitative researchComputer scienceSociologyKnowledge managementSocial scienceWorld Wide Web

Abstract

fetched live from OpenAlex

BACKGROUND: The increased use of digital data in health research demands interdisciplinary collaborations to address its methodological complexities and challenges. This often entails merging the linear deductive approach of health research with the explorative iterative approach of data science. However, there is a lack of structured teaching courses and guidance on how to effectively and constructively bridge different disciplines and research approaches. OBJECTIVE: This study aimed to provide a set of tools and recommendations designed to facilitate interdisciplinary education and collaboration. Target groups are lecturers who can use these tools to design interdisciplinary courses, supervisors who guide PhD and master's students in their interdisciplinary projects, and principal investigators who design and organize workshops to initiate and guide interdisciplinary projects. METHODS: Our study was conducted in 3 steps: (1) developing a common terminology, (2) identifying established workflows for research question formulation, and (3) examining adaptations of existing study workflows combining methods from health research and data science. We also formulated recommendations for a pragmatic implementation of our findings. We conducted a literature search and organized 3 interdisciplinary expert workshops with researchers at the University of Zurich. For the workshops and the subsequent manuscript writing process, we adopted a consensus study methodology. RESULTS: We developed a set of tools to facilitate interdisciplinary education and collaboration. These tools focused on 2 key dimensions- content and curriculum and methods and teaching style-and can be applied in various educational and research settings. We developed a glossary to establish a shared understanding of common terminologies and concepts. We delineated the established study workflow for research question formulation, emphasizing the "what" and the "how," while summarizing the necessary tools to facilitate the process. We propose 3 clusters of contextual and methodological adaptations to this workflow to better integrate data science practices: (1) acknowledging real-life constraints and limitations in research scope; (2) allowing more iterative, data-driven approaches to research question formulation; and (3) strengthening research quality through reproducibility principles and adherence to the findable, accessible, interoperable, and reusable (FAIR) data principles. CONCLUSIONS: Research question formulation remains a relevant and useful research step in projects using digital data. We recommend initiating new interdisciplinary collaborations by establishing terminologies as well as using the concepts of research tasks to foster a shared understanding. Our tools and recommendations can support academic educators in training health professionals and researchers for interdisciplinary digital health projects.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.491
metaresearch head score (Gemma)0.598
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Methods · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: Qualitative
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.509
Threshold uncertainty score0.628

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.4910.598
Meta-epidemiology (narrow)0.0020.002
Meta-epidemiology (broad)0.0020.003
Bibliometrics0.0170.011
Science and technology studies0.0100.013
Scholarly communication0.0090.013
Open science0.0090.017
Research integrity0.0040.006
Insufficient payload (model declined to judge)0.0030.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.196
GPT teacher head0.588
Teacher spread0.392 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designQualitative
DomainMethods
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations2
Published2024
Admission routes1
Has abstractyes

Explore more

Same venueJMIR Medical EducationSame topicInterdisciplinary Research and CollaborationFrench-language works237,207