MétaCan
Menu
Back to cohort
Record W3016902346 · doi:10.1055/s-0040-1701979

Challenges and Best Practices in Ethical Review of Human and Organizational Factors Studies in Health Technology: a Synthesis of Testimonies

2020· article· en· W3016902346 on OpenAlexaffabout
Linda Peute, Valentina Lichtner, Melissa Baysari, Maria Hägglund, Juell Homco, Stephanie Jansen-Kosterink, Ignacio Jauregui, Johanna Kaipio, Craig Kuziemsky, Elin C. Lehnbom, Francisca Leite, Blake Lesselroth, Daniel Luna, Carlos Otero, Rune Pedersen, Sylvia Pelayo, Raquel Santos, Nuno-André Silva, Mari Tyllinen, Lex van Velsen, Wu Yi Zheng, Monique Jaspers, Romaric Marcilly

Bibliographic record

VenueYearbook of Medical Informatics · 2020
Typearticle
Languageen
FieldMedicine
TopicEthics in Clinical Research
Canadian institutionsMacEwan University
FundersAgence Nationale de la Recherche
KeywordsInstitutional review boardBest practicePromotion (chess)LegislationInformed consentPublic relationsMedical educationMedicinePsychologyPolitical scienceAlternative medicineLawPathology

Abstract

fetched live from OpenAlex

OBJECTIVE: Human and Organizational Factors (HOF) studies in health technology involve human beings and thus require Institutional Review Board (IRB) approval. Yet HOF studies have specific constraints and methods that may not fit standard regulations and IRB practices. Gaining IRB approval may pose difficulties for HOF researchers. This paper aims to provide a first overview of HOF study challenges to get IRB review by exploring differences and best practices across different countries. METHODS: HOF researchers were contacted by email to provide a testimony about their experience with IRB review and approval. Testimonies were thematically analyzed and synthesized to identify and discuss shared themes. RESULTS: Researchers from seven European countries, Argentina, Canada, Australia, and the United States answered the call. Four themes emerged that indicate shared challenges in legislation, IRB inefficiencies and inconsistencies, general regulation and costs, and lack of HOF study knowledge by IRB members. We propose a model for IRB review of HOF studies based on best practices. CONCLUSION: International criteria are needed that define low and high-risk HOF studies, to allow identification of studies that can undergo an expedited (or exempted) process from those that need full IRB review. Enhancing IRB processes in such a way would be beneficial to the conduct of HOF studies. Greater knowledge and promotion of HOF methods and evidence-based HOF study designs may support the evolving discipline. Based on these insights, training and guidance to IRB members may be developed to support them in ensuring that appropriate ethical issues for HOF studies are considered.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.376
metaresearch head score (Gemma)0.548
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Research integrity
Consensus categoriesMetaresearch
DomainCandidate signal: Methods · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: Qualitative
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.988
Threshold uncertainty score0.770

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.3760.548
Meta-epidemiology (narrow)0.0010.002
Meta-epidemiology (broad)0.0020.002
Bibliometrics0.0110.012
Science and technology studies0.0140.024
Scholarly communication0.0230.024
Open science0.0050.018
Research integrity0.0120.018
Insufficient payload (model declined to judge)0.0020.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.719
GPT teacher head0.627
Teacher spread0.092 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designQualitative
DomainMethods
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations13
Published2020
Admission routes2
Has abstractyes

Explore more

Same venueYearbook of Medical InformaticsSame topicEthics in Clinical ResearchFrench-language works237,207