MétaCan
Menu
Back to cohort
Record W2588113643 · doi:10.1177/1747016117693828

Revisions to the Common Rule: A proposal in search of evidence

2017· article· en· W2588113643 on OpenAlexaff
Stuart G. Nicholls

Bibliographic record

VenueResearch Ethics · 2017
Typearticle
Languageen
FieldMedicine
TopicEthics in Clinical Research
Canadian institutionsChildren's Hospital of Eastern OntarioUniversity of Ottawa
Fundersnot available
KeywordsImperfectCriticismSubject (documents)Empirical evidenceScientific evidencePublic relationsField (mathematics)Political scienceLaw and economicsPositive economicsEngineering ethicsSociologyEconomicsEpistemologyLawComputer scienceEngineering

Abstract

fetched live from OpenAlex

Proposed changes to the Common Rule are proffered to save almost 7,000 reviews annually and consequently vast amounts of investigator and IRB-member time. However, the proposed changes have been subject to criticism. While some have lauded the changes as being imperfect, but nevertheless as improvements, others have contended that ‘neither the scientific community nor the public can be confident that improved practices will emerge from the regulatory changes mandated by the NPRM.’ In the present article, I discuss an important aspect that has been overlooked: the question of whether benefits will emerge is demonstrably empirical, yet data upon which to draw conclusions are conspicuous by their absence. This is thrown into sharp relief when we consider the current environment in which health research is increasingly focused on providing evidence of need or benefit, where there is greater emphasis on evidence-based practice, and when we have the nascent field of implementation science.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.621
metaresearch head score (Gemma)0.831
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Research integrity
Consensus categoriesMetaresearch
DomainCandidate signal: Methods · Consensus signal: none
Study designCandidate signal: Theoretical or conceptual · Consensus signal: Theoretical or conceptual
GenreCandidate signal: Commentary · Consensus signal: Commentary
Teacher disagreement score0.827
Threshold uncertainty score0.468

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.6210.831
Meta-epidemiology (narrow)0.0050.008
Meta-epidemiology (broad)0.0130.027
Bibliometrics0.0170.010
Science and technology studies0.0140.069
Scholarly communication0.0380.054
Open science0.0380.034
Research integrity0.1730.176
Insufficient payload (model declined to judge)0.0050.008

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.948
GPT teacher head0.774
Teacher spread0.174 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designTheoretical or conceptual
DomainMethods
GenreCommentary

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations6
Published2017
Admission routes1
Has abstractyes

Explore more

Same venueResearch EthicsSame topicEthics in Clinical ResearchFrench-language works237,207